All systems are operational

Stickied Incidents

Wednesday 2nd October 2024

Dallas Network Dallas network instability

Our Dallas Path.net DDoS protected IPs are currently seeing intermittent high packet loss and very short outages. We're already in contact with Path about this and hope it's resolved shortly.

  • We have now removed Path.net from our network. Path has not shown any willingness to work with us to resolve major issues on their end therefore we have decided to permanently switch to CosmicGuard. We do not currently have a customer control panel developed due to the quick switch to CosmicGuard, it is being worked on and will be released soon. If you need rules/filters created in the meantime, please contact us via support ticket.

  • We have moved our IP prefixes to CosmicGuard ddos protection until Path.net resolves their issues. If you require any specific filters made for CosmicGuard, let us know, as we do not currently have a customer control panel available for this yet.

    • Maintenance
    Seattle IGW1.13.3 power maintenance

    Some servers in Seattle cabinet IGW1.13.3 are currently offline due to scheduled power maintenance that we emailed you about.

    Past Incidents

    Thursday 30th May 2024

    Seattle Network Seattle network issues

    Our Seattle DDoS protected network is seeing degraded performance due to issues with the two upstreams we have access to. Routes inbound via Twelve99/Arelion that route via New York <-> Palo Alto are seeing high latency and some packet loss. Cogent is seeing major congestion in Los Angeles due to major fiber cuts in the area, any traffic routing through here will see very high packet loss.

  • This was resolved after around 12 hours when AS1299 resolved their issues then we re-enabled Cogent a short while later when they also resolved their fiber cut.

    • Wednesday 29th May 2024

    No incidents reported

    Tuesday 28th May 2024

    No incidents reported

    Monday 27th May 2024

    No incidents reported

    Sunday 26th May 2024

    Seattle Network Degraded China performance - Seattle

    We're currently seeing degraded performance to China via AS4837 (China Unicom) on our Seattle network at peak China time. The issue appears to be at China Unicom's side, we've contacted our upstream to ask about this and will provide any further updates on this page.

  • We saw evidence that this was resolved on 30th May as promised and within the last 24 - 48 hours appears to have been stable.

  • Current estimate for this being fixed is today, 30th May, the cause is AAG cable under maintenance.

    • Dallas Network Dallas network offline

    Our Dallas location went offline at 11:15 UTC (6:15 am local time) due to a major power outage in the area.

    All services have since come back online as of 14:45 UTC.

    We received the following update from our Data Center provider, Hivelocity, during the outage:

    At roughly 6:15am EDT the facility where Hivelocity operates its DAL1 data center (Prime, formerly Carrier-1 and Evocative) lost utility power. Redundant power sources, UPS and generators, did not operate as designed thus causing the entire facility to lose power. Prime Data Centers has electrical engineers on site at this time working to solve the problem. Hivelocity has technicians on site standing by and ready to get all impacted servers back online the moment power is restored to the facility. More information will be forthcoming as solutions progress.

    Saturday 25th May 2024

    No incidents reported

    Friday 24th May 2024

    No incidents reported