All systems are operational

Stickied Incidents

Saturday 28th June 2025

Seattle Network Increased latency for China

We're currently seeing increased latency to/from China for our Seattle network due to suspected fiber cuts on the US west coast, this appears to be heavily impacting China Unicom's network (AS4837) which has likely lost considerable capacity. CMIN2 should not see any impact apart from a temporary 20ms latency increase due to a re-route caused by the fiber cuts. This shouldn't take too long to be resolved.

  • The fiber cut was fixed at 4pm UTC and we can confirm everything is now looking normal.

  • Confirmed fiber cut, here is the explanation from our transport provider: There is a fiber cut between Vacaville, CA and Sacramento, CA. The fiber cut was caused by a car hitting a utility pole.

    It's likely that China Unicom is suffering capacity loss due to this same incident, there is no estimated fix time yet.

    • Past Incidents

    Friday 31st May 2024

    No incidents reported

    Thursday 30th May 2024

    Seattle Network Seattle network issues

    Our Seattle DDoS protected network is seeing degraded performance due to issues with the two upstreams we have access to. Routes inbound via Twelve99/Arelion that route via New York <-> Palo Alto are seeing high latency and some packet loss. Cogent is seeing major congestion in Los Angeles due to major fiber cuts in the area, any traffic routing through here will see very high packet loss.

  • This was resolved after around 12 hours when AS1299 resolved their issues then we re-enabled Cogent a short while later when they also resolved their fiber cut.

    • Wednesday 29th May 2024

    No incidents reported

    Tuesday 28th May 2024

    No incidents reported

    Monday 27th May 2024

    No incidents reported

    Sunday 26th May 2024

    Seattle Network Degraded China performance - Seattle

    We're currently seeing degraded performance to China via AS4837 (China Unicom) on our Seattle network at peak China time. The issue appears to be at China Unicom's side, we've contacted our upstream to ask about this and will provide any further updates on this page.

  • We saw evidence that this was resolved on 30th May as promised and within the last 24 - 48 hours appears to have been stable.

  • Current estimate for this being fixed is today, 30th May, the cause is AAG cable under maintenance.

    • Dallas Network Dallas network offline

    Our Dallas location went offline at 11:15 UTC (6:15 am local time) due to a major power outage in the area.

    All services have since come back online as of 14:45 UTC.

    We received the following update from our Data Center provider, Hivelocity, during the outage:

    At roughly 6:15am EDT the facility where Hivelocity operates its DAL1 data center (Prime, formerly Carrier-1 and Evocative) lost utility power. Redundant power sources, UPS and generators, did not operate as designed thus causing the entire facility to lose power. Prime Data Centers has electrical engineers on site at this time working to solve the problem. Hivelocity has technicians on site standing by and ready to get all impacted servers back online the moment power is restored to the facility. More information will be forthcoming as solutions progress.

    Saturday 25th May 2024

    No incidents reported