All systems are operational

Stickied Incidents

Friday 26th April 2024

Seattle Network Reduced China network performance

Our network transport provider that we use to reach AS4837 from Seattle has gone offline. We have temporarily switched the outbound route to China to use AS4134.

  • This has now been resolved and AS4837 outbound routing to China Telecom and Unicom is now active again.

  • We have been informed the cause is a fiber cut along the route, our transport provider said they cannot provide an ETA currently.

  • Past Incidents

    Saturday 30th July 2022

    No incidents reported

    Friday 29th July 2022

    No incidents reported

    Thursday 28th July 2022

    SEAHKVM6 SEAHKVM6 outage

    VPS server SEAHKVM6 had a brief outage starting at 19:24 UTC and ending at 19:32 UTC, the server was frozen so required a reboot. We're investigating the cause.

    Seattle network outage

    Our DDoS protected Seattle network saw an outage starting at 23:59 UTC caused by Cnservers/Ceranetworks going offline, our backup network took over within 2 minutes. We're still talking to them about a solution being implemented on their end for this.

  • Ceranetworks has informed us that the latest outage was due to their equipment failure issue coming back and then a secondary outage shortly after due to them performing emergency maintenance in an attempt to resolve the long standing periodic outage issues, hopefully this is the last such outage.

  • Wednesday 27th July 2022

    Seattle Network Degraded China network performance

    We are currently seeing degraded network performance to China using our AS4837 route, this is caused by a cut in the APG submarine fiber cable AS4837 uses.

    Degraded performance may continue until this fiber cut is fixed.

  • China Unicom has said the APG Marine cable S3 has been repaired as of 06:45 UTC, this means all submarine cables are now back online. We're monitoring the network, let us know if you see any issues.

  • China Unicom has confirmed that the APG Marine cable S3 repair is scheduled to start on 1st September and is expected to be completed on 8th September. We believe that this submarine cable carries a lot of capacity so hopefully significant improvements will be seen when it's back online.

  • One of the offline submarine cables has been repaired but at least one, including the APG Marine cable S3, is still offline with no estimated restoration date, we believe this submarine cable being offline is responsible for most of the congestion. We'll update when we receive an estimated restoration date.

  • The submarine cable that was due to be fixed on 20th August has been rescheduled to 23rd August.

  • We've been informed that one of the currently offline submarine fiber cables is due to be fixed on 20th August but there is still one other offline with no estimated fix date so performance may still not improve to previous performance levels.

  • Throughput at peak time has dropped to very low levels, less than 5Mb/s multithreaded. Ceranetworks has confirmed they're seeing significantly lower traffic levels meaning the fault is still within China Unicom's network.

  • Seattle Network Seattle network outage

    Our Seattle network is currently suffering an outage due to issues with our router, we're monitoring.

  • Everything appears to be functioning normally, let us know if you see any issues.

    We'll be investigating this incident to attempt to prevent a reoccurrence in the future.

  • Network should be fully back online within 10 minutes.

  • Tuesday 26th July 2022

    No incidents reported

    Monday 25th July 2022

    No incidents reported

    Sunday 24th July 2022

    Seattle Network Seattle network outage

    Our DDoS protected Seattle network saw a short outage at 19:54 UTC due to Cnservers/Ceranetworks going offline, our backup network took over within 1 -2 minutes. We're talking to them about a permanent resolution.