We're currently seeing increased latency to/from China for our Seattle network due to suspected fiber cuts on the US west coast, this appears to be heavily impacting China Unicom's network (AS4837) which has likely lost considerable capacity. CMIN2 should not see any impact apart from a temporary 20ms latency increase due to a re-route caused by the fiber cuts. This shouldn't take too long to be resolved.
The fiber cut was fixed at 4pm UTC and we can confirm everything is now looking normal.
Confirmed fiber cut, here is the explanation from our transport provider: There is a fiber cut between Vacaville, CA and Sacramento, CA. The fiber cut was caused by a car hitting a utility pole.
It's likely that China Unicom is suffering capacity loss due to this same incident, there is no estimated fix time yet.
No incidents reported
Our DDoS protected Seattle network saw an outage starting at 23:59 UTC caused by Cnservers/Ceranetworks going offline, our backup network took over within 2 minutes. We're still talking to them about a solution being implemented on their end for this.
We are currently seeing degraded network performance to China using our AS4837 route, this is caused by a cut in the APG submarine fiber cable AS4837 uses.
Degraded performance may continue until this fiber cut is fixed.
China Unicom has said the APG Marine cable S3 has been repaired as of 06:45 UTC, this means all submarine cables are now back online. We're monitoring the network, let us know if you see any issues.
China Unicom has confirmed that the APG Marine cable S3 repair is scheduled to start on 1st September and is expected to be completed on 8th September. We believe that this submarine cable carries a lot of capacity so hopefully significant improvements will be seen when it's back online.
One of the offline submarine cables has been repaired but at least one, including the APG Marine cable S3, is still offline with no estimated restoration date, we believe this submarine cable being offline is responsible for most of the congestion. We'll update when we receive an estimated restoration date.
The submarine cable that was due to be fixed on 20th August has been rescheduled to 23rd August.
We've been informed that one of the currently offline submarine fiber cables is due to be fixed on 20th August but there is still one other offline with no estimated fix date so performance may still not improve to previous performance levels.
Throughput at peak time has dropped to very low levels, less than 5Mb/s multithreaded. Ceranetworks has confirmed they're seeing significantly lower traffic levels meaning the fault is still within China Unicom's network.
Our Seattle network is currently suffering an outage due to issues with our router, we're monitoring.
No incidents reported
No incidents reported
No incidents reported