We're currently seeing increased latency to/from China for our Seattle network due to suspected fiber cuts on the US west coast, this appears to be heavily impacting China Unicom's network (AS4837) which has likely lost considerable capacity. CMIN2 should not see any impact apart from a temporary 20ms latency increase due to a re-route caused by the fiber cuts. This shouldn't take too long to be resolved.
The fiber cut was fixed at 4pm UTC and we can confirm everything is now looking normal.
Confirmed fiber cut, here is the explanation from our transport provider: There is a fiber cut between Vacaville, CA and Sacramento, CA. The fiber cut was caused by a car hitting a utility pole.
It's likely that China Unicom is suffering capacity loss due to this same incident, there is no estimated fix time yet.
Past Incidents
Saturday 5th October 2024
No incidents reported
Friday 4th October 2024
SEABKVM26Seattle E5 KVM - SEABKVM26 outage
Seattle E5 KVM VPS server - SEABKVM26 - suffered a power off event at 18:34 UTC 4th October 2024. We powered the server back on and VMs were booting up within 6 minutes of the downtime occurring. We'll monitor this server and take action in the future if necessary.
This server has since been stabilised, we will live migrate VPS off it in the near future - no downtime.
The server has since rebooted twice, we're currently working on a migration plan.
Thursday 3rd October 2024
No incidents reported
Wednesday 2nd October 2024
Dallas NetworkDallas network instability
Our Dallas Path.net DDoS protected IPs are currently seeing intermittent high packet loss and very short outages. We're already in contact with Path about this and hope it's resolved shortly.
We have now removed Path.net from our network. Path has not shown any willingness to work with us to resolve major issues on their end therefore we have decided to permanently switch to CosmicGuard. We do not currently have a customer control panel developed due to the quick switch to CosmicGuard, it is being worked on and will be released soon. If you need rules/filters created in the meantime, please contact us via support ticket.
We have moved our IP prefixes to CosmicGuard ddos protection until Path.net resolves their issues. If you require any specific filters made for CosmicGuard, let us know, as we do not currently have a customer control panel available for this yet.
Tuesday 1st October 2024
Dallas NetworkDallas - 65.75.xxx.xx/24 - Offline
We have been notified that one of our subnets is offline in Dallas. We are working with Path to get the issues resolved.
Subnet: 65.75.xxx.x/24
Subnet was brought online around 1 hour ago on a backup link.
Monday 30th September 2024
No incidents reported
Sunday 29th September 2024
No incidents reported
Saturday 28th September 2024
Seattle NetworkSeattle partial network failure
The switch in one of our Seattle cabinets has gone offline, IGW1.10.2, this will affect all dedicated servers prefixed with this ID.
VPS servers SEAKVM18, SEAKVM19, SEABKVM24 and SEABKVM25 are also offline as a result.
We're investigating.
Switch is back online now and the services are currently recovering from the downtime.
