Our Dallas and Ashburn DDoS protected network is currently offline for any traffic that doesn't route directly to Dallas.
CosmicGuard's global network is suffering an outage, we're awaiting an update from them.
CosmicGuard post mortem: https://status.as30456.net/cmnigw4ki0ejswkl8ij6nn44f
CosmicGuard post mortem: https://status.as30456.net/cmnigw4ki0ejswkl8ij6nn44f
CosmicGuard have reassured us that they are working on implementing significant redundancy improvements in the near future. They understand the recent outages are unaccompanied. We are constantly evaluating all DDoS mitigation options available on the market in case improvement in CosmicGuard's stability doesn't occur.
All CosmicGuard POPs are now back online.
We apologise greatly for the inconvenience, we will be taking to CosmicGuard about what steps they'll take to prevent a repeat incident.
Everywhere except traffic routing through Los Angeles came back online at 05:33 UTC. CosmicGuard has said Los Angeles will come back online within 5 minutes.
Our Seattle DDoS protected network saw instability starting at 20:37 UTC and ending at 20:45 UTC, this was caused by one of our DDoS mitigation providers, Neoprotect, suffering a full network outage, our backup network automatically took over within minutes and this will remain active until Neoprotect is stable again.
See the update below for full details:
Neoprotect has stated that they are not going to continue their service. We are investigating alternative DDoS mitigation providers and hope to have one available soon, this will also return latency to normal levels.
Neoprotect is still offline, they use datapacket/CDN77 as a sole upstream and they disabled Neoprotect's service which resulted in the full global outage of Neoprotect's network. You can read more about the cause here: https://status.neoprotect.net
We are currently routing DDoS protected inbound traffic through Cnservers Los Angeles so there will be a latency increase for locations that are geographically close to Seattle, if this is a problem for you in the short term, please contact us and we'll discuss the options available with you.
Longer term, we will onboard another ddos mitigation provider, potentially GSL, that has a local Seattle POP, this will ensure latency is normal.
No incidents reported
No incidents reported
As of today, our inbound routing from the AS4134 NCP line (only used by our 20Gb/s DDoS protected IPs) has been disabled due to Ceranetworks closing their Portland POP. All inbound China routing now routes via Los Angeles therefore latency from China will have increased in many scenarios for 20Gb/s DDoS protected IPs. We are working on a feasibility study of whether we can obtain our own AS4134 NCP line, we currently do not have a time estimate.
All non China inbound traffic for 20Gb/s DDoS protected IPs is temporarily being routed via Los Angeles too, this will be corrected in the coming days to route directly via Seattle instead.
200Gb/s DDoS protected IPs are unaffected by this and have identical routing to before.
No incidents reported
No incidents reported
The China Mobile (CMI) inbound routing for Seattle 20Gb/s DDoS protected IPs is currently offline as Ceranetworks' connectivity with them is temporarily disabled, potentially due to maintenance. Due to this, there will be higher latency for a small number of China Mobile regions due to routing going via Europe - something we have no control over without the CMI routing.
No incidents reported