Resolved

Our vendor, Leaseweb, has replaced the failing switch and things should be normalizing now. We will provide a full RCA once Leaseweb makes it available.

We are also prioritizing moving these servers into our own data centers to avoid such unacceptable resolution times in the future.

Updated

Leaseweb is replacing the failed switch and rebooting the affected nodes. Connectivity should return shortly.

Updated

Leaseweb's data center engineer and the EOD team are actively working on the issue. We expect this to be resolved very soon.

Identified

Leaseweb, our vendor, has isolated this to a bad rack affecting a few nodes and they're working on restoring the network connectivity to resolve the packet loss. We expect this to be resolved very soon.

Updated

We are continuing to investigate this issue.

Investigating

We are investing an issue in London affecting two nodes and working with our vendor to correct it as quickly as possible.

We apologize for any inconvenience this may cause.

Began at:

Affected components
  • Rocket.net - Data Centers
    • UK - London