Incident Details

This page contains all current information on the status of this incident.



Start

2019-11-01 12:00:00 CET


End

2019-11-01 19:00:00 CET


Severity

Major Outage


Current Status

Resolved


Services Impacted

- Core Network (fra1)


Description

We are currently experiencing a network outage. Our networking team is working on the problems.



Timeline

2019-11-01 19:00:00 CET

First of all, all our systems are currently stable and running. The network outage was caused by so-called "Carpet Bomb" DDOS attacks which lasted from 12:00 to 19:00 CET with permanent attack size of more than 350 Gbps. The attacks caused immediate issues for our network once they started. We immediately started to debug the network for issues and were able to identify the cause of the problems. But due to big number of attacked hosts it took us a while to get the attack under control.

In order to decrease attack surface for further attacks traffic from attacked customers has been rerouted and is now being filtered by additional DDOS applications.

We apologize for all the troubles this attacks have created and hope for your understanding in this matter.

2019-11-01 18:26:06 CET

Since 12:00 PM we are receiving heavy DDoS attacks on over 1000 IP addresses with an attack bandwidth higher than 300 Gbit/s up until now. Our network engineers are currently trying to mitigate the attacks over many different methods. We already got in contact with our carriers to reduce the incoming traffic.

Currently we are not able to give an accurate statement when the problem will be solved.

We apologize for this long network disruption and hope for you understanding.

2019-11-01 15:22:36 CET

With regard to the current network disruption, the problem could be further limited. Our network engineers are working hard on problem solving.
Once an approximate recovery time of the services is known, we will promptly notify you. We try to solve the problems in the short-term and apologize at this point for the network problems that have occurred.

2019-11-01 12:00:00 CET