17 September 2018 8:38PM
We’re working to mitigate a DDOS which is preventing the server from serving sites successfully.
8:46 PM
The DDOS has been mitigated. Apologies for the inconvenience.
Author: Texo [Steve]
Emergency maintenance: Baratheon
12:55PM The server Baratheon will be rebooted within the next 10 minutes to address a software error. We expect downtime to be no more than 30 minutes, unless the server requires a file check on startup, which could take up to 2 hours. Please accept our apologies for the inconvenience.
13:16PM The server has booted successfully, and services are returning to normal. Websites will be slow until the server load drops over the next 10-20 minutes.
Lannister: Apache error
10:50AM Apache on Lannister is encountering an error, and is not serving any websites on this server. We’re working on the problem.
10:57AM The problem has been fixed, and Apache restarted. All websites should be functioning correctly now.
Greyworm offline: DDOS
14:00 Greyworm is currently offline due to a DDOS attack. We’re working on mitigating it.
14:17 We’ve null-routed the target of the attack, and this seems to have stopped the DDOS. Unless another site on this server is targeted, the server should now run normally. Please accept our apologies for this downtime.
Network Issues
17:15 Hetzner is currently experiencing a routing issue in the Samrand data-centre. Connections to some of our servers hosted in that data-centre are affected. Hetzner engineers are working on the problem.
17:28 The problem has been resolved.
Littlefinger: High Load
06:54 AM The server Littlefinger (129.232.170.66) is currently experiencing high load which is slowing websites to a crawl. We are working on fixing the issue.
07:38 AM Server load has dropped to acceptable levels. We will be monitoring to ensure that the problem doesn’t return.
Arya: Emergency maintenance
1:42PM Apache on this server needs to be updated and restarted urgently. Sites on this server might go offline for up to 5 minutes at a time until maintenance is completed. Apologies for the unavoidable inconvenience.
2:10PM Maintenance has completed successfully
Baratheon: error
Baratheon is currently experiencing a problem, with some sites not loading.
We are investigating.
I have found a temporary fix, until cPanel can provide a fix or patch for the problem.
My “temporary” fix appears to be the only fix for this, until Comodo sorts their problem out. Response from cPanel support:
Hi, I can see you've already corrected this issue: # grep -i stapl /usr/local/apache/conf/includes/pre_virtualhost_global.conf SSLUseStapling off Unfortunately, the 'ocsp.comodoca.com' server is currently facing issues, which would prevent SSL sites from being served. You've disabled SSL Stapling properly. Unfortunately, there isn't much else we can do until Comodo investigates why their OCSP server is not responding. I certainly apologize for the inconvenience. Please let me know if you have anymore questions or issues. Thanks,
Arya offline
14:32 The server Arya has gone offline – we’re busy troubleshooting now
14:43 The problem has been found and fixed. A problem with the firewall was denying all connections, Sincere apologies for the inconvenience.
Arya: DDOS attack
18:22 The server Arya is current;y experiencing a DDOS attack. Sites hosted on this server will be slow, or will not open at all.
We are working on mitigating the problem.
18:30 The attack has been mitigated for the most part, but we are still seeing occasional spikes in activity.
Texo: Network Status 