Category: outages

06:54 AM The server Littlefinger (129.232.170.66) is currently experiencing high load which is slowing websites to a crawl. We are working on fixing the issue.

07:38 AM Server load has dropped to acceptable levels. We will be monitoring to ensure that the problem doesn’t return.

Baratheon is currently experiencing a problem, with some sites not loading.
We are investigating.

I have found a temporary fix, until cPanel can provide a fix or patch for the problem.

My “temporary” fix appears to be the only fix for this, until Comodo sorts their problem out. Response from cPanel support:

Hi,

I can see you've already corrected this issue:

# grep -i stapl /usr/local/apache/conf/includes/pre_virtualhost_global.conf
SSLUseStapling off

Unfortunately, the 'ocsp.comodoca.com' server is currently facing issues, which would prevent SSL sites from being served. You've disabled SSL Stapling properly. Unfortunately, there isn't much else we can do until Comodo investigates why their OCSP server is not responding.

I certainly apologize for the inconvenience. Please let me know if you have anymore questions or issues.

Thanks,

14:32 The server Arya has gone offline – we’re busy troubleshooting now

14:43 The problem has been found and fixed. A problem with the firewall was denying all connections, Sincere apologies for the inconvenience.

18:22 The server Arya is current;y experiencing a DDOS attack. Sites hosted on this server will be slow, or will not open at all.

We are working on mitigating the problem.

18:30 The attack has been mitigated for the most part, but we are still seeing occasional spikes in activity.

10:40 AM The server ARYA is offline. We’re investigating the problem.

10:45 AM The problem has been found and fixed. The server is now online.

12:04PM

Email 5 is currently offline, due to a CPU temperature spike. Hetzner technicians are currently attending.

12:57 Hetzner techs have replaced the faulty hardware, and server is booting up now.

10:12AM The server tyrion.texo.co.za has just gone offline. We’re investigating.

10:20 We’ve found and fixed the problem, but websites might be a little slow for the next 10-20 minutes while we do some testing.

6 June 2016  5:17 PM Daenerys appears to be under DDOS attack which has taken the server offline. We’re working on mitigating the attack.

5:31 PM It appears to be another problem in the Hetzner datacentre, probably one of their switches again: https://hetzner.co.za/network-notices/

5:46 PM Hetzner has fixed their network routing problem.

03 June 2016 9:56 AM

Three servers are offline. It appears to be a problem at the datacentre, which is being investigated.

Affected servers:

Daenerys
Lannister
Email 4

10:03 AM Hetzner has confirmed a networking error in their Samrand DC which is being worked on.

10:05 AM Hetzner seems to have fixed the problem, all servers are now accessible.

2 May 2016 5:38 PM Daenerys (197.189.230.226) is currently inaccessible due to what appears to be a network problem at Seacom / Hetzner. I’m still waiting for feedback from Hetzner.

5:45 PM Daenerys is accessible again, but connections are slow. Still waiting for feedback from Hetzner.

5:56 PM Inaccessible again. Still waiting for Hetzner to respond.

6:02 PM No feedback from Hetzner yet (email or phone) but they have updated their “Network Notices” page with the cause of the problem: a DDOS attack:

• DDOS – Network connectivity – Johannesburg data centre (2016-05-02, ATTENDING)

  Start: 2016-05-02 5:53:48 SAST
  Resolved: TBA
  Status: attending
  Point of impact: Truserv and Co-Location customers
  Symptoms: Truserv and Co-location customers will have intermittent connectivity to their servers.
  Cause of problem: DDos
  Estimated time of repair: TBA
  Attending: Hetzner Engineers

Source: Hetzner Network Notices

6:20 PM Daenerys appears to be 1oo% accessible now.