18:05 We’re seeing very high loads on Lannister which has resulted in websites not being served. We are investigating.
17:40 WordPress MAX server Dothraki has lost connection and is offline. Technicians are investigating.
17:52 Dothraki is back online. No reboot was needed, so there won’t be any post-boot high disk IO slowing sites down. Apologies for the inconvenience.
15 July 2019 17:30
Planned maintenance of Apache on the server tommen.texo.co.za will commence. Maintenance is indicated to improve performance of your website. We do not expect downtime, but there might be intermittent, seconds-long interruptions.
18:03 Maintenance has completed successfully.
06:00 AM As a result of the power failure at Hetzner this morning, mysql on Greyworm has failed, and needs to be repaired. We are hoping to get this fixed as soon as we can.
6:50 AM MySQL has been repaired and is running.
03:00AM A number of servers are offline, due to a problem affecting Hetzner’s Samrand datacenter.
Update: Hetzner informs me that the issue is due to a power outage, affecting “a large number of rows [of servers]” and that their technicians are working on the problem.
05:40AM Hetzner appears to have fixed their problem, and servers are booting up. There will be degraded performance (sluggish websites, timeouts) until disk I/O settles down within 30 minutes or so.
13:20 We’re seeing timeouts and slow responses from websites hosted on Bumblebee, and are investigating the problem.
13:30 The problem has been found and fixed, and everything should be back to normal.
07:30 Scheduled maintenance has completed
07:40 Server has booted up, Sites will be slow for up to 40 minutes as disk activity normalises.