Multiple Servers Offline

12:50 xneelo appears to have fixed their electrical problem, and our servers are now booting up. I expect everything to be back to normal within 10 to 15 minutes.

12:30 Update from Xneelo (Hetzner):

xneelostatus.co.za/notice/4815/

xneelo network unreachable – Samrand data centre

Notice ID:#4815
Start: 03 Dec 2019 12:15 SAST
Maintenance Window: 30min
Issue: Electrical Failure

12:20PM There appears to be a problem in Hetzner’s Samrand datacentre which has taken all servers, including their own website, offline.

Lannister: server relocation

The server Lannister (129.232.145.146) will be shut down at 6PM on Thursday 14 November 2019 for a required relocation within the datacentre.

Downtime for websites and emails hosted on the server is expected to last until 6:40PM barring any unforseen problems. Thank you for your patience while this necessary maintenance completes

Dothraki offline

17:40 WordPress MAX server Dothraki has lost connection and is offline. Technicians are investigating.

17:52 Dothraki is back online. No reboot was needed, so there won’t be any post-boot high disk IO slowing sites down. Apologies for the inconvenience.

Tommen: maintenance

15 July 2019 17:30 
Planned maintenance of Apache on the server tommen.texo.co.za will commence. Maintenance is indicated to improve performance of your website. We do not expect downtime, but there might be intermittent, seconds-long interruptions.

18:03 Maintenance has completed successfully.

Outage: Johannesburg

03:00AM A number of servers are offline, due to a problem affecting Hetzner’s Samrand datacenter.

Update: Hetzner informs me that the issue is due to a power outage, affecting “a large number of rows [of servers]” and that their technicians are working on the problem.

05:40AM Hetzner appears to have fixed their problem, and servers are booting up. There will be degraded performance (sluggish websites, timeouts) until disk I/O settles down within 30 minutes or so.