14 July 2020 10:55AM
We’re seeing high loads on the Tyrion server, which is causing slowness and timeouts for websites. We’re investigating.
11:04AM
The problem has been found, and everything should return to normal shortly.
Viserion: MySQL failures
4PM MySQL is failing on this server, and a fix is being worked on. Occasional “failed to connect to mysql server” or similar messages might appear from time to time when browsing your website.
8:15PM We are starting an emergency migration of all accounts on this server to the server skizzle.texo.co.za
Multiple Servers Offline
12:50 xneelo appears to have fixed their electrical problem, and our servers are now booting up. I expect everything to be back to normal within 10 to 15 minutes.
12:30 Update from Xneelo (Hetzner):
xneelostatus.co.za/notice/4815/
xneelo network unreachable – Samrand data centre
Notice ID:#4815
Start: 03 Dec 2019 12:15 SAST
Maintenance Window: 30min
Issue: Electrical Failure
12:20PM There appears to be a problem in Hetzner’s Samrand datacentre which has taken all servers, including their own website, offline.
Lannister: server relocation
The server Lannister (129.232.145.146) will be shut down at 6PM on Thursday 14 November 2019 for a required relocation within the datacentre.
Downtime for websites and emails hosted on the server is expected to last until 6:40PM barring any unforseen problems. Thank you for your patience while this necessary maintenance completes
Lannister offline
18:05 We’re seeing very high loads on Lannister which has resulted in websites not being served. We are investigating.
18:28 The problem has been found and fixed.
Dothraki offline
17:40 WordPress MAX server Dothraki has lost connection and is offline. Technicians are investigating.
17:52 Dothraki is back online. No reboot was needed, so there won’t be any post-boot high disk IO slowing sites down. Apologies for the inconvenience.
Tommen: maintenance
15 July 2019 17:30
Planned maintenance of Apache on the server tommen.texo.co.za will commence. Maintenance is indicated to improve performance of your website. We do not expect downtime, but there might be intermittent, seconds-long interruptions.
18:03 Maintenance has completed successfully.
Greyworm: MySQL error
06:00 AM As a result of the power failure at Hetzner this morning, mysql on Greyworm has failed, and needs to be repaired. We are hoping to get this fixed as soon as we can.
6:50 AM MySQL has been repaired and is running.
Outage: Johannesburg
03:00AM A number of servers are offline, due to a problem affecting Hetzner’s Samrand datacenter.
Update: Hetzner informs me that the issue is due to a power outage, affecting “a large number of rows [of servers]” and that their technicians are working on the problem.
05:40AM Hetzner appears to have fixed their problem, and servers are booting up. There will be degraded performance (sluggish websites, timeouts) until disk I/O settles down within 30 minutes or so.
Bumblebee: Timeouts
13:20 We’re seeing timeouts and slow responses from websites hosted on Bumblebee, and are investigating the problem.
13:30 The problem has been found and fixed, and everything should be back to normal.
Texo: Network Status 