Lannister: Emergency Maintenance

15:40PM The server Lannister  has to be shut down in 20 minutes in order to replace a cooling fan which has failed.
The fan must be replaced urgently to prevent overheating of the server and to avoid the possibility of data loss.

16:00 Lannister has been powered down

16:05 The faulty fan has been replaced

16:06 Server is booting up now

Websites will be slow for the next 20 minutes or so as everything settles down. Thank you for your patience.

Advertisements

Greyworm DDOS

9:50PM We’re working hard to mitigate a DDOS targeting two sites on this server. Sites on this server will be unresponsive until the attack has been stopped.

10:20PM Almost there, we’ve stopped 90% of the attack, now blocking the last sources.

10:33PM Things are almost back to normal. Server iowait is a bit high, so sites will be a bit slow until that is resolved. Thanks for your patience, and apologies for this inconvenience.

Bumblebee offline

21 September 2:50PM

Server Bumblebee 156.38.146.98 is offline. Technicians are investigating.

3:15PM The problem has been found, and technicians are working to fix the hardware fault.

3:26PM The problem has been fixed, and the server will be booted up shortly

3:37PM Still waiting for the server to be booted.

3:45 Server is booting up now. For the next 10-20 minutes or so, websites and emails will be slow while disk IO is high after the reboot.

Emergency maintenance: Baratheon

12:55PM The server Baratheon will be rebooted within the next 10 minutes to address a software error. We expect downtime to be no more than 30 minutes, unless the server requires a file check on startup, which could take up to 2 hours. Please accept our apologies for the inconvenience.

13:16PM The server has booted successfully, and services are returning to normal. Websites will be slow until the server load drops over the next 10-20 minutes.

Greyworm offline: DDOS

14:00 Greyworm is currently offline due to a DDOS attack. We’re working on mitigating it.

14:17 We’ve null-routed the target of the attack, and this seems to have stopped the DDOS. Unless another site on this server is targeted, the server should now run normally. Please accept our apologies for this downtime.