20:00 We’ve had to reboot Chiss to fix a problem. The server is currently doing a filesystem check, and should be back online within 30 minutes.
20:28 The filecheck is at 82% so it won’t be much longer before the server is back online.
20:38 Chiss is back up
16 February 2012
We’re aware of a network issue affecting two servers:
which has made them inaccessible, and we’re working on it.
update 07:49 It’s been identified as a RAID issue, the DC’s engineers are on the phone to HP to work on a fix.
We have no ETA at the moment.
update 08:20 HP engineers are onsite now and we should have a fix shortly.
update 08:50 the HP engineers are still working on the problem…
update 09:14 The engineers say they’ve fixed the problem, so we’ll be booting these two servers now.
update 09:22 both servers are back up, but until the disk IO settles down after the reboot, please expect slow page loads. Everything should be back to normal within 15-20 minutes.
update 09:56 Fudge is back to normal, but Mojito is still experiencing very high load. We’re working to get it down.
update 10:15 Mojito is running normally now.