Network Issue

16 February 2012

We’re aware of a network issue affecting two servers:

Fudge
Mojito

which has made them inaccessible, and we’re working on it.

update 07:49 It’s been identified as a RAID issue, the DC’s engineers are on the phone to HP to work on a fix.
We have no ETA at the moment.

update 08:20 HP engineers are onsite now and we should have a fix shortly.

update 08:50 the HP engineers are still working on the problem…

update 09:14 The engineers say they’ve fixed the problem, so we’ll be booting these two servers now.

update 09:22 both servers are back up, but until the disk IO settles down after the reboot, please expect slow page loads. Everything should be back to normal within 15-20 minutes.

update 09:56 Fudge is back to normal, but Mojito is still experiencing very high load. We’re working to get it down.

update 10:15 Mojito is running normally now.