Official off-network notifications for Texo clients
29 May 2012 14:52
The server Glee is offline. We’re working on the problem.
15:13 Datacentre has informed us that the problem is being caused by a faulty node. They’re working on getting everything back to normal.
16:46 Services are running normally on Glee.
I have just been informed of emergency maintenance on the MTN Business routing infrastructure tonight which will affect these servers:
Aramandi
Barabel
Byron
Chiss
Dantari
Emergency Maintenance: MTN Business routing infrastructure
Start Time: 2012-05-16 22:00:00
End Time: 2012-05-16 23:00:00
Impact: Clients hosted on these servers may experience intermittent, brief connectivity problems.
Additional information: MTN Business will be replacing a faulty interface converter module on their core routing facility. No downtime is expected, however slight degradation of services may be experienced during the maintenance window.
Thursday 26 April 2012 15:30PM There sems to be a network problem in our London DC which has made all servers inaccessible.
We’re liasing with the DC to find and fix the problem.
Update 15:41PM all servers are up and running correctly. Apologies for the inconvenience.
12 April 2012 15:20 A problem with the MTN backbone providing internet connectivity to some of our servers in Cape Town has made them inaccessible. MTN engineers are working on the problem.
Affected servers:
Aramandi
Byron
Chaucer
Lizzy
Toffee
16:10 everything appears to be working correctly now
Date: 28 March 2012
Time: 00:00 – 01:30
Anticipated impact: No downtime is expected, but websites hosted on these servers may experience intermittent packet loss (slowness, timeouts)
Servers affected:
Sunday 25 March 2012 4:20PM
Routing issues in our London DC are causing packet loss/timeouts to some servers in our London DC. Technicians are working on the problem.
4:36PM
The problem seems to be fixed. If you’re experiencing any issues, please submit a support ticket so that we can take a look.
00:00 10 March 2012
Planned maintenance has begun on these servers:
Aramandi
Byron
and will finish at 02:00
Intermittent connectivity disruptions will be experienced during the maintenance window.
10:32AM MySQL on the server Glee is offline. We’re working on the problem.
11:00 AM The problem has been fixed. If you’re seeing any errors on your website, please send an email to support@texo.co.za so that we can fix it for you.
12:10 We’re seeing very high loads on the server “Lizzy” which is causing connection errors and timeouts.
We’re working to find and fix the problem.
update 12:20 We’ve found the account causing the problem, and have suspended it while we investigate the root cause.
update 12:35 Lizzy is running normally again.
16 February 2012
We’re aware of a network issue affecting two servers:
Fudge
Mojito
which has made them inaccessible, and we’re working on it.
update 07:49 It’s been identified as a RAID issue, the DC’s engineers are on the phone to HP to work on a fix.
We have no ETA at the moment.
update 08:20 HP engineers are onsite now and we should have a fix shortly.
update 08:50 the HP engineers are still working on the problem…
update 09:14 The engineers say they’ve fixed the problem, so we’ll be booting these two servers now.
update 09:22 both servers are back up, but until the disk IO settles down after the reboot, please expect slow page loads. Everything should be back to normal within 15-20 minutes.
update 09:56 Fudge is back to normal, but Mojito is still experiencing very high load. We’re working to get it down.
update 10:15 Mojito is running normally now.
Texo: Network Status 