Macquarie Telecom customers in Friday gridlock

 

SAN controller failure.

Premium hosting company Macquarie Telecom has advised affected customers as to the root cause of performance issues that took sites such as iTnews.com.au out of action for three and a half hours on Friday.

The incident, which occurred between 10:20am and 1:50pm on Friday, was caused by a hardware failure within one of two controllers of a sizable shared Storage Area Network (SAN) array.

The hosting provider was alerted to the issue after virtual machine management software began alerting NOC (network operations centre) staff to connectivity issues with the SAN.

As the storage controller failed, all traffic directed to it automatically failed over to a second storage controller within the array. The integrity of the data was maintained, but calls on databases slowed to such a point that several customers - iTnews.com.au included - were forced to shut down service.

The vendor of the storage array - which iTnews.com.au believes to be EMC - was contacted and supplied a replacement array within three hours.

Services were restored shortly afterwards. Fortunately, iTnews.com.au suffered no data corruption issues as a result of the failure.

Macquarie Telecom now plans to investigate what alternative automated course of action could be put in place for when one storage controller fails and a single controller is left to handle a larger volume of SAN traffic, without suffering performance degradation.

Copyright © iTnews.com.au . All rights reserved.


Macquarie Telecom customers in Friday gridlock
 
 
 
Top Stories
Toll Group to go Google
Poaches Woolworths project manager.
 
How News Corp's CIO tackled skills in his race to the cloud
What to do when your team’s talents are no longer needed.
 
Photos: How Thodey transformed Telstra
From turbulent Trujillo to Australia's leading telco.
 
 
Sign up to receive iTnews email bulletins
   FOLLOW US...
Latest Comments
Polls
Who do you trust most to protect your private data?







   |   View results
Your bank
  35%
 
Your insurance company
  5%
 
A technology company (Google, Facebook et al)
  9%
 
Your telco, ISP or utility
  8%
 
A retailer (Coles, Woolworths et al)
  4%
 
A Federal Government agency (ATO, Centrelink etc)
  18%
 
An Australian law enforcement agency (AFP, ASIO et al)
  15%
 
A State Government agency (Health dept, etc)
  7%
TOTAL VOTES: 3960

Vote
Do you support the abolition of the Office of the Information Commissioner?

   |   View results
I support shutting down the OAIC.
  27%
 
I DON'T support shutting the OAIC.
  73%
TOTAL VOTES: 1348

Vote