Firmware update blamed for Office365 outage

 

Caused Office365, Windows Live, Azure platform management to cut out.

Microsoft has blamed a botched update applied to a load balancer for an outage that cut access to a number of hosted services including Office365 and Windows Live a fortnight ago.

The outage, which occurred on September 9, was initially thought to have been caused by power cuts in Southern California although speculation had centred on whether it was domain name service (DNS) related.

A post-mortem released by Microsoft confirmed it was an issue in Microsoft's DNS service.

"A tool that helps balance network traffic was being updated and the update did not work correctly," Windows Live test and service engineering vice president Arthur de Haan said.

"As a result, configuration settings were corrupted, which caused a service disruption."

The file corruption occurred for two reasons, Microsoft said. Firstly, the load balancing tool was unable to parse an incorrectly constructed line in the updated configuration file, de Haan said.

"The second condition was related to how the configuration is synchronised across the DNS service to ensure all client requests return the same response regardless of the connection location of the client," he said.

"Each of these conditions was tracked to the networking device firmware used in the Microsoft DNS service."

De Haan said Microsoft was focused on hardening the DNS service, improving redundancy and failover capabilities.

"We are also developing an additional recovery process that will allow a specific property the ability to fail over to restore service and then fail back when the DNS service is restored," he said.

"In addition, we are reviewing the recovery tools to see if we can make more improvements that will decrease the time it takes to resolve outages."

Copyright © iTnews.com.au . All rights reserved.


Firmware update blamed for Office365 outage
 
 
 
Top Stories
Taking the fight to the disruptors
Seven West Media's new chief digital officer, Clive Dickens, says if a media company as historic as Disney can take on the new media landscape, then so can he.
 
How Australia plans to mark NAPLAN with cognitive computing
National schools test to be scored electronically from 2017.
 
M2 makes $1.6bn play for iiNet
Challenges TPG's March takeover offer.
 
 
Sign up to receive iTnews email bulletins
   FOLLOW US...
Latest articles on BIT Latest Articles from BIT
Small business win in a budget with 'fair' savings: Abbott
Apr 17, 2015
Tony Abbott has reaffirmed that the government’s aim is “always to get taxes ...
Xero now includes an inventory function built-in
Mar 26, 2015
Xero has added inventory and other major new features to the latest release of its cloud ...
Apple reveals its new MacBook
Mar 13, 2015
Replacing the MacBook Air as Apple's thinnest laptop, the new MacBook comes packed with features.
Xero has released a new version of its app for the iPad
Mar 6, 2015
iPad-wielding Xero users can now take advantage of a new version of the iOS app for the cloud ...
Microsoft is offering Azure for Disaster Recovery to Australian SMBs
Feb 10, 2015
If you haven't talked to your IT provider about disaster recovery, it might be worth discussing ...
Latest Comments
Polls
Do you support the Government's data retention scheme?

   |   View results
Yes
  11%
 
No
  89%
TOTAL VOTES: 2558

Vote