Firmware update blamed for Office365 outage

 

Caused Office365, Windows Live, Azure platform management to cut out.

Microsoft has blamed a botched update applied to a load balancer for an outage that cut access to a number of hosted services including Office365 and Windows Live a fortnight ago.

The outage, which occurred on September 9, was initially thought to have been caused by power cuts in Southern California although speculation had centred on whether it was domain name service (DNS) related.

A post-mortem released by Microsoft confirmed it was an issue in Microsoft's DNS service.

"A tool that helps balance network traffic was being updated and the update did not work correctly," Windows Live test and service engineering vice president Arthur de Haan said.

"As a result, configuration settings were corrupted, which caused a service disruption."

The file corruption occurred for two reasons, Microsoft said. Firstly, the load balancing tool was unable to parse an incorrectly constructed line in the updated configuration file, de Haan said.

"The second condition was related to how the configuration is synchronised across the DNS service to ensure all client requests return the same response regardless of the connection location of the client," he said.

"Each of these conditions was tracked to the networking device firmware used in the Microsoft DNS service."

De Haan said Microsoft was focused on hardening the DNS service, improving redundancy and failover capabilities.

"We are also developing an additional recovery process that will allow a specific property the ability to fail over to restore service and then fail back when the DNS service is restored," he said.

"In addition, we are reviewing the recovery tools to see if we can make more improvements that will decrease the time it takes to resolve outages."

Copyright © iTnews.com.au . All rights reserved.


Firmware update blamed for Office365 outage
 
 
 
Top Stories
The True Cost of BYOD - 2014 survey
Twelve months on from our first study, is BYOD a better proposition?
 
Photos: Unboxing the Magnus supercomputer
Pawsey's biggest beast slots into place.
 
ANZ looks to life beyond the transaction
If digital disruptors think an online payments startup could rock the big four, they’ve missed the point of why people use banks, says Patrick Maes.
 
 
Sign up to receive iTnews email bulletins
   FOLLOW US...
Latest articles on BIT Latest Articles from BIT
Pass on carbon tax savings, warns ACCC
Jul 24, 2014
The ACCC is warning businesses that supply "regulated goods" to pass on any cost savings ...
Have customers that won't pay debts?
Jul 10, 2014
The ACCC and ASIC have updated their advice when it comes to collecting debts.
Carpet cleaner faces court over online testimonials
Jul 4, 2014
The ACCC has initiated proceedings against A Whistle (1979) Pty Ltd, the franchisor of Electrodry...
You can now get 15GB of free online storage using Microsoft OneDrive
Jun 25, 2014
Cloud storage has reached both the capacity and price where it's a viable alternative to local ...
Another clever trick you can perform with Xero
Jun 25, 2014
Here is another way to reach out to particular subsets of your customers using Xero.
Latest Comments
Polls
What is delaying adoption of public cloud in your organisation?







   |   View results
Lock-in concerns
  29%
 
Application integration concerns
  3%
 
Security and compliance concerns
  28%
 
Unreliable network infrastructure
  9%
 
Data sovereignty concerns
  22%
 
Lack of stakeholder support
  3%
 
Protecting on-premise IT jobs
  4%
 
Difficulty transitioning CapEx budget into OpEx
  3%
TOTAL VOTES: 1114

Vote