Twitter replicates twice in data centre move

 

Two-stage migration.

Twitter has completed a major migration of its infrastructure into a new data centre, shifting 20TB of tweets and much of its backend gear twice in the process.

The company's engineering team said the migration process began last September to increase resilience and reduce downtime for the microblogging service.

Engineers started by extending Twitter's systems to replicate tweets to multiple data centres – allowing the service to operate throughout the migration.

Some hardware and "non-runtime systems" were shifted from the old primary facility to a secondary data centre, which also acted as a "staging laboratory" to test Twitter's replication and migration strategy.

Engineers started serving live traffic from the secondary data centre for test purposes "and to continue to shed load from our primary data centre".

At the same time, engineers prepared a third location which was to become Twitter's new home.

Once the migration strategy from primary to secondary was proven, engineers shifted "all of Twitter from the first and second data centres to the final nesting grounds" - the new third data centre.

"This essentially required us to move much of Twitter two times," engineers said.

Copyright © iTnews.com.au . All rights reserved.


Twitter replicates twice in data centre move
 
 
 
Top Stories
Photos: iTnews Benchmark Awards countdown begins
Just a few days left until entries close for 2014.
 
Australian Govt to rethink cyber security strategy
Six-year old policy to be refreshed.
 
The failure of the antivirus industry
[Blog post] Insights from AVAR 2014.
 
 
Sign up to receive iTnews email bulletins
   FOLLOW US...
Latest Comments
Polls
Who do you trust most to protect your private data?







   |   View results
Your bank
  38%
 
Your insurance company
  3%
 
A technology company (Google, Facebook et al)
  8%
 
Your telco, ISP or utility
  8%
 
A retailer (Coles, Woolworths et al)
  2%
 
A Federal Government agency (ATO, Centrelink etc)
  20%
 
An Australian law enforcement agency (AFP, ASIO et al)
  15%
 
A State Government agency (Health dept, etc)
  5%
TOTAL VOTES: 1046

Vote