AARNet completes major upgrade to mirror

 

Hitachi Storage Area Network boosted to 55 Terabytes.

Australia's Academic Research Network (AARNet) has upgraded the SAN (Storage Area Network) used for its mirror service from 11.4 Terabytes to 55 Terabytes.

The SAN is used by Australia's academic community as a local mirror site for the downloading of important software such as updates to various flavours of the Unix and Linux operating systems.

A mirror (sometimes called a cache), is a local store of popular data users can draw on to prevent multiple users from attempting to download the same sets of data across international networks.

According to Steve Maddocks, director of operations at AARNet, the mirror contains "most of the major public domain Unix software" available, including Ubuntu, Fedora, Debian and FreeBSD. The mirror automatically downloads all updates to these systems - such that when systems within Australia's academic community download an update, they download it from a local source.

Maddocks said there are two goals to the mirror. The first is to allow better performance for users on AARNet - as they will receive files faster if they are stored closer to them.

"It is quite frustrating to download large objects from sites overseas," he said.

Second, the mirror saves AARNet and its customers in terms of reducing their reliance on international traffic.

"We have met these objectives," Maddocks said. "We save the cost of international transmission, of users downloading the same files over and over again across the international networks."

AARNet also uses its mirror to provide these same files to the general public.

"The mirror serves tens of thousands of ordinary Australians, with 50,000 to 60,000 people using it every day, downloading around 1.3 Terabyte of data," he said. "Of all the content on the mirror, two-thirds goes to Australian internet users."

Maddocks said it is of incremental cost to provide these files to the public.

AARNet uses Hitachi Data Systems (HDS SMS100) storage arrays to store the data, whilst the front-end of AARNet's mirror is a 1.5 Terabyte SSD (solid state drive) array to provide fast access to popular content.

"Its very useful if the mirror is very sporadic or bursting," Maddocks explained. "If a new version of Ubuntu or Fedora comes down, the hits on our storage go through the roof."

Maddocks said AARNet provides a 10Gbps link to the mirror. Strictly speaking, the Mirror SAN storage architecture has 28 Gbps of bandwidth. AARNet engineers have demonstrated ther mirror delivering 7.6Gbps successfully with no observable degradation of service.

New content

Maddocks said AARNet is "desperately trying to get the Sourceforge collection" of open source software onto the mirror in the coming months.

But the research network is not interested in providing a mirror for commercial software vendors, he said.

Maddocks said AARNet has "dabbled" in cacheing updates of commercial software, but has learned that it is too much pain for little reward.

"Almost always it ends in some proprietary copyright process - its just too difficult to manage," he said.


AARNet completes major upgrade to mirror
 
 
 
Top Stories
Hockey flags billion-dollar Centrelink mainframe replacement
Claims 30 year-old tech is holding Govt back.
 
Ombudsman wants to monitor warrantless metadata access
Requests ability to report publicly.
 
Frugality as a service: the Amazon story
Behind the scenes, Amazon Web Services is one lean machine.
 
 
Sign up to receive iTnews email bulletins
   FOLLOW US...

Latest VideosSee all videos »

The great data centre opportunity on Australia's doorstep
The great data centre opportunity on Australia's doorstep
Scott Noteboom, CEO of LitBit speaking at The Australian Data Centre Strategy Summit 2014 in the Gold Coast, Queensland, Australia. http://bit.ly/1qpxVfV Scott Noteboom is a data centre engineer who led builds for Apple and Yahoo in the earliest days of the cloud, and who now eyes Asia as the next big opportunity. Read more: http://www.itnews.com.au/News/372482,how-do-we-serve-three-billion-new-internet-users.aspx#ixzz2yNLmMG5C
Interview: Karl Maftoum, CIO, ACMA
Interview: Karl Maftoum, CIO, ACMA
To COTS or not to COTS? iTnews asks Karl Maftoum, CIO of the ACMA, at the CIO Strategy Summit.
Susan Sly: What is the Role of the CIO?
Susan Sly: What is the Role of the CIO?
AEMO chief information officer Susan Sly calls for more collaboration among Australia's technology leaders at the CIO Strategy Summit.
Meet the 2014 Finance CIO of the Year
Meet the 2014 Finance CIO of the Year
Credit Union Australia's David Gee awarded Finance CIO of the Year at the iTnews Benchmark Awards.
Meet the 2014 Retail CIO of the Year
Meet the 2014 Retail CIO of the Year
Damon Rees named Retail CIO of the Year at the iTnews Benchmark Awards for his work at Woolworths.
Robyn Elliott named the 2014 Utilities CIO of the Year
Robyn Elliott named the 2014 Utilities CIO of the Year
Acting Foxtel CIO David Marks accepts an iTnews Benchmark Award on behalf of Robyn Elliott.
Meet the 2014 Industrial CIO of the Year
Meet the 2014 Industrial CIO of the Year
Sanjay Mehta named Industrial CIO of the Year at the iTnews Benchmark Awards for his work at ConocoPhillips.
Meet the 2014 Healthcare CIO of the Year
Meet the 2014 Healthcare CIO of the Year
Greg Wells named Healthcare CIO of the Year at the iTnews Benchmark Awards for his work at NSW Health.
Meet the 2014 Education CIO of the Year
Meet the 2014 Education CIO of the Year
William Confalonieri named Healthcare CIO of the Year at the iTnews Benchmark Awards for his work at Deakin University.
Meet the 2014 Government CIO of the Year
Meet the 2014 Government CIO of the Year
David Johnson named Government CIO of the Year at the iTnews Benchmark Awards for his work at the Queensland Police Service.
Q and A: Coalition Broadband Policy
Q and A: Coalition Broadband Policy
Malcolm Turnbull and Tony Abbott discuss the Coalition's broadband policy with the press.
AFP scalps hacker 'leader' inside Australia's IT ranks.
AFP scalps hacker 'leader' inside Australia's IT ranks.
The Australian Federal Police have arrested a Sydney-based IT security professional for hacking a government website.
NBN Petition Delivered To Turnbull's Office
NBN Petition Delivered To Turnbull's Office
UTS CIO: IT teams of the future
UTS CIO: IT teams of the future
UTS CIO Chrissy Burns talks data.
New UTS Building: the IT within
New UTS Building: the IT within
The IT behind tomorrow's universities.
iTnews' NBN Panel
iTnews' NBN Panel
Is your enterprise NBN-ready?
Introducing iTnews Labs
Introducing iTnews Labs
See a timelapse of the iTnews labs being unboxed, set up and switched on! iTnews will produce independent testing of the latest enterprise software to hit the market after installing a purpose-built test lab in Sydney. Watch the installation of two DL380p servers, two HP StoreVirtual 4330 storage arrays and two HP ProCurve 2920 switches.
The True Cost of BYOD
The True Cost of BYOD
iTnews' Brett Winterford gives attendees of the first 'Touch Tomorrow' event in Brisbane a brief look at his research into enterprise mobility. What are the use cases and how can they be quantified? What price should you expect to pay for securing mobile access to corporate applications? What's coming around the corner?
Ghost clouds
Ghost clouds
ACMA chair Chris Chapman says there is uncertainty over whether certain classes of cloud service providers are caught by regulations.
Was the Snowden leak inevitable?
Was the Snowden leak inevitable?
Privacy experts David Vaile (UNSW Cyberspace Law and Policy Centre) and Craig Scroggie (CEO, NextDC) claim they were not surprised by the Snowden leaks about the NSA's PRISM program.
Latest Comments
Polls
Which bank is most likely to suffer an RBS-style meltdown?





   |   View results
ANZ
  20%
 
Bankwest
  9%
 
CommBank
  12%
 
National Australia Bank
  17%
 
Suncorp
  23%
 
Westpac
  19%
TOTAL VOTES: 1516

Vote