Researchers rue cost of public cloud data haul

 

Can cloud services address researchers’ computing demands?

With tight budgets and varying computational needs, researchers seem a good match for the scalable, utility-based cloud.

Today's cloud customers can purchase anything from email to supercomputing as a service through vendors like Amazon Web Services, Google and Steam Engine.

But researchers in Australian laboratories are still concerned about data ownership, transfer costs and vendor lock-in.

Guido Aben, e-Research director of Australian research network AARNet, says overseas data centres are an issue for researchers with bandwidth limitations or information to protect.

AARNet currently provides a beta "store and forward" service called CloudStor that uses a recently upgraded 6TB of local storage to transfer files between collaborating research teams.

CloudStor has been designed to overflow into Amazon's S3 Cloud Storage Service if it runs out of local disk space. But this will not be enabled until Amazon establishes a local data centre, Aben says.

"The geography of Australia simply dictates that if you have to ship data out of Australia out of Australia, the economy of cost completely changes," he says.

"Even if I save [money] to store data out of Australia, it costs me [money] to ship data. If cloud compute providers don't set up shop in Australia, it doesn't make sense for us."

Aben says universities are formulating their own strategies about if and how they will use the cloud.

"It's coming to a point where you have to ask yourself as a university, 'Do I have to own my compute power' as much as you ask yourself, 'Do I want a car, or do I want to take taxis all the time'," he says.

"Let's be honest: the marketing is really good, yet experts tell me that most people don't really know what it really is."

Tom Fifield, a high energy physics grid research programmer at the University of Melbourne, favours NIST's definitive characteristics (doc): on-demand self-service; broad network access; resource pooling; rapid elasticity; and a metering capability.

Using grid workload management software called DIRAC, Fifield is using Amazon EC2 to process data from the Belle/Belle II experiment, which investigates why matter is more commonly observed in nature than antimatter.

DIRAC distributes jobs between local resources, Amazon EC2 and the Belle grid. Between January and August, it processed 21TB of data with 27.8 percent of computing power from Amazon, 38.2 percent from collaborators in Japan and 5.82 percent from Melbourne.

"Across physics, a lot of people are looking into it [infrastructure-as-a-service]," Fifield says. "Sometimes, you find that you just need more capacity ... we have several large peak computing demands."

But while processing is cheaper on Amazon's cloud, transferring data to EC2 - which is outside the 10Gbps AARNet and its partner networks - is not so. Data is routed to and from Melbourne via Japan, from where it is cheaper to transfer data from Amazon's cloud.

Another concern is vendor lock-in. Belle/Belle II researchers believe Amazon has the best pricing, community, and features for their project at the moment, but this may not always be the case.

Fifield says the researchers are "embracing the cloud model", preparing themselves for changes by storing all data on their own grid.

And with DIRAC set up, Fifield expects to need only a week to move to, or add, another cloud provider.

Commercial cloud services are less appealing to University of Sydney physiotherapy researcher Marlene Fransen, who uses AARNet's CloudStor to collaborate with researchers in Austria.

While CloudStor lets Fransen electronically transfer data that previously had to be shipped in minutes, she considers infrastructure-as-a-service "not applicable" to her work due to the sensitivity of patient information and use of a specific software program.

"I think some unis must now be starting to realise that the honeymoon period for cloud is over and it's time to draw your own strategy as to what you're going to do," AARNet's Aben says.

"There is the promise of enormous compute cycles, but there is a risk of getting locked into a particular compute paradigm by setting up your experiments to use their platform exclusively.

"We're really keen to keep an eye on it and see what happens," he says.

Copyright © iTnews.com.au . All rights reserved.


Researchers rue cost of public cloud data haul
 
 
 
Top Stories
Frugality as a service: the Amazon story
Behind the scenes, Amazon Web Services is one lean machine.
 
Negotiating with the cloud email megavendors
[Blog post] Lessons from Woolworths’ mammoth migration.
 
Qld govt to move up to 149k staff onto Office 365
Australia's largest deployment, outside of the universities.
 
 
Sign up to receive iTnews email bulletins
   FOLLOW US...

Latest VideosSee all videos »

The great data centre opportunity on Australia's doorstep
The great data centre opportunity on Australia's doorstep
Scott Noteboom, CEO of LitBit speaking at The Australian Data Centre Strategy Summit 2014 in the Gold Coast, Queensland, Australia. http://bit.ly/1qpxVfV Scott Noteboom is a data centre engineer who led builds for Apple and Yahoo in the earliest days of the cloud, and who now eyes Asia as the next big opportunity. Read more: http://www.itnews.com.au/News/372482,how-do-we-serve-three-billion-new-internet-users.aspx#ixzz2yNLmMG5C
Interview: Karl Maftoum, CIO, ACMA
Interview: Karl Maftoum, CIO, ACMA
To COTS or not to COTS? iTnews asks Karl Maftoum, CIO of the ACMA, at the CIO Strategy Summit.
Susan Sly: What is the Role of the CIO?
Susan Sly: What is the Role of the CIO?
AEMO chief information officer Susan Sly calls for more collaboration among Australia's technology leaders at the CIO Strategy Summit.
Meet the 2014 Finance CIO of the Year
Meet the 2014 Finance CIO of the Year
Credit Union Australia's David Gee awarded Finance CIO of the Year at the iTnews Benchmark Awards.
Meet the 2014 Retail CIO of the Year
Meet the 2014 Retail CIO of the Year
Damon Rees named Retail CIO of the Year at the iTnews Benchmark Awards for his work at Woolworths.
Robyn Elliott named the 2014 Utilities CIO of the Year
Robyn Elliott named the 2014 Utilities CIO of the Year
Acting Foxtel CIO David Marks accepts an iTnews Benchmark Award on behalf of Robyn Elliott.
Meet the 2014 Industrial CIO of the Year
Meet the 2014 Industrial CIO of the Year
Sanjay Mehta named Industrial CIO of the Year at the iTnews Benchmark Awards for his work at ConocoPhillips.
Meet the 2014 Healthcare CIO of the Year
Meet the 2014 Healthcare CIO of the Year
Greg Wells named Healthcare CIO of the Year at the iTnews Benchmark Awards for his work at NSW Health.
Meet the 2014 Education CIO of the Year
Meet the 2014 Education CIO of the Year
William Confalonieri named Healthcare CIO of the Year at the iTnews Benchmark Awards for his work at Deakin University.
Meet the 2014 Government CIO of the Year
Meet the 2014 Government CIO of the Year
David Johnson named Government CIO of the Year at the iTnews Benchmark Awards for his work at the Queensland Police Service.
Q and A: Coalition Broadband Policy
Q and A: Coalition Broadband Policy
Malcolm Turnbull and Tony Abbott discuss the Coalition's broadband policy with the press.
AFP scalps hacker 'leader' inside Australia's IT ranks.
AFP scalps hacker 'leader' inside Australia's IT ranks.
The Australian Federal Police have arrested a Sydney-based IT security professional for hacking a government website.
NBN Petition Delivered To Turnbull's Office
NBN Petition Delivered To Turnbull's Office
UTS CIO: IT teams of the future
UTS CIO: IT teams of the future
UTS CIO Chrissy Burns talks data.
New UTS Building: the IT within
New UTS Building: the IT within
The IT behind tomorrow's universities.
iTnews' NBN Panel
iTnews' NBN Panel
Is your enterprise NBN-ready?
Introducing iTnews Labs
Introducing iTnews Labs
See a timelapse of the iTnews labs being unboxed, set up and switched on! iTnews will produce independent testing of the latest enterprise software to hit the market after installing a purpose-built test lab in Sydney. Watch the installation of two DL380p servers, two HP StoreVirtual 4330 storage arrays and two HP ProCurve 2920 switches.
The True Cost of BYOD
The True Cost of BYOD
iTnews' Brett Winterford gives attendees of the first 'Touch Tomorrow' event in Brisbane a brief look at his research into enterprise mobility. What are the use cases and how can they be quantified? What price should you expect to pay for securing mobile access to corporate applications? What's coming around the corner?
Ghost clouds
Ghost clouds
ACMA chair Chris Chapman says there is uncertainty over whether certain classes of cloud service providers are caught by regulations.
Was the Snowden leak inevitable?
Was the Snowden leak inevitable?
Privacy experts David Vaile (UNSW Cyberspace Law and Policy Centre) and Craig Scroggie (CEO, NextDC) claim they were not surprised by the Snowden leaks about the NSA's PRISM program.
Latest Comments
Polls
Which bank is most likely to suffer an RBS-style meltdown?





   |   View results
ANZ
  21%
 
Bankwest
  9%
 
CommBank
  11%
 
National Australia Bank
  17%
 
Suncorp
  24%
 
Westpac
  19%
TOTAL VOTES: 1429

Vote