Radioastronomy at the exascale

 

SKA researchers to dump 99 percent of raw data.

When radiotelescopes in the Square Kilometre Array (SKA) begin producing exabytes of data in 2024, 99 percent of that raw data will be deleted.

The loss of potentially valuable information is “unfortunate”, but according to CSIRO scientist Tim Cornwell, unavoidable due to the cost of data storage.

Instead of storing exabytes of new data each week, raw data from the SKA will be processed by a supercomputer into images and time-series information that will be stored and used by researchers.

This will reduce the project’s storage requirements to tens of petabytes a week – equivalent to the total capacity of some of today’s largest data centres.

“We will only store data products,” said Cornwell, the computing project lead for the Australian Square Kilometre Array Pathfinder (ASKAP), a 36-dish array that will launch in 2013.

“There’s too much raw data so [researchers] don’t get access to that. It’s unfortunate, but the cost-benefit is very much in favour of throwing [raw data] away.”

Cornwell’s team at the CSIRO is developing software to produce scientific images and data about the strengths, frequencies and locations of sources of radiation in real time.

For the ASKAP, CSIRO’s algorithms will process some 2.4 gigabytes of data a second and require 100 teraFLOPS of computing grunt from the purpose-built, petascale Pawsey Centre.

Phase one of the SKA will deliver about a tenth of the array’s full capacity by 2019 and require a 100 petaFLOP machine.

By 2024, the full, 3000-dish SKA will require an exascale supercomputer – more than a hundred times faster than today’s most powerful machines.

Cornwell noted that the major hurdle will not be FLOPS (floating operations per second) but ‘memory bandwidth’, which is how quickly data is transmitted into and out of computing cores.

To that end, CSIRO aims to build algorithms that utilise many cores in parallel.

Power consumption is likely to be another major challenge, with existing eight-petaflop machines drawing almost ten megawatts of electricity at a cost of about $10 million a year.

“The key roadblocks are things like power consumption on the multicore chips as you build up heat, and how you move data around,” Australian bid director Brian Boyle said.

“There are roadblocks to be gotten past, but the computing industry is bullish about it ... If we extrapolate from our progress, we don’t see a reason why we wouldn’t get to SKA data rates.

“IBM has told us that exascale computing will be around in 2018, and it will be a Thursday,” he joked.

Besides IBM, the anzSKA team responsible for Australia and New Zealand’s bid to host the array has been working with HP, Cray and Silicon Graphics on potential supercomputing technology.

The anzSKA industry consortium also includes Cisco, Sun Microsystems, the Federal Department of Innovation, CSIRO and supercomputing consortium iVEC.

Many of those vendors also have separate teams working with the competing Southern Africa bid. International SKA organisers will decide between Australia and South Africa in February.

Peter Quinn, director of the International Centre for Radio Astronomy Research, estimated that a third of the SKA funds could be spent on ICT, generating a $670 million business opportunity to technology vendors.

IBM Australia’s research and development director Glenn Wightwick said it began working with the anzSKA consortium five years ago, and had about eight staff in Australia and an equal number elsewhere working on the project.

“We find the problem very compelling,” said Wightwick, noting that existing data management technology like IBM's General Parallel File System were unlikely to scale to meet the SKA’s demands.

“What you would do is access all survey data and search for objects of interest and changes. The constant comparison implies enormous computing requirements.

“You’ll probably want to have processing elements embedded into the data flow, but there are also operations akin to data mining.”

Wightwick hoped an Australia-based SKA would inspire more people to pursue careers in science, technology, engineering and mathematics.

But should Australia be unsuccessful in bidding to host the SKA, “it’s not like work gets wasted”, he said.

Boyle agreed, estimating there to be a “seven-year lag” between the development of cutting-edge supercomputers for research and the use of such machines in high-end enterprises.

Copyright © iTnews.com.au . All rights reserved.


Radioastronomy at the exascale
Tags
 
 
 
Top Stories
Frugality as a service: the Amazon story
Behind the scenes, Amazon Web Services is one lean machine.
 
Negotiating with the cloud email megavendors
[Blog post] Lessons from Woolworths’ mammoth migration.
 
Qld govt to move up to 149k staff onto Office 365
Australia's largest deployment, outside of the universities.
 
 
Sign up to receive iTnews email bulletins
   FOLLOW US...

Latest VideosSee all videos »

The great data centre opportunity on Australia's doorstep
The great data centre opportunity on Australia's doorstep
Scott Noteboom, CEO of LitBit speaking at The Australian Data Centre Strategy Summit 2014 in the Gold Coast, Queensland, Australia. http://bit.ly/1qpxVfV Scott Noteboom is a data centre engineer who led builds for Apple and Yahoo in the earliest days of the cloud, and who now eyes Asia as the next big opportunity. Read more: http://www.itnews.com.au/News/372482,how-do-we-serve-three-billion-new-internet-users.aspx#ixzz2yNLmMG5C
Interview: Karl Maftoum, CIO, ACMA
Interview: Karl Maftoum, CIO, ACMA
To COTS or not to COTS? iTnews asks Karl Maftoum, CIO of the ACMA, at the CIO Strategy Summit.
Susan Sly: What is the Role of the CIO?
Susan Sly: What is the Role of the CIO?
AEMO chief information officer Susan Sly calls for more collaboration among Australia's technology leaders at the CIO Strategy Summit.
Meet the 2014 Finance CIO of the Year
Meet the 2014 Finance CIO of the Year
Credit Union Australia's David Gee awarded Finance CIO of the Year at the iTnews Benchmark Awards.
Meet the 2014 Retail CIO of the Year
Meet the 2014 Retail CIO of the Year
Damon Rees named Retail CIO of the Year at the iTnews Benchmark Awards for his work at Woolworths.
Robyn Elliott named the 2014 Utilities CIO of the Year
Robyn Elliott named the 2014 Utilities CIO of the Year
Acting Foxtel CIO David Marks accepts an iTnews Benchmark Award on behalf of Robyn Elliott.
Meet the 2014 Industrial CIO of the Year
Meet the 2014 Industrial CIO of the Year
Sanjay Mehta named Industrial CIO of the Year at the iTnews Benchmark Awards for his work at ConocoPhillips.
Meet the 2014 Healthcare CIO of the Year
Meet the 2014 Healthcare CIO of the Year
Greg Wells named Healthcare CIO of the Year at the iTnews Benchmark Awards for his work at NSW Health.
Meet the 2014 Education CIO of the Year
Meet the 2014 Education CIO of the Year
William Confalonieri named Healthcare CIO of the Year at the iTnews Benchmark Awards for his work at Deakin University.
Meet the 2014 Government CIO of the Year
Meet the 2014 Government CIO of the Year
David Johnson named Government CIO of the Year at the iTnews Benchmark Awards for his work at the Queensland Police Service.
Q and A: Coalition Broadband Policy
Q and A: Coalition Broadband Policy
Malcolm Turnbull and Tony Abbott discuss the Coalition's broadband policy with the press.
AFP scalps hacker 'leader' inside Australia's IT ranks.
AFP scalps hacker 'leader' inside Australia's IT ranks.
The Australian Federal Police have arrested a Sydney-based IT security professional for hacking a government website.
NBN Petition Delivered To Turnbull's Office
NBN Petition Delivered To Turnbull's Office
UTS CIO: IT teams of the future
UTS CIO: IT teams of the future
UTS CIO Chrissy Burns talks data.
New UTS Building: the IT within
New UTS Building: the IT within
The IT behind tomorrow's universities.
iTnews' NBN Panel
iTnews' NBN Panel
Is your enterprise NBN-ready?
Introducing iTnews Labs
Introducing iTnews Labs
See a timelapse of the iTnews labs being unboxed, set up and switched on! iTnews will produce independent testing of the latest enterprise software to hit the market after installing a purpose-built test lab in Sydney. Watch the installation of two DL380p servers, two HP StoreVirtual 4330 storage arrays and two HP ProCurve 2920 switches.
The True Cost of BYOD
The True Cost of BYOD
iTnews' Brett Winterford gives attendees of the first 'Touch Tomorrow' event in Brisbane a brief look at his research into enterprise mobility. What are the use cases and how can they be quantified? What price should you expect to pay for securing mobile access to corporate applications? What's coming around the corner?
Ghost clouds
Ghost clouds
ACMA chair Chris Chapman says there is uncertainty over whether certain classes of cloud service providers are caught by regulations.
Was the Snowden leak inevitable?
Was the Snowden leak inevitable?
Privacy experts David Vaile (UNSW Cyberspace Law and Policy Centre) and Craig Scroggie (CEO, NextDC) claim they were not surprised by the Snowden leaks about the NSA's PRISM program.
Latest Comments
Polls
Which bank is most likely to suffer an RBS-style meltdown?





   |   View results
ANZ
  21%
 
Bankwest
  9%
 
CommBank
  11%
 
National Australia Bank
  17%
 
Suncorp
  24%
 
Westpac
  19%
TOTAL VOTES: 1429

Vote