iTnews

Designs for Square Kilometre Array’s supercomputer completed

By Matt Johnston on May 13, 2019 4:57PM
Designs for Square Kilometre Array’s supercomputer completed

Science Data Processor to be world's fastest.

The international consortium behind the Square Kilometre Array (SKA) have completed the five-year process of designing one of two supercomputers that will crunch its way through the mountains of celestial data collected by the fields of radio telescopes.

Almost 40 institutions from 11 countries, including Australia’s CSIRO, Pawsey Supercomputing Centre, and the Perth-based Internationational Centre for Radio Astronomy Research (ICRAR) participated in the design of the Science Data Processor (SDP).

The SDP functions will be split across two supercomputers, one in Perth and one in Cape Town, to be close to the SKA-low frequency and SKA-mid frequency sites in each respective country.

When fully functional, the combined power of the SDP is expected to produce the world’s fastest supercomputer, SKA Organisation’s SDP project manager Maurizio Miccolis said.

“We estimate SDP’s total compute power to be around 250 PFlops – that's 25 percent faster than IBM’s Summit, the current fastest supercomputer in the world.".

“In total, up to 600 PB of data will be distributed around the world every year from SDP – that’s enough to fill more than a million average laptops," he said

Doing that will require the SDP to ingest data and move it through data reduction pipelines to then form packages that will be copied and distributed to a global network of regional centres to be studied.

Designing the process of ingesting and sorting the data was handled by ICRAR in Perth.

“Our job has been to create something called the ‘execution framework’, which will run up to
100 million tasks every few hours as it ingests and processes data flowing from the telescope at enormous speeds,” ICRAR’s head of Data Intensive Astronomy Andreas Wicenec said.

“Because of the sheer quantity of data flowing into SDP - some 5 Tb/s, or 100,000 times faster than the projected global average broadband speed in 2022 - it will need to make decisions on its own in almost real-time about what is noise and what is worthwhile data to keep.”

The CSIRO, meanwhile, contributed to the software architecture design and imaging algorithm development.

Pawsey’s existing high performance computing capabilities came in handy, with the organisation developing the local infrastructure interface specification between SDP and the hosting data centres.
It also ported and tested automated scaling test frameworks on its Cray supercomputers.

Rosie Bolton, data centre scientist at the SKA Organisation, added that all of these systems behind the SDP have been designed to evolve with the SKA project over its 50-year lifespan.

“We have to design a system that’s highly scalable and highly extensible so that we can add on modules and change the size of it as time goes by.”

Construction of the systems will begin in Australia and South Africa from 2021.

Got a news tip for our journalists? Share it with us anonymously here.
Copyright © iTnews.com.au . All rights reserved.
Tags:
astronomycsirohardwarepawseypawsey supercomputing centreresearchsdpskasoftwaresquare kilometre arraysupercomputer

Partner Content

DoT Victoria turns to Oracle to implement unified cloud-based platform
Promoted Content DoT Victoria turns to Oracle to implement unified cloud-based platform
Vast majority of surveyed firms still rely on password authentication
Promoted Content Vast majority of surveyed firms still rely on password authentication
Security through visibility: supporting Essential Eight cyber mitigation strategies
Promoted Content Security through visibility: supporting Essential Eight cyber mitigation strategies
Security "mindset shift" needed to protect organisations
Promoted Content Security "mindset shift" needed to protect organisations

Sponsored Whitepapers

Planning before the breach: You can’t protect what you can’t see
Planning before the breach: You can’t protect what you can’t see
Beyond FTP: Securing and Managing File Transfers
Beyond FTP: Securing and Managing File Transfers
NextGen Security Operations: A Roadmap for the Future
NextGen Security Operations: A Roadmap for the Future
Video: Watch Juniper talk about its Aston Martin partnership
Video: Watch Juniper talk about its Aston Martin partnership
Don’t pay the ransom: A three-step guide to ransomware protection
Don’t pay the ransom: A three-step guide to ransomware protection

Events

  • iTnews Benchmark Awards 2022 - Finalist Showcase
  • 11th Annual Fraud Prevention Summit 2022
  • IoT Impact Conference
  • Cyber Security for Government Summit
By Matt Johnston
May 13 2019
4:57PM
0 Comments

Related Articles

  • Pawsey brings new $2m GPU cluster online
  • Pawsey begins hunt for new $70m supercomputer
  • HPE to build Pawsey's $48m new supercomputer
  • NCI, Pawsey join US-led compute consortium for COVID-19 research
Share on Twitter Share on Facebook Share on LinkedIn Share on Whatsapp Email A Friend

Most Read Articles

Kmart Australia stands up consent-as-a-service platform

Kmart Australia stands up consent-as-a-service platform

Telstra to open its 5G network to wholesale customers

Telstra to open its 5G network to wholesale customers

Macquarie Bank creates a broker portal on Salesforce

Macquarie Bank creates a broker portal on Salesforce

Active Directory defaults lead to no-fix PrivEsc vulnerability

Active Directory defaults lead to no-fix PrivEsc vulnerability

Digital Nation

Metaverse hype will transition into new business models by mid decade: Gartner
Metaverse hype will transition into new business models by mid decade: Gartner
The other ‘CTO’: The emerging role of the chief transformation officer
The other ‘CTO’: The emerging role of the chief transformation officer
As NFTs gain traction, businesses start taking early bets
As NFTs gain traction, businesses start taking early bets
Case Study: PlayHQ leverages graph technologies for sports administration
Case Study: PlayHQ leverages graph technologies for sports administration
COVER STORY: From cost control to customer fanatics, AI is transforming the contact centre
COVER STORY: From cost control to customer fanatics, AI is transforming the contact centre
All rights reserved. This material may not be published, broadcast, rewritten or redistributed in any form without prior authorisation.
Your use of this website constitutes acceptance of nextmedia's Privacy Policy and Terms & Conditions.