Pawsey project grows supercomputing team

 

Readies next phase for Fornax GPU cluster.

View larger image View larger image View larger image

See all pictures here »

Supercomputing group iVEC could more than double its technical headcount as it prepares to install and support all three components of the Federal Government’s $80 million Pawsey Centre project.

The group has so far delivered a $5 million Linux cluster named 'Epic' and a $4 million hybrid-GPU cluster named 'Fornax' under Stages 1A and 1B of the project.

It is expected to deliver a separate, petascale supercomputer by next year, under Stage 2 of the project.

IVEC acting executive director Paul Nicholls said the group had recruited two operational staff for Epic and five storage and HPC specialists for Fornax.

Nicholls said iVEC would gradually grow the size of its operational team over the next 12 months as Fornax went into production and it began designing, installing and testing the Stage 2 machine.

“We’re very, very close [to announcing the petascale technology],” he told iTnews.

“The solution has been identified and we are in discussions with five vendors ... it is a multi-vendor solution.”

Nicholls said staffing requirements would depend on the design of the final petascale machine, but indicated the operational team could grow to more than 15 people.

In May, iVEC also established a separate, six-person Supercomputing Technology and Applications Program (STAP) team to help scientists develop code for Pawsey machines.

The Western Australian Government last year committed $15.8 million over four years to attract skilled workers to the Pawsey Centre.

Fornax goes into production

The Fornax GPU cluster will shortly enter production phase, involving up to 20 scientific projects, after being installed at the University of Western Australia in January.

The supercomputer was supplied by SGI and comprises 96 nodes, each containing two six-core Intel Xeon CPUs, an Nvidia Tesla GPU, 48 GB memory and seven terabytes of local storage.

IVEC spokespeople told iTnews that the machine had performed largely as expected during a seven-week ‘early adopter’ phase that ended in June.

System administrator Ashley Chew highlighted a brief outage due to subnet management issues in the InfiniBand network that connected Fornax nodes and a 500-terabyte global file system.

Chew said the issue was resolved by running subnet management software on a Fornax node, rather than using software embedded on an InfiniBand switch.

“InfiniBand is great at what it does but it requires a lot of tinkering to make it work,” he noted.

Additionally, Chew observed that researchers tended to use Open GLX application programming interface for Fornax, instead of newer OpenCL or CUDA technology.

“We have a job to educate users of the GPU cluster better,” Nicholls noted.

Five members of the STAP team devoted work to developing code for Fornax users, with the remaining member focused on Epic.

Nicholls said early adopters of Fornax had been chosen for their experience with GPU programming.

Early adopters used Fornax for geoscience, bioinformatics, chemistry, and radioastronomy projects including processing data from the Murchison Widefield Array — one of Australia’s pathfinders for the Square Kilometre Array.

Similarly, the first round of the production phase would likely involve researchers with GPU experience, while the STAP team worked with four to five other groups in preparation for round two in early 2013, Nicholls said.

IVEC expects Fornax’s combination of GPUs and fast local storage to be particularly well-suited to data-intensive computations in radioastronomy and the geosciences.

Copyright © iTnews.com.au . All rights reserved.


 
 
 
Top Stories
Frugality as a service: the Amazon story
Behind the scenes, Amazon Web Services is one lean machine.
 
Negotiating with the cloud email megavendors
[Blog post] Lessons from Woolworths’ mammoth migration.
 
Qld govt to move up to 149k staff onto Office 365
Australia's largest deployment, outside of the universities.
 
 
iVEC system administrator Ashley Chew in Fornax's 67-square-metre room.
Sign up to receive iTnews email bulletins
   FOLLOW US...

Latest VideosSee all videos »

The great data centre opportunity on Australia's doorstep
The great data centre opportunity on Australia's doorstep
Scott Noteboom, CEO of LitBit speaking at The Australian Data Centre Strategy Summit 2014 in the Gold Coast, Queensland, Australia. http://bit.ly/1qpxVfV Scott Noteboom is a data centre engineer who led builds for Apple and Yahoo in the earliest days of the cloud, and who now eyes Asia as the next big opportunity. Read more: http://www.itnews.com.au/News/372482,how-do-we-serve-three-billion-new-internet-users.aspx#ixzz2yNLmMG5C
Interview: Karl Maftoum, CIO, ACMA
Interview: Karl Maftoum, CIO, ACMA
To COTS or not to COTS? iTnews asks Karl Maftoum, CIO of the ACMA, at the CIO Strategy Summit.
Susan Sly: What is the Role of the CIO?
Susan Sly: What is the Role of the CIO?
AEMO chief information officer Susan Sly calls for more collaboration among Australia's technology leaders at the CIO Strategy Summit.
Meet the 2014 Finance CIO of the Year
Meet the 2014 Finance CIO of the Year
Credit Union Australia's David Gee awarded Finance CIO of the Year at the iTnews Benchmark Awards.
Meet the 2014 Retail CIO of the Year
Meet the 2014 Retail CIO of the Year
Damon Rees named Retail CIO of the Year at the iTnews Benchmark Awards for his work at Woolworths.
Robyn Elliott named the 2014 Utilities CIO of the Year
Robyn Elliott named the 2014 Utilities CIO of the Year
Acting Foxtel CIO David Marks accepts an iTnews Benchmark Award on behalf of Robyn Elliott.
Meet the 2014 Industrial CIO of the Year
Meet the 2014 Industrial CIO of the Year
Sanjay Mehta named Industrial CIO of the Year at the iTnews Benchmark Awards for his work at ConocoPhillips.
Meet the 2014 Healthcare CIO of the Year
Meet the 2014 Healthcare CIO of the Year
Greg Wells named Healthcare CIO of the Year at the iTnews Benchmark Awards for his work at NSW Health.
Meet the 2014 Education CIO of the Year
Meet the 2014 Education CIO of the Year
William Confalonieri named Healthcare CIO of the Year at the iTnews Benchmark Awards for his work at Deakin University.
Meet the 2014 Government CIO of the Year
Meet the 2014 Government CIO of the Year
David Johnson named Government CIO of the Year at the iTnews Benchmark Awards for his work at the Queensland Police Service.
Q and A: Coalition Broadband Policy
Q and A: Coalition Broadband Policy
Malcolm Turnbull and Tony Abbott discuss the Coalition's broadband policy with the press.
AFP scalps hacker 'leader' inside Australia's IT ranks.
AFP scalps hacker 'leader' inside Australia's IT ranks.
The Australian Federal Police have arrested a Sydney-based IT security professional for hacking a government website.
NBN Petition Delivered To Turnbull's Office
NBN Petition Delivered To Turnbull's Office
UTS CIO: IT teams of the future
UTS CIO: IT teams of the future
UTS CIO Chrissy Burns talks data.
New UTS Building: the IT within
New UTS Building: the IT within
The IT behind tomorrow's universities.
iTnews' NBN Panel
iTnews' NBN Panel
Is your enterprise NBN-ready?
Introducing iTnews Labs
Introducing iTnews Labs
See a timelapse of the iTnews labs being unboxed, set up and switched on! iTnews will produce independent testing of the latest enterprise software to hit the market after installing a purpose-built test lab in Sydney. Watch the installation of two DL380p servers, two HP StoreVirtual 4330 storage arrays and two HP ProCurve 2920 switches.
The True Cost of BYOD
The True Cost of BYOD
iTnews' Brett Winterford gives attendees of the first 'Touch Tomorrow' event in Brisbane a brief look at his research into enterprise mobility. What are the use cases and how can they be quantified? What price should you expect to pay for securing mobile access to corporate applications? What's coming around the corner?
Ghost clouds
Ghost clouds
ACMA chair Chris Chapman says there is uncertainty over whether certain classes of cloud service providers are caught by regulations.
Was the Snowden leak inevitable?
Was the Snowden leak inevitable?
Privacy experts David Vaile (UNSW Cyberspace Law and Policy Centre) and Craig Scroggie (CEO, NextDC) claim they were not surprised by the Snowden leaks about the NSA's PRISM program.
Latest Comments
Polls
Which bank is most likely to suffer an RBS-style meltdown?





   |   View results
ANZ
  21%
 
Bankwest
  9%
 
CommBank
  11%
 
National Australia Bank
  17%
 
Suncorp
  24%
 
Westpac
  19%
TOTAL VOTES: 1461

Vote