IBM eyes brain-like computing

 

Reveals research priorities ahead of Melbourne R&D centre launch.

View larger image View larger image View larger image

See all pictures here »

IBM has set its sights on a new era of ‘cognitive computing’ to make sense of unprecedented amounts of noisy, unstructured data in various industry sectors today.

Speaking at the University of Melbourne ahead of the launch of its latest R&D facility, IBM’s research director John E Kelly III described the end of the 70-year programmable computing era.

The next decade, he said, would yield exaflop devices that learned and recognised patterns in order to extract useful information from exascale (million-terabyte) data centres.

That cognitive computing era was glimpsed in February, he said, when IBM’s supercomputing software, Watson, beat human opponents in the US quiz show, ‘Jeopardy!’.

Watson used about $3 million of hardware, drew 85kW of power and was customised to understand each question, search 500GB of local memory and make a decision within the game’s three-second time limit.

Meanwhile its opponents, Ken Jennings and Brad Rutter, didn’t study for the show and information was “instantly there” in their brains, Kelly said, describing conversations with the former Jeopardy! champions.

“They have no filing system, the answer is just there and they’ve done this for so long that they trust the information for the answer will be there when presented with a question.

“For those two human beings, the brain consumes only 20W [of power]. The incredible thing is it took 85kW to beat a 40W machine.

“We need to do bio-inspired computer science; we need to understand how this does what it does. If [computers] can do the type of reasoning we can do with the brain, then we can do some very interesting things.”

To highlight the gap in capabilities of biological and digital systems, Kelly described a Blue Gene/P supercomputer that IBM built for the Lawrence Livermore National Laboratory in 2009.

The supercomputer, dubbed Dawn, had almost 147,456 processor cores, 144 TB of memory and performed 500 TeraFLOPS, placing ninth on the Top500 supercomputer list that June.

But it was only “roughly” capable of simulating the 764 million neurons and 6100 billion synapses in a cat’s brain, Kelly said, referring to a November 2009 cognitive computing project by IBM (pdf).

Earlier this year, Salk Institute computational neuroscientist Terrence Sejnowski told Australian scientists that new power-efficient, parallel computing hardware was needed to support brain-like processing.

Although electrons travel far quicker than neurons in the brain, the latter functions probabilistically, performing only the calculations most likely to produce the desired outcome, and doing many such calculations in parallel, Sejnowski explained.

Kelly expects IBM to be able to simulate the human brain’s 20 billion neurons and 200,000 billion synapses in exascale supercomputers of the next decade.

“That’s the easy part,” he said. “We do not understand how this is wired; we do not understand the fundamentals of how the neurons and synapses are behaving.

“All we know is that they’re not ones and zeros – they’re multi-state devices, and they learn over time and their behaviour changes based on what they have experienced.”

IBM is building arrays of electronic, synapse-like devices under its SyNAPSE project that aim to physically mimic the human brain.

The project delivered prototype silicon chips in August that contained 256 neurons and either 262,144 programmable synapses or 65,536 “learning synapses”.

The next step, Kelly said, is to replace components of the chip with materials that support multiple states, and not just the traditional ones and zeros.

“Between what we’re doing with computer modelling and what we’re doing with physical devices, we’re fundamentally on a journey [towards] these so-called learning systems,” he said.

A Watson for the enterprise?

Last month, IBM finalised an agreement with US health insurance company WellPoint to develop Watson-based technology using the insurer’s historical data of treatments and outcomes.

Kelly said the healthcare sector presented the “largest opportunity” for Watson, which could quickly assist doctors in diagnosing patients.

Decisions made by human doctors tended to be skewed by their experiences, he said, while Watson could make purely statistical decisions, “[wiping] the slate clean” before each question.

Kelly acknowledged that IBM faced challenges in acquiring and using healthcare data due to privacy restrictions in western countries.

"We have to deal with the privacy issues in each country," he said. "In the US and Australia, we need data to be sanitised and anonymous if we’re going to deal with it.

"In other places around the world, that’s not the case; in China, they’re very open to sharing healthcare data so we can do things there much more quickly and easily than we can do in the western world."

Pilots of the technology were “astonishing”, he said.

According to IBM research fellow Brenda Dietrich, enterprise-focused decision-making systems could produce better outcomes and reduce “decision fatigue” in organisations.

IBM was already working with the State of New York’s taxation department to automatically identify fraudulent or erroneous tax returns and recommend the most effective means of collecting money from debtors.

Real-world problems were far more complex than those Watson faced on television, Dietrich noted, adding that it could take five, ten, or even 20 years before a full decision-making system was enterprise-ready.

“Jeopardy! was simple; you were right or you were wrong. In medicine, you may not know if your treatment was accurate; we have to figure out how to deal with noisy feedback.”

But “I think the biggest bottleneck is human acceptance,” she said. “It’s gotten a whole lot better in the 25 years I’ve worked in this space, but it’s still not completely solved.”

Copyright © iTnews.com.au . All rights reserved.


 
 
 
Top Stories
Frugality as a service: the Amazon story
Behind the scenes, Amazon Web Services is one lean machine.
 
Negotiating with the cloud email megavendors
[Blog post] Lessons from Woolworths’ mammoth migration.
 
Qld govt to move up to 149k staff onto Office 365
Australia's largest deployment, outside of the universities.
 
 
Sign up to receive iTnews email bulletins
   FOLLOW US...

Latest VideosSee all videos »

The great data centre opportunity on Australia's doorstep
The great data centre opportunity on Australia's doorstep
Scott Noteboom, CEO of LitBit speaking at The Australian Data Centre Strategy Summit 2014 in the Gold Coast, Queensland, Australia. http://bit.ly/1qpxVfV Scott Noteboom is a data centre engineer who led builds for Apple and Yahoo in the earliest days of the cloud, and who now eyes Asia as the next big opportunity. Read more: http://www.itnews.com.au/News/372482,how-do-we-serve-three-billion-new-internet-users.aspx#ixzz2yNLmMG5C
Interview: Karl Maftoum, CIO, ACMA
Interview: Karl Maftoum, CIO, ACMA
To COTS or not to COTS? iTnews asks Karl Maftoum, CIO of the ACMA, at the CIO Strategy Summit.
Susan Sly: What is the Role of the CIO?
Susan Sly: What is the Role of the CIO?
AEMO chief information officer Susan Sly calls for more collaboration among Australia's technology leaders at the CIO Strategy Summit.
Meet the 2014 Finance CIO of the Year
Meet the 2014 Finance CIO of the Year
Credit Union Australia's David Gee awarded Finance CIO of the Year at the iTnews Benchmark Awards.
Meet the 2014 Retail CIO of the Year
Meet the 2014 Retail CIO of the Year
Damon Rees named Retail CIO of the Year at the iTnews Benchmark Awards for his work at Woolworths.
Robyn Elliott named the 2014 Utilities CIO of the Year
Robyn Elliott named the 2014 Utilities CIO of the Year
Acting Foxtel CIO David Marks accepts an iTnews Benchmark Award on behalf of Robyn Elliott.
Meet the 2014 Industrial CIO of the Year
Meet the 2014 Industrial CIO of the Year
Sanjay Mehta named Industrial CIO of the Year at the iTnews Benchmark Awards for his work at ConocoPhillips.
Meet the 2014 Healthcare CIO of the Year
Meet the 2014 Healthcare CIO of the Year
Greg Wells named Healthcare CIO of the Year at the iTnews Benchmark Awards for his work at NSW Health.
Meet the 2014 Education CIO of the Year
Meet the 2014 Education CIO of the Year
William Confalonieri named Healthcare CIO of the Year at the iTnews Benchmark Awards for his work at Deakin University.
Meet the 2014 Government CIO of the Year
Meet the 2014 Government CIO of the Year
David Johnson named Government CIO of the Year at the iTnews Benchmark Awards for his work at the Queensland Police Service.
Q and A: Coalition Broadband Policy
Q and A: Coalition Broadband Policy
Malcolm Turnbull and Tony Abbott discuss the Coalition's broadband policy with the press.
AFP scalps hacker 'leader' inside Australia's IT ranks.
AFP scalps hacker 'leader' inside Australia's IT ranks.
The Australian Federal Police have arrested a Sydney-based IT security professional for hacking a government website.
NBN Petition Delivered To Turnbull's Office
NBN Petition Delivered To Turnbull's Office
UTS CIO: IT teams of the future
UTS CIO: IT teams of the future
UTS CIO Chrissy Burns talks data.
New UTS Building: the IT within
New UTS Building: the IT within
The IT behind tomorrow's universities.
iTnews' NBN Panel
iTnews' NBN Panel
Is your enterprise NBN-ready?
Introducing iTnews Labs
Introducing iTnews Labs
See a timelapse of the iTnews labs being unboxed, set up and switched on! iTnews will produce independent testing of the latest enterprise software to hit the market after installing a purpose-built test lab in Sydney. Watch the installation of two DL380p servers, two HP StoreVirtual 4330 storage arrays and two HP ProCurve 2920 switches.
The True Cost of BYOD
The True Cost of BYOD
iTnews' Brett Winterford gives attendees of the first 'Touch Tomorrow' event in Brisbane a brief look at his research into enterprise mobility. What are the use cases and how can they be quantified? What price should you expect to pay for securing mobile access to corporate applications? What's coming around the corner?
Ghost clouds
Ghost clouds
ACMA chair Chris Chapman says there is uncertainty over whether certain classes of cloud service providers are caught by regulations.
Was the Snowden leak inevitable?
Was the Snowden leak inevitable?
Privacy experts David Vaile (UNSW Cyberspace Law and Policy Centre) and Craig Scroggie (CEO, NextDC) claim they were not surprised by the Snowden leaks about the NSA's PRISM program.
Latest Comments
Polls
Which bank is most likely to suffer an RBS-style meltdown?





   |   View results
ANZ
  21%
 
Bankwest
  9%
 
CommBank
  11%
 
National Australia Bank
  17%
 
Suncorp
  24%
 
Westpac
  19%
TOTAL VOTES: 1463

Vote