Boffins aim to tame information overload

 

Dartmouth College researchers tout process query systems.

US boffins have developed a way of making sense of the huge volume of data that is constantly collected from diverse sources including computer network monitors, video surveillance cameras, financial transaction records and databases.

Dartmouth College engineers George Cybenko and Vincent Berk believe that process query systems (PQS) will help to make sense of the fast growing volumes of digital data currently being generated.

The pair presented their case in a paper published in this month's IEEE Computer, the magazine of the Institute of Electrical and Electronics Engineers Computer Society. 

"PQS closes the gap between gathering a tremendous amount of valuable data and figuring out what the data means," said Cybenko, the Dorothy and Walter Gramm professor of engineering at Dartmouth's Thayer School of Engineering.

Engineers have been investigating the potential of PQS as an evolving algorithmic and software framework for the past few years, and Cybenko and Berk believe that the system could be a useful and powerful tool in a variety of fields.

Applications could include analysing credit reports for identity theft, discovering attacks on computer networks, and measuring activity at national borders, car parks or wildlife refuges.

"PQS can do for discrete, categorical data analysis problems what classical times series analysis did for finance and control systems where the data is numerical," said Professor Cybenko.

The technique is based on the premise that sensed environments, be they computer networks, email traffic or high-security buildings, all consist of processes with distinct states, dynamics and observables.

PQS works to detect and understand the changes or irregularities in these processes.

"I think the most interesting application of PQS is in network security monitoring," said Berk, research associate and lecturer at Thayer School of Engineering.

"Network administrators have many options when it comes to monitoring tools, but none of them are integrated. And, while all of them produce useful information, it is often in hugely impractical quantities.

"PQS brings the information together, and effectively focuses on the most important issues first. To my knowledge there has not been a new software technology that is this versatile since the introduction of relational databases."

Copyright ©v3.co.uk


Boffins aim to tame information overload
 
 
 
Top Stories
At the top of her game
A decision to bring digital operations back in-house three years ago has paid big dividends for Tabcorp.
 
Westpac hires SAP man as CTO
Creates four new IT lead positions.
 
Qld Transport to replace core registration system
State's biggest citizen info repository set for overhaul.
 
 
Sign up to receive iTnews email bulletins
   FOLLOW US...
Latest Comments
Polls
Who do you trust most to protect your private data?







   |   View results
Your bank
  38%
 
Your insurance company
  3%
 
A technology company (Google, Facebook et al)
  8%
 
Your telco, ISP or utility
  7%
 
A retailer (Coles, Woolworths et al)
  2%
 
A Federal Government agency (ATO, Centrelink etc)
  21%
 
An Australian law enforcement agency (AFP, ASIO et al)
  15%
 
A State Government agency (Health dept, etc)
  5%
TOTAL VOTES: 965

Vote