Tool flags vulnerability news, bypasses Twitter dribble

Powered by SC Magazine
 

Web app highlights technical security posts, silences tweets about lunch.

A Sydney security researcher has created a Twitter feed system to enrich security vulnerability news and cut through garbage tweets.

The web-based system dubbed Talkback was pitched as an alternative and more pure security news source to Twitter that skipped “utter rubbish” tweets.

It aimed to provide researchers, infosec professionals, and intrepid journalists and bloggers with easier access to rich technical documentation and commentary about vulnerabilities. 

A map of vulnerability tweets

“Public vulnerability reports suck,” Talkback designer Matt Jones said.

He said public intelligence feeds like NVD (National Vulnerability Database) often missed important technical information because maintaining them was “an extremely hard task”.

“The real nitty-gritty of vulnerabilities is specific and requires an in-depth understanding and that can be time-consuming.”

Talkback worked by tapping tweets issued from thousands of Twitter profiles – 13,500 and growing at the time of writing – which cited vulnerability and vendor identity prefixes such as CVE (Common Vulnerabilities and Exposures), NVD, VMSA (VMware Security Advisory), and RHSA (Red Hat Security Advisory).

“They are relatively unique short character sequences so can be used to mine through the millions of messages flying through Twitter in any minute,” Jones said.

“Not only is it common for people to refer to a vulnerability by its ID, but it allows the mining process to work over many languages since these IDs are universal.”

Talkback could not only identify the first account to tweet a vulnerability reference but also those who may later tweet links to valuable blog information that shed light on vulnerabilities.

It uses social media to maintain a dynamic vulnerability timeline which is composed of a mix of “sysadmins writing about patching systems, technical write-ups, short snippets of information, and incidents and outbreaks".

But it also helps measure "the general hype from the community across all walks of life", Jones said.

Through logic algorithms and manual tweet moderation, Talkback is “learning” the difference between infosec noise and news, and is continually building its database of security researchers which it monitors.

“If you're tweeting about what you ate for lunch, then that's noise,” Jones said. “There's more quiet security people who don't tweet often, but tweet valuable information.”

Jones pointed out that knowing who to follow on social media sites like Twitter was difficult: good researchers may tweet a ream of general banter, then drop links to useful security blogs and news.

Those quiet accounts may also have few followers and be missed in the flurry of re-tweeted security news, AntiSec proclamations and daily banality.

Talkback is being modified to allow it to tap into social media sites used in countries where Twitter was not dominant, such as China.

Jones is also working on analysis of users to identify how information passed through Talkback, visualising language or location-specific vulnerability trends, and identifying where “points of influence” reside.

Jones, director of security consultancy Volvent Security and co-organiser of the Ruxcon conference, pieced Talkback together adding new features, GUIs and tweaking its smarts over the past 18 months.

The system could establish trends and help identify “hype” – popular vulnerabilities like MS12-120 and MS11-083 – which do not result in weaponised exploits or widespread compromise.

Each item is weighted by popularity from fly to obese according to the number of tweets on a given subject. The weights eliminate pollution by re-tweets, hashtags and shortened URLs by calculating the difference between parent tweets and potential child items.

A parent tweet is weighted according to the number of child items that cite it. The system determines whether child items are more or less unique.

Tweets can be represented in a side-scrolling timeline or by dots placed on a map that indicatethe location of Twitter accounts

The web interface is built with Bootstrap, jqPlot and Exhibit Simile.

Jones said in recent years more researchers have released technical documentation on bugs which appear to be driven by “independents cashing in on bug-bounties” and “research teams showcasing their technical calibre and writing about a vulnerability in-depth”.

Read Jones' blog: A year of mining Twitter.

Copyright © SC Magazine, Australia


Tool flags vulnerability news, bypasses Twitter dribble
 
 
 
Top Stories
Frugality as a service: the Amazon story
Behind the scenes, Amazon Web Services is one lean machine.
 
Negotiating with the cloud email megavendors
[Blog post] Lessons from Woolworths’ mammoth migration.
 
Qld govt to move up to 149k staff onto Office 365
Australia's largest deployment, outside of the universities.
 
 
Sign up to receive iTnews email bulletins
   FOLLOW US...

Latest VideosSee all videos »

The great data centre opportunity on Australia's doorstep
The great data centre opportunity on Australia's doorstep
Scott Noteboom, CEO of LitBit speaking at The Australian Data Centre Strategy Summit 2014 in the Gold Coast, Queensland, Australia. http://bit.ly/1qpxVfV Scott Noteboom is a data centre engineer who led builds for Apple and Yahoo in the earliest days of the cloud, and who now eyes Asia as the next big opportunity. Read more: http://www.itnews.com.au/News/372482,how-do-we-serve-three-billion-new-internet-users.aspx#ixzz2yNLmMG5C
Interview: Karl Maftoum, CIO, ACMA
Interview: Karl Maftoum, CIO, ACMA
To COTS or not to COTS? iTnews asks Karl Maftoum, CIO of the ACMA, at the CIO Strategy Summit.
Susan Sly: What is the Role of the CIO?
Susan Sly: What is the Role of the CIO?
AEMO chief information officer Susan Sly calls for more collaboration among Australia's technology leaders at the CIO Strategy Summit.
Meet the 2014 Finance CIO of the Year
Meet the 2014 Finance CIO of the Year
Credit Union Australia's David Gee awarded Finance CIO of the Year at the iTnews Benchmark Awards.
Meet the 2014 Retail CIO of the Year
Meet the 2014 Retail CIO of the Year
Damon Rees named Retail CIO of the Year at the iTnews Benchmark Awards for his work at Woolworths.
Robyn Elliott named the 2014 Utilities CIO of the Year
Robyn Elliott named the 2014 Utilities CIO of the Year
Acting Foxtel CIO David Marks accepts an iTnews Benchmark Award on behalf of Robyn Elliott.
Meet the 2014 Industrial CIO of the Year
Meet the 2014 Industrial CIO of the Year
Sanjay Mehta named Industrial CIO of the Year at the iTnews Benchmark Awards for his work at ConocoPhillips.
Meet the 2014 Healthcare CIO of the Year
Meet the 2014 Healthcare CIO of the Year
Greg Wells named Healthcare CIO of the Year at the iTnews Benchmark Awards for his work at NSW Health.
Meet the 2014 Education CIO of the Year
Meet the 2014 Education CIO of the Year
William Confalonieri named Healthcare CIO of the Year at the iTnews Benchmark Awards for his work at Deakin University.
Meet the 2014 Government CIO of the Year
Meet the 2014 Government CIO of the Year
David Johnson named Government CIO of the Year at the iTnews Benchmark Awards for his work at the Queensland Police Service.
Q and A: Coalition Broadband Policy
Q and A: Coalition Broadband Policy
Malcolm Turnbull and Tony Abbott discuss the Coalition's broadband policy with the press.
AFP scalps hacker 'leader' inside Australia's IT ranks.
AFP scalps hacker 'leader' inside Australia's IT ranks.
The Australian Federal Police have arrested a Sydney-based IT security professional for hacking a government website.
NBN Petition Delivered To Turnbull's Office
NBN Petition Delivered To Turnbull's Office
UTS CIO: IT teams of the future
UTS CIO: IT teams of the future
UTS CIO Chrissy Burns talks data.
New UTS Building: the IT within
New UTS Building: the IT within
The IT behind tomorrow's universities.
iTnews' NBN Panel
iTnews' NBN Panel
Is your enterprise NBN-ready?
Introducing iTnews Labs
Introducing iTnews Labs
See a timelapse of the iTnews labs being unboxed, set up and switched on! iTnews will produce independent testing of the latest enterprise software to hit the market after installing a purpose-built test lab in Sydney. Watch the installation of two DL380p servers, two HP StoreVirtual 4330 storage arrays and two HP ProCurve 2920 switches.
The True Cost of BYOD
The True Cost of BYOD
iTnews' Brett Winterford gives attendees of the first 'Touch Tomorrow' event in Brisbane a brief look at his research into enterprise mobility. What are the use cases and how can they be quantified? What price should you expect to pay for securing mobile access to corporate applications? What's coming around the corner?
Ghost clouds
Ghost clouds
ACMA chair Chris Chapman says there is uncertainty over whether certain classes of cloud service providers are caught by regulations.
Was the Snowden leak inevitable?
Was the Snowden leak inevitable?
Privacy experts David Vaile (UNSW Cyberspace Law and Policy Centre) and Craig Scroggie (CEO, NextDC) claim they were not surprised by the Snowden leaks about the NSA's PRISM program.
Latest Comments
Polls
Which bank is most likely to suffer an RBS-style meltdown?





   |   View results
ANZ
  21%
 
Bankwest
  9%
 
CommBank
  11%
 
National Australia Bank
  17%
 
Suncorp
  24%
 
Westpac
  19%
TOTAL VOTES: 1443

Vote