iTnews

Govt finds one third of open data was "junk"

By Allie Coyne on Nov 12, 2013 10:30AM
Govt finds one third of open data was "junk"

Cleans out data.gov.au

The number of datasets available on the Government’s open data website has slimmed by more than half after the agency discovered one third of the datasets were junk.

Since its official launch in 2011 data.gov.au grew to hold 1200 datasets from government agencies for public consumption.

In July this year the Deaprtment of Finance migrated the portal to a new open source platform - the Open Knowledge Foundation CKAN platform - for greater ease of use and publishing ability.

Since July the number of datasets fell from 1200 to 500. 

Australian Government CTO John Sheridan said in his blog late yesterday the agency had needed to review the 1200 datasets as a result of the CKAN migration, and discovered a significant amount of them were junk.

“We unfortunately found that a third of the “datasets” were just links to webpages or files that either didn’t exist anymore, or redirected somewhere not useful to genuine seekers of data,” Sheridan said.

“In the second instance, the original 1200 number included each individual file. On the new platform, a dataset may have multiple files. In one case we have a dataset with 200 individual files where before it was counted as 200 datasets.”

The number of datasets following the clean out now sits at 529. Around 123 government bodies contributed data to the portal.

Sheridan said the number was still too low.

“A lot of momentum has built around open data in Australia, including within governments around the country and we are pleased to report that a growing number of federal agencies are looking at how they can better publish data to be more efficient, improve policy development and analysis, deliver mobile services and support greater transparency and public innovation,” he said.

“The Australian Government has a lot of fantastic data sets that many agencies are working hard to make public."

Finance launched a request site for the wider public to submit request for specific data requests and vote up requests submitted by others. Government agencies will be alerted to relevant requests and the process of resolving them will be publicly viewable, he said.

The Federal Government’s approach to open data has previously been criticised as “patchy” and slow, due in part to several shortcomings in the data.gov.au website as well as slow progress in agencies adopting an open approach by default.

The Australian Information Commissioner’s February report on open data in government outlined the manual uploading and updating of datasets, lack of automated entry for metadata and a lack of specific search functions within data.gov.au as obstacles affecting the efforts pushing a whole-of-government approach to open data. 

The introduction of the new CKAN platform is expected to go some way to addressing the highlighted concerns.

In a July post announcing the move the Finance Department's director of coordination and gov 2.0 Pia Waugh said the move was the beginning of a new effort to support and increase the open publishing of datasets whilst “making the data easier to use with API access and some basic data visualisation tools”. 

“We’re in the process of looking at adding some new functionality over the coming months and later in the year, but we wanted to get basic publishing right first,” Waugh said at the time.

Got a news tip for our journalists? Share it with us anonymously here.
Copyright © iTnews.com.au . All rights reserved.
Tags:
agimodatadatagovauopen datasoftware

Partner Content

Teaching tech teams every step of implementing a machine learning project
Promoted Content Teaching tech teams every step of implementing a machine learning project
The case for postponing mainframe migration has eroded
Partner Content The case for postponing mainframe migration has eroded
How a 'micro data centre' enables your business, your way
Promoted Content How a 'micro data centre' enables your business, your way
Alienated from your own data? You’re not alone
Promoted Content Alienated from your own data? You’re not alone

Sponsored Whitepapers

Planning before the breach: You can’t protect what you can’t see
Planning before the breach: You can’t protect what you can’t see
Beyond FTP: Securing and Managing File Transfers
Beyond FTP: Securing and Managing File Transfers
NextGen Security Operations: A Roadmap for the Future
NextGen Security Operations: A Roadmap for the Future
Video: Watch Juniper talk about its Aston Martin partnership
Video: Watch Juniper talk about its Aston Martin partnership
Don’t pay the ransom: A three-step guide to ransomware protection
Don’t pay the ransom: A three-step guide to ransomware protection

Events

  • iTnews Benchmark Awards 2022 - Finalist Showcase
  • 11th Annual Fraud Prevention Summit 2022
  • IoT Impact Conference
  • Cyber Security for Government Summit
By Allie Coyne
Nov 12 2013
10:30AM
0 Comments

Related Articles

  • Gov unveils Australia's first-ever data strategy
  • Defence's enterprise-wide data division takes shape
  • Macquarie Bank chases data-driven view of its customers
  • How NAB's buyout forced 86 400 to lift its data game
Share on Twitter Share on Facebook Share on LinkedIn Share on Whatsapp Email A Friend

Most Read Articles

Kmart Australia stands up consent-as-a-service platform

Kmart Australia stands up consent-as-a-service platform

Telstra to open its 5G network to wholesale customers

Telstra to open its 5G network to wholesale customers

Macquarie Bank creates a broker portal on Salesforce

Macquarie Bank creates a broker portal on Salesforce

Active Directory defaults lead to no-fix PrivEsc vulnerability

Active Directory defaults lead to no-fix PrivEsc vulnerability

Digital Nation

Metaverse hype will transition into new business models by mid decade: Gartner
Metaverse hype will transition into new business models by mid decade: Gartner
Case Study: PlayHQ leverages graph technologies for sports administration
Case Study: PlayHQ leverages graph technologies for sports administration
The other ‘CTO’: The emerging role of the chief transformation officer
The other ‘CTO’: The emerging role of the chief transformation officer
As NFTs gain traction, businesses start taking early bets
As NFTs gain traction, businesses start taking early bets
COVER STORY: From cost control to customer fanatics, AI is transforming the contact centre
COVER STORY: From cost control to customer fanatics, AI is transforming the contact centre
All rights reserved. This material may not be published, broadcast, rewritten or redistributed in any form without prior authorisation.
Your use of this website constitutes acceptance of nextmedia's Privacy Policy and Terms & Conditions.