You are on page 1of 20

Creating Greater Value from Open Data

David Mitton davidmitton@liberata.com 07770 442931

Reference data (Code Lists)
County Codes (Local Gov Standard) Kent Essex Hertfordshire Bedfordshire Cambridgeshire KT101 EX101 HT101 BD101 CB101 County Codes (Central Gov Standard) Essex Herts Beds Cambridgeshire Kent ESX HFD BD1 CB KNT

Mapping competing codes together creates a data translation layer

Federated data is made interoperable without redefining data standards

Fly Tipping

Picture: Kevin Rothwell, Creative Commons

• • •

Wasteful Drain on resources Costly

Dumping

© European Union, 1995-2012

• •

Fees generated from commercial ‘tippers’ Sales of electricity from gas generated

Recycling

Social and economic benefits
Reduction in pollution Creation of 4 :1 extra jobs versus traditional incineration Eases demand for natural resources

Fly Tipping
Local Authority Barnsley Borough Council Doncaster Metropolitan Borough Council Knowsley Metropolitan Borough Newcastle upon Tyne City Council Oldham Metropolitan Borough Council Sunderland City Council North Tyneside Council St Helens Borough Council Homeless Spending £396,000 £489,000 £547,000 £1,239,000 £395,000 £876,000 £248,000 £399,000 B&B Temp Accom Hostels Leasehold Dwellings Admin £396,000 £489,000 £547,000 £1,239,000 £395,000 £876,000 £0 £0 % Admin

100% 100% 100% 100% 100% 100% 0% 0%

"from OpenlyLocal"

Wasteful
Resource to publish and high cost to interrogate Where to start?

Dumping
Local Authority Bradford Metropolitan Council South Tyneside Metropolitan Borough Council Sefton Metropolitan Borough Council Sheffield Council Coventry City Council Salford City Council Leeds City Council Wigan Metropolitan Borough Rotherham Metropolitan Borough Council

Homeless Spending
£1,459,000 £344,000 £257,000 £5,141,000 £676,000 £1,695,000 £9,489,000 £820,000 £785,000

B&B

Temp Accom

Hostels £472,000

Leasehold Dwellings

Admin £987,000 £215,000

% Admin

68% 63% 62% 59% 49% 48% 45% 43% 15%

£129,000 £33,000 £2,109,000 £345,000 £239,000 £2,937,000 £69,000 £507,000 £527,000 £1,723,000 £399,000 £25,000 £501,000 £140,000 £137,000 £65,000 £0

£160,000 £3,032,000 £331,000 £812,000 £4,302,000 £352,000 £119,000

"from OpenlyLocal"

Organising

The standards against which they report
Bed & Breakfast Hotels Administration Temporary Accommodation

• •

The reference data to classify it
Ability to map reference data A means to make sense of diverse data sets

Outcomes
Improved quality and reusability of data

Data.gov.uk

How important is being organised?
• • • •
The Soham Murders Holly Wells & Jessica Chapman Data was not interoperable Information existed to prevent this tragedy

The challenge of interoperability
M = Male, F = Female, U = Unkown….or does it?

• • •

Try to enforce standards and you get resistance Solution is to manage diversity, not try to impose uniformity Good standards emerge by embracing all standards and collaborating

The Police National Database
PND Outcomes National View of Criminal Intelligence £2,500,000 savings on data integration

Police National Dbase 300 code list standards 4. Translation layer (XML)
CRASH PentiP

5. Quality Control

6. Re-use of standards

HOLMES 3 HODH

Alerts

Web Services

MoJ

3. Map to PND

Police.uk

2. Application Context
1. Validate Local Codes

300 ICT systems and 43 police forces = 12000 competing code lists Gender Classifications Male = M, Male = M1, Male = 001, Male = M101

EC2A 4JE

The value of one data standard
Vehicle Make Model Code List

Government Police SAFETY VOSA CRASH statistics DVA NI

Private Sector Insurance Companies QUALITY Trade – e.g. RAC, Tracker MOT Failure Codes Rental & Leasing

VALUE Aftermarket parts

VRM Lookup companies Department for Transport 40 x Motor Manufacturers
1000’s Parts suppliers

It seems obvious. So why is data ‘dumped’ and savings missed?
• • •
Only 35% of UK civil servants know that using data standards can reduce IT implementation costs Only 40% know that data standards make data interoperable 78% do not know what benefits will flow from the open data agenda

Source: Listpoint/ Dods civil service research into understanding of open data agenda and benefits – December 2012. More information at www.listpoint.co.uk

What can the OD community do to give data more value?

• •

Government Open Data is not Open Data without the reference data sat alongside it Champion the cause
Raise awareness of the role classifications play

• •

Re-use the tools available Outcomes
Reduce costs, improve services, innovation Greater value in ‘Open Data’

£655 Million in savings if code lists are organising and reused
GOVERNMENT SPEND ON IT PROJECTS (RENEWING) Department Attorney General’s Office Cabinet Office Department for Business, Innovation and Skills Department for Communities and Local Government Department for Culture, Media and Sport Department for Education Department for Environment, Food and Rural Affairs Department for Health Department for Transport Department for Work and Pensions Department of Health Foreign and Commonwealth Office Greater London Authority HM Revenue and Customs HM Treasury Home Office Local Authority Ministry of Defence Ministry of Justice Police Transport for London Welsh Assembly Other Grand Total Average spend on data integration = 12.5% of total Savings by adopting Listpoint (as per PND) Savings over 4 Years on ICT projects 2013 ICT Value No. 2014 ICT Value No. 2015 ICT Value No. 2016 ICT Value No. £240,000 £5,000,000 £15,000,000 £15,000,000 £106,700,000 £153,700,000 £135,000,000 £149,000,000 £270,000,000 £1,610,000,000 £122,000,000 £687,396,347 £23,500,000 £501,410,000 £4,800,000 £10,500,000 £9,000,000 £3,869,246,347 £483,655,793 £96,731,159 1 1 2 1 4 3 1 2 1 2 1 30 3 3 1 1 3 63 £100,154,000 £30,500,000 £351,397,244 £173,000,000 £62,000,000 £0 £274,000,000 £8,744,551,244 £1,093,068,906 £218,613,781 3 1 22 2 2 1 2 56 £12,000,000 £9,575,455,000 £1,242,460,000 £248,492,000 1 64 £4,052,500,000 £506,562,500 £101,312,500 £665,149,440 30 £260,000,000 £14,000,000 £90,000,000 £11,500,000 3 1 2 1 £125,000,000 £800,000,000 £25,000,000 2 2 1 £500,000,000 £48,200,000 £82,000,000 £300,000,000 £82,000,000 £12,000,000 1 1 1 1 1 1

£687,000,000 £6,680,000,000

3 12

£946,200,000 £100,000,000

5 1

£38,000,000 £56,000,000 £80,000,000 £10,000,000 £364,225,000 £6,895,000,000 £8,430,000

2 1 2 2 33 6 4

£1,328,100,000 £896,200,000 £80,000,000 £600,000,000

4 14 1 2

Appendix

• • •

Listpoint Background Listpoint Features Reference data mapping

Listpoint Background
• •
16,000 Government reference data sets published Classified as a re-usable asset on the ICT ASK register
ICT Asset and Services Knowledgebase Part of the ERG process (Cabinet office review of planned £5m+ government projects – to ensure re-use and not re-invention)

• •

A member of the European Commission CESAR programme
Community of European Semantic Asset Repositories Largest contributor of semantic ‘assets’

Award winning application
Emergency Services Awards 2011

A free to use platform to find, load, validate and collaborate around reference data standards

Listpoint in practice

Code List quality
Browser-based editing/publishing and integrated validation rules


• •

Context management
Group relevant code lists together Recognise in which ‘context’ a data standard is being used

Context Mapping
Listpoint approach to semantic interoperability Join competing standards together with auto mapping)

Quality maintenance
Alerts (e-mail and web services) when standards are updated

Translation
Output includes XML and SKOS – XML mappings used to translate data across multiple applications for efficient data integration