Professional Documents
Culture Documents
Version 1.1
This Toolkit has This toolkit has been developed by Future Cities Catapult
to help organisations share city data. It sets out a high-
been designed to
level process for sharing data and includes links to further
guidance and resources. For those working in public sector
organisations, or closely with them, this toolkit provides
help people share guidance on setting up data sharing projects/processes.
DISCOVER 14
Define your reasons 15
Identify internal team 17
Understand your data sharing ecosystem 19
Identify specific data and systems 21
Understand what data others have 23
Data Sharing Canvas 24
PREPARE 25
Build your business case 26
Update legal, privacy and ethical approvals 27
Prepare data 30
Update your technical architecture 32
Confirm Governance 34
SHARE 35
Support a sharing culture 36
RESOURCES
document. These resources include:
CASE STUDY
A short description of developing practice which illustrates a
specific point
GUIDANCE
Policy and best practice produced by key organisations
REPORT
Think tank or support organisation report on relevant topic
BLOG
Personal perspective on a specific topic, sometimes offering
useful ‘hints and tips’
ONLINE LEARNING
Structured course or learning materials
TOOL
Artefact or approach designed to help carry out a
particular task
TOOLKIT
A collection of tools curated on a particular topic
6
Why share city data? 2/2 CITY DATA SHARING TOOLKIT - Version 1.1
DATA SHARING IS MORE THAN Sharing data drives collaboration Sharing data shares value
A TECHNICAL UNDERTAKING Data sharing, although it might first appear to be Sharing data also necessarily implies some form
a technical undertaking, is also about building of exchange of value - be that insight, resource
Thinking about data sharing from a technical organisational collaboration. The aim of data or goodwill. By sharing data with another
perspective is only half the picture. Data sharing is to enable the sharing of information, organisation you may expect to gain:
will only be shared between organisations knowledge and wisdom between and through
when you have identified organisational • value internally from the new insight
organisations so that they are able to deliver
synergies and fostered a culture of sharing • financial resource for selling data to other
some form of social or financial benefit.
more broadly. In addition, data sharing organisations which then supports the delivery
arrangements will only be sustainable if all of of your public task as an organisation.
We recognise that sharing of data is not always
those involved recognise, and are happy with, second nature for public sector organisations.
the type of value exchange developed. Throughout this document we have highlighted
In the short term, the same pressures that will
where there are specific considerations
ultimately force organisational collaboration
dependent on whether you have provided or
- stretched finances, complex problems etc.
received data using these icons:
- are also likely to reduce engagement as
organisations initially attempt to deliver purely
on the basis of their own resources. Sharing and
collaboration may not come naturally and may DATA PROVIDER
be difficult. Organisations will need to see more
clearly how the first data sharing arrangements
help them achieve their own organisational DATA RECEIVER
aims.
7
Sharing you
Identify non-personal city data 1/21/3
internal stakeholders CITY DATA SHARING TOOLKIT - Version 1.1
21 22
Protection of vulnerable Better personalisation of Optimising flows Planning and BIM Monitoring air quality
people social care around the city
Potential data shared: Potential data shared:
Potential data shared: Potential data shared: Potential data shared: • Address data • Mapping data
• Vulnerable people and their needs • Vulnerable people and their needs • Traffic light sensors • Mapping data • Air quality sensor data
• NHS data • Addresses • Public transport data • Data about developers
• Police data • Sensor data • Mapping data • Utility data
• Service delivery data 8
Sharing you
Identify non-personal city data 2/21/3
internal stakeholders CITY DATA SHARING TOOLKIT - Version 1.1
9
Sharing business
Identify you rates
internal data in Belfast
stakeholders 1/3 CITY DATA SHARING TOOLKIT - Version 1.1
SHARING BUSINESS
RATES DATA IN BELFAST
Future Cities Catapult have been involved in a landscape. As the project developed, it became This data came from a range of sources, in a To initiate the sharing, all data was uploaded to
number of projects where city data has been clear that a data-informed approach was likely range of formats and with different levels of a web-based shared space requiring credentials
shared. One of these was the Future Belfast to be valuable and we began the discover, quality. It was also made available at different for access. This space also recorded the time
project in 2016. We set up a collaboration with prepare and share process. levels of granularity. and nature of any access requests for security
Belfast City Council to help them identify further purposes. If no longer using the data for the
revenue from business rates. In Belfast, business As part of this, we identified data relating to: To make sharing easier and to enable fair prescribed project, collaborators were required
rates provide more than half of the Council’s access to all collaborators, the Council to remove the data from their systems.
annual revenue which is used to fund services • Addresses generated individual collaboration agreements
from waste collections to leisure facilities. • Flood Inspections with each partner. These collaboration
• Property Licensing agreements confirmed governance
To develop, constrain and communicate the • Commercial Waste Collections arrangements and addressed legal, privacy and
challenge, Future Cities Catapult worked with • Building Waste ethical issues.
Belfast City Council to understand the rates • Building Control
process, the actors involved and the data • Utilities
1010001
01 1010
1 0 0 1
10
Is your organisation
Identify you internal ready to share?
stakeholders 1/3 CITY DATA SHARING TOOLKIT - Version 1.1
H
organisations involved, there also need to be
M
innovation in city data, as well as a loose framework
H
L
individuals in each organisation with the right for writing a City Data strategy as part of a city or
M
skills to be able to collect, store and analyse
L
region’s wider data or digital strategy.
the data.
LEGAL RESOURCES Online organisational data maturity assessment (Nesta
There are a number of other frameworks and / LGA) - an online tool for UK Local Authorities to
assessments in the pipeline. Nesta and the Local assess the level of their current organisational data
L
Government Association for example, have both maturity and to benchmark this against their peers.
M
H
L
developed online tools to support local public
M
Open Data Maturity Model (The Open Data Institute)
sector organisations assess their data maturity.
H
L - although this maturity model focuses on open data
publication, there may be elements useful for public
Our recently published Quick Start Guide to City M
sector organisations thinking about the full data value
Data sets out a framework to think about your H chain.
city data project and an approach to thinking OPERATIONS SKILLS
about your organisational preparedness for Data Fundamentals (School of Data) - an online course
using data that covers Technology, Mindset, that provides “a solid overview over the workflow with
Resources, Skills, Operations and Legal issues. data guiding you from what data is, to how to make
your data tell a story”.
11
A CITY DATA
SHARING PROCESS
Overview
Identify of internal
you the process
stakeholders 1/3 CITY DATA SHARING TOOLKIT - Version 1.1
Identify your internal Understand what Update legal, privacy Support a sharing culture
team & understand your data others have and ethical approvals Data sharing code of practice (ICO) -
data sharing ecosystem statutory code of practice developed to
support the DPA 1998 and currently being
updated for the DPA (2018). Practices
TECHNICAL
Update your
technical architecture included mostly relate to personal data
sharing.
Data sharing canvas
Information Sharing Toolkit Scotland
(The Scottish Government) - developed
Identify specific
data & systems
by the Scottish Government with a focus
Prepare data on the sharing of personal data with
some tools and approaches that may be
The visual above sets out our initial thoughts NOT A LINEAR PROCESS A COLLABORATION BETWEEN useful. Practices included mostly relate to
on a city sharing data process in the form of a personal data sharing.
Kanban board. This Kanban board details those This toolkit was drawn from discussions with
TECH AND SERVICE
phases and jobs that we identified as core to those who have undertaken data sharing It also became clear that data sharing projects
setting up a city data sharing arrangement, and projects in cities. Whilst it became clear that the require both technical and service skills. Often
positions them according to who is likely to be process for making data sharing arrangements the work is a collaboration between those with
leading on each aspect. wasn’t always straightforward or linear, we were ownership of particular service issues needing
able to define a number of general phases. data to be shared, and those with the technical
Each card on the board relates to a following
responsibility and knowhow to set up the data
section of the Toolkit. Please feel free to jump to the sections which sharing arrangements.
are relevant to your circumstance or use in a
different order. We have highlighted above where the skills
needed at different stages are more technical or
service (or both). 13
A CITY DATA
SHARING PROCESS
DISCOVER
DISCOVER
Identify you-internal
Define your reasons 1/2
stakeholders 1/3 CITY DATA SHARING TOOLKIT - Version 1.1
DISCOVER
15
DISCOVER - Define your reasons 2/2 CITY DATA SHARING TOOLKIT - Version 1.1
Data
Where both organisations have a need for data, Citizen Sensing Toolkit (Making Sense) - featuring lots of tools, this details a
the exchange creates mutual benefit. step-by-step approach to undertaking a citizen sensing project - i.e. working
with the community to use IoT technology and analyse the data collected.
Data
Data
Sharing the benefits - How to use data effectively in the public sector
Here we’ve represented these relationships (Reform) - recent report on the benefits of sharing data in the public sector.
Organisation A Organisation B as only between two parties but clearly where
there are more organisations involved then Using open data for public services (ODI) - sets out a number of case studies
Data on how open data is used in and benefits the delivery of public services.
these patterns are likely to be more complex.
2. Data exchanged
Organisation A
for
Dataother benefit
Organisation B
Service Manual (HMG) - helps government teams create and run digital
Where access to the data is exchanged for services that meet the Digital Service Standard.
another form of benefit (e.g. financial, resource
Data
etc.) Development Impact and You Toolkit (Nesta) - primarily for designing and
Data running development projects, this could help clarify reasons for sharing
from the outset of your project.
Organisation A Organisation B
Data for Public Benefit (Involve) - This project by Involve focuses on
Benefit elaborating the benefits of sharing personal data but may also be useful
reading in relation to non-personal data
Organisation A Organisation B
Data
Benefit
Benefit
16
Data
Benefit
DISCOVER
Identify you-internal
Identify stakeholders
internal team1/3
1/2 CITY DATA SHARING TOOLKIT - Version 1.1
DISCOVER
GIS Specialist
• Geographic Information System (GIS)
specialists understand what data is held
especially in relation to creation data
• they will also understand the capability of
current systems
Data Scientist
• usually found in organisations where data
used routinely and with greater data maturity
(e.g. may use a programming language to
automatically produce analysis of live data)
• likely to be someone who would use the data
once it’s shared
17
DISCOVER
Identify you-internal
Identify stakeholders
internal team1/3
2/2 CITY DATA SHARING TOOLKIT - Version 1.1
18
DISCOVER
Identify you-internal
Understand your data1/3
stakeholders sharing ecosystem 1/2 CITY DATA SHARING TOOLKIT - Version 1.1
DISCOVER
UNDERSTAND YOUR
DATA SHARING ECOSYSTEM
As well as getting to know who can help you DATA INFRASTRUCTURE SERVICE SUPPLIERS
internally, you will want to understand your
broader data sharing ecosystem beyond your
organisation. This will include the potential City Data Platforms IoT supplier Large Tech Providers
external organisations who you could share In some cities there are technology IoT suppliers may be involved in There are a number of large tech
data with, as well as other organisations which platforms which have been built to collecting data on your behalf and providers your organisation may
might be able to help support you, either support the sharing of data between therefore they may need to share have a relationship with and may
through providing technical services to help you different organisations. You may data with you. Some may also be providing some services already
share or analytical services on the basis of data find these useful in providing offer additional services in terms of e.g. database solutions.
once it’s shared. technology to share data or to find analysis and visualisation. Examples - IBM, Cisco, BT,
data from other organisations. Examples - Cleanspace, Smart Northgate, Siemens
Here we have elaborated the different types of Examples - MK Data Hub, Fiware, Parking, Siemens, IoTUK
organisations which have been highlighted in CityVerve Manchester, Data Support Organisations
our research, however there may well be others Observatories Cloud Service Providers A number of organisations provide
which we haven’t included. Cloud Service Providers are used to resources, tools and opportunities
Data Catalogues host data, especially large datasets. to meet those who are also
Your organisation may be using They also allow the provision of undertaking city data sharing
a data catalogue to publish open other services such as data analysis projects.
data. and visualisation. Examples - Future Cities Catapult,
Examples - CKAN, Socrata, Data Examples - Amazon Web Services Digital Catapult, Nesta, the Open
Mill North (AWS), Microsoft Azure Data Institute, Universities
SUPPORT
?
Some questions to ask at this stage: Transport for London have a complex Mapping Data Ecosystems (Open Data
• Do you have a clear idea of the data ecosystem which they have Institute) - The Open Data Institute
Open Source Code external organisations that could built on the basis of a heritage of have put together a workshop
Open source repositories which help you in your data sharing releasing open data. Their ecosystem methodology that will help you
may provide code to help in sharing work? includes organisations which provider identify your broader data ecosystem.
the data you identify. This includes • Do you know who externally could travel planning services for people
using transport in London (including
code for APIs etc. use your data?
apps like CityMapper), as well as Service Innovation Handbook (Lucy
Examples - Tombolo Digital
those who incorporate travel data Kimbell) - a resource with a number
Connector, GitHub, Libriaries.io into their other services (e.g. Google of tools designed to help people
Maps, Apple Maps). There is a range bring service design and innovation
Data Standards of organisations which re-use and techniques into their organisation. In
Data standards exist which may repackage the data made available. particular the “Mapping Innovation
help the process of sharing as data The Open Data Institute have begun Ecosystem” toolkit provides a detailed
can be more easily interpreted by to map TfL’s eco-system, as well as workshop format to help you map your
different organisations. others, to show how open data is innovation ecosystem.
Examples - British Standards used to deliver public services and
have also developed a workshop Platform Design Toolkit - Platform
Institute, City Data Standards
methodology too Design Toolkit is based on the tradition
Network, European Standards e.g
of Service Design Thinking and was
Datex, Inspire, ISO
born to overcome the limitations in
traditional, linear, Business Modelling
approaches. This methodology helps
Forums and Communities you model multi-sided, ecosystem
There are a number of forums and based, platform models that are
communities which you can access transforming the world of business and
to find others who may be able to services.
give support and advice on data
sharing.
Examples - LocalGovDigital Slack,
Twitter #finddata, Knowledge Hub
Conferences
20
DISCOVER
Identify you-internal
Identify stakeholders
specific data 1/3
& systems 1/2 CITY DATA SHARING TOOLKIT - Version 1.1
DISCOVER
CAPTURE DATA ABOUT DATA • System - What system is the data held in?
• Format - What format is the data saved in?
In response to the Shakespeare Using Customer Journey Mapping
Data about data is known as ‘meta-data’ and Common formats include .csv, .xlsx, .doc, Review of Public Sector Information, as a Tool for Data Discovery (Nesta)
at this stage you will need to start collecting .json, .pdf the UK Government committed in - You may want to use a tool from
meta-data about the data of interest to you • Time period - What time period does the data 2013 to create a National Information Service Design to better identify the
in your data sharing project. In some cases, refer to? Infrastructure (NII). The NII was specific datasets and systems
the collective ‘meta-data’ is known as a ‘data • Frequency of update - How frequently is the described as containing “the data
dictionary’. data updated? held by government which is likely to Data dictionary tools - A database
• Publication status - Is the data published in have the broadest and most significant of technical tools to support the
any form and if so where? economic and social impact if made development of data dictionaries.
The following is a (non-exhaustive) list of data
available and accessible outside of
that you may find helpful to capture about your
government”. In order to create this
data. On the particular topic you’re interested Having started to create a list of relevant
list, the Cabinet Office team charged
in there may be a recognised standard for internal data you may want to liaise with the with developing this led a collaborative
the meta-data that will help you organise the person responsible in your organisation for the process to create an inventory of data
information. Information Asset List to see how the list you held by government. This list was first
have curated can be incorporated in a broader published on Data.gov.uk in 2013 and
• Title of dataset - The formal title of the data list of information held by the organisation. updated in 2015.
set
• Description - what topic does it cover etc.?
• Personal data - Does the data include any
personal data as covered by the DPA?
• Owner - who in the organisation owns the
dataset?
• Uses and users - how is the data currently
used and by whom in the organisation?
• Location - Where is the data kept? Is it
possible to capture a URL of the location
and link to it directly?
22
DISCOVER
Identify you-internal
Understand what data
stakeholders 1/3others have CITY DATA SHARING TOOLKIT - Version 1.1
DISCOVER
UNDERSTAND WHAT
DATA OTHERS HAVE
As well as knowing what data your organisation knowledge of the data which is held by other APPROACH DATA There have been a number of attempts to
has you will also need to know what data others organisations? Perhaps there is someone who create canonical lists of the data held by the
have. You may already have a good idea of this, has been involved in the field who is more than MARKETPLACES, CITY public sector at both the national and local
but if not here are some approaches that might willing to chat about the data that’s available. PLATFORMS AND VENDORS level. These have been taken forward by
be helpful. It’s always worth talking to more than one various groups and organisations. Specifically
person as they will have a different perspective. Data may be available through data in relation to Smart Cities there are a number
If you are providing data, an marketplaces or through a city data platform. of underlying models of the data which are
These intermediaries are a developing industry being developed:
organisation may have already
reached out to you and it might and so the amount and availability of data
INTERNET SEARCH they hold will vary. • BSI through it’s PAS 183 have made available
be relatively straightforward
an underlying concept model
to understand the data they Unfortunately there is no current catalogue of • FIWARE or FI-WARE is a middleware
already have and what they are data held by public and private organisations platform, driven by the European Union, for
looking to get from you. which is openly searchable. However some NETWORK WITH THE the development and global deployment of
open data is discoverable online - Google has applications for Future Internet
If you are looking to receive
COMMUNITY • The Local Government Association has
recently launched a search engine for open
data you may already have a data - toolbox.google.com/datasetsearch. This produced a Local Government Services list
As well as identifying an expert in the field
clear idea of which organisation • The Government Digital Service also
open data search might highlight organisations there may be others in the wider community undertook a programme of developing
may be able to provide data. who hold data. Academic organisations and who are able to help. This could mean Registers of government data. A register
Alternatively you may need to central government are key data holders and networking in person at a conference or is a list of information that is managed and
identify specific datasets and so you may want to search their websites meetup or online in a relevant forum that approved by government. For example, the
organisations. specifically. you’ve identified through your ecosystem country register lists all countries recognised
analysis. by the Foreign and Commonwealth Office.
A more focused approach could be to search
on the websites of the organisations you have Local multi-agency networks and meetings
FIND AN EXPERT identified as part of your data ecosystem. If might also be a useful opportunity to identify
they are a public body they may have a specific data. These types of meetings might include Finding Open Data (the Open Data Institute)
In reality knowledge about data that could be part of their website for data. If there have been Local Enterprise Partnerships or where - the Open Data Institute has curated a list
available is built up by people in the course of Freedom of Information requests for the data organisations in your Combined Authority of resources where you might be able to find
their career. You may have a knowledgeable previously these may be published on their meeting to discuss issues. open data published by UK institutions.
expert about data in your organisation - perhaps website as well.
one of your analytical community has a good
23
Data sharing
Identify canvas stakeholders 1/3
you internal CITY DATA SHARING TOOLKIT - Version 1.1
s
n Aim Us
er
tio
Ne
isa
ed
an
s
Org
Summarise the output here from
‘Clarify your reason for sharing’
Summarise the output here from Summarise the output here from
‘Identify specific data and systems’ ‘Understand what data others have’
24
A CITY DATA
SHARING PROCESS
PREPARE
PREPARE - Buid
Identify you yourstakeholders
internal business case
1/3 CITY DATA SHARING TOOLKIT - Version 1.1
PREPARE
1
for your project from senior members of the Strategic Case - shows that the proposed • A lot of this thinking will have been developed in the Discovery Stage of the project. However you may want to
organisation. data share fits with your organisations update this on the basis of the additional information you have been able to find.
strategy, sets out why it’s needed and
Different organisations will have different what the expected outcomes are.
approaches to the development and
2
Economic Case - demonstrate that the • Can you quantify the overall costs and benefits? • Can you quantify the overall costs and benefits?
presentation of a business case and there will
data share optimises public value • In terms of costs, what is the cost of technical changes • In terms of costs, what is the cost of technical changes
likely be formal documents and processes which
needed in order to provide the data? Are there any needed in order to receive the data? Does any further
you will have to complete. Given this, it’s best additional legal costs in terms of developing licenses? cleaning of the data need to be undertaken and how
to establish what the expectations are for the • In terms of benefits, can any of these be quantified and much will this cost?
development of your business case early and over what timescale? • In terms of benefits, can any of these be quantified and
who specifically needs to be consulted. Perhaps over what timescale?
3
you could undertake a prototype of the business • Have you appraised all the possible different sources
Commercial Case - this sets out any
case early in the process to identify areas where • What license will the data be made available under and
procurement strategy and the contractual of similar data and what are their relevant benefits
are there any other legal considerations?
you will need to do more investigation. arrangements needed and disbenefits?
• If there is a charge associated with the data share and
• What are the legal considerations in terms of the
have you identified what the charging structure would
HM Treasury guidance for the development of be?
licenses you will be asked to take on?
business cases in Government uses a 5-case • Is there a cost associated with the data?
4
model. This type of approach is usually used to Financial Case - demonstrates that the • Can you detail the precise costs of the data share for your organisation?
develop business cases for spending on large data share is affordable • Who is going to pay for the data share? Do you need to find further funding for this or will it pay for itself?
capital projects such as infrastructure so not
all elements are relevant for a city scale data
5
sharing arrangement. In the following table, Management Case - demonstrates • What are the project management arrangements for the data share? What methodology will be used?
we have given some initial starting points for that the data share is capable of being • What are the arrangements for the ongoing monitoring of the data share?
delivered successfully, in accordance with • Are there any contingency plans for risk management?
consideration for incorporation in a business
recognised best practice
case using this model, both for where you will be
providing data and where you will be receiving
Green Book and Business Case Guidance (HMT) - If you are Business Model Canvas - This is a one page
it. working within a public sector organisation you may already tool which may help to structure your thinking
have processes for developing a business case. However HM about the business model which underpins the
Treasury produce guidance on building business cases for data share, in particular if you are providing26
spending public money which you might find helpful. data as a product.
26
PREPARE
Identify - Update
you internallegal, privacy and
stakeholders 1/3 ethical approvals 1/3 CITY DATA SHARING TOOLKIT - Version 1.1
PREPARE
27
PREPARE - Update legal, privacy and ethical approvals 2/3 CITY DATA SHARING TOOLKIT - Version 1.1
28
PREPARE - Update legal, privacy and ethical approvals 3/3 CITY DATA SHARING TOOLKIT - Version 1.1
PRIVACY ETHICS
As part of CityVerve, Manchester’s smart
Although you’re likely to have already city demonstrator, the team set up a
There is increasing interest in the ethics of data
established that the data you’re wanting to use, again especially in relation to personal Data Ethics Framework (DCMS) - Public
process for undertaking Privacy Impact
sector organisations should use the
share is non-personal, it is good practice to Assessments. They used a Privacy data. A number of guides and tools have been
Data Ethics Framework to guide the
ensure that you undertake a Data Protection Impact Assessment screener to engage developed in particular by DCMS.
appropriate use of data to inform policy
Impact Assessment. Depending on your colleagues to understand when they need
and service design.
organisation this might also be standard practice to complete a document and provided
and part of the information governance policies. support and guidance in completing
The Ethics of Data Sharing: A guide
the detail. Due to the complexity of the
to best practices and governance
consortium, the team took legal advice
You might come across the following documents (Accenture) - Document setting out some
to identify who was best placed to sign
used in your organisation in realation to privacy: of the specific ethical considerations of
off the completed PIAs. A complete PIA
sharing data including a useful approach
assessment was needed in every instance
• Privacy Notice - This is a statutory notice to risk management.
of data sharing, regardless of whether
which has to be published so that individuals the data was explicitly personal or not. A
Data Ethics Canvas (Open Data Institute)
know how an organisation is processing their lesson from the project was to start the
- The Data Ethics Canvas is designed
personal data. PIA process at near the beginning of the
to help identify potential ethical issues
project rather than to start later on.
associated with a data project or activity.
• Data Protection Impact Assessment (DPIA) It promotes understanding and debate
- a process to help you identify and minimise around the foundation, intention and
the data protection risks of a project. The ICO potential impact of any piece of work, and
sets out a checklist to help you understand Data protection impact assessments (ICO) helps identify the steps needed to act
- DPIA (also know as a Privacy Impact ethically.
whether you need to undertake one of these
Assessment) is a process to help you
and what steps to follow.
identify and minimise the data protection
risks of a project. The ICO publishes best
practice guidance which includes useful
checklists and approaches.
29
PREPARE - Prepare
Identify you internal data 1/2
stakeholders 1/3 CITY DATA SHARING TOOLKIT - Version 1.1
PREPARE
PREPARE DATA
Having identified the specific datasets which CLARIFY YOUR USERS’ NEEDS • Administrative and Statistical Geographies Use the data yourself
you are wanting to share you will want to make - Administrative geographies are defined If there are currently no users for the data
technical preparations for sharing. It’s best to understand what the users of your by government and usually reflect the internally, or it hasn’t been used so far, perhaps
data need in order to be able to develop the organisational make up of local government. you could undertake some exploratory data
If you are providing data you appropriate specification for the data. The Office for National Statistics produces analysis on the data so as to understand it’s
will want to make sure that statistical Georgraphies. Both of these are limitations and foibles. Visualisation of the data
you are aware of all the needs This is where it’s important to have developed available through a Gov.uk Register may be a quick way to identify any anomalies
of those who will be using the working-level relationships between • Companies - A common unique reference with the data.
data. those organisations involved in the data indicators that is used to identify companies
share. Perhaps you could collaborate on a is the D-U-N-S Number from Dunn and Clean the data
If you are receiving data you will specification for the data or find a data standard Bradstreet. If there are inadequacies highlighted in the data
want to understand more detail which is appropriate. you will need to make plans and potentially
of the data you are receiving You may or may not need to consistently use a seek resource to make amends. Some of these
and how to prepare your Perhaps you can talk to the current users data standard or shared identifiers dependent may be relatively straightforward (e.g. using
existing data so that it can be of the data to help build content for the on whether the organisation which is using the a consistent naming of entities throughout the
useable with the new data. documentation. Through this process it would be data has data matching tools. These tools can data and deduplication) however some may
important to document those aspects of the use match datasets in the absence of standards or require changes to data collection in the longer
of the data which are taken for granted. identifiers and are becoming increasingly widely term.
used.
Be transparent about data quality and
MAKING LINKS
You will need to ensure that you have the right remedies
One way of increasing the usefulness of the license to incorporate data which you have You can summarise the quality of the data in
data being shared is to include the most not created yourself into a dataset which you a Data Quality Statement. You may want to
relevant shared identifiers so that it can be subsequently share with another organisation. specify the process by which there is continual
easily linked to other datasets in the receiving evaluation of the data to make sure that it is fit
for purpose.
organisation. Some common examples of shared QUALITY ASSURANCE
identifiers include:
You are likely to have internal processes
• Address data - In particular where you have already to ensure data quality and should
data on properties you may want to use the spend time understanding how these can
Unique Property Reference Number and / or support the process of preparing the data for
the Postcode depending on need sharing.
30
PREPARE - Prepare data 2/2 CITY DATA SHARING TOOLKIT - Version 1.1
31
PREPARE
Identify - Update
you internalyour technical 1/3
stakeholders architecture 1/2 CITY DATA SHARING TOOLKIT - Version 1.1
PREPARE
UPDATE YOUR
TECHNICAL ARCHITECTURE
You will need to spend some time designing and CONSIDER CURRENT IN-HOUSE OR OUTSOURCED As part of the Tombolo project, Future Cities
testing the technical architecture for sharing
the data. This means both the systems used to SYSTEMS AND YOUR Further considerations are whether you should Catapult developed a tool to make it easier to
share and combine different sources of data.
share data but also the related data format in BROADERS STRATEGY develop the data sharing technical architecture
The Tombolo Digital Connector is an open
which the data is made available. in house, get a supplier to develop a bespoke
source software library that enables users to
Can your current systems be used to undertake system or buy an “off the shelf” solution; the seamlessly combine different sources of data in
The architecture you choose will depend on: data sharing and if so how much does that cost implications of this in terms of maintenance an efficient, transparent and reproducible way.
in comparison to the alternatives? Does tailoring and up-keep; whether you have the skills
1. The capabilities of your internal systems your current system have implications in terms internally to undertake any development; At present, the tool can be used to combine
2. The capabilities of the systems of the other of capacity and training of those who will use it whether it’s better to train employees or use an information relating to mobility, the environment,
organisations you are sharing data with internally? outside supplier; and how this decision fits with air quality and even the street network. Because
3. The nature of the data being shared your broader Digital and IT strategies for the it is open source, the Tombolo Digital Connector
The precise nature of the technical aspects of can be extended by anyone to meet their needs
organisation.
the data share may mean that there will need for data sharing and combination. It is designed
Your IT colleagues will be able to advise about
to be further investment in your systems and to work on a range of operating systems
how your current technical architecture can
be set up to enable you to be able to share this cost will need to be incorporated into your TECHNICAL SECURITY including, MacOS, Windows and Ubuntu.
32
PREPARE - Update your technical architecture 2/2 CITY DATA SHARING TOOLKIT - Version 1.1
PREPARE
CONFIRM GOVERNANCE
Governance arrangements for data sharing are
START HERE The Government has recently announced
important where there is ongoing sharing of
data. However, this is a developing area and the development of a Geospatial
Commission to oversee to maximise the
arrangements can vary from organisation to
value of all UK government data linked
organisation and dependent on the types of data If the data share is not seen as controversial or it
Could the issues be covered by to location. This is a very high-level
which are being shared. YES is an internal share and there is an organisational
working level contacts? governance arrangement for data held by
policy of sharing openly within the organisation.
a number of government organisations
By Governance we mean all of the arrangements which create and hold location data. The
for ensuring the oversight and accountability of organisations involved include HM Land
NO
the data sharing arrangements. This includes Registry, the Ordnance Survey, the British
the processes for programme and project Geological Survey, the Valuation Office
Are there existing arrangements for In the world of sharing personal data
management, including formal meetings with Agency, the UK Hydrographic Office and
personal data which include the right YES there are sometimes very mature
senior members of the organisations sharing data the Coal Authority. The Commission is
organisations? arrangements for data governance.
in the process of being set up but will
and identifying signatories for formal contracts.
include two joint chairs and a number
NO of independent commissioners. The
Formal governance arrangements are common first task of the commission will be to
when sharing personal data on an ongoing establish how to open up freely the
Are there existing Ideally your Governance arrangements would
basis. In these circumstances, some of these arrangements for the service / function YES OS MasterMap data to UK-based small
reflect the management arrangements for the
governance arrangements are set out in the UK for which the data is being shared? delivery of the service which the data share is businesses.
Data Protection Action 2018, such as the role of enabling. A simple approach would be to fold any
the Data Protection Officer. governance arrangements into these.
NO
We have put together this flow chart to help you
Consider setting up specific arrangements
ask questions about the type of Governance
for this data sharing project. You may want to
arrangements that you need and to design the
consider:
right option for your organisational circumstances. • Level of seniority of those needed
This is a work in progress and we would value • Frequency of any meeting
feedback. • Which organisation would lead
• Who is secretariat
If your organisation has an Information • Which organisations need to be involved
Governance function they will be able to help you • What level of detail is required
design the appropriate Governance arrangements
for your data sharing programme.
34
A CITY DATA
SHARING PROCESS
SHARE
SHARE
Identify -you
Support a sharing
internal culture1/3
stakeholders CITY DATA SHARING TOOLKIT - Version 1.1
SHARE
36
Next steps
Identify you internal stakeholders 1/3 CITY DATA SHARING TOOLKIT - Version 1.1
NEXT STEPS
37
Acknowledgements 1/2
Identify you internal stakeholders 1/3 CITY DATA SHARING TOOLKIT - Version 1.1
ACKNOWLEDGEMENTS
FUTURE CITIES CATAPULT INTERVIEWEES Hilary Simpson Simon Navin
Sleuth Ordnance Survey
TEAM As part of the research for this Toolkit we spoke
to the following and would like to thank them for Nick Allott Steve Skelton
their contributions: nquiring minds Stockport City Council
Ed Parkes
Content Lead
Adrian Slatcher Nicola Bryant Thom Townsend
Manchester City Council Digital Birmingham Department for Digital, Culture, Media and Sport
Tom Leaver
Project Manager
Alan Moore Luke Smith Tom Symons
thinkWhere Technical Architect University of Newcastle Nesta
Felipe Caro
Design and Illustration
Andrew Beechener Nicola Biggs
Republic of Things University Hospitals of Morecambe Bay
Lee Markham
Narrative Design
Conor Dumigan Paul Connell
Analytics Engines ODI Leeds
David Altabev
Director, Data and Demonstrators
Carl Rodrigues Paul Hodgson
Streamr Greater London Authority (GLA)
Dr Joseph Bailey
Data Science Team Lead
Geoff Snelson Raj Mack
Digital Birmingham
Dr Jacqui Taylor
FlyingBinary Limited Richard Vilton
Emu Analytics
John Gibson
ASI Sam Roberts
Department for Digital, Culture, Media and Sport
Jovian Smalley
Information Commissioner’s Office Sarah Butler
Greenwich Council
Fran Bennett
Mastodon C Sarah Gates
Department for Digital, Culture, Media and Sport
38
Acknowledgements 2/2 CITY DATA SHARING TOOLKIT - Version 1.1
WORKSHOP ATTENDEES Jose Maria De Uriate Diaz There are a number of organisations which have FEATURE BACKLOG
CypherOrdin Inc. useful programmes that relate to the issue of
We held a workshop on 5th September 2018 data sharing: This is the first version of this City
to test an early version of the content of this Laurie Platt Data Sharing Toolkit. During its
Toolkit. The following attended this workshop: Sheffield City Council • City Standards Network development we have identified some
• British Standards Institute further improvements that we’d like to
Abbas Lokat Maciej Ziarkowski • Information Commissioner’s Office incorporate in a next version.
GeoPlace LLP Local Data Company • The Open Data Institute
• Local Government Association • Expansion / refinement of the data
Adrian Slatcher Mareike Schmidt • Nesta sharing process - to include a review
Manchester City Council Q-Bot • The Data Lab and retirement stage for data sharing
arrangements
Camilla Bertoncin Mark Cridge
Nesta mySociety • Assessment of tool quality/utility - In a
subsequent version it might be possible
Daniel Taylor Michael Mulquin to flag the quality and usefulness of the
Sheffield City Council IS Communications Ltd tools which we have identified
Jennifer Sayer
Humanising Autonomy
39
About Future Cities Catapult
The Future Cities Catapult’s mission is to help UK firms If you have any comments about this document or if
develop innovative products and services to meet the you’d like to get in touch with the authors please email
changing needs of cities, and to sell them to the world. jbailey@futurecities.catapult.org.uk.
In doing so, we will support the emerging Advanced
Urban Services sector in becoming an enabler of
national productivity and a central plank of the UK
economy. City Data Sharing Toolkit by Future Cities Catapult
is licensed under a Creative Commons Attribution-
We develop ambitious and impactful new projects NonCommercial-NoDerivatives 4.0 International
that leverage our established strengths as a neutral License. Based on a work at https://futurecities.
convenor, helping buyers better articulate their needs catapult.org.uk/. Permissions beyond the scope of
to the market, working with suppliers to respond this license may be available at https://futurecities.
to those needs, engaging academic leaders to catapult.org.uk/.
translate the latest R&D into application, driving the
dissemination of evidence that unlocks investment and The content of this publication does not reflect the
adoption, and provoking creative disruption in services official opinion of Future Cities Catapult. Responsibility
and systems overdue for innovative transformation. for the information and views expressed herein lies
entirely with the authors. Reproduction is authorised
In short, we are dismantling the barriers to provided the source is acknowledged. Any mention
market success, ensuring that British innovators of specific products or services in this report does not
and entrepreneurs are positioned to enjoy a imply endorsement by Future Cities Catapult.
disproportionately large share of the global market for
advanced urban services – a market estimated to value
$1 trillion globally by 2023.
Follow us on Twitter
@FutureCitiesCat
Or send us an email
info@futurecities.catapult.org.uk