You are on page 1of 7

A Survey on the Problems Affecting the

Development of Open Government Data Initiatives


Henry N. Roa Edison Loza-Aguirre Pamela Flores
Facultad de Ingeniería Facultad de Sistemas Facultad de Sistemas
Pontificia Universidad Católica del Escuela Politécnica Nacional Escuela Politécnica Nacional
Ecuador Quito, Ecuador Quito, Ecuador
Quito, Ecuador edison.loza@epn.edu.ec pamela.flores@epn.edu.ec
hnroa@puce.edu.ec

Abstract— Open Government Data is an initiative that While many problems affecting open government data
promotes transparency, accountability and value creation by initiatives has been reported, a clear understanding of such
making government data available to all. Open government data problems, its commonness, and its impact during the adoption
initiatives have become very popular worldwide because of the process of such initiative is not evident in literature [7-10].
benefits that they can entail, especially in developed countries. In this research, first, we aim to explore the different types
However, many of these initiatives no always achieve the of problems affecting open data initiatives. And second, to
expected benefits. Although related research has reported that understand the impact of those problems on each stage of the
most of these initiatives face various problems affecting their adoption process of open government data initiatives.
success, little emphasis has been put on understanding such
Accordingly, we conducted a systematic literature review of
problems. Accordingly, in this study, we report our efforts to
a substantive body of knowledge pertaining to the study of
explore the main problems affecting open government data
initiatives. Specifically, we performed a literature review to open data in the Computer Science field. This paper presents
identify six problem categories, its subcategories, and its a brief background of open government data and its adoption
incidence. Additionally, using an Information Systems adoption process. Then, we present the results of our review, which
process, we established the impact and occurrence of each of provides an overview of the issues affecting open government
these problems before, during, and after an open government data initiatives, as well as the impact of this problems on its
data initiative. adoption process. We conclude the paper with a summation
of the results, research opportunities and limitations.
Keywords—open government data, open data problems, open
data, IS adoption II. BACKGROUND CONCEPTS

I. INTRODUCTION A. Open Government Data


Open data, in a governmental context, is a concept that
“Open data is data made freely available by governments,
means governmental data must be available, with free access,
organizations, researchers, among others, for use by anyone
and with a possibility of redistribution in any form and
without copyright restrictions.” [1]. When data is released by
without any author right restriction [11]. Although this term
governments, we refer it as government open data.
became popular in the scientific community, it has received
Government open data is an initiative, a philosophy that
considerable attention in public sectors in the last years [12-
promotes transparency, accountability and value creation by
14].
making government data available to all [2, 3]. The open data
Currently, open government data is conceived as a
popularity is based on that this data can serve as a basis for
political philosophy which promulgates several values. First,
government innovation, and as a tool to foment governance
to contribute to citizens’ rights through the access to
and democracy [1, 4]. For example, in developed countries
government information as a pillar for democracy [15]. This
such as Australia, the United Kingdom, and France, these
principle contribute to public trust and confidence on
initiatives of open access to data are a reality, allowing
governments [16]. Second, to promote the engagement of
citizens to take advantage of such data through their data
citizens to participate in projects that involve open
portals, e.g. see https://data.gov.au/ or https://data.gov.uk/.
government data. Citizens’ participation foment discussions
Although open government data initiatives have been
developed worldwide, recent research reports that most of about how to address their needs in a better way [12]. Third,
these initiatives are affected for many factors such as data to increase transparency, accessibility to information, and
improve decision making [2, 3]. Transparency means that
quality [1], access policies [5], infrastructure capacity,
stakeholders not only can access data, but these stakeholders
security issues, privacy issues [2], among others. These also should be able to use, reuse and distribute this data [8].
factors prevent that open government data benefits can be Finally, to stimulate the development of applications or
achieved with success [4]. Considering these problems, some initiatives that can be used on both public and private sectors
researchers have tried to establish some solutions. For [17, 18], which directly contribute to economic growth [12,
example, some researchers propose theoretical models to 19].
foment democracy through open data [4]. Other researchers Despite the many advantages of using open government
propose ways to measure and to control open data quality [6]. data, there are some problems that hinder its benefits. For
Also, others have tried to understand the main barriers to example, lack of clear guidelines for the development of open
release data [7]. In short, many studies have been conducted data policies [20], problems with data access such as data
to understand and to improve the open government data fragmentation (different portals keeping a same data set) [21],
benefits. However, the factors affecting open government data access restrictions (only specific user groups have access
data initiatives are numerous and very little understood [7- to some data sets, poor data catalogues (people do not know
10]. the existence of some data sets) [7], among others.
157
978-1-7281-1704-1/19/$31.00 © 2019 IEEE
B. The Adoption Process of Open Government Data During this phase, one of the coders made a full text analysis
The adoption of open government data can be studied of the selected publications and established an initial list of
drawing on the Information Systems (IS) adoption body of codes using NVivo. Each code of the list represents a problem
knowledge. The advantage of this approach is that it allows affecting open government data initiatives. All the problems
us to understand the process by which an IS is introduced in on the list were discussed, one by one, by the two coders to
a social system from the awareness of a new technology till solve any inconsistency. Accordingly, we established a 28-
its routinization in the organization [22]. The adoption problem list to be used on the next coding phase.
process has been divided in three stages, namely pre- On the second phase, we used an axial coding approach.
adoption, adoption and post-adoption. This approach consist of using the previous phase codes to
The pre-adoption stage covers the awareness of a new organize ideas or themes and to identify the axis of the main
technology, the efforts from individuals to learn about it, and problems in analysis [36]. During this phase, one of the
the development of a favorable or unfavorable attitude toward coders grouped the 28 initial codes into different categories
the new technology. The pre-adoption of open government using NVivo. Each category was discussed and agreed by the
data has been studied using the Institutional Theory [23], the two coders, resulting on a six-problem category affecting
Symbolic Adoption Model [24] and the Diffusion of open government data initiatives. On this phase, we also
Innovations Theory [25, 26]. added to each coded problem, three additional sub- codes.
The adoption stage itself is related to the testing of new Each sub-code represents one of the three stages of the
technology, the decision to adopt an IS, and its adoption process of open government data initiatives, i.e. pre-
implementation. Several theories has been used to study this adoption, adoption, and post adoption.
phase, such as the Theory of Reasoned Action [27], the Finally, on the third phase, we used a selective coding
Theory of Planned Behavior [10], the Technology approach. This approach consists of using previous codes,
Acceptance Model [28], and the Unified Theory of looking selectively for cases that illustrates the problems we
Acceptance and Use of Technology [29]. coded [36]. Accordingly, using NVivo, we searched for
The post-adoption stage covers the routinization and stemmed words of 12 key words that could inform about
infusion of a new IS. Routinization happens when an IS is problems with open government data initiatives, namely
widely used as an integral part in a firm’s value chain “risk”, “lack”, “barrier”, “affect”, “cause”, “problem”,
activities. Infusion refers to the increase of organizational “issue”, “avoid”, “critics”, “negative”, “restrict”, and “stop”.
effectiveness using IS. This stage has been studied on the All these words are synonyms of the word “problem”. The
basis of the Expectation-Confirmation Theory [30] and the result of this search returned 4980 references over the 164-
Coordination Theory [31]. publication dataset. Each one of these references was
Over time, the IS adoption process has been used to analyzed and coded – when relevant – to one of the problem
understand what happens in organization before, during and codes we established before. Furthermore, we coded each
after an innovative technology is introduced [32]. Also, it reference to one of the sub codes representing the adoption
allows to study how it changes the interactions among human process stage, which we also established on the previous
concerns, data, hardware, software and processes [33]. In this coding phase. Accordingly, we gathered data to evidence a
research, we use the IS adoption process to understand the problem, but also to establish what adoption process stage
impact and occurrence of different problems before, during was affected by a specific problem. It is important to notice
and after an open government data initiative. that, on this phase, each researcher coded a sub-set of
publications, but them constantly interchanged opinions
III. RESEARCH APPROACH during the coding process to solve any inconsistence. The
To understand the problems affecting open government results of our analysis are presented in the next section.
data initiatives, its occurrence, and the impact of these
problems on the adoption process, we conducted a systematic IV. RESEARCH FINDINGS
search of literature to identify relevant publications for our
analysis [34]. To identify these publications, we used the Open government data can bring many benefits for both
terms “open data”, “government” and “public” to search government and society. However, these initiatives must
publications in the Scopus database. Specifically, we frequently face and solve problems or challenges, during each
performed the following query: “open data” AND stage of the adoption process, to achieve such benefits [4]. To
(“government” OR “public”) in the titles and abstracts of the identify these issues, first, we looked for reports of this kind
publications. The query was performed on February 2018 and of problems and then, we identify the adoption stage in which
returned more than 600 hits. To obtain a more valuable set, as these problems occur, on the set of publications that we
well as for analytical feasibility, we limited our search only selected. During this process we got several findings, which
to Q1 and Q2 journal articles according to the Computer we describe to follow.
Science SJR index, resulting on 166 publications. First, the results show that there is an important number
Unfortunately, we could not have access to two publications, of publications reporting problems that affect open
therefore only 164 publications were selected for the final government data initiatives since 2012 (See Fig.1). Precisely,
analysis. 69 publications, from our initial 164-publication data set,
The analysis process had three phases with a different report this kind of problems. Moreover, according to Fig. 1,
coding approach each one. Additionally, to make our coding these figures tend to growth in the last years. It is important
process more objective, we used the NVivo 11 [35] software to notice that the figures corresponding to 2018, may be lower
and two independent senior researchers as coders of the data, than the previous years because of our data set was collected
both on each phase. This analysis process is described in at the beginning of 2018.
detail to follow.
On the first phase, we used an open coding approach in
order to locate and to assign initial codes to the data [36].
158
to collect or to produce, and on most occasions is not enough
to be useful [49].

TABLE I. MAIN PROBLEMS AFFECTING OPEN GOVERNMENT DATA


INITIATIVES
Main Problems
Citizens
Public participation
User skills
Data quality
Data accuracy
Data ambiguity
Data completeness
Data formats
Data misuse
Fig. 1. Number of Publications per Year Reporting Open Government
Data quality
Data Initiative Problems
Data representation
Data scarcity
Second, our results show that there is a great diversity on Economic and financial problems
the problems affecting open government data initiatives Budget provision
(Table I). However, all these problems can be grouped into Cost metrics
six main categories as shown on Table I. On this table, Organizational
Authority involvement
problem categories are sorted alphabetical to facilitate Awareness
reading. We describe to follow each one of these categories. Benefit metrics
Citizen problems are related to factors that involve Competition
citizens, which in some way affect the adoption of open Institutionalization
government data initiatives. In this category, we identified Inter-organization collaboration
two main problems. One of the problems is related to public Motivation
Policy and legal
participation. Public participation means that citizens are no Copyright & licensing
interested or motivated on using open government data [37, Liability
38], and more importantly that citizens do not know what they Regulations
need regarding open government data [39]. Public Privacy & data protection
participation problems also refer to that public stakeholders Technical
Data access
may not participate actively in the open government data Data interoperability
initiatives by using data portals, suggesting what data to Storage capacity
publish, rating data sets and portals, among others [40]. The Technical knowledge
other citizen problem is related to user’s or citizen’s skills. Technical support
Event thought citizens would like to be part of open
government data initiatives, most citizens lack of technical Economic and Financial problems are related specifically
skills that allow them to use the data [41, 42]. to budget provision and cost metrics. On the one hand, it is
Data quality problems are the most reported problems difficult to provide enough budget by public organizations to
during our review. Some of them are reported, on a general make open data initiatives real and operational during time.
way, as data quality problems, while others are described For example, there may not be any local budget allocation for
more specifically. This kind of problems are related to the open government data initiatives during the adoption and post
data lifecycle stages, namely data creation and receipt, data adoption process, which could affect the success culmination
distribution, data consumption, data disposition, and data of such adoption [37, 46, 50]. On the other hand, it is very
destruction [43] .Although there is a vast variety of factors difficult to establish metrics that allow to measure the costs
related to data quality problems [44], we have identified in of implementing and keep operational this kind of initiatives
our review just a few. For example, first, data accuracy [51, 52].
problems refer to that metadata records may not correctly Organizational problems are related to the way in which
describe the data in a dataset, which directly affects the public organizations manage the open government data
discoverability of datasets [45]. Second, data ambiguity initiatives. Specifically, we detected several problems
problems refer to that data is not useful because it is no easily involving public organizations. First, there is a lack of
understandable even it is in a machine-readable format [46]. involvement of authorities in this kind of initiatives.
Third, data completeness problems refer to that the number of Normally, authorities delegate decision taking or do not put
completed fields that a meta records have is incomplete. If the much resources and efforts on releasing open government
metadata records are not complete, it will affect the data [53, 54]. Second, the awareness problems refer to be
discoverability of datasets [46]. Fourth, data format problems conscious of what open government data means and what it
refer to that data is not made open to the public in a machine- implies. For example, some public entities may consider that
readable format which is also non-proprietary [41, 47]. Fifth, the provision of raw data is a daunting task, or the
data misuse refers to that data is not enough on quality, which requirement might not be understood clearly [55]. Third,
leads to misuse or misunderstanding of the data [41]. Sixth, public organizations do not see clearly or cannot measure
data representation problems refer to that data is published in properly the benefits of open government data, which leads to
portals in a non-standardized manner in terms of semantics, a lack of interest on adopting these open data initiatives.
standards, and schema [48]. It makes difficult to aggregate Fourth, competition refers to that public organizations may
existing metadata in a way that would be useful for data think that releasing government data or public data is unfair
consumers. Finally, data scarcity refers to that data is difficult because of private organizations can get commercial
159
appropriation of it [50, 56]. Fifth, the institutionalization
problems refer to that open data tasks are usually assigned to
employees whose jobs were already predefined for other
activities, with no institutional structure or entity specifically
dedicated to this task [46]. This issue directly affects the
performance of open data initiatives [51]. Sixth, inter-
organizational collaboration problems refer to that many
organizations do not interact or collaborate properly in order
to release data to citizens [51]. For example, some
government data hosted in a specific public organization
needs a review and an approval from others in order to avoid
legal or privacy issues [54]. Finally, motivation problems are
in some way related to some of the previous problems. By
motivation, we mean that public organizations, authorities, Fig. 2. Total Number of Reported Problems
and public employees do not see benefits by doing all the
tasks related to open data [37, 56]. In fact, they see these tasks There are several types of problems affecting open
as extra work without any purpose [57]. government data initiatives, and most of them impact on each
Policy and legal problems are related with all the stage of the adoption process (see Fig. 3). However, Figure 3
regulatory and legal issues resulting of the release of also show that most of the reported problems are during the
government data to public. We established four problems on post-adoption stage. Surprisingly, during the adoption stage,
this category as we describe to follow. First, copyright and the report of problems affecting open government data
licensing problems refer to that open licensing with different initiatives are relatively low comparing to the other figures.
grades may contain restrictions that prevent data – with Moreover, Figure 3 also show that data quality problems have
different licenses – from being merged for a specific use [57]. more incidence during the post-adoption stage, while policy
Second, liability problems refer to the fear that public entities and legal problems have more incidence during the pre-
generated because of these entities may be held liable for adoption stage. In fact, we can see the same pattern of
damaged caused using the provided data [58]. This normally behavior if we analyze data on each year (see Fig. 4).
occur when data is stale, incorrect or wrongly interpreted
[50]. Thus, public organizations do not collect and/or publish
its data to avoid these problems [50]. Third, privacy and data
protection problems refer to the conflict between open data
and the aims of transparency and accountability, and data
protection and the right to privacy. For example, merging
different data sets can lead to discover personal data on
anonymized data [59]. Finally, regulation problems refer to
the lack of open government data policies even though there
are legal frameworks concerning freedom of information,
reuse of public sector information and the exchange of data
between public entities [8, 57].
Technical problems are related with several issues of
keeping open government data initiatives operational. First, Fig. 3. Main Problems Affecting Adoption Stages
data access problems are the main concern on this kind of
initiatives. Most of the time, even though organizations wants
to release public data, there is a lack of infrastructure and
support to achieve it [50, 60]. Second, data interoperability
problems refer to that it is necessary that data sets from
different organizations are linked with each other in order to
provide richer data and to facilitate information discovery
[61, 62]. Third, storage capacity problems refer to that
organizations do not have the enough infrastructure to keep
large data sets stored and available for long periods of time
[60]. Finally, technical knowledge and technical support
problems are related with the lack of technical skills on public
employees, who are involved in open data initiatives. These
skills are needed in order to work with open data and to
provide support to any stakeholder or citizen who requires it
[50, 58]. Fig. 4. Main Problems Affecting Adoption Stages per Year
Our results also show that, from the six problem
categories we established, there are two categories that are Fig. 5 shows the different problems that are present on
more incident in the open government data initiatives, namely each category, on each adoption stage of open government
data quality, and policy and legal (see Fig. 2). Contrarily, data initiatives. According to Fig. 5, we can see more clearly
other problems such as organizational, technical, citizens, and that during the post-adoption stage, data representation
economical and financial are less common. problems are more frequently reported than the other
problems. Contrarily, during the pre-adoption stage, all the

160
policy and legal problems are more frequently reported than develop citizens’ skills to explode and to get benefits from
the other problems. open government data. Accordingly, the level of citizen
participations, the needs of open government data, and the
skills that citizens need to maximize the benefits of open
government data should be studied.
Second, data quality problems have the highest incidence,
especially during the post-adoption stage. In this case, we do
not recommend to study new solutions for data quality
problems because data quality by itself is a very big research
area. In fact, both academy and industry have been
undertaken many efforts to establish solutions for these
problems. Instead, the types of data quality problems that
affect specifically to a particular organization should be
study.
Third, economic and financial problems are those ones
with the lowest incidence. Our results show two main
problems, namely budget provision and cost metrics.
Although studies on provision of budget for open government
data initiatives are not very attractive, it is not the case for
cost metrics. This last issue is a very interesting topic to study
because organizations need to know how to measure the real
costs of adopting open government data.
Fourth, organizational problems have an important
incidence on both the pre-adoption stage and the post-
adoption stage. Problems in this category such as authority
involvement, awareness, benefit metrics, competition,
institutionalization, inter-organization collaboration, and
motivation show that open government data initiatives face
Fig. 5. Main Problems Affecting Adoption Stages per Year
similar challenges as any technology adoption initiative.
Accordingly, it would be interesting to study how such
organizational problems can be addressed and minimized in
V. DISCUSSION AND FUTURE RESEARCH
order to decrease the impact on the open data initiatives.
Promoting the effective use of open government data Fifth, policy and legal problems have an important
requires the establishment of an adequate framework of incidence during the three adoption stages of open
recommendations, guidelines and policies that, on the one government data initiatives. Consequently, these kind of
hand, minimize the appearance of problems affecting open factors can be a serious issue that can impact and even
government data initiatives and, on the other hand, allow to terminate the adoption of open government data initiatives.
maximize the benefits of open government data. This can Accordingly, before public organizations embark on this type
only be achieved by understanding the current problems that of initiatives, it is necessary to anticipate the organizations to
open government data initiatives have during its adoption any future legal problem. Specifically, especial attention
process. For this reason, in this research, we explored the should be paid to copyright and licensing problems, and
different kind of problems that open government data privacy and data protection problems.
initiatives may face during its adoptions process through a Finally, technical problems such as data access, data
systematic review of literature. interoperability, storage capacity, technical knowledge, and
The results of this review show that there is an important technical support are present on the pre-adoption stage and
number of reports that evidence several problems affecting the post-adoption stage. Although these kind of problems are
open government data initiatives since 2012. In fact, these very common during the adoption of any technology in
reports tend to growth since they were reported. organizations, it should be study what technical knowledge
Consequently, despite the benefits that this kind of initiatives public employees involved in open data government data
can provide to government and society, to achieve such initiatives should have in order to provide support to internal
benefits are not that easy. Accordingly, we consider that it is and external stakeholders.
necessary to explore deeply such problems in order to provide This study is not without limitation. Due the large volume
solutions that allow to minimize them. Such exploring study of related publications (in the tens of hundreds, making full
could be performed by collecting empirical data. Specifically, analysis not feasible), we limited our data set to only Q1 and
this study could be performed in a particular organization or Q2 journal articles according to the Computer Science SJR
several organizations into a same government. index. This strategy eliminates many publications from the
The results also show that there are six main problem analysis. However, we consider that the 164 publications in
categories, namely citizen, data quality, economic and our data set is enough to provide a clear understanding of
financial, organizational, policy and legal, and technical what the main problems affecting open government data
problems. These problem categories represent a very complex initiatives are, and how these problems affect to each stage of
environment that open government data initiatives have to the adoption process of such initiatives. Additionally, it is
face. To follow, we discuss each one of these categories. important to notice that our research approach use
First of all, problems related to citizens show that it is publications instead of empirical data; thus, we cannot
necessary to establish mechanism, first, to develop citizen’ generalize our results for every government or organization.
interest on participating on these initiatives, and second, to Our results just present an initial exploration of real and
161
diverse problems that open government data initiatives face, International Journal of Technology Management, vol. 60, no. 1-2, pp.
reported by the academy. 114-129, 2012.
[20] A. Zuiderwijk and M. Janssen, "Open data policies, their
ACKNOWLEDGMENT implementation and impact: A framework for comparison,"
Government Information Quarterly, vol. 31, no. 1, pp. 17-29,
This research was supported by the Pontificia Universidad 2014/01/01/ 2014.
Católica del Ecuador through the grant research project [21] G. Boulton, M. Rawlins, P. Vallance, and M. Walport, "Science as a
O13050. In addition, we acknowledge and thank the public enterprise: the case for open data," The Lancet, vol. 377, no.
Anonymous Reviewers for their valuable recommendations, 9778, pp. 1633-1635, 2011/05/14/ 2011.
which contributed to improving the quality of this paper. [22] R. B. Cooper and R. W. Zmud, "Information technology
implementation research: a technological diffusion approach,"
Management science, vol. 36, no. 2, pp. 123-139, 1990.
REFERENCES
[23] M. S. Altayar, "Motivations for open data adoption: An institutional
[1] S. Sadiq and M. Indulska, "Open Data: Quality over Quantity," theory perspective," Government Information Quarterly, vol. 35, no. 4,
International Journal of Information Management, vol. 37, no. 3, pp. pp. 633-643, 2018.
150-154, 6// 2017. [24] K. Mossberger, Y. Wu, and B. S. Jimenez, "Developments and
[2] J. Bertot, U. Gorham, P. Jaeger, L. Sarin, and H. Choi, "Big data, open challenges in e-participation in major US cities," Routledge Handbook
government and e-government: Issues, policies and on Information Technology in Government, p. 219, 2017.
recommendations," Information Polity, vol. 19, no. 1-2, p. 5, 2014. [25] I. Susha, Å. Grönlund, and M. Janssen, "Driving factors of service
[3] S. S. Dawes, "Stewardship and usefulness: Policy principles for innovation using open government data: An exploratory study of
information-based transparency," Government Information Quarterly, entrepreneurs in two countries," Information Polity, vol. 20, no. 1, pp.
vol. 27, no. 4, pp. 377-383, 2010/10/01/ 2010. 19-34, 2015.
[4] E. Ruijer, S. Grimmelikhuijsen, and A. Meijer, "Open data for [26] V. Weerakkody, Z. Irani, K. Kapoor, U. Sivarajah, and Y. K. Dwivedi,
democracy: Developing a theoretical framework for open data use," "Open data and its usability: an empirical view from the Citizen’s
Government Information Quarterly, vol. 34, no. 1, pp. 45-52, 1// 2017. perspective," Information Systems Frontiers, Article vol. 19, no. 2, pp.
[5] A. T. Chatfield and C. G. Reddick, "A longitudinal cross-sector 285-300, 2017.
analysis of open data portal service capability: The case of Australian [27] H.-J. Wang and J. Lo, "Adoption of open government data among
local governments," Government Information Quarterly, Article in government agencies," Government Information Quarterly, vol. 33,
Press vol. 34, no. 2, pp. 231-243, 2017. no. 1, pp. 80-88, 2016.
[6] A. Vetrò, L. Canova, M. Torchiano, C. O. Minotas, R. Iemma, and F. [28] Y. Charalabidis, E. Loukis, and C. Alexopoulos, "Evaluating second
Morando, "Open data quality measurement framework: Definition and generation open government data infrastructures using value models,"
application to Open Government Data," Government Information in System Sciences (HICSS), 2014 47th Hawaii International
Quarterly, Article vol. 33, no. 2, pp. 325-337, 2016. Conference on, 2014, pp. 2114-2126: IEEE.
[7] P. Conradie and S. Choenni, "On the barriers for local government [29] A. Zuiderwijk, M. Janssen, and Y. K. Dwivedi, "Acceptance and use
releasing open data," Government Information Quarterly, Article vol. predictors of open data technologies: Drawing upon the unified theory
31, no. SUPPL.1, pp. S10-S17, 2014. of acceptance and use of technology," Government Information
[8] J. Attard, F. Orlandi, S. Scerri, and S. Auer, "A systematic review of Quarterly, vol. 32, no. 4, pp. 429-440, 2015.
open government data initiatives," Government Information Quarterly, [30] M. S. Ahmed, M. B. Mahmuddin, and N. I. B. Mahat, "The Factor
Article vol. 32, no. 4, pp. 399-418, 2015. Affecting Malaysian Citizens Satisfaction with Open Government
[9] D. S. Sayogo and T. A. Pardo, "Exploring the determinants of scientific Data," Journal of Engineering and Applied Sciences, vol. 12, no. 15,
data sharing: Understanding the motivation to publish research data," pp. 3843-3846, 2017.
Government Information Quarterly, Article vol. 30, no. SUPPL. 1, pp. [31] A. Zuiderwijk and M. Janssen, "A coordination theory perspective to
S19-S31, 2013. improve the use of open data in policy-making," in International
[10] D. S. Sayogo and T. A. Pardo, "Exploring the motive for data Conference on Electronic Government, 2013, pp. 38-49: Springer.
publication in open data initiative: Linking intention to action," in 2012 [32] J. Y. Thong, "An integrated model of information systems adoption in
45th Hawaii International Conference on System Sciences, 2012, pp. small businesses," Journal of management information systems, vol.
2623-2632: IEEE. 15, no. 4, pp. 187-214, 1999.
[11] P. Murray-Rust, "Open Data in Science," Serials Review, vol. 34, no. [33] R. Baskerville and J. Pries‐Heje, "A multiple‐theory analysis of a
1, pp. 52-64, 2008/03/01/ 2008. diffusion of information technology case," Information Systems
[12] M. Kassen, "A promising phenomenon of open data: A case study of Journal, vol. 11, no. 3, pp. 181-212, 2001.
the Chicago open data project," Government Information Quarterly, [34] J. Webster and R. T. Watson, "Analyzing the Past to Prepare for the
vol. 30, no. 4, pp. 508-513, 2013/10/01/ 2013. Future: Writing a Literature Review," MIS Quarterly, vol. 26, no. 2,
[13] P. T. Jaeger and J. C. Bertot, "Transparency and technological change: pp. 13-23, 2002.
Ensuring equal and sustained public access to government [35] QSR International. (2018, 01/02/2018). NVivo. Available:
information," Government Information Quarterly, vol. 27, no. 4, pp. https://www.qsrinternational.com/
371-376, 2010/10/01/ 2010. [36] W. L. Neuman, Social Research Methods: Qualitative and
[14] P. McDermott, "Building open government," Government Information Quantitative Approaches, Seventh ed. Boston, USA: Pearson
Quarterly, vol. 27, no. 4, pp. 401-413, 2010/10/01/ 2010. Education Inc., 2011.
[15] K. B. Allen, "Access to government information," Government [37] M. Lee, E. Almirall, and J. Wareham, "Open data and civic apps: first-
Information Quarterly, vol. 9, no. 1, pp. 67-80, 1992/01/01/ 1992. generation failures, second-generation improvements," Commun.
[16] C. J. Tolbert and K. Mossberger, "The Effects of E-Government on ACM, vol. 59, no. 1, pp. 82-89, 2015.
Trust and Confidence in Government," Public Administration Review, [38] I. Susha, A. Zuiderwijk, M. Janssen, and Å. Grönlund, "Benchmarks
vol. 66, no. 3, pp. 354-369, 2006/05/01 2006. for evaluating the progress of open data adoption: usage, limitations,
[17] A. Graves, "A case study for integrating public safety data using and lessons learned," Social Science Computer Review, vol. 33, no. 5,
semantic technologies," Information Polity, vol. 16, no. 3, pp. 261-275, pp. 613-630, 2015.
2011. [39] J. Hivon and R. Titah, "Conceptualizing citizen participation in open
[18] J. v. Dijk, S. Kalidien, and S. Choenni, "Development, implementation data use at the city level," Transforming Government: People, Process
and use of a judicial data space system," presented at the Proceedings and Policy, vol. 11, no. 1, pp. 99-118, 2017.
of the 7th International Conference on Theory and Practice of [40] L.-J. Chen et al., "An open framework for participatory PM2. 5
Electronic Governance, Seoul, Republic of Korea, 2013. monitoring in smart cities," IEEE Access, vol. 5, pp. 14441-14454,
[19] M. T. Borzacchiello and M. Craglia, "The impact on innovation of open 2017.
access to spatial environmental information: A research strategy," [41] W.-M. To and L. S. Lai, "Data analytics in China: trends, issues, and
challenges," IT Professional, vol. 17, no. 4, pp. 49-55, 2015.
162
[42] A. Slingsby, J. Dykes, J. Wood, and R. Radburn, "Designing an
exploratory visual interface to the results of citizen surveys,"
International Journal of Geographical Information Science, vol. 28,
no. 10, pp. 2090-2125, 2014.
[43] S. Chaki, Enterprise Information Management in Practice. New York,
USA: Springer, 2015.
[44] S. Sadiq, Handbook of data quality: Research and practice. Springer,
2013.
[45] J. M. Becker, Martin; Müller, Oliver; Winkelmann, Axel, "Towards a
Semantic Data Quality Management-Using Ontologies to Assess
Master Data Quality in Retailing," AMCIS 2008 Proceedings, 2008.
[46] M. Janssen, Y. Charalabidis, and A. Zuiderwijk, "Benefits, Adoption
Barriers and Myths of Open Data and Open Government," Information
Systems Management, vol. 29, no. 4, pp. 258-268, 2012/09/01 2012.
[47] O. Marjanovic and D. Cecez-Kecmanovic, "Exploring the tension
between transparency and datification effects of open government IS
through the lens of Complex Adaptive Systems," The Journal of
Strategic Information Systems, vol. 26, no. 3, pp. 210-232, 2017.
[48] N. Shadbolt et al., "Linked Open Government Data: Lessons from
Data.gov.uk," IEEE Intelligent Systems, vol. 27, no. 3, pp. 16-24, 2012.
[49] A. M. Clark, A. J. Williams, and S. Ekins, "Machines first, humans
second: on the importance of algorithmic interpretation of open
chemistry data," Journal of cheminformatics, vol. 7, no. 1, p. 9, 2015.
[50] E. Barry and F. Bannister, "Barriers to open data release: A view from
the top," Information Polity, vol. 19, no. 1,2, pp. 129-152, 2014.
[51] R. Krishnamurthy and Y. Awazu, "Liberating data for public value:
The case of Data. gov," International Journal of Information
Management, vol. 36, no. 4, pp. 668-672, 2016.
[52] E. Styrin, L. F. Luna-Reyes, and T. M. Harrison, "Open data
ecosystems: an international comparison," Transforming Government:
People, Process and Policy, vol. 11, no. 1, pp. 132-156, 2017.
[53] T. Nam, "Challenges and concerns of open government: A case of
government 3.0 in korea," Social Science Computer Review, vol. 33,
no. 5, pp. 556-570, 2015.
[54] T.-M. Yang, J. Lo, and J. Shiang, "To open or not to open?
Determinants of open government data," Journal of Information
Science, vol. 41, no. 5, pp. 596-612, 2015.
[55] E. Lakomaa and J. Kallberg, "Open Data as a Foundation for
Innovation: The Enabling Effect of Free Public Sector Information for
Entrepreneurs," IEEE Access, vol. 1, pp. 558-563, 2013.
[56] A. Zuiderwijk, M. Janssen, G. van de Kaa, and K. Poulis, "The wicked
problem of commercial value creation in open data ecosystems: Policy
guidelines for governments," Information polity, vol. 21, no. 3, pp.
223-236, 2016.
[57] M. Khayyat and F. Bannister, "Open data licensing: More than meets
the eye," Information Polity, vol. 20, no. 4, pp. 231-252, 2015.
[58] J. Russnák, P. Ondrejka, L. Herman, P. Kubíček, and A. Mertel,
"Visualization and spatial analysis of police open data as a part of
community policing in the city of Pardubice (Czech Republic)," Annals
of GIS, vol. 22, no. 3, pp. 187-201, 2016.
[59] A. Zuiderwijk and M. Janssen, "Towards decision support for
disclosing data: Closed or open data?," Information Polity, vol. 20, no.
2, 3, pp. 103-117, 2015.
[60] U. Aguilera, O. Peña, O. Belmonte, and D. López-de-Ipiña, "Citizen-
centric data services for smarter cities," Future Generation Computer
Systems, vol. 76, pp. 234-247, 2017.
[61] J. M. Alvarez-Rodríguez, J. E. Labra-Gayo, A. Rodríguez-González,
and P. O. De Pablos, "Empowering the access to public procurement
opportunities by means of linking controlled vocabularies. A case
study of Product Scheme Classifications in the European e-
Procurement sector," Computers in Human Behavior, vol. 30, pp. 674-
688, 2014.
[62] A. Callahan, J. Cruz-Toledo, and M. Dumontier, "Ontology-based
querying with Bio2RDF’s linked open data," in Journal of biomedical
semantics, 2013, vol. 4, no. 1, p. S1: BioMed Central.

163

You might also like