Professional Documents
Culture Documents
Abstract—Considering an environment that consists of several the majority and, not having a two-way flow, prevents any
services, applications and platforms, each present entity produces existence of an Open Data Ecosystem.
a certain amount of data. With so many sources of data, there are Lack of incentive from government authorities and major
a number of things bound to exist: different formats of informa-
tion, redundancy and no consistent standards of information. In industry actors decrease the sustainability and long-term ex-
environments as these, the collaboration between different entities istence of currently available applications. The result is an
creates an opportunity for innovation, where data interoperability unstable market of services and applications which are of
allows for the re-use of information, the possibility of different unpredictable nature in terms of supply, in both quality and
services taking advantage of other third-party sources and the quantity, producing an environment with low quality data,
development of new businesses from existing information. This,
however, is only possible if there is some sort of interoperability decentralized accesses and no absolute standard or innovation
between the data, a way for it to be transmitted from entity guide lines. The main goal of this paper is to develop a
to entity, always with the possibility of creating value with its platform that enables the creation of an Open Data Ecosystems
manipulation and consumption. This paper exposes the work within a Smart City by trying to solve issues of interoper-
done in the development of a platform focused on data, looking ability and communication between all data generating and/or
into its forms of representation and how to solve the problems
caused by the ever existing necessity of data interoperability consuming devices while promoting Open Data application-
between systems. The possibility for maintaining and creating s/services and Citizen-driven Innovation with public ease-of-
Open Data Ecosystems is also analysed in the scope of the access methods to all stored information. In this context, this
proposed platform. document starts with a literature review on the topics of
Keywords—smart cities, data interoperability, open data, open Interoperability and Smart Cities, followed by some related
repository.
work. A conceptualization and architecture details are given
on the proposed platform ending with a case test to validate
I. I NTRODUCTION our approach and contributions.
The concept of Smart Cities slowly gained popularity, being II. BACKGROUND
defined as a city that invests in human and social assets,
traditional and modern communication infrastructures which A. Interoperability
translate to a sustainable economic growth and a high quality Interoperability is the capability that two or more system-
of life, through participatory governance [1], [2]. The goals of s/applications have when they can exchange information and
implementing this concept are to address issues like the ones successfully make use of that same information within itself
mentioned and many more, and to perpetrate this Smart City at data, application and business level [3].
vision, a lot can be done, in terms of creating infrastructure, Heterogeneous data creates issues in terms of different
technological foundations and the provisioning of services and entities using different standards of data and semantic incon-
applications in a sustainable fashion. Amongst the different sistencies when having attributes on data with the same name
ways of contributing, this document focuses on a solution that but different meaning.To solve issues such as these and gen-
tackles issues on interoperability between systems, Open Data erate interoperability between systems, there are a couple of
and Citizen-driven Innovation enablers. approaches. In particular, considerations were made towards an
With all the buzz created around the idea of being a Smart ontological approach [4] where some have been suggested and
City, we stray further away from a non-data-centric model, still applied as to mitigate the interoperability problems, namely:
implemented in most cities today, where we have a unilateral Data Standardization Consists on defining all the concepts
flow of data. Data producers, such as governments and private on semantics and representation of every element possibly
sector organizations generate greats amount of information that presented on data. With this, all systems have knowledge
might never reach a public platform, thus never available to of the properties of each element without the need for
978-1-5386-2524-8/17/$31.00
2017
c IEEE translations which facilitates data communication [5];
Data Mediation A mediator, stands between the receiver and problems using the FIWARE GEs and implement themselves
sender of information, translating the queries from the the domain-specific services for transportation and logistic
receiver and adapting the responses generated by the domain.
sender. A receiver will query the source or sender, this
query will go through the mediator, which will translate III. P LATFORM OVERVIEW
it against the source database and acts a semantic adapter The platform is defined by the collection of 3 components
for all the terms contained on the query, which can then and their interactions. Here the framework’s internal processes
be interpreted by the source [6]. and logic functioning is explained in a high-level overview.
The 3 main components that constitute the framework are:
B. Smart Cities (i) Back-end Application, in the exposed format of an API;
Many cities nowadays rush to become a Smart City by (ii) User Management Interface (UMI); (iii) Data Storage.
implementing the means for quality Information and Commu- The back-end application, which contains most of the logic
nications Technology (ICT), which is assumed to transform a processes and flows of information in the framework, exposes
city into smart one. They are the underlining factor for the all its functionalities through its API’s endpoints and is sub-
successful accomplishment of many, of the aspects considered divided into modules:
fundamental for a Smart City [7]. It is the interaction of the (i) Subscriptions; (ii) Input/Output; (iii) Helpers; (iv) Public
cities actor components with the ICTs that provides core value Controllers.
and make it so that it becomes a Smart City. People, can make Internally, every entity which constitutes either a data con-
use of ICTs to become empowered and educated citizens with sumer or producer, is considered an App, represented through
the ability to create disruptive motions on its development and the data model Apps. It is only once a user registers its App
innovation environment [7], [8], [9]. can he begin to request any type of information exchange or
Hence, the effort goes into utilising the latest technology ”in consultation.
mobile and pervasive computing, wireless networks, middle- The Subscription module encapsulates the API methods
ware and agent technologies as they become embedded into the that allow a user to (i) Subscribe an Application as an App;
physical spaces of cities” [2] with the goal of better managing (ii) Define a read schema; (iii) Define a write schema;
and forecasting urban developments. The first encountered The process of subscribing an entity/application/system
challenge is the prioritisation of development choices of the gives the user the information needed for him to make other
city within the innovation world. To address this issue, major types of I/O requests, provided that he, at the time of the
actors must strategise means of developing business models request, sends a name for the entity he intends to register. It is
that integrate both physical and digital worlds with the goal of this name that, combined with a randomly generated number,
establishing long lasting sustainable partnerships which create serves as the universal identifier for the entity.
an environment with e-services and innovative applications [2], For a user to either receive information or inject any, he
[10]. must first inform the framework what that data is. This is
done by the two methods (methods 2 and 3) on the API,
C. Related Work each receives either a read or write schema which is a piece
Focusing solutions in the format of platforms, applications of information that clearly states/defines a model that can be
or whole software stacks which tackle problems in data used to be verified against another piece of information. That
interoperability, projects as Smart Nation Singapore [11], [12] verification states true or false for whether the information
and SmartAppCity [13] are some examples of those solutions. given fits a certain model and its required attributes.
The FIWARE Platform constitutes a open cloud-based in- The data processing methods are defined on the Input/Out-
frastructure for the acceleration on SME and Start-ups their put module since it is through them that the API exposes
development of innovative services and applications using its the read and write methods. Additionally, these are the only
own technologies [14]. It exposes a catalogue of components methods on this module.
denominated Generic Enablers (GE) spanning a wide variety In order for a user to be able to either read or write on to
which serve a general purpose and functioning through the the framework he must first have the appropriate permissions.
well defined API specifications of FIWARE. The whole ini- Having the necessary permissions a user can perform a
tiative also gathers an academy, tutorials, very well defined read/write request by using their respective schemas, as shown
and open Data Models and most important the FIWARE Lab on Figure 1 (p. 3).
which aims at providing an environment that enables real test- The functionalities provided by the Helpers module are ones
beds for developers and companies [15]. that perform small tasks and don’t belong to any particular
In [16], Franklin et al. demonstrate a setting where they module. However, they are given some relevance because they
make use of FIWARE practices and components. They go offer the schema validation methods mentioned previously.
through with building a platform that serves the transportation From validating data payloads from user’s requests, loading
and logistic industry named FInest. By taking advantage of schema files and managing the state of the kept information.
the rapid development and cost-efficient perks of using Future Although most endpoints provided by the API are restricted
Internet components, they tackle their generic implementation and must require a key for access, the Public Controller mod-
map.
This section describes the functionalities implemented on this
UMI in particular, made for the purpose of this dissertation. In
future instances and implementations of the whole platform,
it is encouraged that the developers either use this example,
extending its capabilities, or, given the tools provided by the
platform, design their own domain-specific UMI.
IV. I NTRINSIC P ROCESSES
Fig. 1. Typical Input/Output request from a user to the platform, referencing
both cases of either read or write and their respective paths.
Following the conceptualization, the main processes and
interactions between users, applications, and framework com-
ponents are explained covering the technological overhead, a
ule exposes all endpoints which do not necessitate said key. descriptive exposure of the API’s endpoints.
This module contains only one method and is often overlooked The most important aspect of this platform is the interoper-
in favour of other functionalities, during implementation. That ability it offers between data exchanges. This is possible due to
endpoint replies with the attributes available and from which how data is processed once it reaches the platform, added, the
App they belong, also including all available metadata on those interaction the data owners, the users, have with the framework
same attributes. by defining read/write schemas, make it so that it is possible
for different systems to communicate.
A. User Management Interface
Seeing as there was no visual interface on to interact with A. Schema Definition and Validation
and manage, there came the necessity of a User Management The data schemas are essentially JSON Schema1 , which
Interface (UMI), accompanied with a User data model, asso- is a JSON-like object that describes other pieces of data, in
ciating Apps with users allowing users to manage their Apps. the same format. They can be used to assert: (1) ways of
It is proposed that this interface only be used an example, interaction with information; (2) how to extract information
although its a fully functioning one. As this platform, as a from it; (3) to define how the data must look like, by
whole, can be used in various situations and environments, describing it in a human and machine readable way; (4)
it is only fair to make it possible for whoever uses it to validate client-submitted data, which is the functionality most
be able to build their own interface adapted to their specific used in the framework; (5) perform automated testing. The
needs. With the use of the Public Controller module’s exposed document being validated against the schema is usually named
functionalities and the ease of integration of the Apps with an instance [17]. Here it is only taken upon analysis the
any type of user data model, the assembly of domain-specific validation capabilities of the JSON Schema.
UMIs should come as an relatively easy task for any developer. These schemas by themselves serve as an exceptional tool
for validation and other specification tasks but so far, there
is still a gap, however, in content, namely, in context. The
schema, as it is given, does not provide any context on
what its content means, how it is applised or specification on
measurement types for numerical values. By using metadata
keywords, that are part of the JSON Schema specification,
the information given becomes context-aware, through the
keywords title and description as they must be a string value
when used. They can be placed on the root level of the schema
and at the property level, providing context for the schema’s
purpose and its individual properties’ meaning and usage,
respectively.
"dangerScale" : {
"title" : "Danger Scale" ,
"description" : "Indicator for the level of urgency (from 0 to 10)." ,
"type" : "integer" ,
"maximum" : 1 0 ,
"minimum" : 0
}
{
"appName" : "TrafficStatus" ,
Register Application Create New App
/subscribe
"include" : [ "lng" , "trafficState" , "lat" ] ,
Persiste Information "exclude" : [ ]
}
"The Publisher" Registered
Listing 3. User A’s write schema that allows him to publish news article
loop
[App registered]
alt
/write
Write Payload
/write
Process and Store
/read
Read data from TrafficStatus
/read
Query Storage
Result Dataset
Return Dataset filtered by Schema Fig. 5. Server with deployed instance of the framework, portraying component
modularity and interactions.
C. Storage Sharing
Storage in the project was approached having mind the
decentralization concept for scenarios which have several
instances of the framework running with different storage
systems. Aside from a collection to store the details of Apps,
named apps, including their configurations and schemas, there
are the collections that store each of the Apps data blocks,
injected by their users. The name of these collections start with
the App name followed by a unique identifier, in the format
Fig. 6. City Dashboard case study components’ diagram, illustrating interac-
of <appName>-<UUID>. This UUID identifies a collection, tions and communication with the framework.
a the single and only collection to which that App, whose has
the same UUID, can write information to. That App, this way, This dashboard is placed onto a small scale technological
is able to have its information not only sharded through several environment, deployed in a Raspeberry Pi 2 Model B, able to
instances of the framework, it is also able to write to any of execute all the developed functionalities.
The major actors in this scenario are, the Dashboard itself [5] D. Lieberman, M. Nadel, R. A. Smith, W. Atkin, S. B. Duggirala,
and two mobile applications 6 (p. 5). These two application R. Fletcher, S. N. Glick, C. D. Johnson, T. R. Levin, J. B. Pope, M. B.
Potter, D. Ransohoff, D. Rex, R. Schoen, P. Schroy, and S. Winawer,
are, respectively, a real-time traffic state reporter, TrafficStatus, “Standardized colonoscopy reporting and data system: report of the
for users to tweet out their current traffic situation while Quality Assurance Task Group of the National Colorectal Cancer
expression their feelings towards it [19]. The other allows Roundtable,” Gastrointestinal Endoscopy, vol. 65, no. 6, pp. 757–766,
2007.
its users to report information on holes and abnormalities in [6] S. A. Renner, J. G. Scarano, and A. S. Rosenthal, “Data interoperability:
streets or city transit infrastructures, named Pavements. Standardization or Mediation,” 1st IEEE metadata conference, pp. 1–8,
The Dashboard has 3 components, namely the News Broad- 1996.
[7] A. Caragliu, C. Del Bo, and P. Nijkamp, “Smart
caster (on the left panel), the Google Map instance (on the Cities in Europe,” Journal of Urban Technology,
centre panel) and the Notification Center (on the right panel). vol. 18, no. 2, pp. 65–82, 2011. [Online]. Available:
The panel on the centre and on the right are focused on the http://www.tandfonline.com/doi/abs/10.1080/10630732.2011.601117
[8] R. G. Hollands, “Will the real smart city please stand up?”
display of information read by the Dashboard application from City, vol. 12, no. 3, pp. 303–320, 2008. [Online]. Available:
the framework. The centre panel displays every type of data https://www.tandfonline.com/doi/full/10.1080/13604810802479126
retrieved that contains geo-located attributes. The Notification [9] S. Carvalho, L. Sarmento, and R. J. F. Rossetti, “Real-time sensing of
traffic information in twitter messages,” in 4th Workshop on Artificial
Center will display tiles for every new piece of information, Transportation Systems and Simulation (ATSS), 2010 13th International
retrieved from the framework. Lastly the left panel, the News IEEE Conference on Intelligent Transportation Systems - (ITSC 2010),
Broadcaster, is a form, that acts as a broadcaster for the Funchal, Portugal, 19-22 Sept. 2010, 2010, pp. 1–4.
[10] R. J. F. Rossetti and R. Liu, Advances in Artificial Transportation
operator of the Dashboard and allows submission of pieces Systems and Simulation. Academic Press, 2014.
of information with content, urgency and category. The Dash- [11] E. Ho, “Smart subjects for a Smart Nation? Governing
board, in the perspective of the framework, is also an App, it (smart)mentalities in Singapore,” Urban Studies, 2016. [Online].
Available: http://usj.sagepub.com/cgi/doi/10.1177/0042098016664305
can read and write information. It reads data from other mobile [12] “About smart nation — enablers,” https://www.smartnation.sg/about-
applications and writes its news pieces that are submitted smart-nation/enablers, (Accessed on 06/16/2017).
through the left panel. [13] E. Marı́a, O. Moreno, and A. L. Delgado, “De La Smart City
a La Smart Human City. Inclusión Digital En Aplicaciones From
The TrafficStatus mobile application, besides writing its Smart Cities To Smart Human Cities: Digital Inclusion in App’S,”
tweets to the framework also reads, acting as a broadcaster to Revista Fuentes, vol. 17, pp. 41–65, 2015. [Online]. Available:
its users, by displaying the information sent by the Dashboard. http://dx.doi.org/10.12795/revistafuentes.2015.i17.02
[14] “Fiware technologies,” http://www.europeanpioneers.eu/en/fiware-
VI. C ONCLUSION technologies.html, (Accessed on 06/14/2017).
[15] “Home — fiware catalogue,” https://catalogue.fiware.org/, (Accessed on
After designed and implemented the proposed framework, 06/14/2017).
we can enumerate our contributions as: [16] R. Franklin, A. Metzger, M. Stollberg, Y. Engel, K. Fjørtoft,
R. Fleischhauer, C. Marquezan, and L. S. Ramstad, “Future Internet
(i) Provided an Open Data enabling framework accessible in Technology for the Future of Transport and Logistics,” pp. 290–301,
the format of an Application Program Interface (API); (ii) Pro- 2011. [Online]. Available: http://link.springer.com/10.1007/978-3-642-
vided a tool to solve interoperability issues; (iii) Created a 24755-2 27
[17] A. Wright, “JSON Schema: A Media Type for Describing JSON
platform fully extensible and with room for improvements, Documents,” no. draft-wright-json-schema-00, pp. 1–18, 2016. [Online].
that makes use of the collected information; (iv) Created an Available: http://www.ietf.org/internet-drafts/draft-wright-json-schema-
incentive for individual and collective action towards a better 00.txt
[18] A. Zaiat, R. J. F. Rossetti, and R. J. S. Coelho, “Towards an integrated
Open Data Ecosystem. multimodal transportation dashboard,” in 17th International IEEE Con-
Furthermore, with the case study, we were able to demon- ference on Intelligent Transportation Systems (ITSC), Oct 2014, pp. 145–
strate the applicability and viability of our approach and its 150.
[19] F. Rebelo, C. Soares, and R. J. F. Rossetti, “Twitterjam: Identification
associated contributions. This work follows up the implemen- of mobility patterns in urban centers based on tweets,” in 2015 IEEE
tation of a platform defined elsewhere [20], that implements First International Smart Cities Conference (ISC2), Oct 2015, pp. 1–6.
the concept of ATS [10] to support the project life cycle of [20] R. J. F. Rossetti, E. C. Oliveira, and A. L. C. Bazzan, “Towards a
specification of a framework for sustainable transportation analysis,” in
smart mobility systems. 13th Portuguese Conference on Artificial Intelligence, EPIA, Guimarães,
Portugal. APPIA, 2007, pp. 179–190.
R EFERENCES
[1] M. Deakin, Creating Smart-Er Cities, 2012, vol. 2012. [Online].
Available: http://books.google.com/books?id=FmCJtgAACAAJ&pgis=1
[2] H. Schaffers, N. Komninos, M. Pallot, B. Trousse, M. Nilsson,
and A. Oliveira, “Smart cities and the future internet: Towards
cooperation frameworks for open innovation,” Lecture Notes in
Computer Science, vol. 6656, pp. 431–446, 2011. [Online]. Available:
http://link.springer.com/10.1007/978-3-642-20898-0 31
[3] S. Blanc, “Interoperability problems: Management of evolution
of collaborative enterprises,” Interoperability for Enterprise
Software and, vol. 5, 2005. [Online]. Available: http://interop-
esa05.unige.ch/INTEROP/Proceedings/Doctoral/PerPaper/VII-1-
Blanc.pdf
[4] A. Seliverstov and R. J. F. Rossetti, “An ontological approach to spatio-
temporal information modelling in transportation,” in 2015 IEEE First
International Smart Cities Conference (ISC2), Oct 2015, pp. 1–6.