You are on page 1of 11

See discussions, stats, and author profiles for this publication at: https://www.researchgate.

net/publication/343935293

Data Visualization in Internet of Things: Tools, Methodologies, and Challenges

Conference Paper · August 2020


DOI: 10.1145/3407023.3409228

CITATIONS READS
4 2,898

4 authors:

Antonis I Protopsaltis Panagiotis G. Sarigiannidis


University of Western Macedonia University of Western Macedonia
7 PUBLICATIONS   11 CITATIONS    263 PUBLICATIONS   2,257 CITATIONS   

SEE PROFILE SEE PROFILE

Dimitrios Margounakis Anastasios Lytos


International Hellenic University The University of Sheffield
50 PUBLICATIONS   127 CITATIONS    11 PUBLICATIONS   64 CITATIONS   

SEE PROFILE SEE PROFILE

Some of the authors of this publication are also working on these related projects:

Techniques for learning constraint satisfaction problems with applications in telecommunications View project

ArchGIS View project

All content following this page was uploaded by Antonis I Protopsaltis on 28 August 2020.

The user has requested enhancement of the downloaded file.


Data Visualization in Internet of Things
Tools, Methodologies, and Challenges
Antonis Protopsaltis Panagiotis Sarigiannidis Dimitrios Margounakis Anastasios Lytos
Dept. of Electrical & Dept. of Electrical & Sidroco Holdings Ltd Sidroco Holdings Ltd
Computer Engineering Computer Engineering Limassol, Cyprus Limassol, Cyprus
University of Western University of Western dmargoun@sidroco.com alytos@sidroco.com
Macedonia Macedonia
Kozani, Greece Kozani, Greece
aprotopsaltis@uowm.gr psarigiannidis@uowm.gr

Methodologies, and Challenges. In Proceedings of 15th International


ABSTRACT Conference on Availability, Reliability and Security (ARES 2020), Dublin,
As the Internet of Things (IoT) grows rapidly, huge amounts of Ireland, 10 pages.
wireless sensor networks emerged monitoring a wide range of
infrastructure, in various domains such as healthcare, energy,
transportation, smart city, building automation, agriculture, and 1 Introduction
industry producing continuously streamlines of data. Big Data Internet of Things (IoT) has become one of the most emerging and
technologies play a significant role within IoT processes, as visual powerful technologies that is used to improve the quality of life.
analytics tools, generating valuable knowledge in real-time in order IoT connects together a great number of heterogeneous devices in
to support critical decision making. This paper provides a order to dynamically acquire various types of data from the real-
comprehensive survey of visualization methods, tools, and world environment. IoT data is used to mine useful information that
techniques for the IoT. We position data visualization inside the may be used, by context-aware applications, in order to improve
visual analytics process by reviewing the visual analytics pipeline. people’s daily life. As data is typically featured with contextual
information (time, location, status, etc), IoT turns into a valuable
We provide a study of various chart types available for data
and voluminous source of contextual data with variety (several
visualization and analyze rules for employing each one of them, sources), velocity (real-time collection), veracity (uncertainty of
taking into account the special conditions of the particular use case. data) and value.
We further examine some of the most promising visualization tools.
The cooperation of Big Data and IoT has initiated the development
Since each IoT domain is isolated in terms of Big Data approaches,
of smart services for many complex infrastructures. As IoT
we investigate visualization issues in each domain. Additionally,
develops rapidly, Big Data technologies [89-92] play a critical role,
we review visualization methods oriented to anomaly detection. as visual analytics tools, producing valuable knowledge in real-
Finally, we provide an overview of the major challenges in IoT time, within the IoT infrastructures, aiming in supporting critical
visualizations. decision making. Large-scale IoT applications employ a large
number of sensors resulting in a very large amount of collected
CCS CONCEPTS data. In the context of IoT data analysis, two tasks are of relevance:
• Application Security, Intrusion detection and visualization, exploring the large amounts of data to find subsets and patterns of
interest, and; analyzing the available data to make assessments and
Secure communication protocols
predictions. This paper will exploit ways to gain insight from IoT
Data using meaningful visualizations.
KEYWORDS
Visual analytics is an analysis technique that can assist the
Internet of Things (IoT), Data Visualization, Big Data, Anomaly exploration of vast amounts of data by utilizing data mining,
Detection statistics, and visualization. Interactive visualization tools combine
automated analysis and human interaction allowing user control
ACM Reference format: during the data analysis process, aiming in producing valuable
Antonis I. Protopsaltis, Panagiotis Sarigiannidis, Dimitrios Margounakis, insight for decision making. They involve custom data
and Anastasios Lytos. 2020. Data Visualization in Internet of Things Tools, visualization methods that enable the operator to interact with them,
Permission to make digital or hard copies of all or part of this work for personal or classroom use in order to view data through different perspectives and focus on
is granted without fee provided that copies are not made or distributed for profit or commercial
advantage and that copies bear this notice and the full citation on the first page. Copyrights for details of interest. Data analytics methods involve machine learning
components of this work owned by others than the author(s) must be honored. Abstracting with and AI methods, to automatically extract patterns from data and
credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists,
requires prior specific permission and/or a fee. Request permissions from Permissions@acm.org. make predictions. AI methods are usually untrustworthy to their
ARES 2020, August 25–28, 2020, Virtual Event, Ireland operators, due to their black-box operation that does not provide
© 2020 Copyright is held by the owner/author(s). Publication rights licensed to ACM.
insight into the accuracy of their results. Visual analytics can be
ACM ISBN 978-1-4503-8833-7/20/08…$15.00
https://doi.org/10.1145/3407023.3409228 used to make AI methods more transparent and explainable,
visualizing both their results and the way they work.

Antonis I. Protopsaltis, Panagiotis Sarigiannidis, Dimitrios Margounakis, and Anastasios Lytos. 2020. Data Visualization in Internet of Things
Tools, Methodologies, and Challenges. In Proceedings of 15th International Conference on Availability, Reliability and Security (ARES 2020).
Association for Computing Machinery, New York, NY, USA, Article No.: 110, Pages 1–11, https://doi.org/10.1145/3407023.3409228
The published work is available at ACM Digital Library: https://dl.acm.org/doi/abs/10.1145/3407023.3409228
EPESec 2020, August, 2020, Dublin, Ireland A. Protopsaltis et al.

2 Visual Analytics Pipeline visualization and recognition of patterns within the IoT generated
data, play a significant role in the insight-gaining process, and
Visual Analytics is a data analysis method that employs data enhance the decision-making process.
mining, statistics, and visualization. Besides automated analysis,
implementations of visual analytics tools combine human Visualizing data plays a major role in data analytics since it
interaction allowing user control and judgment during data manifests the presentation of findings and its patterns concurrently
analysis, in order to produce valuable insight for decision making with the original data. Data visualization helps to interpret the
[1,79]. Over the years, numerous research studies on visual results by correlating the findings to the goals. It also exposes
analytics were conducted. Most of them deal with a conventional hidden patterns, trends, and correlations, that otherwise would be
visual analytics pipeline originally presented by Keim et al [1] undetected, in an impactful and perceptible manner. As a result, it
which depicts the visual analytics process. As figure1 illustrates, assists the creation of good storytelling in terms of data and data
the visual analytics process starts performing data transformation pattern understanding.
subprocesses, such as filtering and sampling, that modify the data In this section, we will address different types of data charting.
set into representations enabled for further exploration. To create Also, we will analyze chart selection rules, that take into account
knowledge, the pipeline adopts either a visual exploration method special conditions that hold for a particular use case. Moreover, we
or an automatic analysis method, depending on the specific use will present the most popular IoT visualization tools.
case. In the case of automatic analysis, data mining methods are
applied to assist the characterization of the data. The visual 3.1 Types of Charts
interface is operated by analysts and decision-makers, to explore
In the lifeline of data visualization, data scientists operate various
and analyze the data. The framework of the Visual Analytics
visualization tools that implement many conventional visualization
Pipeline [2, 4, 5] has four core concepts: Data, Models,
techniques involving numerous kinds of plots and charts. Scatter-
Visualization, and Knowledge.
plots visualize data instances as points in 2D or 3D spaces. When
The Data module is responsible for the collection and pre- plotting higher dimension data, the data is typically projected to a
processing of the raw and heterogeneous data. As data acquisition lower dimension using multi-dimensional scaling [11] or principal
is done in real-time through sensors, raw data sets are usually component analysis (PCA). Bar-plots depict the relative frequency
incomplete, noisy, or inconsistent making it impossible for them to or relative density of different data items. Histograms and Bar-
be used directly in the Visualization or in the Models module. In charts are similar to Bar-plots but they offer a more fine-grained
order to eliminate these difficulties, some data pre-processing has approach to reveal the parameter distribution over time [13], while
to be applied to the original data sets. Data pre-processing is a the range of values is set into a series of intervals. Bubble-charts
flexible process, depending on the quality of raw data. This module allow the specification of higher dimension pictures in a smaller
includes pre-processing techniques such as data parsing, data dimension by projecting the third dimension on a 2D chart. The
integration, data cleaning (elimination of redundancy, errors, and third dimension can be the weight or the size of the bubble
invalid data), data transformation (normalization), and data corresponding to the point in the 2D space. Box-plots are specific
reduction. The Models module, is responsible for converting data plots that show typical quantiles of the distribution of data and for
to information. This module includes conversion methods such as single dimension measures of central tendency and dispersion of
feature selection and generation, model building, selection, and data.
validation.
Lines-plots are continuous curves that may be used to depict
functional dependencies between output variables.
Radial-charts show the different extents of the relative values that
each variable can take. Similar to these are the Spider charts that
show the achieved level by different dimensions.
Maps are useful for identifying the relative difference or behavior
in different parts of data or if the data has geographic information.
A map is a key data element for both input and output of a data
analytics algorithm indicating geographical data (google maps,
mapquest, OLA maps, etc.). An extension of a map is the Heat map
Figure 1: Visual Analytics Pipeline which illustrates the spatial distribution of a variable on a map [13].
The Visualization module is responsible for visualizing and Circular heatmaps are used to compactly depict the change of a
abstractly transforming the data. This module includes techniques variable over a month [14], while circular heatmaps on a map are
for visual mapping (parallel coordinates, force-directed graphs, used to explore the data from a spatiotemporal point of view [15].
chord graphs, scatter matrices), view generation and coordination, Timelines are useful data elements that are utilized to understand
human-computer interaction. The Knowledge module is the evolution of one or more variables and the behavior of changing
responsible for driving the process of transforming information into trends or patterns over time from an analytics perspective point of
meaningful insight using human machine interaction methods. view.
3 Visualization Charts Rules and Tools Diagrams and Graphs are also extensions of charts used in special
cases. Trees are special data structures used for representing
Data visualization places data in an appropriate visual context that
scenarios with hierarchical decomposition. The Time-Correlation-
triggers people’s understanding of its significance. This reduces the
Partitioning (TCP) tree is a concise visual representation depicting
overall effort to manually analyze the data. As a result,
EPESec 2020, August, 2020, Dublin, Ireland A. Protopsaltis et al.

the correlations of multiple environmental quality parameters and few data points, line-histogram for many data points) (figure 3).
their change over time based on information entropy [17]. Finally, Scatter-plots are mostly used in bivariate cases while in
networks are utilized to show linkages of people, things, computers, multivariate cases 3D-area charts may capture the objective of the
concepts etc. visualization.
SHAP summary plots [17] illustrate the distribution of feature
importance, given a trained model and a dataset. Each classifier
(feature vector) input is represented as a Colored dot, with the color
indicating the value of that feature. A dot is placed on the x-axis,
according to the contribution (positive or negative) of that feature
to the final model outcome. Colored dots on a map depict the
intensity of the measured parameter based on color-coding [13]. Figure 3: Evaluation of Data Set Distribution
Comparing data sets is an essential process when analyzing data
Clustering and dimensionality reduction methods are used to
that makes it possible to identify differences or similarities between
effectively visualize data patterns and their evolution over time.
data points or periods. Different groups of data concerning the same
Cluster storyline visualizations represent data patterns that are
period may be compared using a simple Bar-Chart (figure 4) for
based on derived clusters and capture their evolution over time in a
univariate cases or a Variable-Width Bar Chart for bivariate cases.
timeline graph [18]. Weighted complete graphs have also been
The main difference between the two is that the variable-width Bar
proposed to depict the total correlation of all dimensions in data
chart allows comparisons both on the height and the width of each
[19]. Polar systems with embedded circular pixel bar charts have
bar.
also been proposed as a technique to visualize multivariate
variables and vector variables.
3.2 Chart Selection Rules
To decide upon the kind of chart or visualization to be used for each
case, the context of the visualization must be first taken into
consideration. A visualization tool must consider different IoT data
sources and data types. Before charting, the number of the variables Figure 4: Compare different Data Sets on same time period
evaluating must be determined: a) Univariate Data, where a single
variable, discrete or continuous, needs to be tracked for its On the other hand, when the time variable is important, we compare
performance, value, trends, behavior, or the composition of the the same data set across different periods using a Circular Area
values; b) Bivariate Data, where two variables, either discrete or Chart (also called Radar or Spider Chart). This chart (figure 5)
continuous, need to be tracked. In this case, several complexities enables the comparison of multiple quantitative variables. Each
must be taken into account; c) Multivariate Data, where more than variable is represented by an axis calibrated radially starting from
two variables, either discrete or continuous, need to be tracked. the center. Each variable value is plotted along its axis and all the
Multivariate data, usually high dimensional sets, are difficult to variables are connected to form a polygon.
visualize and overwhelm human perception. Such cases go through
a model-based analysis phase, where dimension reduction
techniques make the visualization process feasible.
The main objectives of performing a visualization process are a) to
assess a relationship; b) to evaluate a distribution; c) to compare
data, and; d) to study a composition.
Assessing a relationship between data sets is called correlation, and Figure 5: Compare same Data Set on different time periods
it is performed in order to determine how these data sets combine Composition is the study of smaller parts that form a group (figure
and interact with each other. The correlation of different data sets 6). Pie charts are mostly used in such cases.
can be either positive or negative, meaning that their variables are
either supportive or working against each other. Scatter-plots
(figure 2) are mostly used in bivariate cases while in multivariate
cases Bubble-charts reveal insight very comprehensively.

Figure 6: Composition Study


In composition cases where time variable is important, Pie Charts
may be productive in studying the change over time. For these cases
(figure 7) a Stacked-Bar Chart or a Stacked-Area Chart would best
Figure 2. Assessing Data Sets’ relationship present the composition of a data set that changes over time by
Evaluating a distribution aims to reveal the existence (or absence) dividing the bars (or the area) among the categories in the data set.
of patterns and their evolution over time. In univariate cases, In such cases, a time series data is stored in databases. Time series
histograms are the best visualization option (column-histogram for
EPESec 2020, August, 2020, Dublin, Ireland A. Protopsaltis et al.

data are measured over a certain duration based on a certain Tableau is a fast and flexible data visualization tool, allowing user
predictable pattern or the current study condition. interaction. Its user interface provides a wide range of fixed and
custom visualizations employing a great variety of intuitive charts.
In-depth analyses may be accomplished by R-scripting. It supports
most data formats and connections to various servers such as
Amazon Aurora, Cloudera Hadoop, and Salesforce. Tableau’s
online service is publicly available but it supports limited storage.
Server and desktop versions are available under commercial
Figure 7: Composition study over Time licenses.
A recent work, DeepEye [60], has presented a method for the ThingsBoard [3] is an open-source IoT platform containing
automatic selection of the appropriate type of visualization. This modules for device management, data collection, processing, and
method provides solutions to three problems: (1) Visualization visualization. The platform allows the creation of custom IoT
recognition, that evaluates the quality of an existing visualization dashboards containing widgets that visualize sensor data collected
by training a binary classifier; (2) Visualization ranking, that selects through multiple devices. It contains a set of features including line
the best of two visualizations by using a supervised learning-to- and bar chart modules for both historical and real-time data
rank model and relying on experts’ rules; and (3) Visualization visualizations. It also contains map widgets enabling object
selection, that efficiently computes the top-k visualizations for an tracking on online maps. Its complex stack technology (Java,
existing data set by addressing optimizations. Python, C++, JavaScript) provides error-free performance and real-
time data analytics. It supports standard IoT protocols for device
3.3 IoT Data Visualization Tools connectivity (e.g. MQTT, CoAP, and HTTP). It can be integrated
Visualization tools assist the decision-making process since they with Node-Red [20], a flow-based programming platform for IoT,
provide strong data analytics that help interpreting big data through a custom function.
acquired from the various IoT devices. IoT data visualization Plotly is an online cloud-based public data visualization service. It
systems involve custom dashboard design that, given a set of is built using Python and Django frameworks. It provides various
measurements acquired by several geographically scattered IoT data storage services and modules for IoT visualization and
sensors, and several AI models applied to the data, allows the analytics. It allows the creation of online dashboards employing a
operator to explore the available raw measurements and gain wide range of charts such as statistical, scientific, 3D, multiple axes
insight about the models’ operation. The main aim of these systems charts, etc. It provides Python, R, MATLAB and Julia based APIs
is to enhance the operator’s trust in the models. for in-depth analyses. Also, graphics libraries such as ggplot2,
A flexible visualization system should maintain some core matplotlib, and MATLAB chart conversion techniques enhance the
characteristics such as the ability to update in real-time, visualizations. Its internal tool Web Plot Digitizer (WPD) may
interactivity, transparency, and explainability. Since, IoT automatically grab data from static images. It is publicly available
measurements are highly dynamic, with new measurements being with limited chart features and storage while its full set of chart
collected in real-time, dashboards should be able to update in real- features are available through a professional membership license.
time as new measurements become available. The dashboard IBM Watson IoT Platform is a cloud platform as a service
should provide an interactive user interface allowing operators to supporting several programming languages, services, and
engage with the data and explore them. The dashboard should also integrated DevOps in order to deploy and manage cloud
provide means of looking into the applied AI models and visualize applications. It features a set of built-in web applications while it
their internals, to enhance the transparency and explainability of the provides support for 3rd-party software integration via REST APIs.
models. The visualization of static and dynamic data is provided through
Many proposed visualization platforms are designed based on SOA effortless creation of custom diagrams, graphs, and tables. It
(Service Oriented Architecture) with four key services: Data provides access to device properties and alert management. Node-
Collection Service, that receives data; Data Visualization Service, RED may be used for IoT device connection, APIs, and online
that observes the data intuitively; Dynamic Dashboard Service, services. Sensor data, stored in Cloudant NoSQL DB, may be
providing an interface that organizes and displays various processed for further data analysis.
information such as text, the value of the machine, or the Power BI is a powerful business analytics service based on the
visualization result; and Data Analytic Service, that delivers cloud. It provides a rich set of interactive visualizations and
statistical analysis tools and consists of three main layers Big Data detailed analysis reports for large enterprises. It is designed to trace
Infrastructure as a Service, Big Data Platform as a Service, and Big and visualize various sensor gathered data. The platform works in
Data Analytics Software as a Service [93]. cooperation with Azure cloud-based analytics and cognitive
The most widely used IoT Data visualization tools, across several services. It consists of 3 basic components: Power BI Desktop,
industries globally, will be summarized in this section. Each one report generator; Service (SaaS), report publisher; and Apps, report
was compared against the following criteria: open-source tool, the viewer, and dashboard. Numerous types of source integrations are
ability to integrate with popular data sources (MapR Hadoop Hive, supported while rich data visualizations are also provided. Among
Salesforce, Google Analytics, Cloudera Hadoop, etc.), interactive other methods, data may be queried using the natural language
visualization, client-type (desktop, online or mobile app), query feature. Data analysis is accomplished both in real-time
availability of APIs for customization and embedding purposes. streaming and static historic data. Power BI provides sub-
components that enable IoT integration. The desktop version of the
EPESec 2020, August, 2020, Dublin, Ireland A. Protopsaltis et al.

software is publicly available with a major restriction of cloud specifically, Augmented Reality (AR) plays a significant role as
services access. information visualization and interaction medium. In this sense,
some generic and scalable AR frameworks have been developed
Gephi is an open-source tool specializing in graph and network
for IoT infrastructures [29, 30], providing IoT visualizations within
analysis providing interactive network exploration and
a user-friendly environment. The utilization of AR user
interpretation and dynamic network visualization. Since it is
environments aims to enhance user perception of the visualized IoT
designed in Java and OpenGL, its GPU 3D render engine
data patterns. AR technologies provide humans the ability to
accelerates its performance [23] making it capable of displaying
visually monitor and process the operation of the IoT infrastructure
large network analyses in real-time. Its flexible and multi-tasking
in real-time.
architecture is able to process very large and complex data sets and
produce meaningful visual results. It provides functions for These days, Immersive Virtual Reality is recognized as one of the
network data spatializing, filtering, navigating, manipulating, and most promising technologies that enables virtual interactions with
clustering. Even though there is no programming skills required, a physical systems. The user is situated within a 3D environment
good knowledge of graphs is considered necessary. where data visualizations and physical space are matched in a sense
that it provides users the ability to orient, navigate, and interact
Grafana, is an emerging open-source data visualization tool. It
naturally. These frameworks [28,80] utilize hybrid collaborative
focuses on time-series metric data analysis and monitoring over a
multi-modal methods to enable collaboration between users and
period of time. As such, it supports several time-series data storage
provide intuitive and natural interaction within a specific virtual
backends. It provides real-time feed allowing data analysis reports
environment. As users remain immersed within a 3D virtual
in near real-time. Its dynamic and interactive visual dashboard
environment, immersive reality applications require sophisticated
covers multiple functionalities, supports highly customized
approaches for interacting with the IoT data analytics visualization.
queries, and provides several charting capabilities for analyzing
As such, immersive analytics is the visualization outcome within
and presenting the data, such as Heat maps, Geo Maps, Histograms,
IoT infrastructures. Immersive analytics frameworks promote a
Charts – Pie/Bar, Graphs. Grafana supports various data sources
better understanding of the IoT ecosystem and enhance decision-
seamlessly like Elasticsearch, InfluxDB, MySQL, PostgreSQL,
making. To ensure such a collaborative virtual environment
Graphite, Prometheus, OpenTSDB, and KairosDB. It provides
presupposes highly responsive connectivity that may be
cloud storage allowing complete control of the infrastructure. It
accomplished by employing high-speed 5G network
also provides alert notifications in the case of an unfavorable event
infrastructures, which provide ultra-low-delay and ultra-high-
occurrence.
reliable communications.
Kibana Tool is an open-source data visualization tool specializing
Similarly, a Cyber-Physical System (CPS) is a set of physical
in data analysis of large sets. It is a component of the ELK Stack, a
devices, connected through a communication network, that
set three tools: ElasticSearch, LogStash, Kibana [16]. Even though
communicates with its virtual cyberspace. Each physical object is
Elasticsearch and Logstash may operate independently, the three
associated with a cyber model that stores all information and
products were initially designed as an integrated solution. Logstash
knowledge of it. This cyber model is called “Digital Twin” [31,32].
is responsible for data acquisition from the various remote sources
It allows data transfer from the physical to the cyber part. However,
while Elasticsearch provides its database services to Kibana which
in a specific CPS, where every physical object has a digital twin
is responsible for data presentation. Beats, the fourth product added
counterpart, the spatiotemporal relations between the individual
to the stack, serves as a lightweight shipper sending data from edge
digital twins are far more valuable than the actual digital twin. The
devices to Logstash. The Elastic Stack may either be deployed or
generation of Digital twins may be accomplished using 3D
be used as cloud-based Software as a Service (SaaS). A set of
technologies [26,27] through AR/VR/MR or even hologram
community plugins are also available. Kibana provides a web-
devices. Digital twins integrate various technologies such as
based interface for search, view, and analyses of data stored in
Haptics, Humanoid Robotics as well as Soft Robotics, 5G and
Elasticsearch cluster. It consists of 4 main components: Discover,
Tactile Internet, Cloud Computing Offloading, Wearable
for interactive data browsing and analyses; Visualize, for data
technology, IoT Contextual data, and AI.
visualization that utilizes various plugins and visual aids (for
production of bar charts, pie charts, heat maps, line graphs, timeline 4 IoT domains and Visualization
visualizations, coordinate/region maps, etc); Dashboards, for
presentation of combined multiple results from Discover and IoT technologies have already entered into various significant
Visualize into one interactive view that may easily produce reports domains of our life. The growing market competition and
for future references; and Management, for internal configuration. inexpensive connectivity have emerged the Internet of things (IoT)
across many domains. Connected sensors, devices, and machines
A plethora of JavaScript libraries, frameworks, and toolkits are also via the Internet are the “things” in IoT. The enormous volume of
available for building custom front-end visualizations such as IoT data provides the information needed to be analyzed to gain
TimelineJS, Angular, the JavaScript Data-Driven Documents D3.js knowledge. Visual analytics, involving data analysis methods,
library, the Three.js WebGL 2D/3D rendering library, and several artificial intelligence, and visualization, aims to improve domain
JavaScript frameworks and utility libraries such as Underscore.js, operations with concerning efficiency, flexibility, and safety.
Backbone.js, and JQuery. In such cases, the back-end technology
is served by the powerful, in massive data cases, NoSQL databases. The employment of IoT smart devices facilitates the transformation
of traditional domains into modern, smart, and autonomous
Nowadays, the continued innovations and evolutions in computer domains. Over the past recent years, many traditional domains such
vision, mobile computing, and portable display devices have made as healthcare, energy, industry, transportation, city and building
human interaction with machines very natural and effective. More management, and agriculture have become IoT-based with
EPESec 2020, August, 2020, Dublin, Ireland A. Protopsaltis et al.

intelligent human-to-machine (H2M) and machine-to-machine cleaning, car parking, street lighting, and emergency control [41].
(M2M) communication. In this section we will investigate the Such systems [44] must be able to process both historical and real-
visualization approaches applied through the different IoT time data produced in the smart environment [28,34,80] to build
domains. valuable knowledge necessary to support the operation of a Smart
City [45,46].
4.1 Healthcare
IoT technologies, have advanced Transportation systems to more
IoT is applied in Healthcare to collect and analyze real-time intelligent and ubiquitous [47] and contributed to a sustainable
medical data aiming to create actionable medical insight and smart environment [35,36,50]. IoT sensors produce continuously a
minimize traditional medical treatment limitations [33]. Medical vast amount of data that is used for route planning, surveillance
data, acquired through smart devices, is stored and analyzed in applications, emergency management, traffic control, traffic
cloud platforms for different stakeholders. A such, a patient’s prediction, and anomaly detection.
health status may be remotely monitored by ubiquitous healthcare
applications. Since smart cities involve heterogeneous multi-source and multi-
modal trace data, such as mobile devices, vehicles, smart cards,
Data analysis and visualization in healthcare often reveals hidden floating sensors, and localization systems (GPS, Wi-Fi, GSM,
patterns in data, producing valuable insight for better planning, and Bluetooth, and payment records), a cross-domain context
cost-efficiency. Many healthcare applications integrate web-portals visualization framework is a major challenge. Visualization
with GIS facilitating the visualization and monitoring of data in techniques in transportation may intuitively display the spatial and
real-time. The enormous amounts and the high dimensionality of temporal distribution of network congestion through a map-based
data is a visualization challenge that is resolved through platform with rich content, filters, and a variety of graphs. Trained
granulation. As such, data visualization tools face many difficulties RNN-RBM models, reveal network congestion evolution patterns,
in terms of poor performances in functionality, scalability, and and facilitate the comprehension of congestion generation and the
response time. New frameworks, that model and characterize prediction of future trends of congestion evolution. Such
visualization strategies, utilize clustering and machine learning frameworks offer a rich set of capabilities of multi-data source
techniques for the visualization of large datasets. This approach processing and analysis that lead to valuable insights concerning
takes into consideration the desired display resolution before critical incidents in traffic monitoring, multi-modal connectivity in
determining the result’s rendering precision which reduces the urban planning, development or modification of policy parameters,
potential computation time. and viability and feasibility of multi-modal routing.
4.2 Smart Grid 4.4 Smart Buildings
A Smart grid is an emerging intelligent electricity distribution Large sets of IoT devices in smart buildings collect sensitive timely
system. It utilizes IoT to integrate renewable resources in power data providing detailed interactions between humans and machines
systems, accurately control the grid, and allow optimal power [51]. A large number of building IoT sensors collect high-
consumption [37,49,88]. Smart Grid employs IoT technologies to resolution meter recordings from heating, ventilation, air-
provide smart services [38,39] such as distribution and conditioning, lighting, digital video, access control, intrusion
consumption management, advanced metering infrastructure detection, fire detection, alarms, weather conditions, and
management, renewable energy integration, anomaly detection, demographics. The integration of these heterogeneous IoT devices
self-healing systems, and energy storage. The utilization of big data enables smart services, called building analytics, which are utilized
technologies produces intelligent insight [21-22,81-84] and to monitor and forecast citizens’ activities [54,55]. The offered
efficient power management [40]. smart services in smart buildings are further optimized through the
Data visualization plays a key role in improving the assessment of employment of general, personal, and critical gathered data.
the smart grid. The aim of visualization in the smart grid is to Visualizations provide a high-level summary of gas, electricity, or
present current and historical energy-consumption patterns to gain water consumption. Benchmarking of building portfolios and
knowledge about their energy profiles. There is a great number of anomaly detection techniques help users detect possible deviations
visualization techniques [25,43,52] based on multivariate and high from the baseline and identify the cause. The prediction of future
dimensional data sets, providing the ability to construct 2D or even energy consumption and its variance is important for the effective
3D visualizations. On the other hand, smart grids involve enormous diagnosis and tracing of abnormal consumptions.
variables that complicate 3D data presentation (3D Power-map,
etc). For high dimensional data cases, scatter diagrams, parallel 4.5 Smart Agriculture
coordinates, and Andrew curves may resolve the presentation
Agriculture is a highly complex system that depends on the climate,
problem. Also, visualized graphs and charts in smart grids present
weather, soil conditions, plant types, and so on. Nowadays, smart
granular and explicit changes in the voltage and frequency.
agriculture applications employ IoT technologies, to collect and
However, correlations or trends between multi-source data lack
process various sensor data, to enhance crop management, assure
effective representation.
improved productivity and product quality, with minimum energy
4.3 Smart city and Transportation consumption and maximum customer satisfaction. The
establishment of sustainable agriculture due to the effects of global
Smart city applications, aim in analyzing city dynamics through warming and frequent extreme weather conditions is increasingly
representation, visualization, and evaluation processes. They important.
employ IoT technologies to optimize the cooperation of various
public systems and services, such as waste management, city Visualization systems empower long-term field monitoring of
factors, analyzing data acquired from IoT sensor devices.
EPESec 2020, August, 2020, Dublin, Ireland A. Protopsaltis et al.

Monitoring and control systems are important for plant growth rather problematic process due to unavailable training data. In IoT
management, crop anomaly detection, and the strengthening of environments, the situation often gets aggravated due to the
protection measures against attacks by pests and diseases [57,58]. enormous volume of data flows. Even though the huge data input
The determination of optimal environmental conditions for each provides valuable, streaming, spatiotemporal and contextual
agricultural activity effectively optimizes cultivation and crop information about anomalous cases, normal cases are characterized
management processes and further enhances the product quality. by high veracity and volatility. As such, big IoT data requires a
flexible and adaptive method that, using the rich context
4.6 Industry information, will effectively identify and interpret normal and
The trend of digitization in industry (often called Industry 4.0) abnormal cases. Existing visual analytics methods provide
generates large amounts of data by sensors and data recordings solutions [74-77] to this problem but they are not flexible and
from almost all machines and devices of the production process adaptive enough to handle large, complex, and dynamic data
with the promise of creating new usage opportunities [64,70]. The environments.
extraction of valuable knowledge from generated data from all Literature [48,49,59,61-63] shows that visual analytics can be very
stages of the industrial product life cycle (PLC), can improve advantageous in the anomaly detection process. However, in IoT
product costs, quality and increased flexibility [68,69]. IoT systems, the anomaly definition is driven by the dynamic,
applications for industrial automation are adopted aiming in the streaming, spatiotemporal big data which is usually characterized
optimization of industry’s procedures and the growth of global by heterogeneity and multidimensionality. “Soft” knowledge, the
economy [59,60]. Industrial IoT applications are utilized to produce additional human knowledge, is often undefined or unavailable to
real-time analyses in product supply chain management, the machine-centric approach. Consequently, capturing anomalous
performance evaluation, simulation, modeling, digital learning patterns in IoT data, while adapting to data changes and
factories, intelligent Machine-to-Machine, Human-to-Machine, accumulated human knowledge in the system, is a rather
and Machine-to-Infrastructure communications, energy saving [65] challenging task. Additionally, existing visualization solutions [74-
and industrial wireless networks [66,67]. The future of 77] and modern spatiotemporal visualization platforms [79-84], are
manufacturing is closely dependent on the industry’s ability to unable to represent intuitively and comprehensively such data and
connect systems for collaboration, optimize manufacturing anomalous patterns along with their spatiotemporal context.
processes and adopt self-learning systems. Moreover, the existing monitoring systems for spatiotemporal
However, observing and analyzing large industrial data sets is often anomalies do not produce satisfying results, since they do not
overwhelming for human perception. The vast volume of support online anomaly investigation and analytical reasoning that
manufacturing data, imposes a great challenge of making full use incorporate human judgment.
of these invaluable datasets. Τhe collected sensed data is Various visualization techniques have been utilized to assist the
characterized by a high degree of abstraction and strong bonding to anomaly detection and evaluation process. Particularly, time series
corresponding manufacturing operations. As a result, analyzing charts and histograms are the most commonly used statistical
relations among different data is extremely complex and difficult diagrams to represent anomalous cases [85-87]. Different types of
to visualize. Visualizations aim to assist end-users, in easing their dimension reduction and multidimensional visualizations
daily operations, and decision-makers, in determining the techniques are used to visualize data distributions and detect
industry’s structure, by visualizing operations and behaviors and outliers: multi-dimensional scaling (MDS), principle component
identifying key players. Visualization of knowledge is classified analysis (PCA), self-organizing map (SOM), and parallel
into three categories: useful values, significant trends, and coordinates.
managerial rules. It is accomplished through statistics and machine
learning approaches for operator performance insights, and through Network anomalies occur due to various internal or external
statistics and prediction models for production progress insights. factors: network device failures, distributed denial of service
Visualization packages used in industry offer various network (DDoS) attacks, and worms. Traditional traffic volume analysis
layout algorithms. Most commonly used layouts are derivations of methods often identify these causes as abnormal traffic patterns.
force directed layouts, in which prominent nodes are drawn in the Recently, considerable attention has been given to traffic anomaly
center and less prominent ones are pushed to the periphery. Nodes detection methods that are based on Entropy as they provide more
close to each other have stronger associations. detailed metrics for traffic distribution patterns than the traditional
methods. Time-series analysis is the main method used for traffic
5 Visual-Aided Anomaly Detection anomaly detection based on entropy since it helps to identify single
The previous section depicted that most IoT domains require traffic distributions and distributional changes over time. The
anomaly detection techniques. Anomaly detection deals with the visualization of multiple entropy-based time series may be
discovery of rare occurrences in data sets aiming to reveal accomplished utilizing timeline methods while its analysis may use
suspicious behaviors. Many techniques have been developed for intelligent or manual methods that detect potential traffic
the identification of outliers and the detection of abnormal cases anomalies.
through unstructured multi-dimensional data sets. Literature Data objects often contain inter-dependencies that must be taken
reviews [71-73] has shown that anomaly detection has been mainly into account during the anomaly detection process. Recently,
approached through machine learning or statistical techniques. considerable focus has been given to anomaly detection techniques
Nevertheless, the effective application of these techniques is for structured graph data [35,59,81]. Graph’s robust and powerful
dependent on two major challenges in anomaly detection problem: machinery could effectively represent and capture long-range
a) there is no clear identification and interpretation of normal and correlations among inter-dependent IoT data objects. The graph
abnormal cases; and b) training and verification of models is a structure, incorporates nodes, edges, and attributes/types, and may
EPESec 2020, August, 2020, Dublin, Ireland A. Protopsaltis et al.

naturally represent data inter-dependencies creating links between The exploration of large and complex data sets imposes a
the related objects. Long-range correlations between related IoT significant challenge. Visual-analytics techniques must be scalable
data objects may effectively be represented using graph’s multiple to fit their functionality according to the size and dimension of the
paths. Additionally, anomalies’ relational nature may be data. However, human’s overwhelmed perceptual and cognitive
represented intuitively using a graph. capacities impose difficulties in exploring and interacting with
large and complex data sets, making scalability a great challenge
6 Challenges and Future Work for visual analytics.
Visual analytics main objective is to discover knowledge and
produce actionable insight. This is succeeded by processing large
6.3 Interactivity
and complex data sets through by integrating techniques from Main aim of visualization systems is to assist decision-making. As
various fields such as data analysis, data management, such, visualization systems must be interactive allowing a
visualization, knowledge discovery, analytical reasoning, human significant set of possible user interactions. Literature review
perception, and human-computer interaction. Even though shows that the development of an extensive and thorough recording
visualization is an important entity in Big IoT data analytics, most of all possible interactions that may be performed on a visualization
visualization tools exhibit poor performance results in terms of system is still a challenge. Such a taxonomy would record each
functionality, scalability, interaction, infrastructure, insight individual user interaction along with its cognitive and perceptual
creation, and evaluation. impact.
6.1 Functionality 6.4 Infrastructure
Common functionality issues in IoT data visualization are caused As stated previously, numerous dimensionality reduction methods
due to the huge volume of data sets, their high dimension, and their have been developed and employed in the visualization of complex
streaming nature: (1) Data overloading, over-plotting, and and high-dimensional IoT data. However, these methods are not
overlapping [42] are the most common symptoms of IoT data sets. suitable and cannot be reused for all types of presented data. As
The state-of-the-art techniques use methods for dimensionality such, a significant challenge is the development of infrastructure
reduction, hierarchical exploration, caching, prefetching [42], containing a common framework. Most proposed frameworks
incremental and adaptive processing [78] to properly visualize the cannot be reused for all types of data since they were designed
enormous volume data. Data cleaning methods are also applied to specifically for a particular domain.
remove outliers. Applying cleaning and reduction methods to
visible data sets is a challenging task since they may cause 6.5 Insight Creation
information loss. On the other hand, effective visualizations of fine Main objective of visual analytics is the creation of valuable
grained dimensions increase the probability of identifying knowledge that will integrate with human judgment into the data
observable correlations, patterns, and outliners; (2) Visualizing analysis process and enhance decision-making. Consequently, a
heterogeneous and diverse data (unstructured, structured, and semi- fundamental challenge is the creation of meaningful visualization
structured) is an essential and challenging task; (3) Additionally, as results maximizing human capacity, and perception, to facilitate
data sets are often closely related to each other, visualizations data exploration, analytical reasoning and gain better insights.
contain visual noise that confuses human’s perception creating
different visualizations of the same type; (4) In cases of presenting 6.6 Evaluation
large data sets, current data visualizations tools face great challenge In the field of Human Computer Interaction, engineers evaluate a
in fitting the entire set in screen due to aspect ratio, device user interface by taking into consideration important factors such
resolution, and physical perception limits. These issues often as user cognition, perception, and analytical reasoning. Since a
overwhelm user’s perceptual and cognitive capacities [12]; (5) In visualization system is a user interaction system, these three factors
IoT environments visualization systems must be responsive in real- are also important for the visual-analytics process. As such, to
time since data is generated dynamically. This imposes the create better visualization systems there must be an evaluation of
challenge of optimal network bandwidth that supports high network the designed utilities for their effectiveness, and trustworthiness.
performance and low latency requirements; (6) As IoT However, the complex functionality of visual-analytics
environments growth rate is enormous, power and bandwidth applications makes its evaluation challenging.
constraints impose that data should be stored locally to efficiently
obtain usable information. As such, data locality is a significant 7 Conclusion
challenge for visualization systems to achieve efficient outcome;
(7) The explosion of IoT data volumes requires the use parallel The emergence of IoT increased drastically the growth rate of data
visualization architectures. As a result, the decomposition of a task production creating large and complex data sets. The integration of
human judgment within the data analysis process enables visual
into independent subtasks that enforce concurrent execution of
analytics in discovering knowledge and gaining valuable insight
visualization subprocesses is an essential challenge for parallel
visualization algorithms [53]; (8) Human error and from these data sets. In this process, every piece of IoT data is
oversimplification of data form a major issue in data visualization. considered crucial for the extraction of information and useful
patterns. Human cognitive and perceptual capabilities identify
Although, the use of machine learning techniques reduces this type
patterns efficiently when data is represented visually. Data
of issues, literature review shows that IoT analytics mostly focus
on data cleaning, data mining, exploratory analysis and diagnostics visualization methods face several challenges in handling the
methods, and very few of them address the use of machine learning. voluminous and streaming IoT data without compromising
performance and response time matters.
6.2 Scalability
EPESec 2020, August, 2020, Dublin, Ireland A. Protopsaltis et al.

This paper provides a comprehensive survey of visualization [16] Bajer, M. (2017, August). Building an IoT data hub with Elasticsearch, Logstash
and Kibana. In 2017 5th International Conference on Future Internet of Things
methods, tools, and techniques for the IoT. In this sense, we and Cloud Workshops (FiCloudW) (pp. 63-68). IEEE.
reviewed the classic visual analytics pipeline [1] that fits the data [17] Lundberg, S. M., Erion, G. G., & Lee, S. I. (2018). Consistent individualized
visualization subtask within the entire visual analytics process. We feature attribution for tree ensembles. arXiv preprint arXiv:1802.03888.
studied various chart types available for data visualization and [18] Zhou, Z., Ye, Z., Liu, Y., Liu, F., Tao, Y., & Su, W. (2017). Visual analytics for
spatial clusters of air-quality data. IEEE computer graphics and applications,
analyzed rules for employing each one of them taking into account 37(5), 98-105.
the special conditions of the particular use case. We also examined [19] Qu, H., Chan, W. Y., Xu, A., Chung, K. L., Lau, K. H., & Guo, P. (2007). Visual
some of the most promising visualization tools and presented useful analysis of the air pollution problem in Hong Kong. IEEE Transactions on
Visualization and Computer Graphics, 13(6), 1408-1415.
details about them. Visualization techniques can boost the decision- [20] Lekić, M., Gardašević, G. (2018). IoT sensor integration to Node-RED platform.
making process by enabling human cognition and perception within In 2018 17th International Symposium INFOTEH-JAHORINA (INFOTEH) (pp.
various IoT domains. We investigated the various IoT domains 1-5). IEEE
since each one imposes different analytics requirements isolating [21] Zhu, J., Zhuang, E., Ivanov, C., & Yao, Z. (2011). A data-driven approach to
interactive visualization of power systems. IEEE Transactions on Power
the evolution of Big Data approaches. The increased amount of Systems, 26(4), 2539-2546.
network security events has emerged Anomaly Detection [22] Zhou, K., Fu, C., & Yang, S. (2016). Big data driven smart energy management:
techniques, which focus on revealing suspicious behaviors in IoT From big data to big insights. Renewable and Sustainable Energy Reviews, 56,
215-225.
data sets, by identifying outliers and rare occurrences. We further [23] Bastian, M., Heymann, S., & Jacomy, M. (2009). Gephi: an open source software
reviewed visualization methods that assist anomaly detection. for exploring and manipulating networks. In Third international AAAI
Finally, we identified major challenges and future directions conference on weblogs and social media.
concerning visualizations in IoT in terms of functionality, [24] Simmhan, Y., Aman, S., Kumbhare, A., Liu, R., Stevens, S., Zhou, Q., &
Prasanna, V. (2013). Cloud-based software platform for big data analytics in
scalability, interaction, infrastructure, insight creation, and smart grids. Computing in Science & Engineering, 15(4), 38-47.
evaluation. [25] Zhou, D., et al (2016). Distributed data analytics platform for wide-area
synchrophasor measurement systems. IEEE Transactions on Smart Grid, 7(5),
2397-2405.
ACKNOWLEDGMENTS [26] El Saddik, A. (2018). Digital twins: The convergence of multimedia
The research leading to these results has received funding from technologies. IEEE multimedia, 25(2), 87-92.
[27] Canedo, A. (2016). Industrial IoT lifecycle via digital twins. In Proceedings of
the European Union’s Horizon 2020 research and innovation the Eleventh IEEE/ACM/IFIP International Conference on Hardware/Software
programme under grant agreement No 833955. Codesign and System Synthesis (pp. 1-1).
[28] Lv, Z., Yin, T., Zhang, X., Song, H., & Chen, G. (2016). Virtual reality smart
city based on WebVRGIS. IEEE Internet of Things Journal, 3(6), 1015-1024.
REFERENCES [29] Jo, D., & Kim, G. J. (2016). ARIoT: scalable augmented reality framework for
interacting with Internet of Things appliances everywhere. IEEE Transactions on
[1] Keim, D., Andrienko, G., Fekete, J., Görg, C., Kohlhammer, J. and Melançon, G.
Consumer Electronics, 62(3), 334-340.
(2008). Visual Analytics: Definition, Process, and Challenges. Lecture Notes in
[30] Michalakis, K., Aliprantis, J., & Caridakis, G. (2018). Visualizing the internet of
Computer Science, pp.154-175.
things: Naturalizing human-computer interaction by incorporating ar features.
[2] Sun, G.D., Wu, Y.C., Liang, R.H., Liu, S.X. (2013) A survey of visual analytics
IEEE Consumer Electronics Magazine, 7(3), 64-72.
techniques and applications: State-of-the-art research and future challenges. J.
[31] Lee, E. A. (2008, May). Cyber physical systems: Design challenges. In 2008 11th
Comput. Sci. Technol. 28(5), 852–867
IEEE International Symposium on Object and Component-Oriented Real-Time
[3] De Paolis, L. T., De Luca, V., & Paiano, R. (2018) Sensor Data collection and
Distributed Computing (ISORC) (pp. 363-369). IEEE.
analytics with ThingsBoard and Spark Streaming. IEEE Workshop on
[32] Baheti, R., & Gill, H. (2011). Cyber-physical systems. The impact of control
Environmental, Energy, and Structural Monitoring Systems (EESMS) (pp. 1-6).
technology, 12(1), 161-166.
[4] Keim, D., Kohlhammer, J., Ellis, G., Mansmann, F. (2010) Mastering the
[33] Zgheib, R., Conchon, E., & Bastide, R. (2017). Engineering IoT healthcare
Information Age-Solving Problems with Visual Analytics. Eurographics
applications: towards a semantic data driven sustainable architecture. In eHealth
Association
360° (pp. 407-418). Springer, Cham.
[5] Wang, X.M., Zhang, T.Y., Ma, Y.X., Xia, J., Chen, W. (2016) A survey of visual
[34] Pan, G., Qi, G., Zhang, W., Li, S., Wu, Z., & Yang, L. T. (2013). Trace analysis
analytic pipelines. J. Comput. Sci. Technol. 31(4), 787–804
and mining for smart cities: issues, methods, and applications. IEEE
[6] Keim D., Hao M. C., Dayal U. (2002) Hierarchical pixel bar charts. IEEE
Communications Magazine, 51(6), 120-126.
Transactions on Visualization and Computer Graphics, 8(3): 255-269.
[35] Rathore, M. M., Ahmad, A., Paul, A., & Jeon, G. (2015, November). Efficient
[7] Tatu A., Albuquerque G., Eisemann M. et al. (2011) Automated analytical
graph-oriented smart transportation using internet of things generated big data.
methods to support visual exploration of high-dimensional data. IEEE
In 2015 11th International Conference on Signal-Image Technology & Internet-
Transactions on Visualization and Computer Graphics, 17(5): 584-597.
Based Systems (SITIS) (pp. 512-519). IEEE.
[8] Turkay C., Lundervold A., Lundervold A. J., Hauser H. (2012) Representative
[36] Kalamaras, I., Zamichos, A., Salamanis, A., Drosou, A., Kehagias, D. D.,
factor generation for the interactive visual analysis of high-dimensional data.
Margaritis, G., ... & Tzovaras, D. (2017). An interactive visual analytics platform
IEEE Transactions on Visualization and Computer Graphics, 18(12): 2621-2630.
for smart intelligent transportation systems management. IEEE Transactions on
[9] Lu Z., Liu C., Zhang Q., Zhang C., Fan D., Yang P. (2013) Visual analytics for
Intelligent Transportation Systems, 19(2), 487-496.
the clustering capability of data. Science China Information Sciences, 56(5):
[37] Chren, S., & Buhnova, B. (2016, October). Local load optimization in smart grids
052110(14).
with Bayesian networks. In 2016 IEEE International Conference on Systems,
[10] Keim D., Kriegel H. P. (1996) Visualization techniques for mining large
Man, and Cybernetics (SMC) (pp. 004021-004027). IEEE.
databases: A comparison. IEEE Transactions on Knowledge and Data
[38] Emmanuel, M., & Rayudu, R. (2017). Evolution of dispatchable photovoltaic
Engineering, 8(6): 923-938.
system integration with the electric power network for smart grid applications: A
[11] Wong P. C., Foote H., Adams D., Cowley W., Thomas J. (2003) Dynamic
review. Renewable and Sustainable energy reviews, 67, 207-224.
visualization of transient data streams. In Proceedings of the Annual IEEE
[39] Collier, S. E. (2016). The emerging enernet: Convergence of the smart grid with
Conference on Information Visualization (INFOVIS). 97–104.
the internet of things. IEEE Industry Applications Magazine, 23(2), 12-16.
[12] Tavel, P. (2007) Modeling and simulation design, AK Peters Ltd. Natick, MA
[40] Jaradat, M., Jarrah, M., Bousselham, A., Jararweh, Y., & Al-Ayyoub, M. (2015).
[13] Chen P. (2019) Visualization of real-time monitoring datagraphic of urban
The internet of energy: smart sensor networks and big data management for smart
environmental quality. EURASIP Journal on Image and Video Processing 2019,
grid.
1 (2019), 42.
[41] Talari, S., Shafie-Khah, M., Siano, P., Loia, V., Tommasetti, A., & Catalão, J. P.
[14] Li H., Fan H., Mao F. (2016) A visualization approach to air pollution data
(2017). A review of smart cities based on the internet of things concept. Energies,
exploration - a case study of air quality index (PM2.5) in Beijing, China.
10(4), 421.
Atmosphere 7, 3, 35.
[42] Bikakis, N. (2018). Big data visualization tools. arXiv preprint arXiv
[15] Lu, W., Ai, T., Zhang, X., & He, Y. (2017). An interactive web mapping
:1801.08336.
visualization of urban air quality monitoring data of China. Atmosphere, 8(8),
148.
EPESec 2020, August, 2020, Dublin, Ireland A. Protopsaltis et al.

[43] Jarrah Nezhad, A., Wijaya, T. K., Vasirani, M., & Aberer, K. (2014). SmartD: [66] Nobre, G. C., & Tavares, E. (2017). Scientific literature analysis on big data and
Smart meter data analytics dashboard. In Proceedings of the 5th international internet of things applications on circular economy: a bibliometric study.
conference on Future energy systems (pp. 213-214). Scientometrics, 111(1), 463-492.
[44] Cheng, B., Longo, S., Cirillo, F., Bauer, M., & Kovacs, E. (2015). Building a big [67] Bilal, M., Oyedele, L. O., Qadir, J., Munir, K., Ajayi, S. O., Akinade, O. O., ... &
data platform for smart cities: Experience and lessons from santander. In 2015 Pasha, M. (2016). Big Data in the construction industry: A review of present
IEEE International Congress on Big Data (pp. 592-599). IEEE. status, opportunities, and future trends. Advanced engineering informatics, 30(3),
[45] Gomes, E., Dantas, M. A., de Macedo, D. D., De Rolt, C., Brocardo, M. L., & 500-521.
Foschini, L. (2016). Towards an infrastructure to support big data for a smart city [68] Armengaud, E., Sams, C., Von Falck, G., List, G., Kreiner, C., & Riel, A. (2017).
project. In 2016 IEEE 25th International Conference on Enabling Technologies: Industry 4.0 as digitalization over the entire product lifecycle: Opportunities in
Infrastructure for Collaborative Enterprises (WETICE) (pp. 107-112). IEEE. the automotive domain. In European Conference on Software Process
[46] Moreno, M. V., Terroso-Sáenz, F., González-Vidal, A., Valdés-Vela, M., Improvement (pp. 334-351). Springer, Cham.
Skarmeta, A. F., Zamora, M. A., & Chang, V. (2016). Applicability of big data [69] Thalmann, S., Mangler, J., Schreck, T., Huemer, C., Streit, M., Pauker, F., ... &
techniques to smart cities deployments. IEEE Transactions on Industrial Vukovic, M. (2018). Data analytics for industrial process improvement a vision
Informatics, 13(2), 800-809. paper. In 2018 IEEE 20th Conference on Business Informatics (CBI) (Vol. 2, pp.
[47] Cheng, J., Wu, W., Cao, J., & Li, K. (2016). Fuzzy group-based intersection 92-96). IEEE.
control via vehicular networks for smart transportations. IEEE Transactions on [70] Yin, S., & Kaynak, O. (2015). Big data for modern industry: challenges and
Industrial Informatics, 13(2), 751-758. trends [point of view]. Proceedings of the IEEE, 103(2), 143-146.
[48] Tsitsiroudi, N., Sarigiannidis, P., Karapistoli, E., & Economides, A. A. (2016). [71] Chandola, V., Banerjee, A., & Kumar, V. (2009). Anomaly detection: A survey.
EyeSim: A mobile application for visual-assisted wormhole attack detection in ACM computing surveys (CSUR), 41(3), 1-58.
IoT-enabled WSNs. In 2016 9th IFIP Wireless and Mobile Networking [72] Fanaee-T, H., & Gama, J. (2016). Tensor-based anomaly detection: An
Conference (WMNC) (pp. 103-109). IEEE. interdisciplinary survey. Knowledge-Based Systems, 98, 130-147.
[49] Janetzko, H., Stoffel, F., Mittelstädt, S., & Keim, D. A. (2014). Anomaly [73] Hodge, V., & Austin, J. (2004). A survey of outlier detection methodologies.
detection for visual analytics of power consumption data. Computers & Graphics, Artificial intelligence review, 22(2), 85-126.
38, 27-37. [74] Chae, J., Thom, D., Bosch, H., Jang, Y., Maciejewski, R., Ebert, D. S., & Ertl, T.
[50] Kyriazis, D., Varvarigou, T., White, D., Rossi, A., & Cooper, J. (2013). (2012). Spatiotemporal social media analytics for abnormal event detection and
Sustainable smart city IoT applications: Heat and electricity management & Eco- examination using seasonal-trend decomposition. In 2012 IEEE Conference on
conscious cruise control for public transportation. In 2013 IEEE 14th Visual Analytics Science and Technology (VAST) (pp. 143-152). IEEE.
International Symposium on" A World of Wireless, Mobile and Multimedia [75] Liao, Z., Yu, Y., & Chen, B. (2010). Anomaly detection in GPS data based on
Networks"(WoWMoM) (pp. 1-5). IEEE. visual analytics. In 2010 IEEE Symposium on Visual Analytics Science and
[51] ul Hasan, N., Ejaz, W., Baig, I., Zghaibeh, M., & Anpalagan, A. (2016). QoS- Technology (pp. 51-58). IEEE.
aware channel assignment for IoT-enabled smart building in 5G systems. In 2016 [76] McKenna, S., Staheli, D., Fulcher, C., & Meyer, M. (2016). Bubblenet: A cyber
Eighth International Conference on Ubiquitous and Future Networks (ICUFN) security dashboard for visualizing patterns. In Computer Graphics Forum (Vol.
(pp. 924-928). IEEE. 35, No. 3, pp. 281-290).
[52] Tu, C., He, X., Shuai, Z., & Jiang, F. (2017). Big data issues in smart grid–A [77] Thom, D., Bosch, H., Koch, S., Wörner, M., & Ertl, T. (2012). Spatiotemporal
review. Renewable and Sustainable Energy Reviews, 79, 1099-1107. anomaly detection through visual analysis of geolocated twitter messages. In
[53] Childs, H., Geveci, B., Schroeder, W., Meredith, J., Moreland, K., Sewell, C., ... 2012 IEEE Pacific Visualization Symposium (pp. 41-48). IEEE.
& Bethel, E. W. (2013). Research challenges for visualization software. [78] Endert, A., Ribarsky, W., Turkay, C., Wong, B. W., Nabney, I., Blanco, I. D., &
Computer, 46(5), 34-42. Rossi, F. (2017). The state of the art in integrating machine learning into visual
[54] Stojkoska, B. L. R., & Trivodaliev, K. V. (2017). A review of Internet of Things analytics. In Computer Graphics Forum (Vol. 36, No. 8, pp. 458-486).
for smart home: Challenges and solutions. Journal of Cleaner Production, 140, [79] Batista, A. F., Correa, P. L., & Palanisamy, G. (2016). Visual analytics improving
1454-1464. data understandability in IoT projects: An overview of the US DOE ARM
[55] Moreno, M. V., Zamora, M. A., & Skarmeta, A. F. (2015). An IoT based program data science tools. In 2016 IEEE 13th International Conference on
framework for user–centric smart building services. International Journal of Web Mobile Ad Hoc and Sensor Systems (MASS) (pp. 349-354). IEEE.
and Grid Services, 11(1), 78-101. [80] Lv, Z., Li, X., Zhang, B., Wang, W., Zhu, Y., Hu, J., & Feng, S. (2016). Managing
[56] Donalek, C., Djorgovski, S. G., Cioc, A., Wang, A., Zhang, J., Lawler, E., ... & big city information based on WebVRGIS. IEEE access, 4, 407-415.
Davidoff, S. (2014). Immersive and collaborative data visualization using virtual [81] Akoglu, L., Tong, H., & Koutra, D. (2015). Graph based anomaly detection and
reality platforms. In 2014 IEEE International Conference on Big Data (Big Data) description: a survey. Data mining and knowledge discovery, 29(3), 626-688.
(pp. 609-614). IEEE. [82] Cuffe, P., & Keane, A. (2015). Visualizing the electrical structure of power
[57] Baranwal, T., & Pateriya, P. K. (2016). Development of IoT based smart security systems. IEEE Systems Journal, 11(3), 1810-1821.
and monitoring devices for agriculture. In 2016 6th International Conference- [83] Bhattarai, B. P., Paudyal, S., Luo, Y., Mohanpurkar, M., Cheung, K., Tonkoski,
Cloud System and Big Data Engineering (Confluence) (pp. 597-602). IEEE. R., ... & Manic, M. (2019). Big data analytics in smart grids: state-of-the-art,
[58] Brun-Laguna, K., Diedrichs, A. L., Chaar, J. E., Dujovne, D., Taffernaberry, J. challenges, opportunities, and future directions. IET Smart Grid, 2(2), 141-154.
C., Mercado, G., & Watteyne, T. (2016). A demo of the PEACH IoT-based frost [84] Munshi, A. A., & Yasser, A. R. M. (2017). Big data framework for analytics in
event prediction system for precision agriculture. In 2016 13th Annual IEEE smart grids. Electric Power Systems Research, 151, 369-380.
International Conference on Sensing, Communication, and Networking [85] Kind, A., Stoecklin, M. P., & Dimitropoulos, X. (2009). Histogram-based traffic
(SECON) (pp. 1-3). IEEE. anomaly detection. IEEE Transactions on Network and Service Management,
[59] Perozzi, B., & Akoglu, L. (2018). Discovering communities and anomalies in 6(2), 110-121.
attributed graphs: Interactive visual exploration and summarization. ACM [86] Laskov, P., Rieck, K., Schäfer, C., & Müller, K. R. (2005). Visualization of
Transactions on Knowledge Discovery from Data (TKDD), 12(2), 1-40. anomaly detection using prediction sensitivity. Sicherheit 2005, Sicherheit–
[60] Luo, Y., Qin, X., Tang, N., & Li, G. (2018). Deepeye: Towards automatic data Schutz und Zuverlässigkeit.
visualization. In 2018 IEEE 34th International Conference on Data Engineering [87] Lin, J., Keogh, E., & Lonardi, S. (2005). Visualizing and discovering non-trivial
(ICDE) (pp. 101-112). IEEE. patterns in large time series databases. Information visualization, 4(2), 61-82.
[61] Cao, N., Shi, C., Lin, S., Lu, J., Lin, Y. R., & Lin, C. Y. (2015). Targetvue: Visual [88] Nga, D. V., See, O. H., Xuen, C. Y., & Chee, L. L. (2012). Visualization
analysis of anomalous user behaviors in online communication systems. IEEE techniques in smart grid. Smart Grid and Renewable Energy, 3(03), 175.
transactions on visualization and computer graphics, 22(1), 280-289. [89] Saggi, M. K., & Jain, S. (2018). A survey towards an integration of big data
[62] Zhou, F., Huang, W., Zhao, Y., Shi, Y., Liang, X., & Fan, X. (2015). ENTVis: A analytics to big insights for value-creation. Information Processing &
visual analytic tool for entropy-based network traffic anomaly detection. IEEE Management, 54(5), 758-790.
computer graphics and applications, 35(6), 42-50. [90] Ge, M., Bangui, H., & Buhnova, B. (2018). Big data for internet of things: A
[63] Cao, N., Lin, C., Zhu, Q., Lin, Y. R., Teng, X., & Wen, X. (2017). Voila: Visual survey. Future generation computer systems, 87, 601-614.
anomaly detection and monitoring with streaming spatiotemporal data. IEEE [91] Ali, S. M., Gupta, N., Nayak, G. K., & Lenka, R. K. (2016, December). Big data
transactions on visualization and computer graphics, 24(1), 23-33. visualization: Tools and challenges. In 2016 2nd International Conference on
[64] Xu, P., Mei, H., Ren, L., & Chen, W. (2016). ViDX: Visual diagnostics of Contemporary Computing and Informatics (IC3I) (pp. 656-660). IEEE.
assembly line performance in smart factories. IEEE transactions on visualization [92] Marjani, M., Nasaruddin, F., Gani, A., Karim, A., Hashem, I. A. T., Siddiqa, A.,
and computer graphics, 23(1), 291-300. & Yaqoob, I. (2017). Big IoT data analytics: architecture, opportunities, and open
[65] Yang, L., Ding, C., Wu, M., & Wang, K. (2017). Robust detection of false data research challenges. IEEE Access, 5, 5247-5261.
injection attacks for data aggregation in an Internet of Things-based [93] Zheng, Z., Zhu, J., & Lyu, M. R. (2013). Service-generated big data and big data-
environmental surveillance. Computer Networks, 129, 410-428. as-a-service: an overview. In 2013 IEEE international congress on Big Data (pp.
403-410). IEEE.

View publication stats

You might also like