DANUBE DELTA NATIONAL

INSTITUTE FOR RESEARCH AND

DEVELOPMENT

SMARTSENSE
Technological Framework for Sustainable
Research and Promotion of Tourist areas
using Innovative Techniques for
Computerized Visualization and Audio-
Visual Recognition

Marius Ivanov, ALTFACTOR

THE 30-th SCIENTIFIC SYMPOSIUM

JUNE 05 - 09, 2023
TULCEA, ROMANIA
SECTION IV - GIS
Who is ALTFACTOR?

We are an IT company with 23 years of experience

in custom software development. Our specialization
is the development of custom web and mobile
application. We have a great amount of experience
in developing educational software, interactive
multimedia simulations, as well as applications for
Virtual Reality and Augmented Reality. We also
have ongoing research projects in which we gain
excellent knowledge of data analysis and
processing using machine-learning algorithms and
Artificial Intelligence.

SECTION IV - GIS
Our business lines
1. RESEARCH, DEVELOPMENT & INNOVATION – We are a
company that accesses European funding to generate both
new products and services as well as new partnerships
through applied research: 10+5 projects financed from EU
funds.

2. VIRTUAL & AUGMENTED REALITY SIMULATIONS

–EDU-VR is the brand under which we create interactive
simulations in VR;
–SMARTSENSE is the project in which we create a set of
innovative applications in the field of tourism, using AR;
3. E-LEARNING – We offer custom designed and built educational software tailored to each client's
particular requirements. When someone needs a multimedia educational material that is interactive and
well-made, that's where we come in!
SECTION IV - GIS
What is SmartSense?

SmartSense is an innovative, software platform, consisting of a suite of software applications based on

modern visualization technologies, audio-visual recognition and IOT components, in order to support and
improve tourism and research activities in the Danube Delta area.

The SmartSense application is centered around the notion of "experience", offering the tourist the
opportunity to interact with the environment without having a negative impact on it, by adding virtual
information and interactions over the real environment.

In addition, SmartSense monitors weather conditions, air and water quality parameters and notifies users
about all of them.

SmartSense is available to users both as a web platform, and as mobile applications for smartphones.

SECTION IV - GIS
About SMARTSENSE Project

Co-funded with EU funds.

Priority Axis 2 "Information and Communication Technology

(ICT) for a competitive digital economy" Specific objective
2.2. "Increasing the ICT sector's contribution to economic
competitiveness" Action 2.2.1 "Supporting the increase in
added value generated by the ICT sector and innovation in
the field through the development of clusters", call
POC/524/2/2

PROJECT NAME: "SMARTSENSE - Technological

framework for research and sustainable promotion of tourist
areas using innovative techniques of computer visualization
and audio-visual recognition", MySMIS Code 128963
SECTION IV - GIS
 SmartSense components

Multilayer interactive map

The component for the simultaneous visualization of various heterogeneous categories of information - points of interest, experiences, meteorological
parameters, etc. This component leverages modern web technologies such as React framework and Open Street Maps.
User dashboard
The user's control panel, used to manage the points of interest and own experiences in the SmarSense platform. The user dashboard also displays
the user’s personal data.
The IOT component for acquiring data from environmental sensors
It allows the visualization of meteorological parameters from sensors located in the Danube Delta, the execution of personalized queries, as well as
the downloading of data in different formats. The data is collected by professional weather stations located in key points across the Danube Delta.
Augmented reality
The SmartSense mobile application allows interaction with digital augmented elements placed in the environment. Augmented experiences within the
application use the technical principle of recognizing objects or geographic coordinates (GPS) that will be overdefined, in real time, with AR elements.
Visual recognition
Using the mobile phone camera, images and markers used as targets are detected, over which 2D and/or 3D digital content can be displayed. The
markers or images can also store hidden content that is decoded by the app and displayed to the user.
Audio recognition
The module for capturing sounds and identifying bird species by their song, using the SmartSense mobile application. This module leverages
machine learning and AI technologies to process and analyze the bird sounds captured by the mobile device microphone.

SECTION IV - GIS
Multilayer
interactive map
In the interactive multilayer map, the user can
access and view different categories of
information. For example, the location of
geographical points where he can find
information about the flora and fauna of the
area, virtual tourist signs, or environmental
conditions can be also found. Also, the map
has a layer on which the user will find points of
interest from the gastronomic or hotel field.
The interactive map uses the GPS technology
of the mobile phone to display the most
relevant results related to the user's current
position.
The map communicates with the server
through the secure API and updates the data in
real time.
SECTION IV - GIS
User
dashboard
This is an administration panel, so the
users can manage their experiences
and points of interest.
The local community can contribute to
the variety of experiences, having the
opportunity to define and personalize
new experiences and points of interest
accessible to tourists.
Tourists have at their disposal a system
for reviewing and scoring their
experiences, to add a higher degree of
interactivity and connectivity between
the users of the SmartSense platform.

SECTION IV - GIS
The IOT component for acquiring
data from environmental sensors

The Smartsense framework has a range of IoT

sensors, including temperature, humidity, atmospheric
pressure, solar radiation, water and air quality sensors.
These sensors generate continuous streams of data,
which are collected and stored on the servers and are
displayed to the users or processed for classification
and predictions.
Visitors can access real-time information on weather
conditions, water and air quality, allowing them to
make informed decisions about their activities in the
Danube Delta.

SECTION IV - GIS
Discover the Danube Delta
through augmented reality
The SmartSense application for mobile devices
allows the user access interesting experiences
using augmented reality technologies.
Augmented experiences use the technical principle
of recognizing objects or geographic coordinates
(GPS) and then augmenting them, in real time, with
three-dimensional graphics, or informational content
in the form of pictures, text, audio, video which will
be exposed to the user through screens of mobile
devices.

SECTION IV - GIS
Audio recognition -
Bird species identification
The audio recognition module allows the user to
identify bird species by their song using the
Smartsense application and the mobile phone's
microphone.
The analysis of the recorded sounds is done in real-
time, and the species with the highest probability of
producing the respective sound are displayed on the
mobile phone screen.

More about, from:

Beia Consult
International
SECTION IV - GIS
Conclusions

The SmartSense application, through the innovative

technologies it uses, can become a useful tool for local
communities, tourists and researchers who want to carry out
tourism, promotional, educational or research activities.

The SmartSense software & hardware framework is

customized for the Danube Delta biosphere, but has the
possibility of customization for any touristic or natural area.

SECTION IV - GIS
 THANK
YOU

SECTION IV THE 30-th SCIENTIFIC SYMPOSIUM - JUNE 05-09, 2023 - TULCEA, ROMANIA
- GIS