You are on page 1of 6

2015 11th International Conference on Signal-Image Technology & Internet-Based Systems

Indoor Navigation System for Vision-impaired Individual


An Application on Android Devices
Varit Prudtipongpun, Wirawan Buakeaw, Thorntita Rattanapongsen, Mingmanas Sivaraksa
Computer Engineering, Mahidol University
Phuttamonton, Nakorn Pathom, Thailand
varit_2005@hotmail.com, Mobu2ty@gmail.com , eyez12744@gmail.com, mingmanas.siv@mahidol.ac.th

Abstract— The number of vision disability individuals has


been increasing continuously, including those who are II. LITERATURE REVIEW
totally blind and have low vision. Technology has become a A. Wi-Fi Positioning System
big part of aiding these people but most of the equipments
do not provide enough utility and convenience. One of the The Wi-Fi positioning system uses the strength of
major problems for those visually impaired individuals is to Wi-Fi signal (RSSI) from the wireless access point (AP)
navigate through indoor buildings without having extra by measuring the intensity of the received signal [1]. The
equipment or devices with them. Currently, there is location of the indoor position will be calculated based on
technology for outdoor navigation, such as Google Maps, the intensity of the Wi-Fi and revert this intensity back to
however navigating through indoor buildings requires the distance of the location to the access point. The
further development. This research is developed an further the location to the Wi-Fi access point the lower
application on a mobile device, being used widely in this the intensity will be. If the location can receive more than
group of people, with available sensors provided on the
one signal, it can combine the intensity from all access
devices. Therefore no extra equipment are needed for those
visually impaired individuals. The application is a prototype points to calculate the location more precisely. The
and has been tested to navigate successfully in a single floor accuracy based on the number of accessed point collected
of a building. in the database. However, this method needs the access to
the MAC address of the access point which many

Keywords- Application on Android, Indoor navigator, Vision building keeps the address private for security reasons
disability individua aid, Indooratlas, Voice command; [1].
I. INTRODUCTION B. Indoor Navigation with RFID
With the increasing numbers of visually impaired The radio frequency identification (RFID) is applied
individuals, not only blindness but also low-vision or to differentiate the location of the object, using the RFID
night blindness, there are limited technology to support tags attached in the different locations [2] [3]. Each RFID
them. Even though, the technology has become more tag will be attached to different objects on the way inside
advance and provide more tools to aid this group of the building for navigation. The user will have stick with
people, but it usually comes in high cost. Moreover, an RFID reader to navigate inside the building. If the
different tools are designed for different purposes; hence RFID tag is detected the reader attached to the walking
it is becoming difficult for those individuals to take all stick can tell where the location precisely with the
aiding devices with them all the time. proximity of 10-15 metres.
Smart phones are being used widely among those For navigation, the walking stick can communicate
people with vision disability since they provide an all-in- with the server to calculate the shortest path of the
one ability that can run different applications for many location to the destination easily with the shortest path
different purposes in a single device. [2].
One of the obstacles in daily life for visually impaired This method, however, needs to install RFID tag to
people is to navigate from one place to another, especially many different locations prior to the start of the
in new places they have never been before. Even though, navigation. It requires skill to properly locate the location
most smart phones provide many applications with GPS to be able to precisely navigate without problems.
access for navigation. However GPS signal cannot be Furthermore, RFID tags will require extra cost and the
accessed inside the building and this becomes one of the RFID reader device will be an extra object that the users
problems for most visually impaired people to be able to have to carry.
navigate easily inside the building.
Additionally, mobile phones are now more capable The previous research has shown that extra devices
with a special feature designed especially for them. The and extra information are needed to be able to navigate.
feature is called an “accessibility mode” that provides Our research will use only a single mobile device for
voice over for all texts and some icons on screen which navigation.
allow the users to interact with the mobile phones.
This paper proposed a prototype application on
Android mobile devices to navigation from one place to
another inside the building.

978-1-4673-9721-6/15 $31.00 © 2015 IEEE 633633


DOI 10.1109/SITIS.2015.66

Figure 2: The example shortest paath calculation of the Dijkstra's
Figure 1: Floor Plan in IndoorAtlas. The grey paaths are collected data algorithhm
and the black dots are validated paths (ready for navigate)

III. METHODOLOGY
Y
The application uses the third flooor of Engineering
building, Mahidol University as the proototype location. It
can navigate from every location to alll 22 rooms on that
floor. The application uses a few methodologies to
complete the application.
A. IndoorAtlas
IndoorAtlas uses the uniqe megnetiic value found in
each location to determine the positioon inside the map
Figure 3 Example of noddes marked on the map, including
with great accuracy, without using external or extra corners, edges,, and rooms
accessories [4]. The location is storeed on IndoorAtlas
service database[4]. IndoorAtlas requirees a graphical map Additional nodes, rather thhan the ones in front of all
provided by the user to the system. Too create a map file, 22 rooms, are at the corner and at edges of the map,
the users will need to have a simple picture with floor ranging from the node labeledd A to AP. The example of
plans and uploaded to the system. The positioning
p is done marked nodes that are used in i the system is shown in
by the map creater walking on predefineed routes to record Figure 3Figure 3.
the megnetic fingerprint of the location.. The map creaters
C. Google Voice Recognition
will have to test and validate the fingerprint
fi data to
confirm the position. The Google voice API iss a free online service by
After the positioning of the locationn is confirmed, the Google [7] to translate the recceived voice to text. Further
map is ready to use for navigation. Figure
F 1 hows the to its capability of translatting voice from multiple
confirmed path that the system has recoorded the magnetic languages into text messagees; it also provides with
fingerprint of all locations. Once the location is overlay user interface which makes
m it very useful but does
confirmed, the system can now locate thhe current position not disturb the main program m. The service provides the
of the user. ability to directly take the voicce from the microphone and
send to the online service, withh a language parameter, and
B. Dijkstra’s Algorithm a translated ‘text’ is passed baack to the sender, allowing
Dijkstra’s algorithm [5][6] is inventted by a computer our application to process thhe text received from the
scientist, named Edsger Dijkstra in 1959. The idea is to service to determine the dessignated location from the
solve the shortest path problem to travell from one place to users.
the others by iteratively search for thee smallest distance
found from neighboring nodes. Figgure 2 shows the IV. THE FLOW OF THE APPLICATION
resulting example from calculating the shortest path with The flowchart of the navigaation is shown in Figure 4.
Dijkstra’s algorithm from a node a. The shortest path The flow of the application is divided
d into 5 steps, A.-E.
from node a to node d has changed froom 6 to 5 because
node d is connecting to node a directly and the distance is
A. Locate the current locationn
6. After finding that node b gives the shhortest path to node
a with the distance 3 and node d is the neighbor
n of node b The application will commuunicate with IndoorAtlas to
with the distance 2. Therefore, the final shortest path from determine the current location and marked the location on
a to d is changed to 5, calculating from 3 + 2. w in Figure 5.
the application screen, as show
In this research, different nodes are marked in a map. This process will take a slight amount of time to
All destination rooms will have a node located in front of initialise the starting locatioon. Once the location is
them so that the Dijkstra’s algorithm can c be applied for confirmed it will notify the useer with the command of the
searching for the shortest route from onne place to the final first move for navigation.
destination.

634634
the users can start inputing the destination with their
Start(login
n) voice.

Locate the cuurrent


positionn

Choose the
t
destination
History
Navigatiion

Arrival at deestination

Figure 6 The choice of destinatioon can be done by clicking the


Stop
p destination room on the screen(left) or use your vice to choose the
destinationn(right)

Figure 4: The application archiitecture.

Figure 5: The blue dot inside the circle shows the current location
determined by the IndoorAtllas

B. Choose the destination


To start navigating, users can select destination by
Figure 7 The confirmed location afterr the voice command has translate
tapping the “Room” button and the meenu will popup, as to location into
i text.
shown in the left panel of Figure 6.
This menu allows the user to chooose the destination For example, a user can sayy “R302” (in either English
from all 22 rooms provided on that floor. or Thai), the program will sennd the voice too the Google
This part is compatible with the accessibility
a mode voice service. After the application received the
provided in all Android devices to readd out the text from translation the confirmation menu
m will bepromted, shown
the provided screen. After tapping on each room button, in Figure 7.
the room name will be read so that thhe user can choose In the accessibility moode, the confirmed room
the room from the screen directly. number will be read and the vooice will be alerted after the
Addition to the normal mode of navvigation, the voice room number is found. So that users can reassured of the
mode is also available in the applicationn. The user can tap destination room.
the “Voice” button then the Google VoiceV Recognition
screen will be popuped. After the ready sound, “beep”,

635635
C. Navigation
The system will determine the neearest node to the
user’s current location. When a user reqquest a navigation,
the Dijkstra’s algorithm will be usedd to calculate the
shortest path from that nearest node of o the user to the
destination node.
The application will use the comppass of the mobile
phone to determine the direction of thee user therefore the
proper adjustment for the direction foor the user can be
done. The adjustment of the direction is particularly
important since visually impaired inddividual can never
know that the location they are facing to. They can
accidently face to the wall without knnowing, the proper
adjustment is very important to avoidd any unexpected
accidents.
When the navigation is active, the screen will show Figure 8:Navigation guiddeline shown on the screen.
green arrows on the map pointing towarrds next upcoming
nodes. The path showing in the applicaation is always the
shortest path since the program runs Dij ijisktra’s algorithm
for every movement of the user. Additioonally the user will
receive voice explaining of the next stepp they will have to
do. For example, from node A to B is a straight line. The
programs will play the voice of “Go straaight for [distance]
meter”. The greens arrows will continuee pointing until the
destination is reached, as shown in Figgure 8. The tipping
point of the arrow is the location of the t nodes that the
users need to walk through. The imporrtant nodes are the
node at the corner, which will give the sudden change of
the direction. These nodes will dettermine from the
direction of the user whether the right turn
t or the left turn
will be made.
Even though, the navigation arrows cannot
c seen by the
visually blind people, it could be useed by people with
normal vision but not used to the loocation inside the
building.
However, the navigator for the blinnd could not be
completed without voice navigation. In this step, the route
will be explained in voice telling the user continuously
how to move from that particular locatioon to the next.
The voice used for navigation is separated into
different formats as:
• Straight line navigation: The system will repeat
voice navigation in every siix steps. After the
sixth step is reached, thhe program will Figure 9 The complete naviigation of a single route
recalculate the route and thhe give remaining
distance in metres to the deestination or to the
next turning point. D. Arrival to the destination
• Corner approching: Whenn the user is When the user is in thee surrounding area to the
approaching the corner, the program will destination node, the system will determine the user’s
immediately tells the user too turn left or right direction and the destination. The
T system will give a voice
without waiting for the step count.
c command to either turn left or right to allow the user to
• Incorrect direction: When the user walks in the face to the correct direction too the room. Figure 9Figure 9
incorrect direction 180 deggrees compared to shows the complete navigatioon of a single route to the
the calculated path, thee voice “Wrong final location.
direction, please turn back” alarms.
a After the complete navigatioon, the system will remove
• End of the map: When the usser walks in to the navigation system and the recommended path from the
end of the map, the voice “End of the map” screen.
will be warned.

636636
E. Login and history V. EVALUATIONS
The login system allow multiple users to login and To evaluate the applicattion two experiments are
view their navigation history with detaails. The login and designed to test both the efficiiency of the program to aid
the register page are shown in Figure 10. The register the navigation of the users andd the satisfaction of the user
page allow a new user to fill in their namme with user name to the application. The firstt experiment is tested on
and password to be able to store their navigation subjects in two groups; peoople who are new to the
information in the database. Once the usser asked to record location and the visual impaireed people who are also new
the location, the application can keep their location and to the location. The experimennt is tested repeatedly from
the time record. the started location, R301/2 to t 9 other different rooms,
Figure 11 shows two different useers who have their numbering with the alphabet ‘A A’ –‘J’.
history stored inside the applicatioon. The right of The navigation time of eacch person to all locations is
u “new”. 
Figure11 shows the detailed record of user recorded. The summary of thhe time record for the two
groups is shown in Table 1 foor those people who are not
Figure 11 shows the records of tim me and the location
used to the route and Table 2 for those who are visually
of the user have been to. The record of the
t location can be
impaired people.
kept all the time either the user uses thee navigation or not
For the first group, the average time consumed when
using. The symbol in the record is alsso shown as ‘O’ if using the application is 1.62 minutes
m while those who did
the navigation system is on during thhe record. On the not use the application take in average 2.06 minutes. With
other hand, the ‘N’ symbol is used whenn the destination is the application the group useed the application took 44
not on or the navigation is off. seconds or 21.77% lower on avverage.
After implementing this system on a cloud service, it
will allow rescue team to easily track annd find lost vision- TABLE 1: THE AVERAGE NAVIGATION N TIME OF PEOPLE WITH NORMAL
VISION BUT NOT USED TO THE BUILDDING, COMPARED BETWEEN USING
disability people who might have gone to wrong places or E APPLICATION.
THE APPLICATION AND NOT USING THE
possibly ouside of provided map area.
Destination Not usingg app. Using app.
(minn) (min)
A 0.3228 0.198
B 2.177 1.182
C 1.4554 1.038
D 1.0662 1.116
E 3.3882 2.336
F 2.2448 2.126
G 2.6882 2.208
H 2.855 2.192
J 2.399 2.148
average 2.066 1.62
TABLE 2: THE AVERGE NAVIGATION TIME
T OF PEOPLE WITH LOW VISION
 AND NOT USED TO THE BUILDING, COMPARED
C BETWEEN USING THE
Figure 10: The login and the regis ter page APPLICATION AND NOT USING THE APPLICATION.

Destination Not using app. Using app.


(minn) (min)
A 0.3006 0.246
B 2.118 1.378
C 1.3664 1.108
D 1.212 1.232
E 3.3336 3.128
F 3.2668 2.198
G 3.2662 2.322
H 3.0778 2.368
J 2.4888 2.296
average 2.277 1.81
Figure 11 The history page. (Left) The name of recorded userrs in the
sytem. (Right) The history of the usse "new".

637637
For the other group, the low vision people who do TABLE 4: THE AVERGE SCORE OF THE APPLICATION ANSWERED BY
NAVIGATION TIME OF PEOPLE WITH IMPAIRED VISION AND NOT USED TO
know in the building structures. An average time
THE BUILDING. THE SCORES ARE RANGED FROM 0-5.
consumed when walking with the application is 1.81
minutes while those who did not use the application took The convenience 4.4
2.27 minutes on average. To summarise, those who use User Interface is easy to understand 4
the application took 46 seconds or 19.92% lower on Choose Destination easily(With button) 4.2
average compared to the ones who did not use the Choose Destination easily(With voice 4.8
application and even faster than the normal vision people command)
who are not using the application. The result shows the The navigation is easy to understand 4.6
usefulness of the application in navigating inside the The accuracy 4.2
building. The time consumed is less for all people when The application can lead to the destination 4
using precisely
The other experiment uses a questionnaire to ask all The voice command to choose the room is 4.8
subjects of their experiences to the use of the application. accuracy
The questionnaire has been divided in 3 main topics. The The voice navigation is accurate 3.8
first one is the convenience to evaluate the ease of use Effectiveness 4.6
and ease of comprehension of the application. The second The effectiveness of the application compared 4.6
one is the accuracy to evaluate the accuracy based on the to not using the application.
user understanding. Lastly, the effectiveness is to evaluate Overall average 4.35
the effectiveness that users perceive from getting from the
application. Table 3 shows the result form the normal VI. CONCLUSION
vision people and Table 4 shows the answer from the From the results, we can conclude that our application
visually impaired people. The answers are giving in the can provide significant improvement to indoor navigating
score, ranging from 0-5. The most satisfactory score will experiences. This application is helpful and can aid
be 5 while the least satisfaction will be given 0. almost every group of vision disability individuals with
The overall average satisfactory score from the two great accuracy. However, there are still rooms for
groups are 4.58 and 4.35 respectively. The score from improvement for example; the voice instruction for
visually impaired people is less than the normal vision navigation can be improved to make visually impaired
people mainly in two topics. The first is the destination individual more comfortable with indoor navigation or
selection using button on the screen is difficult, which is with additional features like navigation between floors or
solved by the use of voice command with high score of automatically detect when user arrives to the service area.
satisfaction. The other topic is the accuracy of voice Additionally, the application requires constant internet
command. If compared to the normal vision people who connection for the use of indoorAtlas service for
found the voice command to be more accurate, it may positioning and Google voice recognition for voice
imply that the voice command is in fact accurate but the translation. Furthermore, the application cannot detect
voice instruction can give a slight delay. abnormal object or some changes after the map in initially
TABLE 3: THE AVERGE SCORE OF THE APPLICATION 1ANSWERED BY installed, the use of walking stick is highly recommended
NAVIGATION TIME OF PEOPLE WITH NORMAL VISION AND NOT USED TO for those with visually impaired problem.
THE BUILDING. THE SCORES ARE RANGED FROM 0-5.
REFERENCES
The convenience 4.65
[1] Y. Chen and H. Kobayashi, “Signal strength based indoor
User Interface is easy to understand 5 geolocation,” in Proceedings of the IEEE International Conference on
Choose Destination easily(With button) 4.8 Communications (ICC ’02), vol. 1, pp. 436–439, New York, NY, USA,
Choose Destination easily(With voice 4.8 April–May 2002.
command) [2] S. Chumkamon , P. Tuvaphanthaphiphat and P. Keeratiwintakorn
"A blind navigation system using RFID for indoor environments", Proc.
The navigation is easy to understand 4 5th Int. Conf. Electr. Eng./Electron. Comput. Telecommun. Inf.
The accuracy 4.46 Technol., vol. 2, pp.765 -768 2008
The application can lead to the destination 4.2 [3] J. Chen , Z. Li , M. Dong and X. Wang "Blind path identification
precisely system design base on RFID", Proc. Int. Conf. Electr. Control Eng.,
pp.548 -551 2010
The voice command to choose the room is 5 [4] Indooratlas.com, (2015). IndoorAtlas. [online] Available at:
accuracy https://www.indooratlas.com/ [Accessed 29 Nov. 2014].
The voice navigation is accurate 4.2 [5] H.C. Thomas, C. E. Leiserson, L.R. and C. Stein, (2001) "Section
24.3: Dijkstra's algorithm". Introduction to Algorithms (Second ed.).
Effectiveness 4.6
MIT Press and McGraw–Hill. pp. 595–601. ISBN 0-262-03293-7.
The effectiveness of the application compared 4.6 [6] Wikipedia, (2015). Dijkstra's algorithm. [online] Available at:
to not using the application. https://en.wikipedia.org/wiki/Dijkstras_algorithm [Accessed 17 Sep.
Overall average 4.58 2015].
[7] Google Developers, (2015). Overview of the Voice Interaction API.
[online] Available at: https://developers.google.com/voice-
actions/interaction [Accessed 17 Sep. 2015].

638638

You might also like