You are on page 1of 50

VISVESVARAYA TECHNOLOGICAL UNIVERSITY, BELAGAVI

Project final phase and seminar (16ECP81)


Report on

“SMART ASSISTIVE SHOES AND CANE TO GUIDE VISUALLY


CHALLENGED PERSONS USING ARDUINO MICROCONTROLLER”

Submitted in partial fulfillment of the requirement for the award of the degree of

Bachelor of Engineering
In
“Electronics & Communication Engineering”
Submitted by
1. Mr.SANDEEP YADAV R 1NC16EC068
2. Mr.SHAIK FEROJ 1NC16EC072
3. Mr.Y PAVAN KUMAR REDDY 1NC16EC096
4. Mr.MANOJ KUMAR G 1NC17EC402

Under the Guidance of


Dr.ROHITH S
Assoc. Professor,

DEPARTMENT OF ELECTRONICS & COMMUNICATION ENGINEERING

NAGARJUNA COLLEGE OF ENGINEERING AND TECHNOLOGY


(An Autonomous Institution under VTU, Belgavi-590014)
VENKATAGIRIKOTE, DEVANAHALLI, BENGALURU– 562164.
2019-2020
DEPARTMENT OF ELECTRONICS AND COMMUNICATION ENGINEERING

CERTIFICATE

This is to Certify that the project work entitled “Smart Assistive Shoes And Cane to Guide Visually
Challenged Persons Using Arduino Microcontroller” carried out by Mr. Sandeep Yadav (1NC16EC068),
Mr.Shaik Feroj (1NC16EC072), Mr.Y.Pavan Kumar Reddy (1NC16EC096), Mr.Manoj Kumar G
(1NC17EC402) a bonafied students of Nagarjuna College of Engineering and Technology in partial fulfillment
for the project work carried out by them for the course “Project Phase-3 and Seminar”During the year 2019-2020.

It is certified that all corrections/suggestions indicated for internal assessment have been incorporated in
the report and submitted to the department library. The project report has been approved, as it satisfies the
academic requirements of project final phase and seminar work.

Signature of the Guide Signature of the HOD Signature of the principal

Dr.Rohith S Dr. Nagesh K N Dr. Srikantamurthy K

Assoc. Professor Professor & HOD Principal

Internal/External Viva

Name of the Examiners Signature with date

1. Dr. Wilfred John Vaz


2. Dr. Premjyothi Patil
3. Prof. Bhavya V
ACKNOWLEDGEMENT

It is our proud privilege and duty to acknowledge the kind of help and guidance received from several people in
preparation of this report. It would not have been possible to prepare this report in this form without their valuable
help, co-operation and guidance.

We thank our coordinator Dr. ROHITH S, Assoc.Professor, Department of Electronics and Communication
Engineering, Nagarjuna College of Engineering and Technology for the valuable information given to us for the
Project.

We would like to thank Dr. NAGESH K N HOD, Department of Electronics and Communication Engineering,
Nagarjuna College of Engineering and Technology for his valuable suggestions and guidance throughout the period
of this Project.

It is indeed gratifying to have the privilege to express our sense of gratitude to our project coordinators Dr.
WILFRED JOHN VAZ, Dr. VENKATESH KUMAR H, Dr. PREMJYOTI PATIL, Dr. BASAVARAJ G M,
Dr. ROHITH S, for their scholarly guidance during the course of project work.

We wish our sincere gratitude to our beloved principal Dr. SRIKANTAMURTHY K, Nagarjuna College of
Engineering and Technology for constant support and encouragement in preparation of this Project and for making
library and laboratory facilities needed to prepare this Project.

We finally thank our Parents, all teaching and non-teaching faculty for providing us with unfailing support and
continuous encouragement throughout our years of study and through the process of researching of this Project.
This accomplishment would not have been possible without them.

Mr. SANDEEP YADAV R 1NC16EC068


Mr. SHAIK FEROJ 1NC16EC072
Mr. Y PAVAN KUMAR REDDY 1NC16EC096
Mr. MANOJ KUMAR G 1NC17EC402
ABSTRACT

This project aims to provide an acoustic assistance to the blind people to deal with the problems faced by
them to walk like the normal human beings. Thus, the project aims to develop a device that would serve as a
guiding assistance to blind people. This project focuses on designing a device for visual impaired (or blind)
people that would help them to travel independently and also with more ease.

The project consists of the smart shoes and the smart cane (stick) that alerts visually-impaired people over
obstacles coming between their ways and could help them in walking with less collision. The shoe module
consists of Arduino Nano, IR sensors to detect the obstacle, Bluetooth module and buzzer to alert the blind people
and Cane module consists Arduino Nano, Ultrasonic sensors to detect the direction of the obstacles, Bluetooth
module to connect with Smart shoe and Buzzers to alert them, this integration of the both modules will help the
visually challenged persons by guiding them to walk easily.
PREAMBLE
Chapter 1: Introduction

In this chapter we have given the introduction of Smart Assistive shoes and cane i.e. the challenges
that are facing by visually challenged persons that are to travel and access the information from the
competitive world and ours concern about how we developing a assistance for them.

Chapter 2: Literature survey

This is a chapter where we have analyzed and researched about the design and development of
humanoid robot from the results of already published paper, taking into account the various parameters of the
project and the extent of the project. This is the most important part of our report as it gives us a direction in
the area of our research.

Chapter 3: System requirement

In this chapter we mentioned the hardware and software requirements for the project.This chapter tells about
the hardware components and software used in the project like Arduino nano, buzzer, LCD display, Bluetooth
module, sensors, and the components specification, operating voltage, power used etc. and about the software
like collection of data or instructions that tell the module how to work. This is in contrast to physical hardware,
from which the system is built and actually performs the work based on the instructions given from the
software

Chapter 4: System design and implementation

This chapter includes Block diagram representation of a Smart shoe and cane, A block diagram is a diagram of
a development of a Shoe and Cane in which the principal parts or functions are represented by blocks
connected by lines that show the relationships between the blocks.

Chapter 5: System flowchart and algorithm.


.A flowchart is a type of diagram that represents a workflow of the working of a humanoid robot. A flowchart
can also be defined as a diagrammatic representation of an algorithm, a step-by-step approach to solving a task.
The flowchart shows the steps as boxes of various kinds, and their order by connecting the boxes with arrows.
This diagrammatic representation illustrates a solution model to a given problem. And The algorithm that we
are used to implement and this project.

Chapter 6: Result and Discussion

In this chapter we have discussed about the outcome of our project i.e. the result of our project that how the
robot has worked after the complete development and also the advantages of a Smart shoe and cane..

Chapter 7: Conclusion and Future work

Finally, in this chapter we state about what we have done in this project and include the future work of this
project.
TABLE OF CONTENT

Chapter No CHAPTER NAME PAGE NO


Abstract I
Table of Contents II
Chapter 1 Introduction 1
Overview
1.1 Problem Statement 2
1.2 Problem Justification 2
1.3 Objectives 2
Chapter 2 Literature Survey 3
Chapter 3 System Requirements 7
3.1 Hardware requirements 7
3.2 Software requirements 7
System Design and 8
Implementation
3.3 Arduino Nano 8
3.4 GPS 12
3.5 Power supply 14
3.6 Buzzer 15
3.7 Ultrasonic sensor 16
3.8 Bluetooth module 18
3.9 Voice recording chip 20
3.10 LCD 20
Chapter 4 Block Diagram 24
4.1 Shoe module 25
4.1 Cane module 26
Chapter 5 Flowchart and circuit 28
diagram
5.1 Flowchart 28
5.2 circuit diagram 30-31
Chapter 6 Result and Discussion 31
Chapter 7 Conclusion and Future 32
work
Advantages 33

Disadvantages 33

REFERENCES 34
APENDIX 35
Smart Assistive Shoes And Cane To Guide Visually Challenged Persons
2019-20

LIST OF FIGURES

FIGURE NO FIGURENAME PAGE NO

1. Graph of estimating the virtually disabled population 01


3.3.1 Arduino Nano 08
3.4.1 GSM module 13
3.5.1 12V battery 14
3.6.1 Buzzer 15
3.7.1 Ultrasonic sensor 16
3.8.1 Bluetooth module 18
3.9.1 Voice recorder chip 20
3.10.1 LCD 21
4.1.1 Block diagram of shoe module 24
4.2.1 Smart shoe 25
4.3.1 Block diagram of cane module 26
4.4.1 Smart cane 27
5.1.1 Flow chart 28
5.2.1 Circuit diagram of shoe module 29
5.2.2 Circuit diagram of cane module 30
6.1.1 Result of cane module 36
6.1.2 Result of shoe module 37

DEPT. ECE, NCET, Page 1


BANGALORE.
Smart Assistive Shoes And Cane To Guide Visually Challenged persons 2019-20

CHAPTER-1
INTRODUCTION
The term “visual impairment” describes a broad range of visual abilities and needs. Selection
of assistive technology should be the result of a team process that takes into consideration
feedback from family, educators, paraprofessionals, and the student. It is important to
remember that “high-tech” is not always the best solution for a student.

Selected tools should reflect the student’s unique strengths and needs, the activities he needs
to be able to accomplish, and the environment in which he will be working.

Fig 1: Graph estimating the virtually disabled person

The Fig1 shows the status of the population of the blind people or the visually
impaired people over the total population. India contributes about 21% of the blind people
over total population. Among every 179 people, there is 1 blind person. In a million
population, there are around 53 persons that are visually impaired, 46 thousand are having
low vision and around 7000 have completely lost their vision.

DEPT. ECE , NCET, Page 2


BANGALORE.
Smart Assistive Shoes And Cane To Guide Visually Challenged Persons
2019-20

1.1 Problem statement

People with visual impairments face unique challenges in the society. Not only must
they be able to access text information across all curricular areas, but they also need to be
able to participate fully in instruction that is often rich with visual content. Assistive
technology is one way of supporting them in that process.

1.2 Problem justification

“Assistive technology” refers to a range of tools, devices, and strategies that allow a visual
impaired one to accomplish a task that they would otherwise be unable to do, or would have
difficulty accomplishing effectively. Assistive technology can be simple or complex.

The objective of the project is to provide best and healthy solution to visual impaired
people that help them to overcome the obstacles coming on their way.

1.3 Objective of the project

 To overcome the limitations of the existing technology for the visually challenged
persons, this project modified the usage of this technology and results in the
integration of both Smart shoes and Smart cane.

 Smart cane will have the ultrasonic sensor to sense the distance between any
obstacles and all the feedbacks will be given to the blind person through buzzer,
Arduino Nano is programmed using arduino IDE to control whole cane module.

 Smart shoe will have the ultrasonic sensor to detect how far the obstacles are and all
the feedbacks will be given to the blind person through buzzer, Bluetooth module to
connect shoe and cane module.

DEPT. ECE, NCET, Page 3


BANGALORE.
Smart Assistive Shoes And Cane To Guide Visually Challenged persons 2019-20

CHAPTER-2
LITERATURE SURVEY
In 2001, Gemperle F, et al proposed that “Most of the assistive devices for the blind
that exploit touch as the substitution sense are tactile displays for the fingertips and palms.
Typical tactile displays involve arrays of vibrators or upward/downward moveable pins as
skin indentation mechanisms. The bandage-sized tactile display is an innovative touch
stimulation device based on EAP soft actuator technology. It is soft and flexible and can to be
wrapped around the finger like a band-aid. This new wearable display could be used as a
Braille display or as a multi-purpose tactile display to convey visual information to the
blind”[3].

In 2006 Shinohara said “Smart cane is one of the creations which was the origination
of the technique required to help blind people equipped with some sensors.” This comprises
of ultrasonic sensors and servo motors to navigate visually impaired people [4].

In July, 2011,Mohd Helmy and Abd Wahab proposed, “The technology can help in
reducing many barriers that people with disabilities face. These kinds of technologies are
referred to as assistive technology (AT). Different kind of disabilities can be cured by an AT
such as hearing aid or blindness however their major limitation is their highly expensive rates.
The main problem with the blind people is the loss of their physical integrity. They do not
have confidence in themselves. This statement has been proven in which an experiment name
“Project Prakash” has been carried out. It was intended attesting the visually-impaired to
utilize their brain to identify set of objects. This can also be applied to different situation” [5].

In 2013, Harshad Girish Lele, et al, said that technology can remove the barriers between the
humans and their illness. There are various methods to measure the distance between the
obstacles and overcome the problem of blind people. One of the methods is the use of
ultrasonic sensors in the shoe implemented in the form of an array around the sole[6]

In 2012, M. Nassih, quoted thatthe smart stick for the blind people can also use the
technique of RFID(Radio Frequency Identification)to detect the objects or the obstacles in
front of user. This invention is just like a simple stick used by blind people but equipped with

DEPT. ECE , NCET, Page 4


BANGALORE.
Smart Assistive Shoes And Cane To Guide Visually Challenged Persons
2019-20

a bag also. This bag provides electricity supply and indicates user by the speaker. However
there were some limitations [7].

In this project we are concerned about the virtually disabled persons that we have to
help them by making smart shoes and smart cane to make them walk easily even in unknown
place.

White cane can only be used to detect obstacles up to knee-level within a range of
only 2-3 feet. Cane mounted knee-above obstacle detection and warning system using
ultrasound beam to enhance the horizontal and vertical detection range. A detachable unit
comprising of an ultrasonic ranger, vibrator and a microcontroller was developed which can
detect obstacles above knee level. Distance information is conveyed to the user though a
vibrator. Vibration frequency increases as the obstacle comes closer. Enables the person to
effectively scan the area in front and detect obstacles on the ground such as uneven surfaces,
holes, steps, walls etc. The user keeps the cane at a convenient inclination. As a result the
ultrasonic detection cone is directed upwards and allows detection of knee above obstacles.
Device consists of an 8051 microcontroller SRF04 ultrasonic ranger, and a vibrator. Runs on
a standard Li-ion rechargeable battery. For charging the user connects an AC or USB adapter
fully charged battery lasts about 10 hours of constant usage before recharging.

Shoes were used to guide the blind person, fitted with an array of ultrasonic sensors
around the sole. The sensors are supported by the proprietary circuit located inside the shoe of
the user. The concept used in this prototype is that the obstacles will be detected by these
sensors and the information about it will be given to the user in real time as physical notice.

For the physical feedback, the shoe has made use of some vibrating boxes that the
user can put in his/her pockets. Arduino controller keeps polling the ultrasonic sensors and
provides feedback via the boxes. This information is processed and fed to the user via one of
his other working senses – here it has used the sense of touch. They’ve used the Arduino
Mega 2560 for processing. Advantage: keeps the user’s hands free for doing other tasks.

The main features are that Blind Shoes are equipped with vibration sensors can
indicate a number of obstacles. Sensors will vibrate when they encounter a number of
obstacles, such as holes, vehicles, walls, and even be able to show the road markings.

DEPT. ECE, NCET, Page 5


BANGALORE.
Smart Assistive Shoes And Cane To Guide Visually Challenged persons 2019-20

The sensor will vibrate when comrades blind encounter resistance at a distance of 80
cm to 1 meter and a height of 15 cm as well as on the hole or limiting the sidewalk. Blind
Shoes are also equipped with a single chip microcomputer that acts as the brain that controls
all of the features and data storage. Smart shoes can charge the battery automatically. Blind
Shoes can charge the battery by itself through kinetic generator pinned under the soles of
shoes. The battery will be charged automatically when the user step.

As a battery-operated walking stick, the prototypical smart cane is equipped with


ultrasonic sensors that are efficient enough to detect obstacles in an extended range, as
compared to a white cane. This smart cane detects obstacles through the transmission of
ultrasonic waves and the decoding of the received reflections to sense the presence of physical
objects. These ultrasonic sensors make it possible to measure and detect the distances to
moving and still objects. The cane is simple to operate and provides distance information
directly. The detection range, including the length of the cane’s tip, may be adjusted based on
the user’s preferences. The smart cane produces vibrotactile feedback on the handle bar. The
prototypical cane had a vibrotactile actuator to generate alerts on the handle when detecting
obstacles within a range of 2 m and above knee-level.

Smart Cane has been designed by students from Central Michigan University where this
invention uses Radio Frequency Identification (RFID). RFID is used to detect objects or
obstacles in front of the user and detects the RFID tag that has been placed in several areas to
navigate the users. This invention is just like a normal stick but is equipped with a bag, worn
by the user. The bag supplies electricity power to the invention and informs the user through
speakers inside the bag. For users who do not have the ability to hear, there are special gloves
that will vibrate at every finger, in which different vibrations in each finger have different
meanings. However, this invention has several weaknesses and is only suitable for small area.

This is because it only detects the area with RFID tag otherwise this invention only works as a
regular blind cane. In addition, this invention requires a high cost if it is used in the external
environment because the larger area that need to be tagged, the higher cost is needed.

According to [1], technology can help in reducing many barriers that people with disabilities
face. These kinds of technologies are referred to as assistive technology (AT).There are many

DEPT. ECE , NCET, Page 6


BANGALORE.
Smart Assistive Shoes And Cane To Guide Visually Challenged Persons
2019-20

types of disabilities, including physical disabilities, hearing-impaired, and visually-impaired.


A T has been utilized in assisting them [4, 5, 6, 9]. However, developing an AT is expensive

[3], making their selling price high.


According to Mazo and Rodriguez [8] the blind Cane is one of the assisting tools for the
visually-impaired and it is really important. According to Herman [3], one of the main
problems of the visually-impaired, is that most of these people have lost their physical
integrity. Also, they do not have confidence in themselves. This statement has been proven by
Bouvrie [7], in which an experiment name “Project Prakash” has been carried out. It was
intended at testing the visually-impaired to utilize their brain to identify set of objects.
According to Chang and Song [12], this can also be applied to different situation. W hen the
visually-impaired walk into a new environment, they will find it difficult to memorize the
locations of the object or obstacles. These examples demonstrate the difficulties of visually-
impaired people.

DEPT. ECE, NCET, Page 7


BANGALORE.
Smart Assistive Shoes And Cane To Guide Visually Challenged persons 2019-20

CHAPTER-3
SYSTEM REQUIREMENTS
 3.1 Hardware
 Arduino nano
 SIM 800L GSM module
 12 V Battery
 DC-85Db Buzzer
 HC-SR04 Ultrasonic sensor
 HC-05 Bluetooth module
 ISD 1820 voice recorder
 Shoe
 Blind cane

 3.2 Software
 Proteus 8
 Keil version4
 Embedded C

DEPT. ECE , NCET, Page 8


BANGALORE.
Smart Assistive Shoes And Cane To Guide Visually Challenged Persons
2019-20

3.3 Arduino Nano

Fig 3.3.1 Arduino Nano Board layout

The fig 3.3.1 shows the board layout of Arduino nano, Arduino is common term for a software
company, project, and user community, that designs and manufactures computer open-source
hardware, open-source and microcontroller-based kits for building digital devices and interactive
objects that can sense and control physical devices. The project is based on microcontroller board
designs, produced by several vendors, using various microcontrollers. These systems provide sets
of digital and analog I/O pins that can interface to various expansion boards (termed shields) and
other circuits. The boards feature serial communication interfaces, including Universal Serial Bus
(USB) on some models, for loading programs from personal computers. For programming the
microcontrollers, the Arduino project provides an integrated development environment (IDE) based
on a languages C and C++. Common examples of such devices intended for beginner hobbyists
include simple robots, thermostats, and motion detectors. Arduino boards are available
commercially in preassembled form, or as do-it-yourself kits. The hardware design specifications
are openly available, allowing the Arduino boards to be produced by anyone. Adafruit Industries
estimated in mid-2011 that over 300,000 official

Arduinos had been commercially produced, and in 2013 that 700,000 official boards were in users'
hands.

DEPT. ECE, NCET, Page 9


BANGALORE.
Smart Assistive Shoes And Cane To Guide Visually Challenged persons 2019-20

Microcontroller ATmega328P

Architecture AVR

Operating Voltage 5 Volts

Flash Memory 32 KB of which 2 KB used by Bootloader

SRAM 2KB

Clock Speed 16 MHz

Analog I/O Pins 8

EEPROM 1 KB

DC Current per I/O Pins 40 milliAmps

Input Voltage (7-12) Volt

Arduino is an open-source electronics platform based on easy-to-use hardware and


software. Arduino boards are able to read inputs - light on a sensor, a finger on a button, or a
Twitter message - and turn it into an output - activating a motor, turning on an LED, publishing
something online. You can tell your board what to do by sending a set of instructions to the
microcontroller on the board. To do so you use the Arduino programming language (based
on Wiring), and the Arduino Software (IDE), based on Processing.

Over the years Arduino has been the brain of thousands of projects, from everyday objects to
complex scientific instruments. A worldwide community of makers - students, hobbyists, artists,
programmers, and professionals - has gathered around this open-source platform, their
contributions have added up to an incredible amount of accessible knowledge that can be of
great help to novices and experts alike.

DEPT. ECE , NCET, Page 10


BANGALORE.
Smart Assistive Shoes And Cane To Guide Visually Challenged Persons
2019-20

Arduino was born at the Ivrea Interaction Design Institute as an easy tool for fast prototyping,
aimed at students without a background in electronics and programming. As soon as it reached a
wider community, the Arduino board started changing to adapt to new needs and challenges,
differentiating its offer from simple 8-bit boards to products for IoT applications, wearable, 3D
printing, and embedded environments. All Arduino boards are completely open-source,
empowering users to build them independently and eventually adapt them to their particular
needs. The software, too, is open-source, and it is growing through the contributions of users
worldwide.

Fig 3.3.2 Nano pin layout

The fig 3.3.2 shows pin layout of Arduino Nano, Thanks to its simple and accessible user
experience, Arduino has been used in thousands of different projects and applications. The
Arduino software is easy-to-use for beginners, yet flexible enough for advanced users. It runs
DEPT. ECE, NCET, Page 11
BANGALORE.
Smart Assistive Shoes And Cane To Guide Visually Challenged persons 2019-20

on Mac, Windows, and Linux. Teachers and students use it to build low cost scientific
instruments, to prove chemistry and physics principles, or to get started with programming and
robotics. Designers and architects build interactive prototypes, musicians and artists use it for
installations and to experiment with new musical instruments. Makers, of course, use it to build
many of the projects exhibited at the Maker Faire, for example. Arduino is a key tool to learn
new things. Anyone - children, hobbyists, artists, programmers - can start tinkering just
following the step by step instructions of a kit, or sharing ideas online with other members of
the Arduino community.

There are many other microcontrollers and microcontroller platforms available for physical
computing. Parallax Basic Stamp, Netmedia's BX-24, Phidgets, MIT's Handyboard, and many
others offer similar functionality. All of these tools take the messy details of microcontroller
programming and wrap it up in an easy-to-use package. Arduino also simplifies the process of
working with microcontrollers, but it offers some advantage for teachers, students, and
interested amateurs over other systems:

 Inexpensive - Arduino boards are relatively inexpensive compared to other microcontroller


platforms. The least expensive version of the Arduino module can be assembled by hand, and
even the pre-assembled Arduino modules cost less than $50
 Cross-platform - The Arduino Software (IDE) runs on Windows, Macintosh OSX, and Linux
operating systems. Most microcontroller systems are limited to Windows.
 Simple, clear programming environment - The Arduino Software (IDE) is easy-to-use for
beginners, yet flexible enough for advanced users to take advantage of as well. For teachers, it's
conveniently based on the Processing programming environment, so students learning to
program in that environment will be familiar with how the Arduino IDE works.
 Open source and extensible software - The Arduino software is published as open source
tools, available for extension by experienced programmers. The language can be expanded
through C++ libraries, and people wanting to understand the technical details can make the leap
from Arduino to the AVR C programming language on which it's based. Similarly, you can add
AVR-C code directly into your Arduino programs
 Open source and extensible hardware - The plans of the Arduino boards are published under
a Creative Commons license, so experienced circuit designers can make their own version of

DEPT. ECE , NCET, Page 12


BANGALORE.
Smart Assistive Shoes And Cane To Guide Visually Challenged Persons
2019-20

the module, extending it and improving it. Even relatively inexperienced users can build
the breadboard version of the module in order to understand how it save money.

3.4 GPS

SIM 800L GSM MODULE (GLOBAL SYSTEM FOR MOBILE COMMUNICATIONS)

A GSM module or a GPRS module is a chip or circuit that will be used to establish
communication between a mobile device or a computing machine and a GSM or GPRS
system. The modem (modulator-demodulator) is a critical part here.

These modules consist of a GSM module or GPRS modem powered by a power supply
circuit and communication interfaces (like RS-232, USB 2.0, and others) for computer. A GSM
modem can be a dedicated modem device with a serial, USB or Bluetooth connection, or it can be
a mobile phone that provides GSM modem capabilities.

General Packet Radio Service (GPRS) is a packet oriented mobile data service on the 2G
and 3G cellular communication system’s global system for mobile communications (GSM).
GPRS was originally standardized by European Telecommunications Standards Institute (ETSI) in
response to the earlier CDPD and i-mode packet-switched cellular technologies. It is now
maintained by the 3rd Generation Partnership Project (3GPP). A GSM module or GPRS modules
are similar to modems, but there’s one difference: A GSM/GPRS Modem is an external
equipment, whereas the GSM/GPRS module is a module that can be integrated within an
equipment. It is an embedded piece of hardware.

The SIM800L module supports quad-band GSM/GPRS network, available for GPRS and SMS
message data remote transmission. The SIM800L communicates with microcontroller via UART
port, supports command including 3GPP TS 27.007, 27.005 and SIMCOM enhanced AT
Commands. It also has built-in level translation, so it can work with microcontroller of higher
voltage than 2.8V default. Besides, the board also supports A-GPS technique which is called

mobile positioning and gets position by mobile.

DEPT. ECE, NCET, Page 13


BANGALORE.
Smart Assistive Shoes And Cane To Guide Visually Challenged persons 2019-20

3.4.2 Functional Diagram

Fig 3.4.1:SIM800C GSM module Functional Diagram.

3.4.2 Pin out Diagram Of SIM800C GSM Module

Fig 3.4.2 SIM800C GSM MODULE

DEPT. ECE , NCET, Page 14


BANGALORE.
Smart Assistive Shoes And Cane To Guide Visually Challenged Persons
2019-20

Fig 3.4.3 GSM module

3.5 12V Rechargeable Battery


This rechargeable battery is environmentally friendly, it is sealed construction, it is
stable quality and high reliability. Solar energy is converted to electrical energy using Battery.
It is used in circuit to power other components. A Battery produces direct current electricity.

Fig3.5.1Battery

DEPT. ECE, NCET, Page 15


BANGALORE.
Smart Assistive Shoes And Cane To Guide Visually Challenged persons 2019-20

3.6 Buzzer
A buzzer or beeper is a signaling device, usually electronic, typically used in
automobiles, household appliances such as a microwave oven, or game shows. It most
commonly consists of a number of switches or sensors connected to a control unit that
determines if and which button was pushed or a preset time has lapsed, and usually
illuminates a light on the appropriate button or control panel, and sounds a warning in
the form of a continuous or intermittent buzzing or beeping sound. Initially this device
was based on an electromechanical system which was identical to an electric bell
without the metal gong. Often these units were anchored to a wall or ceiling and used
the ceiling or wall as a sounding board. Another implementation with some AC-
connected devices was to implement a circuit to make the AC current into a noise loud
enough to drive a loudspeaker and hook this circuit up to a cheap 8-ohm speaker.

Fig 3.6.1 Buzzer.

DEPT. ECE , NCET, Page 16


BANGALORE.
Smart Assistive Shoes And Cane To Guide Visually Challenged Persons
2019-20

3.7 Ultrasonic Sensor

HC-SR04 Sensor Features

Fig 3.7.1 HC-SR04 Sensor module

The fig 3.7.1 shows the Ultrasonic sensor module, Ultrasonic sensors work by emitting
sound waves at a frequency too high for humans to hear. They then wait for the sound to
be reflected back, calculating distance based on the time required. This is similar to how
radar measures the time it takes a radio wave to return after hitting an object.

While some sensors use a separate sound emitter and receiver, it’s also possible to
combine these into one package device, having an ultrasonic element alternate between
emitting and receiving signals. This type of sensor can be manufactured in a smaller
package than with separate elements, which is convenient for applications where size is
at a premium.

While radar and ultrasonic sensors can be used for some of the same purposes, sound-
based sensors are readily available they can be had for just a couple dollars in some
cases and in certain situations, they may detect objects more effectively than radar.

For instance, while radar, or even light-based sensors, have a difficult time correctly
processing clear plastic, ultrasonic sensors have no problem with this. In fact, they’re
unaffected by the color of the material they are sensing.

On the other hand, if an object is made out of a material that absorbs sound or is shaped

DEPT. ECE, NCET, Page 17


BANGALORE.
Smart Assistive Shoes And Cane To Guide Visually Challenged persons 2019-20

in such a way that it reflects the sound waves away from the receiver, readings will be

Unreliable.

If you need to measure the specific distance from your sensor, this can be calculated
based on this formula:

Distance = ½ T x C

(T = Time and C = the speed of sound)

At 20°C (68°F), the speed of sound is 343 meters/second (1125 feet/second), but this varies
depending on temperature and humidity.

Specially adapted ultrasonic sensors can also be used underwater. The speed of sound,
however, is 4.3 times as fast in water as in air, so this calculation must be significantly.

Ultrasonic ranging and detecting devices make use of high-frequency sound waves to detect the
presence of an object and its range. These systems either measure the echo reflection of the
sound waves from objects or detect the interruption of the sound beam as the objects pass
between the transmitter and receiver.

An ultrasonic sensor typically utilizes a transducer that produces an electrical output pulse in
response to the received ultrasonic energy. In such case, the horizontal aperture angle must be at
least 8 degrees for an inter-vehicle distance of 75 meter. The vertical aperture is fixed to be 1
degree and is positioned in such a way to avoid fault reading due to the road conditions.
Test distance = (high level time × velocity of sound (340M/S) / 2,
Summary
Working Voltage DC 5 V
Working Current 15mA
Working Frequency 40Hz
Max Range 4m
Min Range 2cm
Measuring Angle 15 degree
Trigger Input Signal 10uS TTL pulse
Dimension 45*20*15mm

DEPT. ECE , NCET, Page 18


BANGALORE.
Smart Assistive Shoes And Cane To Guide Visually Challenged Persons
2019-20

Fig 4.5.2: Ultrasonic ranging

3.8 HC-05 Bluetooth module

Fig 3.8.1:Bluetooth with Arduino nano connection.

DEPT. ECE, NCET, Page 19


BANGALORE.
Smart Assistive Shoes And Cane To Guide Visually Challenged persons 2019-20

The fig 3.8.1 shows Bluetooth connection Arduino Nano, The HC-05 is a very cool module
which can add two-way (full-duplex) wireless functionality to your projects. You can use this
module to communicate between two microcontrollers like Arduino or communicate with any
device with Bluetooth functionality like a Phone or Laptop. There are many android
applications that are already available which makes this process a lot easier. The module
communicates with the help of USART at 9600 baud rate hence it is easy to interface with any
microcontroller that supports USART. We can also configure the default values of the module
by using the command mode. So if you looking for a Wireless module that could transfer data
from your computer or mobile phone to microcontroller or vice versa then this module might
be the right choice for you. However do not expect this module to transfer multimedia like
photos or songs; you might have to look into the CSR8645 module for that.

Fig3.8.2Bluetoothmodule

DEPT. ECE , NCET, Page 20


BANGALORE.
Smart Assistive Shoes And Cane To Guide Visually Challenged Persons
2019-20

3.9 Voice recording chip


Recordable sound modules may use any number of technologies to produce their
sounds, and they are the small devices that you can store and play the sound that was
recorded before. It can be divided into many kinds such as recording by button,
downloading the voice from computer through USB, or Pre-recorded by the manufacturer
with the audio files customers provided. Normally it will be used for musical greeting card,
gift box, toys, customizing Product and children’s books. Moreover, it can play any sound
like animal sound, birthday songs and the other audio file customer provided, etc. If you're
looking for a best-quality supplier, there is no doubt that our sound module is the best
choice to achieve your requirement.

Fig 3.9.1 Voice recording chip

3.10 LCD 16x2

LCD modules are vey commonly used in most embedded projects, the reason being its
cheap price, availability and programmer friendly. Most of us would have come across these
displays in our day to day life, either at PCO’s or calculators. The appearance and the pinouts
have already been visualized above now let us get a bit technical.

16×2 LCD is named so because; it has 16 Columns and 2 Rows. There are a lot of
combinations available like, 8×1, 8×2, 10×2, 16×1, etc. but the most used one is the 16×2

LCD. So, it will have (16×2=32) 32 characters in total and each character will be made of

DEPT. ECE, NCET, Page 21


BANGALORE.
Smart Assistive Shoes And Cane To Guide Visually Challenged persons 2019-20

5×8 Pixel Dots. A Single character with all its Pixels is shown in the below picture.

Fig 3.10.1 16*2 LCD

LCD Pin Configuration

 Vss : Ground pin connected to system ground

 Vdd (+5 Volt) : Powers the LCD with +5V (4.7V – 5.3V)

 VE(Contrast V) :Decides the contrast level of display.Grounded to get


maximum contrast.

 Register Select : Connected to Microcontroller to shift between


command/data register

 Read/Write : Used to read or write data. Normally grounded to write data to


LCD

 Enable : Connected to Microcontroller Pin and toggled between 1 and 0 for


data acknowledgement

 Data Pin 0 : Data pins 0 to 7 forms a 8-bit data line. They can be connected to
Microcontroller to send 8-bit data. These LCD’s can also operate on 4-bit mode
in such case Data pin 4,5,6 and 7 will be left free.

 LED Positive : Backlight LED pin positive terminal

 LED Negative : Backlight LED pin negative terminal

DEPT. ECE , NCET, Page 22


BANGALORE.
Smart Assistive Shoes And Cane To Guide Visually Challenged Persons
2019-20

16*2 LCD Commands

 For Hex Code-01, the LCD command will be the clear LCD screen.

 For Hex Code-02, the LCD command will be returning home.

 For Hex Code-04, the LCD command will be decrement cursor.

 For Hex Code-06, the LCD command will be Increment cursor.

 For Hex Code-05, the LCD command will be Shift display right.

 For Hex Code-07, the LCD command will be Shift display left.

 For Hex Code-08, the LCD command will be Display off, cursor off.

 For Hex Code-0A, the LCD command will be cursor on and display off.

 For Hex Code-0C, the LCD command will be cursor off, display on.

 For Hex Code-0E, the LCD command will be cursor blinking, Display on.

 For Hex Code-0F, the LCD command will be cursor blinking, Display on.

 For Hex Code-10, the LCD command will be Shift cursor position to left.

 For Hex Code-14, the LCD command will be Shift cursor position to the right.

 For Hex Code-18, the LCD command will be Shift the entire display to the left.

 For Hex Code-1C, the LCD command will be Shift the entire display to the
right.

 For Hex Code-80, the LCD command will be Force cursor to the beginning (1st
line).

 For Hex Code-C0, the LCD command will be Force cursor to the beginning
(2nd line).

 For Hex Code-38, the LCD command will be 2 lines and 5×7 matrix.

DEPT. ECE, NCET, Page 23


BANGALORE.
Smart Assistive Shoes And Cane To Guide Visually Challenged persons 2019-20

Features of 16×2 LCD Module

 Operating Voltage is 4.7V to 5.3V


 Current consumption is 1mA without backlight
 Alphanumeric LCD display module, meaning can display alphabets and
numbers
 Consists of two rows and each row can print 16 characters.
 Each character is build by a 5×8 pixel box
 Can work on both 8-bit and 4-bit mode
 It can also display any custom generated characters
 Available in Green and Blue Backlight

DEPT. ECE , NCET, Page 24


BANGALORE.
Smart Assistive Shoes And Cane To Guide Visually Challenged Persons
2019-20

CHAPTER-4

SYSTEM DESIGN AND IMPLEMENTATION


BLOCK DIAGRAM

4.1 BLOCK DIAGRAM OF SHOE MODULE

Fig 4.1.1 Block diagram of shoe module

Working of shoe module is as follows :

Smart shoe:- Fig 4.1.1 shows the block diagram of shoe module, This module
consists of the arduino nano to control the whole module, Ultrasonic sensors to detect
the motion of the objects, Buzzer to alert the blind person, Bluetooth module to connect

DEPT. ECE, NCET, Page 25


BANGALORE.
Smart Assistive Shoes And Cane To Guide Visually Challenged persons 2019-20

smart shoe and smart cane.

4.2 Shoe module

In the shoe we will mount the Arduino nano and ultrasonic sensors to detect the obstacles
and with the help of buzzer we can alert the physically challenged people.

Fig 4.2.1 Smart shoe

DEPT. ECE , NCET, Page 26


BANGALORE.
Smart Assistive Shoes And Cane To Guide Visually Challenged Persons
2019-20

4.3 BLOCK DIAGRAM OF CANE MODULE

Fig 4.3.1 Block diagram of cane module

Working of cane module is as follows :

Smart cane:- Fig 4.31 shows the block diagram of cane module, This module contains
Arduino Nano to control the whole module, Ultrasonic sensors to detect the object, Voice
recording chip to record the objects sound, Buzzer to alert the blind person.

DEPT. ECE, NCET, Page 27


BANGALORE.
Smart Assistive Shoes And Cane To Guide Visually Challenged persons 2019-20

4.4 Blind stick


In the blind cane Arduino nano will mount, Ultrasonic sensors and Bluetooth
module And shoe and cane will connect through the Bluetooth module.

Fig 4.4.1 Smart cane

DEPT. ECE , NCET, Page 28


BANGALORE.
Smart Assistive Shoes And Cane To Guide Visually Challenged Persons
2019-20

CHAPTER 5
SYSTEM FLOWCHART AND CIRCUIT DIAGRAM

5.1 Flow chart of proposed work

Fig 5.1.1 General Flowchart

Fig 5.1.1 shows the general flowchart of the module, Working of the both shoe and cane
module will follow the procedure as per the above flowchart.

DEPT. ECE, NCET, Page 29


BANGALORE.
Smart Assistive Shoes And Cane To Guide Visually Challenged persons 2019-20

The microcontroller receives the input from the Ultrasonic sensors, executes and decode it and
again select the appropriate saved voice messages (left and above the knee) and commands to
the speaker which give the indication to the user of the obstacle in the respective direction.
The other function of the cane module is to prevent the shoe module from water. For this, a
water prevention circuit has been implemented at the bottom of the cane module. The water
prevention circuit gets completed when it comes in contact with water and thus sends a
command to the microcontroller which executes it and select the command for the water
prevention.

It is the primary part of the whole system or protocol. It consists of 2 Ultrasonic sensors, one
for right direction and other for the front direction. It measures the ground level. The
Ultrasonic sensors continuously works or we can say they results in Ultrasonic wave
continuously. When any obstacle comes in front of these Ultrasonic sensors then the
Ultrasonic waves gets reflected back from the obstacle and come back to the sensor again
which result in some different action in the sensor or we may say any obstacle is front of it.

The analog signal reflected back is converted in to digital one by sensor which is then
compiled by the processor of shoe to check from which direction it came. After compiling, the
processor sends it to the stick via Bluetooth which is further processed by the processor.
According to it the pre-recorded voice message is buzzed through the speaker.

DEPT. ECE , NCET, Page 30


BANGALORE.
Smart Assistive Shoes And Cane To Guide Visually Challenged Persons
2019-20

5.2 CIRCUIT DIAGRAM

Shoe module

Fig 5.2.1 circuit diagram of shoe module

Fig 5.2.1 shows the circuit connection of shoe module, This project presents a prototype
model and a system concept to provide a smart electronic aid for blind people. This system is
intended to provide overall measures object detection, and real-time Assistance. This project
aims at the development of an Electronic Travelling Aid (ETA) kit to help the blind people to
find obstacle free path. This ETA is fixed to the shoe. When the object is detected near to the
shoe and if any person coming in front it alerts them with the help of buzzer and also in
advancement with help of speakers that is voice message. Ultrasonic sensor Gnd pin
connected with common ground connection, out of 32 pins of Arduino Nano we have used
only 4pins to ultrasonic sensor, buzzer and power supply, +5v of ultrasonic sensor connected
to A0 pin of Nano, D12 of Nano pin connected to buzzer positive pin.
DEPT. ECE, NCET, Page 31
BANGALORE.
Smart Assistive Shoes And Cane To Guide Visually Challenged persons 2019-20

Cane module

Fig 5.2.3 circuit diagram of Cane module

Fig 5.2.3 shows the circuit connection of cane module, The analog signal reflected back is converted
in to digital one by sensor which is then compiled by the processor of shoe to check from which
direction it came. After compiling, the processor sends it to the stick via Bluetooth which is further
processed by the processor. According to it the pre-recorded voice message is buzzed through the
buzzer.D9 of Arduino Nano is buzzer positive buzzer negative connected to common Gnd, D11 and
D12 of Nano connected to Ultrasonic sensor.

DEPT. ECE , NCET, Page 32


BANGALORE.
Smart Assistive Shoes And Cane To Guide Visually Challenged Persons
2019-20

CHAPTER 6
6.1 RESULT AND DISCUSSION

Fig 6.1.1 : Result of smart cane

Fig 6.1.1 shows how the cane module will be. Thus, with the ease of use and faster response
time, a visually impaired person can sense, feel, listen and walk with the environment around
him with the help of these smart shoes and smart cane. The execution introduces the general
system of a system for following and checking courses in obscure regions. The system
comprises of small-scale controller, Bluetooth gadget and hand-held application which
comprises of GPS administration. In this we are actualizing the Smart Shoe and Cane which
are wearable and it can be utilized as a part of any outside condition while being append able to
shoe. It can be utilized easily by client to increment simplicity of utilization.

Fig 6.1.2: Result of smart shoe

DEPT. ECE, NCET, Page 33


BANGALORE.
Smart Assistive Shoes And Cane To Guide Visually Challenged persons 2019-20

6.2 ADVANTAGES
 A reliable assistive technology providing a voice feedback as per the surrounding.
 An ease to carry the project without any embarrassment.
 Improved sensing range than the conventional technologies offering a hapticfeedback
upon sensing.

 Offering independency to the subject so he can be able to walk on streets without the
need of an external assistance.

 Provide the best assistance through a switch and a buzzer in case the subject lost the
cane.

6.3 DISADVANTAGES
 One important disadvantage of Arduino microcontroller is that its resolution is
only 10bits if we more than 10 bits then we have use another Arduino
microcontroller.

 Requires more effort to accomplish some tasks such as database storage.

DEPT. ECE , NCET, Page 34


BANGALORE.
Smart Assistive Shoes And Cane To Guide Visually Challenged Persons
2019-20

CHAPTER-7
CONCLUSION AND FUTURE SCOPE
The “Smart assistive shoes and cane to guide visually challenged persons” is very helpful
project to the visually impaired persons with the help of smart shoe and smart cane which are
made with Arduino nano and some sensors.

This project would like to conclude that the proposed system completed successfully.
As we started earlier in a problem statement, the previous problem like less information
conveyed, poor efficiency is overcome and successfully implemented with efficiency of object
detection and with a clear information to a blind people for their guidelines. This project offers
a numerous application in the medical field to provide a better responsive mate to the visually
impaired.
Further we can implement more features like artificial intelligence, GPS tracking
systems by adding cameras and we make this project even more helpful for visually
challenged person.

DEPT. ECE, NCET, Page 35


BANGALORE.
Smart Assistive Shoes And Cane To Guide Visually Challenged persons 2019-20

REFERENCES
[1] Parth Dhall, et al, "A REVIEW PAPER ON ASSISTIVE SHOE & CANE FOR
VISUALLY IMPAIRED PEOPLE", International Journal of Scientific Research and
Management Studies (IJSRMS), Volume 3 Issue 2, pp: 113-117.

[2] Shristhi Thakur, et al, "Smart Assistive Shoes for the Blind People", International Journal
on Recent and Innovation Trends in Computing and Communication (IJRITCC), Volume: 4
Issue: 9, pp: 44-49.

[3] Gemperle F, Ota N, and Siewiorek D (2001) Design of a wearable tactile display. In:
Proc. of. 5th International Symposium on Wearable Computers, Zu.

[4] Shinohara, K. “Designing assistive technology for blind users.” In Proceedings of the 8th
international ACM SIGACCESS conference on Computers and accessibility, ACM (2006),
pp- 293–294.

[5] Mohd Helmy Abd Wahab, Amirul A. Talib, Herdawatie A. Kadir, “Smart Cane: Assistive
Cane for Visually-impaired People”, Journal : IJCSI International Journal of Computer
Science Issues, Vol. 8, Issue 4, No 2, July 2011.

[6] Harshad Girish Lele, Viten Vilas Lonkar, Varun Vasant Marathe, Mrunmayi Mohan
Modak. "Electronic path guidance for visually impaired people." The International Journal of
Engineering and Science (IJES), 09-14, 2013.

[7] M. Nassih, quoted thatthe smart stick for the blind people can also use the technique of
RFID(Radio Frequency Identification)to detect the objects or the obstacles in front of user
on June 2012

DEPT. ECE , NCET, Page 36


BANGALORE.
Smart Assistive Shoes And Cane To Guide Visually Challenged Persons
2019-20

APENDIX

Paper publication

DEPT. ECE, NCET, Page 37


BANGALORE.
Smart Assistive Shoes And Cane To Guide Visually Challenged persons 2019-20

ALGORITHM
Program
#include <Wire.h>
#include <LiquidCrystal_I2C.h>

// Set the LCD address to 0x27 for a 16 chars and 2 line dis play
LiquidCrystal_I2C lcd(0x27, 16, 2);
const int trigPin = 12;
const int echoPin = 14;
long duration;
int distanceCm, distanceInch;
int wifi=0;
int led=13;
int buzz=10;
void setup()
{
lcd.begin();

// Turn on the blacklight and print a message.


lcd.backlight() ;
pinMode(trigPin, OUTPUT);
pinMode(echoPin, INPUT);
pinMode(led, OUTPUT);
pinMode(buzz, OUTPUT);

Serial.begin(9600);

}
void loop()

DEPT. ECE , NCET, Page 38


BANGALORE.
Smart Assistive Shoes And Cane To Guide Visually Challenged Persons
2019-20

digitalWrite(trigPin, LOW);
delayMicroseconds(2);
digitalWrite(trigPin, HIGH);
delayMicroseconds(10);
digitalWrite(trigPin, LOW);
duration = pulseIn(echoPin, HIGH);
distanceCm= duration*0.034/2;
distanceInch = duration*0.0133/2;

lcd.setCursor(0,0);
lcd.print("dist=");
lcd.print(distanceCm);
lcd.print("cm");
lcd.print(" ");

Serial.print("distancecm:");
Serial.println(distanceCm);

if(distanceCm<30)
{
digitalWrite(led, HIGH);
digitalWrite(buzz, HIGH);
// digitalWrite(6, HIGH);
lcd.setCursor(0,1);
lcd.print("buzzer is on ");
lcd.print(" ");
delay(250);
digitalWrite(led, LOW);

DEPT. ECE, NCET, Page 39


BANGALORE.
Smart Assistive Shoes And Cane To Guide Visually Challenged persons 2019-20

digitalWrite(buzz, LOW);
// digitalWrite(6, HIGH);
delay(250);
}
else
{
digitalWrite(led, LOW);
digitalWrite(buzz, LOW);
// digitalWrite(6, HIGH);
Serial.println(distanceCm);
lcd.setCursor(0,1);
lcd.print(" ");
lcd.print(" ");
}

DEPT. ECE , NCET, Page 40


BANGALORE.
Smart Assistive Shoes And Cane To Guide Visually Challenged Persons
2019-20

DEPT. ECE, NCET, Page 41


BANGALORE.
Smart Assistive Shoes And Cane To Guide Visually Challenged persons 2019-20

DEPT. ECE , NCET, Page 42


BANGALORE.

You might also like