EYE WRITER

A Project Report

submitted by

SOORAMPALLI SREE VARSHIT (EDM18B050)

in partial fulfilment of requirements

for the award of the degree of

BACHELOR OF TECHNOLOGY

Department of Electronics and Communication Engineering

INDIAN INSTITUTE OF INFORMATION TECHNOLOGY,
DESIGN AND MANUFACTURING KANCHEEPURAM
DECEMBER 2021
 DECLARATION OF ORIGINALITY

I, Soorampalli Sree Varshit, with Roll No: EDM18B050 hereby declare that the mate-
rial presented in the Project Report titled EYE WRITER represents original work car-
ried out by me in the Department of Electronics and Communication Engineering at
the Indian Institute of Information Technology, Design and Manufacturing, Kancheep-
uram.
With my signature, I certify that:

• I have not manipulated any of the data or results.

• I have not committed any plagiarism of intellectual property. I have clearly indi-
cated and referenced the contributions of others.

• I have explicitly acknowledged all collaborative research and discussions.

• I have understood that any false claim will result in severe disciplinary action.

• I have understood that the work may be screened for any form of academic mis-
conduct.

Soorampalli Sree Varshit

Place: Chennai
Date: 01.05.2021
 CERTIFICATE

This is to certify that the report titled EYE WRITER, submitted by Soorampalli
Sree Varshit (EDM18B050), to the Indian Institute of Information Technology, De-
sign and Manufacturing Kancheepuram, for the award of the degree of BACHELOR
OF TECHNOLOGY is a bona fide record of the work done by him/her under my su-
pervision. The contents of this report, in full or in parts, have not been submitted to any
other Institute or University for the award of any degree or diploma.

Dr.Priyanka Kokil
Project Guide
Assistant Professor
Department of Electronics and Communication Engineering
IIITDM Kancheepuram, 600 127

Place: Chennai
Date: 01.05.2021
 ACKNOWLEDGEMENTS

I would like to express my sincere thanks to Dr.Priyanka kokil for guiding me through-
out the process.I have picked up a lot of learning by working under her.Working under
helped me to understand the importance of research and time management.

And last I thank all my friends, family members and well wishers for supporting me
in tough times during the project.

i
 ABSTRACT

This report discusses about a device or product which helps people who are not able
to communicate with surroundings due to various reasons.the device takes the help of
the movement of the pupil of the eye.This report only shows the result of detection
of the pupil of eye.Furthermore this idea has to be extended to a product which is not
expensive.

ii
 TABLE OF CONTENTS

ACKNOWLEDGEMENTS i

ABSTRACT ii

LIST OF TABLES iv

LIST OF FIGURES v

NOTATION vi

1 Introduction 1
1.1 Background and Motivation . . . . . . . . . . . . . . . . . . . . . 1
1.2 Objective . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2

2 Methodology 3
2.1 Literature Survey . . . . . . . . . . . . . . . . . . . . . . . . . . . 3
2.1.1 Research Done . . . . . . . . . . . . . . . . . . . . . . . . 3
2.1.2 Adapted Methods . . . . . . . . . . . . . . . . . . . . . . . 4

3 Work Done 7
3.1 Proposed Method . . . . . . . . . . . . . . . . . . . . . . . . . . . 7

4 Conclusion and Future Scope 11

4.1 Conclusions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 11
4.2 Future Scope . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 11
LIST OF TABLES

iv
 LIST OF FIGURES

2.1 Flow chart of researched algorithm to detect pupil . . . . . . . . . . 4

2.2 parts of human eye . . . . . . . . . . . . . . . . . . . . . . . . . . 4
2.3 Outer structure of the eye . . . . . . . . . . . . . . . . . . . . . . . 4
2.4 different filtering methods to remove noise . . . . . . . . . . . . . . 5
2.5 gaussian blur . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5
2.6 contour detection . . . . . . . . . . . . . . . . . . . . . . . . . . . 6

3.1 Flow chart of proposed algorithm to detect pupil . . . . . . . . . . . 7

3.2 human eye . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8
3.3 gray image . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8
3.4 Threshold . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8
3.5 Threshold . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8
3.6 Gaussian blurl . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8
3.7 Contour detection . . . . . . . . . . . . . . . . . . . . . . . . . . . 9
3.8 Contour detection . . . . . . . . . . . . . . . . . . . . . . . . . . . 9
3.9 Contour detection of only pupil . . . . . . . . . . . . . . . . . . . . 9
3.10 Contour detection of only pupil . . . . . . . . . . . . . . . . . . . . 9
3.11 detection of movement of the pupil . . . . . . . . . . . . . . . . . . 10

4.1 Threshold detection . . . . . . . . . . . . . . . . . . . . . . . . . . 11

4.2 contour detection . . . . . . . . . . . . . . . . . . . . . . . . . . . 11
4.3 movement of direction of the eye . . . . . . . . . . . . . . . . . . . 11

v
 NOTATION

λ wavelength

vi
 CHAPTER 1

Introduction

One of the most important thing in any person’s life is to interact and communicate
with surroundings and people in any possible manner.Most often or not paralysis takes
away that functionality.Paralysis is something which is not in the control of the effected
person. It effects a human in mental and physical ways.It can be permanent or tempo-
rary.Effected people lose the ability to move some or all of their body due to paralysis.It
is something which is not in our hands and can happen at any moment when something
goes wrong with the way messages passes between the brain and muscles.It is neces-
sary to take care of the effected person which is obviously a burden and it becomes
more difficult if there is no possible communication.

Existing research have mostly worked on facial paralysis evaluation[1], databases

for facial recognition of paralysed people[2] and evaluation of stroke paralysis[3] etc.
We want to create model or device especially for completely paralysed people through
which they can communicate i.e, type,read and use a computer or laptop for daily pur-
poses.

1.1 Background and Motivation

As discussed earlier paralysis effects a person in many ways, especially people who are
unable to communicate with the world and their loved ones.It also effects the people
who they care about.It is essential for paralyses people to have a medium where they can
communicate and use devices like normal people. Existing technologies and devices are
expensive for the middle and lower class people.
CHAPTER 1. INTRODUCTION Enter roll number here

1.2 Objective

Our objective of this project is to design and implement a device or technology where
effected people can communicate, read , write and use laptop or computer like everyone
else without any secondary help or assistance. We are going to make use of the pupil
of the eye.The pupil of the eye gets detected in real time and it becomes a marker or
pointer on the laptop or computer.As we move the eye or the pupil , the pointer is also
moved accordingly. Using this application or technology people can write, read and
probably do other things on the laptop with help of their pupil.

For doing this project we will be needing a high resolution camera and sensors for
detecting the motion of the pupil of the eye and also an application or technology inside
the laptop or pc where we need to connect the detected pupil to the writing/typing
software.In this report we will be seeing the results of detection of the pupil of the
eye.Later on we need to extend it to real time application

Department of ECE, IIITDM Kancheepuram, May 2021 2

 CHAPTER 2

Methodology

2.1 Literature Survey

We need to develop an algorithm to detect the pupil of the eye when the eye is in
motion.Various methods have been used in research history to detect the pupil of the
eye.We are going to use various image processing techniques and contours to detect the
pupil.We are going to use recorded video of the eye.

2.1.1 Research Done

The Starburst algorithm[4],[5],is one of many pupil detection algorithms documented in

the literature.The projection function algorithm [6],the contour analysis[7],the integral
projection and the Gaussian model[8].

We have adapted a few techniques from various research papers.One of them being
A New Robust Pupil Detection Algorithm for Eye Tracking Based Human-Computer
Interface[9].A new pupil detection technique suitable for the construction of head-
mounted eye tracking interfaces is provided in this paper. The proposed algorithm’s
robustness is demonstrated by its short execution time and ability to properly deliver
pupil centre coordinates even in real-world settings such as fluctuating illumination and
high noise levels. The suggested algorithm is based on a feedback-loop driven adaptive
quantitative binarization technique. The Least Square Fit to Ellipse technique is used
to detect the pupil centre in the processed eye image. A 5 pixel detection rate of 93
percent was obtained for eye photos from two representative datasets to demonstrate
the algorithm’s performance.
CHAPTER 2. METHODOLOGY Enter roll number here

Figure 2.1: Flow chart of researched algorithm to detect pupil

This method has been used to detect the pupil in stable condition i.e, for an image.
We need to extend this algorithm to video or a moving eye and track the movement of
the pupil accordingly.

2.1.2 Adapted Methods

First we need to know about the outer structure of the eye to work on it.The eye consists
of mainly three parts on outside:iris,pupil,sclera.

Figure 2.2: parts of human eye

Figure 2.3: Outer structure of the eye

As we can see in the above figures the pupil distinct itself from other parts due to its
shape and colour.We are going to use this uniqueness of the pupil to detect it.

Noise is an unavoidable part of the acquisition process. As a result, knowing the

impacts of a filtering technique is critical for selecting the suitable technique to effec-

Department of ECE, IIITDM Kancheepuram, May 2021 4

CHAPTER 2. METHODOLOGY Enter roll number here

tively filter the image, as the segmentation process can be costly and time-consuming.
It’s usually preferable to have an automatic segmentation method that saves time and
human work.
Noise removal from an image is an important process of filtering the image.The tech-
nique of removing or reducing noise from an image is known as a noise removal algo-
rithm. By smoothing the entire image and leaving sections near contrast boundaries,
noise reduction algorithms diminish or eliminate the visibility of noise.

Figure 2.4: different filtering methods to remove noise

Gaussian Blur in Image filtering and segmentation:

We can understand the effects of using gaussian blur to remove noise during image seg-
mentation and filtering in [10].Their research looks into the qualitative and quantitative
effects of a Gaussian function convolution with an image.

Figure 2.5: gaussian blur

Because the results of the filtering demonstrated a relative independence on the noise
features and a substantial dependence on the variance value of the Gaussian kernel, the
Gaussian blur approach is particularly useful for filtering images with a lot of noise.
Furthermore, while using a big variance in the Gaussian function to filter photos blurs
and degrades the image, it may also be used to generate a mask to segment it.

Department of ECE, IIITDM Kancheepuram, May 2021 5

CHAPTER 2. METHODOLOGY Enter roll number here

Contours:Contour detection is a procedure that may be described as a curve that

connects all continuous points (along with the boundary) that are the same colour or
intensity. Contours are capable of doing more than simply detecting edges. The method
not only finds image edges, but also arranges them in a hierarchy.

Figure 2.6: contour detection

From diverse segmentation tasks to object form recognition, contour detection is a key
stage in a wide range of image processing approaches. In many object form identi-
fication systems, contour detection is the first step. In the literature, various contour
detection methods have been proposed.

Department of ECE, IIITDM Kancheepuram, May 2021 6

 CHAPTER 3

Work Done

3.1 Proposed Method

We are going to detect the pupil using the above adapted methods like contour detection,
gaussian blur etc.The below are the steps we are going to follow-

Figure 3.1: Flow chart of proposed algorithm to detect pupil

As seen in the above flow chart first we are going to convert the video file of moving
eye into gray. What does the pupil have which any other part of the eye dont have in the
below gray image?. The pupil is a black circle.So we can use a threshold to show only
the part of the image that are more black than some gradient.
CHAPTER 3. WORK DONE Enter roll number here

Figure 3.2: human eye Figure 3.3: gray image

Figure 3.4: Threshold Figure 3.5: Threshold

We have selected most of the pupil and eye, except we have some unnecessary noise to
remove.
So the next step is to remove the unnecessary noise by using gaussian blur.We can see
there is less noise compared to before image.

Figure 3.6: Gaussian blurl

Next we detect the contours by using contour function.We print all the contours by us-
ing a for loop as we can see in the below image.

Department of ECE, IIITDM Kancheepuram, May 2021 8

CHAPTER 3. WORK DONE Enter roll number here

Figure 3.7: Contour detection Figure 3.8: Contour detection

But we want only the boundary of the pupil.We can see in the above contour detec-
tion that the pupil has the largest area. Therefore we sort the contours in from largest
area to smallest area and print only the biggest area which is the pupil by breaking the
loop after one execution.

Figure 3.9: Contour detection of only Figure 3.10: Contour detection of only
pupil pupil

As we can see above that the pupil boundary is detected.(Remember we are adjusting
the threshold value as we going through the process. One last thing we can do here is to
construct a rectangle around the pupil to detect the movement of it by finding the center
of the eye to get a more clear direction of the movement of the eye.

Department of ECE, IIITDM Kancheepuram, May 2021 9

CHAPTER 3. WORK DONE Enter roll number here

Figure 3.11: detection of movement of the pupil

Department of ECE, IIITDM Kancheepuram, May 2021 10

 CHAPTER 4

Conclusion and Future Scope

4.1 Conclusions

We have executed pupil detection of a moving eye(not real time) in Open cv.These are
some results of that.

Figure 4.1: Threshold detection Figure 4.2: contour detection

Figure 4.3: movement of direction of the eye

We have adapted different image processing techniques and methods from research
papers to obtain this algorithm like contour detection, gaussian blur etc.

4.2 Future Scope

We detected the pupil of the eye using different techniques and open cv.But this not
real time.Our main objective of the project is to detect the pupil in real time and allow
CHAPTER 4. CONCLUSION AND FUTURE SCOPE Enter roll number here

the person using the device to control the system or pc. For that we will need more
research and components like sensors, high resolution camera. There should also be
a software application in the system which can connect with the camera.Our plan to
execute a quality product but also a product whihch will be available to everyone

Department of ECE, IIITDM Kancheepuram, May 2021 12

 REFERENCES
[1] T. Wang, S. Zhang, L. Liu, G. Wu, and J. Dong, “Automatic facial paralysis eval-
uation augmented by a cascaded encoder network structure,” IEEE Access, vol. 7,
pp. 135 621–135 631, 2019.

[2] Y. Kihara, G. Duan, T. Nishida, N. Matsushiro, and Y.-W. Chen, “A dynamic

facial expression database for quantitative analysis of facial paralysis,” in 2011
6th International Conference on Computer Sciences and Convergence Information
Technology (ICCIT). IEEE, 2011, pp. 949–952.

[3] T. Ikeda, K. Ogawa, and K. Ohnishi, “Quantitative evaluation of stroke paraly-

sis considering individual differences in symptoms,” in 2015 IEEE International
Conference on Mechatronics (ICM). IEEE, 2015, pp. 138–143.

[4] D. Li, D. Winfield, and D. J. Parkhurst, “Starburst: A hybrid algorithm for video-
based eye tracking combining feature-based and model-based approaches,” in
2005 IEEE Computer Society Conference on Computer Vision and Pattern Recog-
nition (CVPR’05)-Workshops. IEEE, 2005, pp. 79–79.

[5] D. Li and D. J. Parkhurst, “Starburst: A robust algorithm for video-based eye

tracking,” Elselvier Science, vol. 6, 2005.

[6] Z.-H. Zhou and X. Geng, “Projection functions for eye detection,” Pattern recog-
nition, vol. 37, no. 5, pp. 1049–1056, 2004.

[7] M. Ciesla and P. Koziol, “Eye pupil location using webcam,” arXiv preprint
arXiv:1202.6517, 2012.

[8] M. Nasor, K. M. Rahman, M. M. Zubair, H. Ansari, and F. Mohamed, “Eye-

controlled mouse cursor for physically disabled individual,” in 2018 Advances in
Science and Engineering Technology International Conferences (ASET). IEEE,
2018, pp. 1–4.

[9] P. Bonteanu, A. Cracan, R. G. Bozomitu, and G. Bonteanu, “A new robust pupil

detection algorithm for eye tracking based human-computer interface,” in 2019
International Symposium on Signals, Circuits and Systems (ISSCS). IEEE, 2019,
pp. 1–4.

[10] E. S. Gedraite and M. Hadad, “Investigation on the effect of a gaussian blur in

image filtering and segmentation,” in Proceedings ELMAR-2011, 2011, pp. 393–
396.

13
design project
ORIGINALITY REPORT

19 %
SIMILARITY INDEX
7%
INTERNET SOURCES
4%
PUBLICATIONS
13%
STUDENT PAPERS

PRIMARY SOURCES

1
Submitted to Indian Institute of Information
Technology, Design and Manufacturing -
11%
Kancheepuram
Student Paper

2
Petronela Bonteanu, Arcadie Cracan, Radu
Gabriel Bozomitu, Gabriel Bonteanu. "A New
3%
Robust Pupil Detection Algorithm for Eye
Tracking Based Human-Computer Interface",
2019 International Symposium on Signals,
Circuits and Systems (ISSCS), 2019
Publication

3
Submitted to National College of Ireland
Student Paper 1%
4
Matthias Omotayo Oladele, Temilola Morufat
Adepoju, Olaide ` Abiodun Olatoke,
1%
Oluwaseun Adewale Ojo. "OFFLINE YORÙBÁ
HANDWRITTEN WORD RECOGNITION USING
GEOMETRIC FEATURE EXTRACTION AND
SUPPORT VECTOR MACHINE CLASSIFIER",
MALAYSIAN JOURNAL OF COMPUTING, 2020
Publication