Group 7 Presents

CHARACTER RECOGNITION
USING PEN TIP
Fernando Edwin Hipson (101817)
Sibin George (101819)
Radley Roy (101849)
ABSTRACT
 ABSTRACT
PROBLEM STATEMENT
● Schools and colleges now are
using online platform so no
traditional pen paper method
used.
● Mouse - inconvenient interface
● Graphics tablet - expensive
SOLUTION
● Air Writing (3D space)
● Using Computer Vision to trace
the trajectory of the pen
detected in front of the camera
● Using Deep Learning to
recognize the characters traced
by the model
INTRODUCTION
01 BACKGROUND
1. Human Based Interaction (HCI)
2. Gesture based systems

02 MOTIVATION
1. People unfamiliar with keyboard 03 OBJECTIVE
key arrangements and mouse
interface 1. Cost effective system
2. Teaching and presentations 2. Easy interface
could be made fun and easy 3. Sensor less system
3. Current solutions are expensive 4. Air-writing using camera
and uses sensors
LITERATURE
REVIEW
 LITERATURE REVIEW

ECONOMICAL AIR AIR WRITING

AIRNOTE WRITING SYSTEM RECOGNITION
Proposed an Air Writing Captures the video and Proposed use of LEAP -
model which used a converts it into a Motion Sensing Device for
fingertip detection model. sequence of frames. tracking
Actions performed by the Frames converted into Window sliding method
model depended on the
binary images and for detection
count of fingers detected.
appended into a single
Used an Air-Character image
recognition model
Character in the image is
Proposed a Word Suggester identified by using
for fast writing correlation mechanisms
against a database of
alphabets.
 LITERATURE REVIEW
Fingertip Detection
and Tracking
Detection of a writing hand
pose
Velocity based termination
criterion is used
Faster RCNN framework is
used for detection of
characters
Trajectory-based
Air-writing
Cursive style writing was
used for this model
This model takes in the
(x,y,z) co-ordinates from
the camera
Uses CNN algorithm for
the detection of characters
Unistroke Numeral
Recognition in
Air-Writing
Marker Segmentation
using generic color
segmentation technique.
Marker tip identification
Trajectory Approximation
Character Recognition
using CNN
CONCLUSION
Explored the realm and scope of our project. Literature
survey was done on few related research papers. Plan to
create a model to detect the trajectory of the pen, trace it and
recognize the traced character with deep learning algorithms.
Intent on creating a good user interface.

GOALS
Model to detect and trace the trajectory of the pen tip

Model for character recognition

Merge the 2 models

Create a user friendly interface

 REFERENCES
PAPERS REFERRED
1. M. Chen, G. AlRegib and B. Juang, "Air-Writing Recognition—Part II:
Detection and Recognition of Writing Activity in Continuous Stream of
Motion Data," in IEEE Transactions on Human-Machine Systems, vol. 46,
no. 3, pp. 436-444, June 2016, doi: 10.1109/THMS.2015.2492599.
2. P. Puranik, T. Sankhe, A. Singh, V. Vishwakarma and P. Rane, "AirNote – Pen
it Down!," 2019 10th International Conference on Computing,
Communication and Networking Technologies (ICCCNT), 2019, pp. 1-7, doi:
10.1109/ICCCNT45670.2019.8944690.
3. P. Ramasamy, G. Prabhu and R. Srinivasan, "An economical air writing
system converting finger movements to text using web camera," 2016
International Conference on Recent Trends in Information Technology
(ICRTIT), 2016, pp. 1-6, doi: 10.1109/ICRTIT.2016.7569563.
 REFERENCES
PAPERS REFERRED
1. Mukherjee, Sohom & Sk, Arif Ahmed & Dogra, Debi & Kar, Samarjit & Roy,
Partha. (2018). Fingertip Detection and Tracking for Recognition of
Air-Writing in Videos.
2. M. S. Alam, K. Kwon and N. Kim, "Trajectory-Based Air-Writing Character
Recognition Using Convolutional Neural Network," 2019 4th International
Conference on Control, Robotics and Cybernetics (CRC), 2019, pp. 86-90,
doi: 10.1109/CRC.2019.00026.
3. P. Roy, S. Ghosh and U. Pal, "A CNN Based Framework for Unistroke
Numeral Recognition in Air-Writing," 2018 16th International Conference on
Frontiers in Handwriting Recognition (ICFHR), 2018, pp. 404-409, doi:
10.1109/ICFHR-2018.2018.00077.
THANK YOU!