STES’s

Sou. Venutai Chavan Polytechnic,

Pune
Department of Computer Technology

Capstone Project
Academic Year 2021-2022
 Virtual Mouse using Hand Gestures

Virtual Mouse using Hand Gestures

Presented By

23. Dnyaneshwari More

31. Shrutika Gade
33. Nikita Sonawane
35. Swapnali Patil

Under the Guidance of

Mrs. P. V. Javkar

June 06, 2022 2 Department of Computer Technology, SVCP

 Virtual Mouse using Hand Gestures

Table of Content
01 Introduction to 05 UML Diagram
the Project

Screenshots of the
02 Architecture of 06
Project
the Project

03 Working Model 07 Conclusion

Hardware Future Scope

08
Requirements
04
Software
Requirements
09 References
June 06, 2022 3 Department of Computer Technology, SVCP
 Virtual Mouse using Hand Gestures

Introduction to the Project

• The main objective of our system to perform
computer mouse cursor functions using a web
camera or build in camera, instead using
traditional mouse device.

• Hand gestures and hand tip detection by using

computer vision is used as a HCL , with the
use of the AI virtual mouse system.

June 06, 2022 4 Department of Computer Technology, SVCP

 Virtual Mouse using Hand Gestures

Architecture of the Project

0
03
01
Capturing 2

Accessing Video Hand

Camera through Tracking
camera

05 04
06
Action Detect
Feature
Performe the
Extraction
d Gesture

June 06, 2022 5 Department of Computer Technology, SVCP

 Virtual Mouse using Hand Gestures

Working Model

June 06, 2022 6 Department of Computer Technology, SVCP

 Virtual Mouse using Hand Gestures

Hardware and Software Requirements

Hardware Requirements
Processor Intel i5

Speed 1.1 GHz

RAM 8 GB (min.)

Hard Disk 500 GB

Keyboard Standard Windows

Monitor SVGA

June 06, 2022 7 Department of Computer Technology, SVCP

 Virtual Mouse using Hand Gestures

Hardware and Software Requirements

Software Requirements
Operating System Windows 10

IDE Visual Studio Code

Script Python 3.7

Open CV
MediaPipe
NumPy
Libraries Time
Math
Autopy

June 06, 2022 8 Department of Computer Technology, SVCP

 Virtual Mouse using Hand Gestures

Use-Case Diagram

June 06, 2022 9 Department of Computer Technology, SVCP

 Virtual Mouse using Hand Gestures

Screenshots of the Project

Figure1: Landmarks of the Hand

Figure2: Index Finger Up causes the Mouse to Move

June 06, 2022 11 Department of Computer Technology, SVCP

 Virtual Mouse using Hand Gestures

Screenshots of the Project

Figure 3: Mouse Moving using Hand Gestures

Figure 4: Index Finger and Middle Finger performing Double-Click Operation

June 06, 2022 12 Department of Computer Technology, SVCP

 Virtual Mouse using Hand Gestures

Screenshots of the Project

Figure 5: Folder Opened using Virtual Mouse

June 06, 2022 13 Department of Computer Technology, SVCP

 Virtual Mouse using Hand Gestures

Conclusion
• This project presented a brand new AI Virtual Mouse
method using OpenCv ,autopy, mediapipe by the help of
fignertip movement interacted with the computer in front
of camera without using any physical device .
• We also intended to add new gesture on it to handle the
system more easily and interact with other system .
• This is a project which uses the whole new technology
making the human computer interaction in an easy and
friendly way with a very minimal project cost .
June 06, 2022 14 Department of Computer Technology, SVCP
 Virtual Mouse using Hand Gestures

Future Scope

• The use of object detection and image

processing in OpenCV for the implementation
of our work has proved to be practically
successful and the task of mouse is achieved
with good precision.

• Though, our system can be used as an

alternative for physical mouse, it still may
perform less accurately in a low light
condition. This is a concern for further
research.

June 06, 2022 16 Department of Computer Technology, SVCP

 Virtual Mouse using Hand Gestures

References

● [1] Abhilash S. S., Lisho Thomas, Naveen Wilson, Chaithanya C.,

performed “Virtual Mouse using Hand Gesture”, (year. 2018).
● [2] S. Shriram, B. Nagaraj, J. Jaya, S. Shankar, P. Ajay, performed
“Deep Learning-Based Real-Time AI Virtual Mouse System using
Computer Vision to Avoid Covid-19 Spread”, (year. 2021).
● [3] Vijay Kumar Sharma, Vimal Kumar, Md. Iqbal, Sachin Tawara,
Vishal Jayaswal, performed “Virtual Mouse Control using Hand Class
Gesture”, (year 2020).
● [4] Saniya Khan, Dnyaneshwari Bagekar, Abhishek Chauhan, Prof.
Deveshree Wankhede, performed “Virtual Mouse using Hand
Gesture”, (year. 2021).

June 06, 2022 16 Department of Computer Technology, SVCP