You are on page 1of 4

e-ISSN: 2582-5208

International Research Journal of Modernization in Engineering Technology and Science


( Peer-Reviewed, Open Access, Fully Refereed International Journal )
Volume:04/Issue:06/June-2022 Impact Factor- 6.752 www.irjmets.com
GESTURE VOLUME CONTROL USING OPENCV
Sagar Bounsley R*1, Thanuja JC*2
*1Dept. Of MCA, Bangalore Institute Of Technology, Bengaluru, India.
*2Dept. Of MCA, Assistant Professor, Bangalore Institute Of Technology, Bengaluru, India.
ABSTRACT
Gestures plays very important role in communication Information among the human. Nowadays new
technologies of Human Computer Interaction (HCI) are being developed to deliver user's instructions to the
Machines. Users can communicate with machines using hand, facial expressions, voice and touch. Gesture
recognition has attracted a lot of research people interests in computer vision, pattern recognition, and human–
computer interaction. The main aim and objective of this research paper is to use one of the important modes of
interaction that is to control the machine using hand gestures. We have used openCv libraries to overcome the
challenges of recognizing the gestures in Human-computer-interaction. OpenCV is a most commonly used tool
for image processing and performing computer vision tasks. OpenCV has more than 47000 people of user
community and estimated number of downloads exceeding 18 million as per 2020 survey.
I. INTRODUCTION
Recently, Human computer interaction technology(HCI) has attracted attention as a promising means of human
computer communication. Human–machine interaction (HMI) refers to the communication and interaction
between a human and a machine via a user interface. In recent decades hand gesture recognition is considered
as a new technique of Human-Computer Interaction because of its automatic, natural and easiness without
requiring input from output devices like keyboard and mouse. By using Hand gestures user can interact more
information in less time duration. So for upgrading the interface between users and computers, human
computers interaction (HCI) technology has great utilization. The best advantage of hands is the ability to
communicate remotely.The use of HCI hand gestures requires that the human hand configuration be measured
by a computer. Performance is highly dependent on the accuracy of the acquisition and tracking of handicrafts.
The main aim of proposed system is to identify specific human hand gestures and we can use it to convey
information or we can control any device or robot for working applications.
II. LITERATURE SURVEY
First, In vision based approach, there are various techniques used for hand detection, training the gestures and
finger tip detection.
There are multiple software for image processing application but among them OpenCV (Open Source for
Computer Vision) software is very popular for Real time image processing applications such as object detection
& gesture recognition. The major advantage is that one can easily integrate the code with hardware. We
implement the proposed system on OpenCV library based on Operating System environment.
OpenCV (Open Source Computer Vision Library) is a library of programming functions mainly aimed at real-
time computer vision. Originally developed by Intel in 1999. openCv is written in C and C++ programming
Language.
Applications of OpenCV:
There are lots of applications which are solved using OpenCV,
some of them are listed below
* face recognition
* Automated inspection and surveillance
* number of people – count (face mask detection count,etc)
* Vehicle counting on highways along with their speeds
* Interactive art installations
* Street view image stitching

www.irjmets.com @International Research Journal of Modernization in Engineering, Technology and Science


[4169]
e-ISSN: 2582-5208
International Research Journal of Modernization in Engineering Technology and Science
( Peer-Reviewed, Open Access, Fully Refereed International Journal )
Volume:04/Issue:06/June-2022 Impact Factor- 6.752 www.irjmets.com
* Video/image search and retrieval
* Robot and driver-less car navigation and control
* object recognition
* Medical image analysis
* Movies – 3D structure from motion
* TV Channels advertisement recognition
OpenCV Functionality
* Image/video I/O, processing, display (core, imgproc, highgui)
* Object/feature detection (objdetect, features2d, nonfree)
* Geometry-based monocular or stereo computer vision
* Computational photography (photo, video, superres)
* Machine learning & clustering (ml, flann)
* CUDA acceleration (gpu)

Figure: Capturing an image of our hand using OPenCV


III. METHODOLOGY
Image-Processing:
Image processing is a method to perform some operations on an image, in order to get an enhanced image and
or to extract some useful information from it. If we talk about the basic definition of image processing then
“Image processing is the analysis and manipulation of a digitized image, especially in order to improve its
quality”.
Image processing is basically signal processing in which input is an image and output is image or characteristics
according to requirement associated with that image.
Image processing basically includes the following three steps:
* Importing the image
* Analysing and manipulating the image
* Output in which result can be altered image or report that is based on image analysis

www.irjmets.com @International Research Journal of Modernization in Engineering, Technology and Science


[4170]
e-ISSN: 2582-5208
International Research Journal of Modernization in Engineering Technology and Science
( Peer-Reviewed, Open Access, Fully Refereed International Journal )
Volume:04/Issue:06/June-2022 Impact Factor- 6.752 www.irjmets.com
MediaPipe :
Mediapipe is an open source cross-platform framework provided by Google to build a pipeline for processing
perceptual data from different modalities such as video and audio. The solutions used in MediaPipe include
multiple items such as posture estimation and face recognition. In this paper, we will use MediaPipe Hands for
hand tracking.

Pycaw :
Python Core Audio Windows Library.The python package pycaw receives a total of 1,399 weekly downloads.
pycaw is a Python library typically used in Programming Style, Reactive Programming applications.
pycaw has no bugs, it has no vulnerabilities, it has build file available, it has a Permissive License and it has low
support. You can install using 'pip install pycaw' or download it. Basically Pycaw is used to Manipulate the
Audio.

www.irjmets.com @International Research Journal of Modernization in Engineering, Technology and Science


[4171]
e-ISSN: 2582-5208
International Research Journal of Modernization in Engineering Technology and Science
( Peer-Reviewed, Open Access, Fully Refereed International Journal )
Volume:04/Issue:06/June-2022 Impact Factor- 6.752 www.irjmets.com

Figure: Controlling volume of our system using hand


IV. RESULTS
As a first step we try the hand detection based on available database of OpenCV. Then for capturing live hand of
Camera the initialization has been done. The two gesture detection like palm and fist by green line which is
trained by integral images. The second step is the extracted image gestures which are compared with stored
positive-negative integral image dataset and perform finger tip tracking by contour detection. The third step
Mediapipe locate the palm and detect the 21 hand Landmarks according to Action. Mediapipe tracks the action
between thumb and index finger and give command to Pycaw to maximize or Minimize the audio.
V. CONCLUSION
The Aim of this project is to develop a real time Gesture Volume Control System. This paper explains a model
that is useful in controlling Audio volume of system with the help of hand gestures. The proposed method here
successfully developed a hand gesture volume control, which is able to manipulate (max to min) with gesture is
performed by the person and accordingly perform the functionality associated with it accuracy.
We have achieved 95% of accuracy using Mediapipe's technology and Machine Learning. The main integral
part of the system presently are the webcam.
VI. REFERENCES
[1] https://ieeexplore.ieee.org/abstract/document/7150886/ Real time finger tracking and contour
detection for gesture recognition using opencv.
[2] http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.667.104&rep=rep1&type=pdf
Hand Gesture Recognition Techniques For Human Computer Interaction.
[3] https://link.springer.com/chapter/10.1007/978-3-030-41862-5_174
Hand gesture recognition using OpenCv and Python
[4] https://ijisrt.com/assets/upload/files/IJISRT22MAY250_(1).pdf ] Volume Control using Gestures.

www.irjmets.com @International Research Journal of Modernization in Engineering, Technology and Science


[4172]

You might also like