A PYTHON-BASED APPROACH FOR SIGN
LANGUAGE RECOGNITION
Baskar.D
Gowtham.M
Asst.prof
Department of Information Technology
Department of Information Technology
V.S.B ENGINEERING COLLEGE
V.S.B ENGINEERING COLLEGE
Karur, India
Karur, India
Akhillan.S Arivarasu.T
Department of Information Technology Department of Information Technology
V.S.B ENGINEERING COLLEGE V.S.B ENGINEERING COLLEGE
Karur, India Karur, India
ABSTRACT
The process of converting sign language
hand motions into spoken or written language is
known as sign language recognition. It involves
analysing and deciphering hand and finger
gestures using computer vision and machine
learning algorithms, then mapping those actions
to corresponding words or phrases. There are
various uses for sign language recognition,
including facilitating communication between
hearing and deaf persons, increasing accessibility
for those with hearing loss, and improving sign
language interpreting education and training
programmes. The usage of this technology could
fundamentally alter how interact with those who
use sign language as their primary form of
communication. There are various methods for
recognising sign language, including sensor-
based methods, computer vision methods, and
hybrid methods that integrate both. Computer
vision-based algorithms identify hand gestures
and movements by evaluating visual data from
cameras. Sensor-based approaches use sensors
that are attached to the hands or fingers to track
motion and record data. As a result, may
examine different ways to sign language
recognition and forecast a superior approach with
a higher accuracy rate.
KEYWORDS: Artificial intelligence, Hand
gestures, Sign language, Deep learning, Neural
networks
1. INTRODUCTION
Sign language recognition is a
transformative technology that bridges
Deivakumar.S
Department of Information Technology
V.S.B ENGINEERING COLLEGE
Karur, India
communication barriers between the Deaf or
hard of hearing community and the hearing
world. Sign language is a rich and expressive
form of communication using hand gestures,
facial expressions, and body movements, and it
serves as the primary means of communication
for many individuals [11][12]. However, this
linguistic diversity presents unique challenges in
automatic sign language recognition. In recent
years, advances in computer vision and machine
learning have paved the way for the development
of sign language recognition systems [13][14].
These systems hold immense promise in
enabling the Deaf community to interact with
technology, access educational resources, and
participate more fully in a world that
predominantly communicates using spoken
language. This technology has the potential to
enhance inclusivity, foster equal opportunities,
and revolutionize how communicate, making it
an exciting and essential field of research and
development. The development of sign language
recognition systems is underpinned by computer
vision and machine learning techniques [15]
[16]. These systems use cameras to capture and
analyse the movements of a signer's hands, face,
and body, and then translate these gestures into
textual or auditory output.[17][18] While still an
evolving field, the technology has made
significant progress, offering applications in
diverse areas such as:
Education: Sign language recognition can be
integrated into educational tools and platforms to
create a more inclusive learning environment
[19][20]. It enables Deaf students to access
content and communicate with teachers and
peers effectively.
Accessibility: In public spaces, such as
transportation hubs and government offices, sign
language recognition systems can facilitate
communication, ensuring that Deaf individuals
can access information and services
independently [21][22].
Healthcare: In healthcare settings, the technology
can be used to bridge the communication gap
between Deaf patients and medical professionals,
allowing for more accurate and empathetic care
[23][24].
Telecommunication: Sign language recognition
can be applied to video conferencing and real-
time communication platforms, enabling Deaf
individuals to participate in virtual meetings and
conversations [25][26].
Figure 1: Sign language for alphabets.
2. RELATED WORK
Farman shah, et.al,…[1] proposed for the
recognition of thirty-six static alphabets using
bare hands. The dataset is obtained from the sign
language videos. At a later step, four vision-
based features are extracted i.e., local binary
patterns, a histogram of oriented gradients, edge-
oriented histogram, and speeded up robust
features. The extracted features are individually
classified using Multiple kernel learning (MKL)
Assistive Devices: Wearable devices with sign
language recognition capabilities can serve as
personal interpreters, improving everyday
communication for Deaf individuals [27].
As research and development in sign
language recognition continue to advance, there
is an increasing focus on enhancing the accuracy
and robustness of these systems, supporting
various sign languages and regional dialects [28].
Furthermore, creating affordable and user-
friendly applications that integrate seamlessly
into daily life remains a critical goal [29]. Fig 1
[Sign Language MNIST on Kaggle] shows the
gestures for alphabets
in support vector machine (SVM). Then
employed a one-to-all approach for the
implementation of basic binary SVM into the
multi-class SVM. A voting scheme is adopted for
the final recognition and the performance of the
proposed technique is measured in terms of
accuracy, precision, recall, and F-score. The
simulation results are promising as compared
with existing approaches. Sign language is the
way of communication and interaction for deaf
people all around the world. This kind of
communication is accomplished over some hand
gestures, facial expressions, or movement of
arm/body. The sign language recognition system
aims to enable the deaf community to
communicate with normal society appropriately.
It is a highly structured symbolic set that
provides the human-computer interaction (HCI).
Sign language is very beneficial as a
communication tool, and every day millions of
deaf people around the world use sign language
to communicate and express their ideas. This
facilitation and assistance to deaf persons enable
and encourage them to be a healthy part of
society and integrate them into society.
Shikhar sharma, et.al,…[2] implemented
Sign language which is a structured form of hand
gestures involving visual motions and signs,
which are used as a communication system. For
the deaf and speech-impaired community, sign
language serves as useful tools for daily
interaction. Sign language involves the use of
different parts of body namely fingers, hand,
arm, head, body and facial expression to deliver
information. However, sign language is not
common among the hearing community, and
fewer are able to understand it. This poses a
genuine communication barrier between the deaf
community and the rest of the society, as a
problem yet to be fully solved until this day.
There are growing numbers of emerging
technology such as EMG, LMC, and Kinect
which capture gesture information more readily.
The common pre-processing method used are
Median and Gaussian filter as well as downsizing
of images prior to subsequent stages. Skin color
segmentation is one of the most commonly used
segmentation method. Color space which are
generally more robust towards illumination
condition are CIE Lab, YCbCr and HSV. More
recent research utilizes combination of several
others spatial features and modelling approaches
to improve segmentation performance.
Nikolas adaloglou, et.al,…[3] presented
a study to provide insights on sign language
recognition, focusing on mapping non-segmented
video streams to glosses. For this task, two new
sequence training criteria, known from the fields
of speech and scene text recognition, are
introduced. Furthermore, a plethora of pre-
training schemes is thoroughly discussed.
Finally, a new RGB+D dataset for the Greek sign
language is created. Sign Language Recognition
(SLR) can be defined as the task of inferring
glosses performed by a signer from video
captures. Even though there is a significant
amount of work in the field of SLR, a lack of a
complete experimental study is profound.
Moreover, most publications do not report results
in all available datasets or share their code. Thus,
experimental results in the field of SL are rarely
reproducible and lacking interpretation. Spoken
languages make use of the “vocal - auditory”
channel, as they are articulated with the mouth
and perceived with the ear. All writing systems
also derive from, or are representations of,
spoken languages. Sign languages (SLs) are
different as they make use of the “corporal -
visual” channel, produced with the body and
perceived with the eyes. SLs are not international
and they are widely used by the communities of
the Deaf. They are natural languages since they
are developed spontaneously wherever the Deaf
have the opportunity to congregate and
communicate mutually. In this paper, a
comparative experimental assessment of
computer vision-based methods for sign
language recognition is conducted. By
implementing the most recent deep neural
network methods in this field, a thorough
evaluation on multiple publicly available datasets
is performed.
Agelos kratimenos, et.al,…[4]
investigated the extraction of 3D body pose, face
and hand features for the task of Sign Language
Recognition. Compared these features, to Open
pose key-points, the most famous method for
extracting 2D skeleton parameters and features
from raw RGB frames and their optical flow that
are fed in a state-of-the-art Deep Learning
architecture used in action and sign language
recognition. The experiments revealed the
superiority of SMPL-X features due to the
detailed and qualitative features extraction in the
three aforementioned regions of interest.
Moreover, exploited SMPL-X to point out the
significance of combining all these three regions
for optimal results in SLR. Future work on 3D
body, face and hands extraction for SLR includes
further experiments in different independent
datasets with more signers and varying
environment. Furthermore, strongly believe that
applying SMPL-X in continuous SLR will give
further prominence to this method, where facial
expressions and body structure are even more
crucial. Finally, applying SMPL-X in different
action recognition tasks is an interesting
experiment to examine the universality of
SMPL-X success. In this work, employ SMPL-
X, a contemporary parametric model that enables
joint extraction of 3D body shape, face and hands
information from a single image. Use this
holistic 3D reconstruction for SLR,
demonstrating that it leads to higher accuracy
than recognition from raw RGB images and their
optical flow fed into the state-of-the-art I3D-type
network for 3D action recognition and from 2D
Open pose skeletons fed into a Recurrent Neural
Network
Ilham elouariachi,et.al,…[5]
implemented three components to constitute a
sign gesture: manual features which are gestures
made with hands, non-manual features such as
facial expressions, body posture, and finger-
spelling when words are spelt into alphabet. In
this context, the importance of fingerspelling can
be noticed when a concept lacks a specific sign,
such as names, technical terms, or foreign words.
Sign recognition is a difficult task due to the
complexity of its composition which uses signs
of different levels, words, facial expression, body
posture and finger-spelling to convey meaning.
With the development of recent technologies,
such as Kinect sensor, new opportunities have
emerged in the field of human computer
interaction and sign language, allowing to
capture both RGB and Depth (RGB-D)
information. In the regard to feature extraction,
the traditional methods process the RGB and
Depth images independently. In this paper,
propose a robust static finger-spelling sign
language recognition system adopting the
Quaternion algebra that provide a more robust
and holistically representation, based on fusing
RGB images and Depth information
simultaneously. Indeed, propose, for the first
time, a new sets of Quaternion Krawtchouk
moments(QKMs) and Explicit Quaternion
Krawtchouk Moment Invariants (EQKMIs). The
proposed system is evaluated on three well-
known fingerspelling datasets, demonstrate the
performance of the novel method compared to
other methods used in the literature, against
geometrical distortion, noisy conditions and
complex background, indicating that it could be
highly effective for many other computer vision
applications
Dongxu li, et.al,…[6] propose a new
method to improve the performance of sign
language recognition models by leveraging
cross-domain knowledge in the subtitled sign
news videos. Coarsely align isolated signs and
news signs by joint training and propose to store
class centroids in prototypical memory for online
training and offline inference purpose. Our
model then learns a domain-invariant descriptor
for each isolated sign. Based on the domain
invariant descriptor, employ temporal attention
mechanism to emphasize class-specific features
while suppressing those shared by different
classes. In this way, our classifier focuses on
learning features from class-specific
representation without being distracted.
Benefiting from our domain invariant descriptor
learning, our classifier not only outperforms the
state-of-the-art but also can localize sign words
from sentences automatically, significantly
reducing the laborious labelling procedure.
External memory equips a deep neural network
with capability of leveraging contextual
information. They are originally proposed for
document-level question answering (QA)
problems in natural language processing.
Recently, external memory mechanisms have
been applied to visual tracking, image
captioning, image classification and movie
comprehension. In general, external memory
often serves as a source providing additional
offline information to the model during training
and testing.
Ozge mercanoglu sincan, et.al,…[7]
summarised the ChaLearn LAP Large Scale
Signer Independent Isolated SLR Challenge. The
challenge attracted more than 190 participants in
two computational tracks (RGB and RGB+D),
who made more than 1.5K submissions in total.
Analysed and discussed the challenge design, top
winning solutions and results. Interestingly, the
challenge activity and results on the different
tracks showed that the research community in
this field is currently paying more attention to
RGB information, compared to RGB+Depth
data. Top winning methods combined hand/face
detection, pose estimation, and transfer learning,
external data, fusion/ensemble of modalities and
different strategies to model spatio-temporal
information. In some signs, there is only a subtle
difference in the position of the hand, e.g.,
government and Ataturk. While in the sign of
government the index finger touches under the
eye, in the sign of Ataturk it touches the cheek.
In some signs, there is only a subtle difference in
movement of hands, e.g., school and soup. In the
sign of soup, the hand moves a little more from
the bottom up. In some signs, facial expression
also contains an important clue for the meaning
of the sign, e.g., heavy. Although the nature of
the problems in this field is primarily similar to
the action recognition domain, some peculiarities
of sign languages make this domain specially
challenging; for instance, for some pairs of signs,
hand motion trajectories look very similar, yet
local hand gestures look slightly different. On the
other hand, for some pairs, hand gestures look
almost the same, and signs are identified only by
the differences in the non-manual features, i.e.,
facial expressions. In some cases, a very similar
hand gesture can impose a different meaning
depending on the number of repetitions. Another
challenge is the variation of signs when
performed by different signers, i.e., body and
pose variations, duration variations etc. Also,
variation in the illumination and background
makes the problem harder, which is inherently
problematic in computer vision.
Boháček, Matyáš, and Marek Hrúz, et.al,
…[8] explored the application of Transformer in
the task of isolated SLR. Previous works tackling
this problem have frequently used a
computationally heavy approach to obtain
sensible results or relied on pre-trained
backbones, which are preventing by using
handcrafted pose feature representations and
hence reducing the dimensionality. Furthermore,
previous systems could not fully utilize any
normalization or augmentations beyond the
standard ones applied to visual data. Propose a
novel approach of utilizing Transformer for this
task. Since our model operates on top of body
pose sequence representations, apply knowledge
from SL linguistics to create a robust
normalization technique as well as new data
augmentation techniques specific for the SL. And
validated the approach on two datasets for
isolated SLR.achieved overall state of the art
results for the LSA64 and established state of the
art results in the pose-based model category for
the WLASL.have also performed a performance
study comparing our model to the I3D baseline,
which proved that the newly proposed
architecture is substantially less demanding and
generalizes well even on very small training sets.
Katoch, Shagun, et.al,…[9] presented a
methodology to build a large, assorted and robust
real-time alphabets (A-Z) and digits (0–9)
recognition system for Indian Sign Language.
Instead of using high-end technologies like
gloves or the Kinect, here authors have
recognised signs from images (which are
accessed from a webcam). The accuracy obtained
in the result is also discussed in this paper. The
real-time, accurate and efficient judgement on
ISL sign recognition is required to bridge the
communication gap between the abled and the
hearing or speech impaired people. In future, the
dataset can be expanded by adding more signs
from different language of various countries,
thereby achieving a more effective framework
for real-time applications. The method can be
extended for the formation of simple words and
expressions for both continuous and isolated
recognition tasks. The secret to true real-time
applications is enhancing the response time.
Kothadiya, Deep, et al,…[10] presented
study was to develop a system that recognizes
sign language, and that can be used offline. A
vision-based approach was developed to obtain
the data from the signer. One of the main
features of this study is the ability of the system
to identify and recognize the words included in
IISL2020 (our customized dataset). The
IISL2020 dataset consists of 11 words; for each
word, there are about 1100 video samples of 16
research participants, including males and
females. The IISL2020 dataset was created
considering natural conditions—without extra
brightness, orientation, background adjustments,
gloves, etc. Unlike most sign language datasets,
the authors did not use any external help, such as
sensors or smart gloves to detect hand
movements. In future research, the model’s
accuracy could be improved by developing
different datasets under ideal conditions,
changing the orientation of the camera, and even
using wearable devices. Currently, the developed
models work in terms of isolated signs; this
approach could be utilized for interpreting
continuous sign language that leads to syntax
generation, especially in the context of ISL. The
use of vision transformers can lead to more
accurate results than those of feedback-based
learning models.
3. EXISTING METHODOLOGIES
The sign language is used widely by
people who are deaf-dumb these are used as a
medium for [30] . A sign language is nothing but
composed of various gestures formed by
different shapes of hand, its movements,
orientations as well as the facial expressions
[31]. There are around 466 million people
worldwide with hearing loss and 34 million of
these are children. `Deaf' people have very little
or no hearing ability. They use sign language for
communication. People use different sign
languages in different parts of the world [32].
Compared to spoken languages they are very less
in number. In existing system, lack of datasets
along with variance in sign language with
locality has resulted in restrained efforts in finger
gesture detection [33][34]. Existing project aims
at taking the basic step in bridging the
communication gap between normal people and
SIGN LANGUAGE BASED
APPROACHES
Vision based approach Sensor based approach
Fig 2. Sign language-based approaches
Vision-based systems use cameras as
primary tools to obtain the necessary input data.
The main advantage of using a camera is that it
removes the need for sensors in sensory gloves
and reduces the building costs of the system [38]
[39]. Cameras are quite cheap, and most laptops
use a high specification camera because of the
blur caused by a web camera [40] [41]
The use of a certain type of instrumented
gloves that are fitted with various sensors,
namely, flexion (or bend) sensors,
accelerometers (ACCs), proximity sensors, and
abduction sensors, is an alternative approach
with which to acquire gesture-related data [42]
[43]. These sensors are used to measure the bend
angles for fingers, the abduction between fingers,
and the orientation (roll, pitch, and yaw) of the
wrist. Degrees of freedom (DoF) that can be
realized using such gloves vary from 5 to 22,
depending on the number of sensors embedded in
the glove [44][45]
The third method of collecting raw
gesture data employs a hybrid approach that
combines glove- and camera-based systems. This
deaf and dumb people using Indian sign language
[50]. Effective extension of existing work is to
words and common expressions may not only
make the deaf and dumb people communicate
faster and easier with outer world, but also
provide a boost in Developing autonomous
systems for understanding and aiding them [35]
[36]. The Indian Sign Language lags behind its
American Counterpart as the research in this
field is hampered by the lack of standard datasets
[37].
Hybrid based approach
approach uses mutual error elimination to
enhance the overall accuracy and precision [46]
[47]. However, not much work has been carried
out in this direction due to the cost and
computational overheads of the entire setup.
Nevertheless, augmented reality systems produce
promising results when used with hybrid tracking
methodology [48][49]
4. PROPOSED METHODOLOGIES
Sign language is a crucial means of
communication for the Deaf and Hard of Hearing
community. Developing a robust sign language
recognition system using CNNs can facilitate
better communication and accessibility. This
proposed work aims to leverage deep learning
techniques to recognize and interpret sign
language gestures for real-time translation and
communication. Sign language serves as a vital
mode of communication for this community, and
the project's central objective is to develop an
accurate and efficient Convolutional Neural
Network (CNN) model capable of recognizing
and interpreting sign language gestures in real
time. The work will involve the creation of a
user-friendly application that allows for the
immediate recognition and translation of sign
language gestures. Additionally, the project will
explore the adaptability of the model to various
sign languages and signers, ensuring it can serve
a broader user base. To enhance the model's
performance, techniques such as data
augmentation and fine-tuning will be employed.
The long-term goal includes examining
opportunities to deploy the system in assistive
technology and educational contexts, ultimately
contributing to improved accessibility and
communication for the Deaf and Hard of Hearing
community.
CNN ALGORITHM STEPS
Data Collection:
 Collect a dataset of sign language
gestures. This dataset should consist of
images or video frames of individuals
making various sign language signs.
Ensure that the dataset is diverse and
well-labeled.
Data Preprocessing:
 Preprocess the dataset by resizing images
to a consistent size, normalizing pixel
values, and potentially applying data
augmentation techniques like rotation,
scaling, and brightness adjustment to
increase dataset diversity.
Data Splitting:
 Divide the dataset into training,
validation, and testing sets. The training
set is used to train the model, the
validation set is used for hyperparameter
tuning, and the testing set is for
evaluating the final model performance.
Model Architecture:
 Design the CNN architecture. It typically
consists of convolutional layers for
feature extraction and fully connected
layers for classification. The architecture
should be deep enough to capture
complex spatial patterns.
Convolutional Layers:
 Implement convolutional layers with
appropriate filter sizes and strides. These
layers learn to detect features and
patterns within the sign language
gestures.
Activation Functions:
 Apply activation functions, such as
ReLU (Rectified Linear Unit), after each
convolutional layer to introduce non-
linearity into the model.
Pooling Layers:
 Insert pooling layers, like max-pooling,
to reduce the spatial dimensions of the
feature maps while retaining essential
information. Pooling helps make the
model more robust to variations in hand
positions.
Flatten Layer:
 After convolutional and pooling layers,
add a flatten layer to convert the 2D
feature maps into a 1D vector for input
to the fully connected layers.
Fully Connected Layers:
 Incorporate fully connected layers for
classification. These layers should have
neurons equal to the number of distinct
signs want to recognize. Use an
appropriate activation function for the
output layer (e.g., softmax for multi-
class classification).
Loss Function:
 Choose a suitable loss function, such as
categorical cross-entropy, to measure the
error between the predicted sign and the
actual sign in the training data.
Optimization Algorithm:
 Select an optimization algorithm (e.g.,
Adam, SGD) to minimize the loss
function. Set hyperparameters like
learning rate and momentum.
Training:
 Train the CNN model using the training
dataset. This involves forward and
backward passes to update the model's
weights through multiple epochs.
Validation:
  Validate the model's performance on the
validation set during training. Monitor
metrics like accuracy and loss to tune
hyperparameters and prevent overfitting.
Testing:
 After training, evaluate the model on the
testing set to assess its generalization and
accuracy.
Fine-Tuning (Optional):
Fig 3: Proposed Block diagram
In this diagram, can split the proposed
work into two phases such as training and testing
phase. In training phase, features vector files are
trained using CNN algorithm. In testing phase,
user hand capture from camera and detect the
hand regions and finger regions. Finally gesture
values are classified and provide the voice alert
about recognized sign.
5. CONCLUSION
 Fine-tune hyperparameters or the model
architecture to improve performance if
necessary.
Deployment:
 Deploy the trained CNN for real-time
sign language recognition, possibly
integrating it into an application or
device with a user-friendly interface.
These steps provide a framework for building a
CNN for sign language recognition, and they can
be adjusted based on the specific requirements of
sign language recognition
Everyone can very persuasively transfer
their thoughts and comprehend each other
through speech. Our initiative intends to close
the gap by including a low-cost computer into
the communication chain, allowing sign
language to be captured, recognised, and
translated into speech for the benefit of blind
individuals. An image processing technique is
employed in this paper to recognise the
handmade movements. This application is used
to present a modern integrated planned system
for hearing impaired people. The camera-based
zone of interest can aid in the user's data
collection. From this survey, vision based real
time streaming approach with CNN algorithm
provide improved efficiency than the existing
sensor and hybrid approaches. Sensor based
approach have high cost and difficult to
implement hybrid approach.
REFERENCES
1. Shah, Farman, et al. "Sign language
recognition using multiple kernel learning: A
case study of pakistan sign language." Ieee
Access 9 (2021): 67548-67558.
2. Sharma, Shikhar, and Krishan Kumar. "ASL-
3DCNN: American sign language recognition
technique using 3-D convolutional neural
networks." Multimedia Tools and
Applications 80.17 (2021): 26319-26331.
3. Adaloglou, Nikolaos M., et al. "A
comprehensive study on deep learning-based
methods for sign language recognition." IEEE
Transactions on Multimedia (2021).
4. Kratimenos, Agelos, Georgios Pavlakos, and
Petros Maragos. "Independent sign language
recognition with 3d body, hands, and face
reconstruction." ICASSP 2021-2021 IEEE
International Conference on Acoustics, Speech
and Signal Processing (ICASSP). IEEE, 2021.
5. Elouariachi, Ilham, et al. "Explicit quaternion
krawtchouk moment invariants for finger-
spelling sign language recognition." 2020 28th
European Signal Processing Conference
(EUSIPCO). IEEE, 2021.
6. Li, Dongxu, et al. "Transferring cross-domain
knowledge for video sign language
recognition." Proceedings of the IEEE/CVF
Conference on Computer Vision and Pattern
Recognition. 2020.
7. Sincan, Ozge Mercanoglu, et al. "Chalearn
LAP large scale signer independent isolated sign
language recognition challenge: Design, results
and future research." Proceedings of the
IEEE/CVF Conference on Computer Vision and
Pattern Recognition. 2021.
8. Boháček, Matyáš, and Marek Hrúz. "Sign
pose-based transformer for word-level sign
language recognition." Proceedings of the
IEEE/CVF winter conference on applications of
computer vision. 2022
9. Katoch, Shagun, Varsha Singh, and Uma
Shanker Tiwary. "Indian Sign Language
recognition system using SURF with SVM and
CNN." Array 14 (2022): 100141.
10. Kothadiya, Deep, et al. "Deepsign: Sign
language detection and recognition using deep
learning." Electronics 11.11 (2022): 1780.
11. A. Wadhawan and P. Kumar, ‘‘Deep
learning-based sign language recognition system
for static signs,’’ Neural Comput. Appl., vol. 32,
no. 12, pp. 7957–7968, Jun. 2020.
12. M. Jiang, J. Dong, D. Ma, J. Sun, J. He, and
L. Lang, ‘‘Inception spatial temporal graph
convolutional networks for skeleton-based action
recognition,’’ in Proc. Int. Symp. Control Eng.
Robot. (ISCER), Feb. 2022, pp. 208–213.
13. P. Das and A. Ortega, ‘‘Symmetric sub-graph
spatio-temporal graph convolution and its
application in complex activity recognition,’’ in
Proc. IEEE Int. Conf. Acoust., Speech Signal
Process. (ICASSP), Jun. 2021, pp. 3215–3219.
14.Z. Huang, X. Shen, X. Tian, H. Li, J. Huang,
and X.-S. Hua, ‘‘Spatio– temporal inception
graph convolutional networks for skeleton-based
action recognition,’’ in Proc. 28th ACM Int.
Conf. Multimedia, Oct. 2020, pp. 2122–2130.
15. A. A. Hosain, P. Selvam Santhalingam, P.
Pathak, H. Rangwala, and J. Kosecka, ‘‘Hand
pose guided 3D pooling for word-level sign
language recognition,’’ in Proc. IEEE Winter
Conf. Appl. Comput. Vis. (WACV), Jan. 2021,
pp. 3429–3439.
16. J. Li, C. Xu, Z. Chen, S. Bian, L. Yang, and
C. Lu, ‘‘HybrIK: A hybrid analytical-neural
inverse kinematics solution for 3D human pose
and shape estimation,’’ in Proc. IEEE/CVF Conf.
Comput. Vis. Pattern Recognit. (CVPR), Jun.
2021, pp. 3383–3393.
17. D. Li, C. R. Opazo, X. Yu, and H. Li,
‘‘Word-level deep sign language recognition
from video: A new large-scale dataset and
methods comparison,’’ in Proc. IEEE Winter
Conf. Appl. Comput. Vis. (WACV), Mar. 2020,
pp. 1459–1469.
18. A. Tunga, S. V. Nuthalapati, and J. Wachs,
‘‘Pose-based sign language recognition using
GCN and BERT,’’ in Proc. IEEE Winter Conf.
Appl. Comput. Vis. Workshops (WACVW), Jan.
2021, pp. 31–40.