You are on page 1of 11

This article has been accepted for publication in IEEE Sensors Journal.

This is the author's version which has not been fully edited and
content may change prior to final publication. Citation information: DOI 10.1109/JSEN.2022.3193718

IEEE SENSORS JOURNAL, VOL. XX, NO. XX, 2022 1

Hand Gestures Classification using Electrical


Impedance Tomography Images
Mehmood Nawaz, Russell W. Chan, Anju Malik Member, IEEE, Tariq Khan, and Peng Cao

Abstract— Human-computer communication using hand gestures


has always been difficult. More than half a century ago people
used different ways of interaction with computers from the early
mediums such as perforated game cards. Nowadays, if a richer lex-
icon of gestures is given, people can communicate more effectively
with computers. Machine learning is now used to recognize and
classify the hand gestures more precise way. In order to increase
the communication between computer and human, we proposed a
technique which uses a wearable low-cost device to generate the
Electrical Impedance Tomography (EIT) images to recover the inner
impedance structure of a user’s wrist. This is done by measuring the
transverse impedance between all the sixteen pairs of electrodes of
wrist band that lie on the skin of the user hand. The proposed technique is enough to integrate the technology into the
prototype wrist band to monitor and classify gestures in real time. We have conducted a study of sixteen gestures with
a focus on gross hand and pinches finger gestures. The results evaluation shows that the gross hand gestures achieved
90% accuracy in wrist position, while pinches gestures achieved 93% accuracy.
Index Terms— Bio-impedance, Electrical impedance tomography, Gesture classification, High resolution image, Image
reconstruction, Wrist band.

I. I NTRODUCTION the impedance distribution from different pairs of electrodes


surrounding an object [9]. When a hand gesture is produced,
H AND gesture recognition is considered as an important
communication tool, which is used in several human-
computer interactions (HCI) scenarios, such as gaming [1],
a temporal difference in conductivity distribution is formed
by the contraction/relaxation of muscles and bones under the
sign language translation [2], voice generation for speech hand skin that can be determined by EIT system.
impairments [3]. The hand gesture recognition pipeline mainly The benefits of EIT system includes radiation-free en-
consists of two blocks: first is the hand gesture capturing vironment, rapid reaction time, and non-destructive nature.
block, where the gesture is captured and stored in computer EIT technology has been applied in several diverse fields
memory, and second is the gesture recognition block, that uses of studies, such as biotechnology [10], [11], [12] material
machine learning techniques to classify the given gesture. engineering [13], medical examination [14], [15], and civil
One of the commonly used method for gesture capturing engineering [16]. Additionally, EIT is a non-invasive and
is camera-assisted technique [4] [5], where an image of a comparatively inexpensive to other tomographic techniques,
single gesture is taken and given as an input to the recognition such as magnetic resonance imaging (MRI) and computed
block [6] [7]. It is a traditional approach and has several tomography (CT) images.
functional drawbacks, i.e need for line-of-sight and application For real time gesture recognition, the resolution of the
restrictions, such as the inability to develop a prosthetic hand. generated EIT image should be high. In order to obtain high-
A recent tomography based gesture capturing technique is resolution images, the commonly employed approach is to
proposed, which is an efficient medical imaging technique, increase the electrode count [17] [18]; more electrodes allow
that uses impedance and low amplitude current for cross- to collect more sophisticated impedance distribution, which
sectional analysis of the composition and inner structures of helps to reconstruct a high resolution image. The large number
the conductive object [8]. The Electrical Impedance Tomog- of electrodes increase the EIT image resolution as well as
raphy (EIT) is a particular case of tomography, that estimates computational power of the system. Tawil et al. [19] proposed
a technique which is used to reconstruct the EIT image within
Mehmood Nawaz and Cao Peng are with the Department of Diag- the conducting domain. This technique is not good enough
nostic Radiology, The University of Hong Kong, Hong Kong. Email:
mehmood.nawaz136@yahoo.com, and caopeng1@hku.hk. Anju Malik for high resolution images in EIT [18]. The low resolution
is with the Department of Electrical Engineering, City University of Hong EIT image is not suitable for the medical domain, where non-
Kong, Kowloon, Hong Kong. Tariq Khan is with The University of New invasive and non-destructive operations are needed.
South Wales, Sydney Australia. Russell W. Chan is a founder, employee,
and shareholder of Gense Technologies Ltd.” EIT-based gesture recognition approach [20] is used to
Corresponding author: Peng Cao optimize the drive pattern of impedance, and decoding grasp

© 2022 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission.See https://www.ieee.org/publications/rights/index.html for more information.
Authorized licensed use limited to: ANNA UNIVERSITY. Downloaded on August 04,2022 at 08:20:15 UTC from IEEE Xplore. Restrictions apply.
This article has been accepted for publication in IEEE Sensors Journal. This is the author's version which has not been fully edited and
content may change prior to final publication. Citation information: DOI 10.1109/JSEN.2022.3193718
2 IEEE SENSORS JOURNAL, VOL. XX, NO. XX, 2022

data signal as shown in Fig. 1. Additionally, we proposed


a Bayesian-ResNet-18 classification technique to classify and
recognize the different hand gestures.
Contributions: The main contributions of this paper are:
• A consistence image reconstruction technique is used to
obtain a high-resolution EIT image by integrating initial
EIT images that are generated by the wrist band with 16
(a) (b) (c) electrodes.
• The localization process is presented to extract ROI
Fig. 1: Shows the affects of band pass filter on EIT data. (a) from EIT images using band pass filtering technique. It
shows the one-dimensional filtered and unfiltered signal, (b) smooths the raw data signals and highlights the geomet-
shows the 2D EIT image without filtering data, and (c) shows rical features of the wrist tissues.
the 2D EIT image with filtering data. So, the filtered EIT data • A deep learning based classification approach is intro-
has high features including clear bones and muscles area of duced for gesture recognition and classification. It uses
the wrist. ResNet-18 and Bayesian optimizer as a back bone.
• Experimental results on different number of subjects
validate the efficacy of our classification system and show
strength [8] for EIT images. In these studies [20], [8], the significant improvement in quality.
two-dimensional (2D) EIT projection systems are used to The rest of the paper is organized as: the literature review
project the three-dimensional (3D) muscular convulsion with is discussed in Section II. The EIT image reconstruction
low spatial resolution on a cross-sectional plane. These ap- is explained in Section III. The wrist data acquisition and
proaches [20], [8] are vulnerable to error detection. Addition- classification is shown in Section IV. The experimental results
ally, in [20], the experiments were performed only for static are described in Section V and Section VI concludes the
gestures. Similarly, the drive patterns [21] was optimized in proposed technique.
the neighborhood by re-positioning the electrodes in the EIT
system. The EIT images of the nerve [22] were analyzed, and
a two-cylinder finite element (FE) model was constructed that II. L ITERATURE R EVIEW
used 16 electrodes. All of these studies [20], [8], [21], and [22] The hand gestures are seen as an essential interaction tool
attempt to produce high resolution EIT images with high to convey information. Hand gestures are in use even before
computational power that is insufficient for an ideal gestures the invention of language [26]. In the modern technology,
classification system. hand gesture recognition systems have a wide area of ap-
An armband-based EIT approach is proposed to interpret the plications in human-computer interactions [27], such as sign
hand movement [23], which is called “TOMO” derived from language detection [24] and robotic arms for amputees [28].
the tomography. This approach first captures the generated In general, most of the approaches for gesture recognition are
impedance signal and then uses a machine learning approach based on camera assistance and wearable devices. The camera
to classify the given gesture. This approach uses a two- assistance-based approaches discussed in [5], [29], [30] are
terminal measurement method with eight electrodes. Later, the flexible and do not require any wearable devices. However,
idea of TOMO was further improved by using 16 electrodes these approaches are not applicable where the interpretation of
with a complex measurement scheme of four terminals [24]. the fine details of the muscular movement is essential. They
These studies show that the quality of the obtained EIT images did not give the inner geometry of wrist hand muscles during
can be improved by increasing the number of electrodes mea- different gestures movement.
surements. However, the increase in electrodes measurements The commonly used technique for gesture recogni-
raise the difficulties in multifaceted data acquisition and cost tion in wearable devices is surface electromyography
processing time. The existing EIT-based gesture recognition (SEMG) [31] [32], where muscular activities are recorded
approaches [18]- [23] are insufficient to obtain high-resolution by attaching electrodes to the skin surface. This approach
images at low cost. However, an efficient image reconstruction is simple and non-invasive. The performance comparison of
and classification approach is needed to classify the hand different SEMG approaches for forearm and wrist level is
gestures in real time applications. presented in [33]. This study [33] demonstrated that the high-
In this paper, we proposed a robust deep learning based quality SEMG signal with less noise could be obtained from
approach for hand gesture classification and recognition. The the wrist position as compared to the forearm. The recon-
proposed integration module integrates the initial EIT images structed images of SEMG approach are low resolution [34].
to obtain a high-resolution EIT image, and the localization Additionally, SEMG can detect signals at a maximum of
process identifies the region of interest (ROI) in generated 1 cm beneath the skin, while signals from deeper muscles
impedance data of the wrist tissues using band pass filter as are not detectable. Other approaches such as implantable
shown in Fig. 1. The initial EIT images are obtained by a myoelectric sensors (IMES) [35] and transverse intrafascicular
fully wearable EIT-based wristband equipped with 16 elec- multi-channel electrode [34] are invasive and have limited
trodes band. The localization process highlights the muscles applications [20] than EIT system. WU et al. proposed a
features. It smooths the irregular behavior of the in-vivo wrist human-machine interface that connects the user to a hand

© 2022 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission.See https://www.ieee.org/publications/rights/index.html for more information.
Authorized licensed use limited to: ANNA UNIVERSITY. Downloaded on August 04,2022 at 08:20:15 UTC from IEEE Xplore. Restrictions apply.
This article has been accepted for publication in IEEE Sensors Journal. This is the author's version which has not been fully edited and
content may change prior to final publication. Citation information: DOI 10.1109/JSEN.2022.3193718
MEHMOOD et al.: HAND GESTURES CLASSIFICATION USING ELECTRICAL IMPEDANCE TOMOGRAPHY IMAGES 3

Fig. 2: The conductivity values of different body tissues in wrist region. From left to right, the frequency range increases from
10KHz to 350KHz but conductivity of tissues remain constant [25]. The vertical values show conductivity (s/m) and horizontal
values show the frequency range (KHz).

prosthesis. It successfully employs an array of electrodes The conventional approaches adopt finite element methods
enclosed on a wristband on the user’s forearm to perform (FEM), which is resulting in high computational cost [19].
electrical impedance tomography. Total eight electrodes are Some techniques are using low computational machine learn-
used to measure the bio-impedance of hand tissues.Despite ing algorithms for object segmentation and detection in images
the fact that training just takes a few minute, which is the [43], [44], [45], [46], [47], [48], [49], [50]. So, the high quality
drawback of this system. The early investigation in this system image acquiring on low computational cost is a main challenge
shows that the feature changes can be acquired due to the in EIT system.
electrode band location [36]. Our body tissues have different impedance value. For ex-
Electrical impedance tomography (EIT) is considered ample, muscles and blood veins have low impedance while
as a possible alternative technique for signal acquisition. skin and bones tissues are high in impedance as shown in
In [37], [38], the viability of EIT is studied for wearable Fig. 2. The most common approaches use specific frequency
devices to detect the hand motion, specifically, touching one range to measure the bio impedance. Some instruments use
finger with the other. These studies have limited use in multiple frequencies like MF-BIA (multi-frequency bioelec-
two-handed gesture touching applications. The estimation of trical impedance analysis). The most basic instruments are
wrist angle for gesture recognition applications is investigated based on a single-frequency measurement of the bioelectrical
in [39]. A comparative study for intra-electrode distance in impedance’s (SF-BIA) or bioimpedance spectroscopy (BIS).
EIT system is presented in [40], where the optimal distance is There are also several methods for assessing the bio
defined by estimating the change in real and imaginary parts impedance outcomes. The most significant are bioelectrical
of impedance measurements. impedance vector analysis and real-time analysis. The mus-
A study related to flexible EIT-based sensor for fingertip cles and blood have comparable resistance values and their
movement detection is reported in [41]; this approach is based impedance is not significantly important if we increase fre-
on 8 and 16 electrodes and uses a baseline update procedure quency upto 350 KHz. It is proven that it cannot be supposed
called iSoft. The use of opposite drive pattern is proposed in impedance plethysmography. In a different research, the
in [42] to identify the contact location for robotic application; researchers have used below 10 KHz frequency to achieve a
this technique based on electrical impedance tomography of constant blood and tissue impedance ratio. The impact of po-
8 and 16 electrodes with supervised quadratic classification larization processes of electrodes are examined on impedance
algorithms. This approach achieves better performance as measurement devices. The hand tissue resistance and capacity
compared to flexible EIT. But this study did not consider the over a broad range of frequencies are described in Fig. 2. The
optimization of data acquisition methods. Other EIT based different conductivity values of body tissues are very helpful
approaches [22]- [24] used additional use of electrodes to en- to reconstruct an instructive EIT image.
hance the image quality, which is a highly non-linear problem.

© 2022 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission.See https://www.ieee.org/publications/rights/index.html for more information.
Authorized licensed use limited to: ANNA UNIVERSITY. Downloaded on August 04,2022 at 08:20:15 UTC from IEEE Xplore. Restrictions apply.
This article has been accepted for publication in IEEE Sensors Journal. This is the author's version which has not been fully edited and
content may change prior to final publication. Citation information: DOI 10.1109/JSEN.2022.3193718
4 IEEE SENSORS JOURNAL, VOL. XX, NO. XX, 2022

Fig. 3: Illustrates the electrical impedance features of different gestures at wrist position. There are sixteen different gestures
with EIT feature maps. The right-side bar represents the impedance values from 0 to 1 (best viewed in color).

III. E LECTRICAL I MPEDANCE TOMOGRAPHY A PPROACH used for real-time image reconstruction. Many other image
reconstruction techniques are discussed in [7].
Electrical impedance tomography is a non invasive imaging
Reconstruction of images in the EIT system is a non-linear
technique which aims is to recover the conductivity of muscles
issue, however linear approximations are highly helpful. The
in region of interest from the surface using electrical measure-
presence of measurement noise and geometric uncertainty
ments. A typical two dimensional wrist shaped domain is used
in clinical experimental affects the image reconstruction ef-
for EIT data. Data acquisition and EIT image reconstruction
ficiency in EIT data. The linear algorithms also offer the
of different wrist tissues are discussed below.
advantage of images reconstruction, where the impacts of data
artifacts can be detected easily. So, the linear reconstruction
A. Electrical impedance of body tissues might be realized as a quick matrix multiplication. The linear
Different approaches are using bio-impedance or bio- EIT image reconstruction is represented by a matrix R that
capacitive sensing technique in medical application such as translates the measurements (y) to a reconstructed image (X).
computerized scales with body fat detection capabilities and
accurately capture and analyse the human movement [9], [22]. X = R × y. (1)
The research area of hand gestures classification is based on This section discusses the Gauss–Newton (GN) EIT image
bio-impedance that is calculated by Gauss-Newton method reconstruction technique, which has been used frequently
as discussed in [20]. These types of systems are equipped form the last decade for EIT system. This technique enables
with a single transmitter and receiver, which can operate on a the adoption of advanced regularized models of the inverse
single or multiple frequency with multiple electrode pattern (4, EIT issue, which may then express the answer as a linear
8, 16 electrodes) to get a consistence bio-impedance values. reconstruction matrix that enables fast real-time image recon-
The multiple electrodes based technique has been used in struction. The Graz consensus reconstruction algorithm for
different approaches like Cornelius et al. [6], which examines EIT (GREIT) contains the finite element models and has a
cross-sectional impedance among all four and eight pairs of systematic approach to optimize the linear reconstruction ma-
electrodes on the forearm of a user. This technique is limited trix in different clinical systems. It was proposed to reconstruct
to eight electrodes to recognize the gestures. Cheng et al. [5] the lung images in [51]. It mostly supports the minimum size
has proposed a neckband to test user neck impedance. The of the dataset, as discussed in [51]. It might be a dilemma
Neck-related actions, such as head movements, talk, coughing in EIT image reconstruction for large dataset training. While
and swallowing can be determined by this technique. This our proposed approach has been focused on the features of
technique has similar idea to our approach but include high the EIT image using Gauss-Newton (GN) technique with low
computational cost in real time features extraction. computational cost. The connection between (x) and (y) can
be linearized for modest changes to the reference conductivity
B. EIT Image Reconstruction (r).
To generate the 2D interior image, we used Gauss-Newton
Y = J × X + n, (2)
(GN) reconstruction approach, one of the most popular recon-
Nm ×Nn
struction algorithms for industrial applications. Compared to where J ∈ R shows the sensitivity matrix, X shows
other algorithms, it has low computational cost and widely reconstructed image, and n shows the measurements noise that

© 2022 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission.See https://www.ieee.org/publications/rights/index.html for more information.
Authorized licensed use limited to: ANNA UNIVERSITY. Downloaded on August 04,2022 at 08:20:15 UTC from IEEE Xplore. Restrictions apply.
This article has been accepted for publication in IEEE Sensors Journal. This is the author's version which has not been fully edited and
content may change prior to final publication. Citation information: DOI 10.1109/JSEN.2022.3193718
MEHMOOD et al.: HAND GESTURES CLASSIFICATION USING ELECTRICAL IMPEDANCE TOMOGRAPHY IMAGES 5

Fig. 4: Flow chart of gestures classification model based on ResNet-43. It follows the VGG model design with same number of
output channels. Each convolution layer has ReLU activation and batch normalization function. This kind of classifier required
the same shape of output and input layers. An augmented dataset of EIT hand gestures is used to train this classifier.

is assumed a white Gaussian noise. The J is calculated by for different EIT with identical channels. The regularization
finite element analysis (FEM) which depends on the reference matrix P can be used to represent the probability of image
conductivity, injection current, and electrodes model (EM). components and their interactions. The one step invariance
obtained as:
γ[Y ]σn
[J] = , (3)
γ[X]σm  −1
1 1 1
where σn and σm are the foreground and background con- X= J T 2 V −1 J + 2 P −1 J T 2 V −1 y, (5)
σn σn σn
ductivity, respectively. This system is undetermined because
σn > σm . Regularization methods are necessary to compute −1
X = J T V −1 J + λ2 P −1 J T V −1 y, (6)
a conductivity change estimate x, that is true to both the
measurements y, and a priori reconstruction on an image. where λ is the regularization hyper-parameter, which
The GN use a generalized Tikhonvo reularization that is the controls the trade-off between the noise attenuation and
minimum of the sum of a quadratic norm for inverse problem
−1 T −1 image. The mtarix R =
resolution in the reconstructed
solution x′ . J T V −1 J + λ2 P −1 J V is the linear matrix of one
step inverse function. The R can be reconstructed in the data
2 2
∥y − Jx′ ∥P−1 + ∥x − ⃗x∥P−1 , (4) form or Wiener filter form to decrease computing time and
n x
enhance inverse accuracy and stability, which is calculated as:
whereP x − ⃗x is change of conductivity in different EIT
−1
images. n is the co-variance matrix of measurement noise −1
P−1 R = P J T JP J T + λ2 V , (7)
n. The x is diagonal matrix due to uncorrelated measure-
P−1
ment noise n with x = σi2 , where σ is noise variance where P becomes an identity matrix and employs zero-order
at measurment i. The expected co-variance of the
P imagePis Tikhonov regularization if image elements are considered to
denoted by x ∈ RnN ×nN . Covariance matrices n and x
P
be independent with identical variance. Because measured data
are often not computed directly, but are heuristically modeled are significantly more sensitive to boundary image compo-
from a priori assumptions as V = 2. Where n is the average nents, such solutions tend to shift reconstructed noise towards
measurement noise amplitude and x is the a priori amplitude of the border for EIT. P can be scaled in accordance with
conductivity change and V represents the measuring precision the sensitivity of each element. The obtained EIT raw data
(eqs. 5 and 6). Each diagonal element in uncorrelated noise contains materials and skin contact noise that is removed by
is proportional to the signal-to-noise ratio and (V = I) band pass filter as shown in Fig. 1. Finally, we get the 2D

© 2022 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission.See https://www.ieee.org/publications/rights/index.html for more information.
Authorized licensed use limited to: ANNA UNIVERSITY. Downloaded on August 04,2022 at 08:20:15 UTC from IEEE Xplore. Restrictions apply.
This article has been accepted for publication in IEEE Sensors Journal. This is the author's version which has not been fully edited and
content may change prior to final publication. Citation information: DOI 10.1109/JSEN.2022.3193718
6 IEEE SENSORS JOURNAL, VOL. XX, NO. XX, 2022

EIT image, which is the difference of reference (rest position B. Data acquisition procedure
gesture) and current hand gesture in EIT that is shown in Fig. Our investigation included two data collecting phases that
3. served various experimental goals. Phase one data is used to
measure user precision, required training volume, and user
accuracy (i.e., universality). Phase two data is used for the
IV. S YSTEM I MPLEMENTATION re-producibility assessment. All phases data is taken after a
short introduction about wrist protocols. All subjects wore a
We used bio sensor board and 16 electrode based wrist band
wrist band in their left hand. Our method requires conductive
that are manufactured by Gense Technologies Limited [52] to
gel like other electromyography (EMG) devices. Participants
collect the hand gestures data. The obtained data include bio
were then instructed to do one gesture at a time. The gestures
tissues conductivity values that are used to reconstruct the EIT
are retained by the participants until the laptop released a beep,
image. The deep learning based classifier is used to classify
which took few seconds to collect different features. During
the hand gestures (discussed in section IV).
data collection, participants received feedback (e.g graphical)
which shows the conductivity of electrodes with hand skin.
During phase one, participants do sixteen gestures one by
one with 20 seconds break among each gestures. After all
gestures, a single cycle of data collecting is completed. We
can acquire data based on frequency cycle or time based. But
in all experiments, we adopted time based strategy up to 60
seconds.
During phase two, a one minute break was then granted to
participants to remove the wrist band. After the break, the band
Fig. 5: The electrical impedance tomography data acquisition is reinstalled on the wrist (as close as feasible to the original
setup. (a) shows the wrist band position in left hand (b) shows place at hand). Participants performed the same gestures as
the EIT setup with Gense devise. This devise reconstruct previously.
the one dimensional impedance signal to two dimensional
image as shown on laptop screen. It is a real time EIT image C. Gestures sets
reconstruction. We divided a set of gestures into two sub sets like hand
gestures and pinch gestures. The hand gesture data contains
Rest, Left, Right, Point, Thumb, Stretch, and Fist gestures
as shown in the first row of Fig. 6. The pinch gesture data
A. Wrist band and EIT device contains finger gestures like Pinch, Index Pinch, Middle Pinch,
Ring Pinch, Little Pinch, Loser Pinch, Spider Pinch, Victory
The 16-electrode based belt is used in left hand as shown Pinch and Rock Pinch as shown in the second row of Fig.
in Fig. 5(a). It is made by sixteen electrodes that are equally 6. We represented a relaxation gesture as a neutral gesture in
spread as shown in Fig. 5(a). In order to establish a strong both data sets. So, the total number of pinch and hand gestures
contact between the electrodes and the skin of users, the belt are sixteen in our proposed technique.
elasticity has been adopted. This belt is flexible and easily
adjustable to any size of the arm. D. Gesture Classification
The EIT device is a beta version that is built by Gense
The hand gesture dataset is classified by using Bayesian-
Technologies Limited, as shown in Fig. 5(b). This device has
ResNet-18 based Convolution Neural Network. It is a Python-
a buid-in analog-to-digital converter that enables impedance
based framework uses Bayesian optimizer to enhance the
measurement with a precision of 0.1 Hz at a specified fre-
computing capacity of proposed method. the ResNet-18 CNN
quency range between 10 KHz to 350 KHz. We have used
model includes certain pre-trained weights that may be used
a 140 KHz excitement signal, which shows the consistence
immediately for feature extraction, prediction, and fine-tuning.
impedance values of the body tissues during the muscles
movements.

V. W RIST DATA ACQUISITION

A. Experimental Study
We recruited twenty two people with a mean age of 28, all
are right handed. The research was completed in two parts,
and took around two hours. Since all our participants were Fig. 6: Gestures dataset: images in red doted lines are simple
right handed, the system was worn on the left wrist position hand gestures and other images are pinch gestures.
(watch position).

© 2022 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission.See https://www.ieee.org/publications/rights/index.html for more information.
Authorized licensed use limited to: ANNA UNIVERSITY. Downloaded on August 04,2022 at 08:20:15 UTC from IEEE Xplore. Restrictions apply.
This article has been accepted for publication in IEEE Sensors Journal. This is the author's version which has not been fully edited and
content may change prior to final publication. Citation information: DOI 10.1109/JSEN.2022.3193718
MEHMOOD et al.: HAND GESTURES CLASSIFICATION USING ELECTRICAL IMPEDANCE TOMOGRAPHY IMAGES 7

input into the correct shape for the addition operation. Figure
7 illustrates two different sorts of networks, with and without
1 × 1 convolution.
The ResNet-18 model contains the same first two layers as
the GoogLeNet, which includes a 7 × 7 convolutional layer
with 64 output channels and a stride of 2, followed by a 3 × 3
maximum pooling layer. The distinction between ResNet and
other convolutional networks is the batch normalization layer
that is added after each convolutional layer. GoogLeNet is
composed of four modules, each of which contains inception
blocks. ResNet employs four modules, each with the same
number of output channels, that are made up of residual
Fig. 7: ResNet Block with and without convolution blocks. The number of channels in the first module is equal
(1×1 CON V ). to the number of channels in the input. It is not essential to
reduce the height and width because a maximum pooling layer
with a stride of 2 has already been applied. The number of
In gesture classification, we used a dataset that includes channels in the first residual block of each succeeding module
different hand gestures images, such as Down, Up, Stretch, is doubled when compared to the previous module, and the
Victory, Pinch, Fist, Left, Right, Little, Ring, Index, Middle, height and width are halved.
Spider, Thumb, Point and Rock. The Bayesian-ResNet-18 Note that the first module has undergone special processing.
model is fast and straightforward that supports the proposed After that, we load ResNet with all of the modules. Each
framework on both CPUs and GPUs smoothly. module in this example has two residual blocks. Finally, we
add a global average pooling layer, similar to GoogLeNet,
E. Bayesian-ResNet-18 robust classifier followed by the output of the fully-connected layer. Each
module consists of four convolutional layers (excluding the
Fig. 4 presents the general design of gesture classifier 1 × 1 convolutional layer). There are 18 layers in total,
model based on Bayesian and ResNet-18 model. The proposed including the first 7 × 7 convolutional layer and the last fully
classifier has three major phases such as the offline data connected layer. As a result, this model is called ResNet-18.
augmentation in the raw data set, training of the Bayesian Different ResNet models, such as the deeper 152-layer model,
ResNet-18 model for optimisation, and the decision making can be created by different numbers of channels and residual
network. In the first phase, the offline data augmentation blocks. ResNet has a similar architecture to the GoogLeNet.
technique is used on EIT images due to uneven distributions The ResNet’s structure is more straightforward and easier to
samples. This method is preferred for smaller classes with change. As demonstrated in Figs. 4 and 7, all of these factors
fewer number of samples to increase the size of the classes contributed to ResNet’s rapid and widespread adoption.
by a transformation factor, resizing, and rotation, etc. The
2) Bayesian optimization: In both machine and deep learn-
augmented data set is split into three sub-sets as training,
ing algorithms, hyper-parameters play a major role since they
validation and testing. The second phase contains training
closely manage the actions of training algorithms and greatly
and optimization of the proposed classifier. This phase uses
impact the models’ performance. Therefore, it is a signifi-
training and validation data sets as an input [53]. For the test
cant task to optimize hyper-parameters, particularly in deep
phase, the decision making network uses specific test data set
learning of medical images. In general, there are two types of
to check the efficiency of the model.
optimized parameters searching like manual and automatic.
Our data set is based on reconstructed EIT images that is
Most of the models suggest manual searching for hyper-
different from the ImageNet data set. A good data set is always
parameters which is insufficient in big data set [30], [37].
helpful for a classifier to smooth its training. The optimal
decision-making part contains Bayesian optimizer, which is The tuning of the hyper-parameters is a problem in optimiz-
used to differeniat the gestures as shown in Fig. 4. For updating ing process. A Bayesian optimization is an effective approach
the optimization process, a validation error is used. to solve these kinds of problems [30], [39]. Bayesian opti-
1) ResNet-18 architecture: ResNet is based on the VGG-16 mization is based on a usual approximation, which is similar
model, which uses 3 × 3 convolutional layers. The residual to the idea of the likelihood of posterior. Here, observations of
block is made up of two 3 × 3 convolutional layers that all the algorithm are derived from the model assessments, where
have the same number of output channels. Each convolutional the online learning results are presented. This means that our
layer is followed by a batch normalizer layer and a ReLU network requires a training process in Bayesian optimization.
activation module. The input is then inserted just before the This model traces a function throughout the training, which we
final ReLU activation function, bypassing the two convolution know exclusively from the learning data. The major goal is to
phases in the process. In order to be combined together in this achieve the hyper-parameters, which make a learning outline
architecture, the outputs of the two convolutional layers must maximum [40] during the Bayesian optimization stage.
have the same form as the input. If the number of channels is
modified, a new 1×1 convolutional layer is needed to turn the

© 2022 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission.See https://www.ieee.org/publications/rights/index.html for more information.
Authorized licensed use limited to: ANNA UNIVERSITY. Downloaded on August 04,2022 at 08:20:15 UTC from IEEE Xplore. Restrictions apply.
This article has been accepted for publication in IEEE Sensors Journal. This is the author's version which has not been fully edited and
content may change prior to final publication. Citation information: DOI 10.1109/JSEN.2022.3193718
8 IEEE SENSORS JOURNAL, VOL. XX, NO. XX, 2022

Fig. 8: The data augmentation samples of sixteen different gestures. We applied six different types of data augmentation (
contrast, resize, re-scaling, illumination, cropping, and brightness). (best viewed in color).

Fig. 9: Classification and confusion matrix of sixteen different


gestures. (a) shows the accuracy value of six different gestures,
(b) shows the confusion matrix based on precision values of Fig. 11: Classification accuracy of hand gestures and pinch
each gestures. Our classifier gives the good results on sixteen gestures with respect to re reproducibility, within user and
different gestures. cross user. The hand gestures classification accuracy is little
high as compared to pitch. During the pinch, the conductivity
change is high than hand gesture change.

classification performance due to imbalance class distribution.


We execute a comprehensive offline augmentation over ges-
tures images to deal with this unfavorable condition. First, by
flipping each image, we acquire the reflected version of the
original images. Then both the original and flipped images are
Fig. 10: Illustrates the training and validation loss and accu- used in data augmentation. It is shown in Fig. 8.
racy. (a) represents the classifier training and validation loss
of gestures data set, and (b) shows the accuracy of classifier B. Training data
on training and validation data sets. The minimum loss and
high accuracy shows the efficiency of the proposed classifier We have divided gesture data into three sets: training data
on sixteen different gestures.(best viewed in color). (80%), validation data (10%), and test data (10%). The training
data set contains 1500 images with labels, validation data set
contains 200 images, and the test data set has 200 images with
sixteen different classes. The hand gestures images have size
VI. E XPERIMENTAL R ESULTS
256×256 with PNG format. The loss and accuracy of training
we have carried out detail experiments on 22 different and validation dataset are shown in Fig. 10.
subjects data. This section include the data training, param-
eters settings, reproducibility of gestures, and universality of
gestures. The qualitative detail of these experiment results is C. Reproducibility of data
discussed below. The ideal hand gestures classification system should be
stable over time. The proposed method is stable and smooth
A. Offline augmentation during re-training. To check the stability of our method, we
acquiesce the data from different users. The stability of model
The imbalance ratio of the class distribution of the data also depends on the structure similarity of the EIT image. We
set has a big effect on the classification of both traditional also checked the SSIM index of different subjects data. We
machine learning and deep learning methods performance. In have trained our model on one subject data set and test on
the study [39], the authors investigate systematically how data other subjects data sets.
imbalances affect the performance of CNN classification. The
results of the investigation show a destructive influence on the

© 2022 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission.See https://www.ieee.org/publications/rights/index.html for more information.
Authorized licensed use limited to: ANNA UNIVERSITY. Downloaded on August 04,2022 at 08:20:15 UTC from IEEE Xplore. Restrictions apply.
This article has been accepted for publication in IEEE Sensors Journal. This is the author's version which has not been fully edited and
content may change prior to final publication. Citation information: DOI 10.1109/JSEN.2022.3193718
MEHMOOD et al.: HAND GESTURES CLASSIFICATION USING ELECTRICAL IMPEDANCE TOMOGRAPHY IMAGES 9

tomography images. It finds the cross section bio impedance


of hand using 16 electrodes. Our proposed method recover the
impedance distribution of hand tissues. These impedance dis-
tribution used to reconstruct the electrical impedance tomog-
raphy image. People can communicate even more effectively,
if a richer lexicon of gestures is given. Deep learning learning
is now used to recognize the hand gestures that was always
more difficult in past. Deep learning based models recognize
gestures more precise than ever before. The proposed tech-
nique is enough to integrate the technology into the prototype
wrist band, to monitor and classify gestures in real time. The
proposed method has achieved 90% and 93% accuracy at wrist
position using hand and pinch gestures data set, respectively.

VIII. ACKNOWLEDGMENT
Fig. 12: Quantitative analysis of different hand gestures with This work is partly supported by the Hong Kong Innova-
respect to precision, recall, and F-measure score. (best viewed tion and Technology Fund (PRP/014/20FX), and Hong Kong
in color). Research Grants Council (Project C1007-15G).

D. Universality of data R EFERENCES


The universality of proposed method is also checked on [1] H. Brock, J. P. Chulani, L. Merino, D. Szapiro, and R. Gomez,
“Developing a lightweight rock-paper-scissors framework for human-
the cross users data sets. For this purpose, we used the robot collaborative gaming,” IEEE Access, vol. 8, pp. 202 958–202 968,
combination of different subjects data and test it on the single 2020.
subject data. The confusion matrix in Fig. 9 shows the inner [2] S. Pariselvam et al., “An interaction system using speech and gesture
based on cnn,” in 2020 International Conference on System, Computa-
gestures similarity score. We have divide our gesture set into tion, Automation and Networking (ICSCAN). IEEE, 2020, pp. 1–5.
two sets. The Fig. 9(a) shows the confusion matrix of Rest, [3] M. Madhushankara and P. K. Shetty, “A mechanism to generate voice
Left, Right, Point, Thumb, Stretch, and Fist and Fig. 9(b) for speech impaired through hand gesture,” in Advances in Control
shows the confusion matrix of Rest, Pinch, Index, Middle, Instrumentation Systems. Springer, 2020, pp. 117–125.
[4] K. Sridevi, M. Sundarambal, K. Muralidharan, and R. Josephine, “Fpga
Ring, Little, Loser, Spider, Victory, and Rock. The first set of implementation of hand gesture recognition system using neural net-
gestures is widely used and second set of gestures is rarely works,” in 2017 11th International Conference on Intelligent Systems
used in applications. The proposed method has 90% accuracy and Control (ISCO). IEEE, 2017, pp. 34–39.
[5] Y. S. Tan, K. M. Lim, and C. P. Lee, “Hand gesture recognition
in first gestures set and 93% accuracy in second gestures set. via enhanced densely connected convolutional neural network,” Expert
We have also checked the cross user reproducibility score Systems with Applications, vol. 175, p. 114797, 2021.
which is shown in Fig. 11. The quantitative analysis of each [6] D.-S. Tran, N.-H. Ho, H.-J. Yang, E.-T. Baek, S.-H. Kim, and G. Lee,
“Real-time hand gesture spotting and recognition using rgb-d camera
hand gesture with respect to precision, recall, and F-measure and 3d convolutional neural network,” Applied Sciences, vol. 10, no. 2,
is shown in Fig. 12. These results show that our proposed p. 722, 2020.
method performs well on each hand gesture. [7] M. Wang, Z. Yan, T. Wang, P. Cai, S. Gao, Y. Zeng, C. Wan, H. Wang,
L. Pan, J. Yu et al., “Gesture recognition using a bioinspired learning
architecture that integrates visual data with somatosensory data from
E. EIT wrist applications stretchable sensors,” Nature Electronics, vol. 3, no. 9, pp. 563–570, 2020.
[8] E. Zheng, Y. Li, Q. Wang, and H. Qiao, “Toward a human-machine
We can deployed our proposed system in different smart interface based on electrical impedance tomography for robotic manipu-
wearables in future. We can also adopt different electrode lator control,” in 2019 IEEE/RSJ International Conference on Intelligent
model on wrist band to collect the electrical impedance Robots and Systems (IROS). IEEE, 2019, pp. 2768–2774.
[9] R. P. Henderson and J. G. Webster, “An impedance camera for spatially
features (4, 8, 16,..etc). By wearing wrist band device, user specific measurements of the thorax,” IEEE Transactions on Biomedical
can easily recognise the gestures of the hand. Yan Zhang [54] Engineering, no. 3, pp. 250–254, 1978.
also proposed the similar device for smart watches but it has [10] P. Linderholm, L. Marescot, M. H. Loke, and P. Renaud, “Cell culture
imaging using microimpedance tomography,” IEEE Transactions on
limited features due to less number of electrodes (8 electrodes) Biomedical Engineering, vol. 55, no. 1, pp. 138–146, 2007.
and used simple machine learning features to classify the [11] T. Sun, S. Tsuda, N. G. Green, K.-P. Zauner, and H. Morgan, “On-
hand gestures with high computational cost. We ultimately chip electrical impedance tomography for monitoring the kinetics in the
cell culture,” in International Conference on Miniaturized Systems for
intend to include this technique in future smart wearables that Chemistry and Life Sciences, 2008.
can work together collaboratively to support the interactive [12] R. Qureshi, M. Nawaz, A. Ghosh, and H. Yan, “Parametric models for
tasks on small screens with hand gestures and direct touch understanding atomic trajectories in different domains of lung cancer
causing protein,” IEEE Access, vol. 7, pp. 67 551–67 563, 2019.
manipulation. [13] Z. Ma and D. G. Seiler, Metrology and Diagnostic Techniques for
Nanoelectronics. CRC Press, 2017.
VII. CONCLUSION [14] T. Dowrick, C. Blochet, and D. Holder, “In vivo bioimpedance measure-
ment of healthy and ischaemic rat brain: implications for stroke imaging
In this paper, we have proposed a deep learning based using electrical impedance tomography,” Physiological measurement,
gesture classification technique using electrical impedance vol. 36, no. 6, p. 1273, 2015.

© 2022 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission.See https://www.ieee.org/publications/rights/index.html for more information.
Authorized licensed use limited to: ANNA UNIVERSITY. Downloaded on August 04,2022 at 08:20:15 UTC from IEEE Xplore. Restrictions apply.
This article has been accepted for publication in IEEE Sensors Journal. This is the author's version which has not been fully edited and
content may change prior to final publication. Citation information: DOI 10.1109/JSEN.2022.3193718
10 IEEE SENSORS JOURNAL, VOL. XX, NO. XX, 2022

[15] C. J. Roth, T. Becher, I. Frerichs, N. Weiler, and W. A. Wall, “Coupling [36] Y. Wu, D. Jiang, X. Liu, R. Bayford, and A. Demosthenous, “A
of eit with computational lung modeling for predicting patient-specific human–machine interface using electrical impedance tomography for
ventilatory responses,” Journal of Applied Physiology, vol. 122, no. 4, hand prosthesis control,” IEEE transactions on biomedical circuits and
pp. 855–867, 2017. systems, vol. 12, no. 6, pp. 1322–1333, 2018.
[16] D. Smyl, M. Pour-Ghaz, and A. Seppänen, “Detection and reconstruction [37] M. Zhang, Q. Dai, P. Yang, J. Xiong, C. Tian, and C. Xiang, “idial:
of complex structural cracking patterns with electrical imaging,” NDT Enabling a virtual dial plate on the hand back for around-device
& E International, vol. 99, pp. 123–133, 2018. interaction,” Proceedings of the ACM on Interactive, Mobile, Wearable
[17] M. Tang, W. Wang, J. Wheeler, M. McCormick, and X. Dong, “The and Ubiquitous Technologies, vol. 2, no. 1, pp. 1–20, 2018.
number of electrodes and basis functions in eit image reconstruction,” [38] Y. Lu, B. Huang, C. Yu, G. Liu, and Y. Shi, “Designing and evaluating
Physiological measurement, vol. 23, no. 1, p. 129, 2002. hand-to-hand gestures with dual commodity wrist-worn devices,” Pro-
[18] D. S. Tawil, D. Rye, and M. Velonaki, “Improved image reconstruction ceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous
for an eit-based sensitive skin with multiple internal electrodes,” IEEE Technologies, vol. 4, no. 1, pp. 1–27, 2020.
Transactions on Robotics, vol. 27, no. 3, pp. 425–435, 2011. [39] E. Zheng, J. Wan, L. Yang, Q. Wang, and H. Qiao, “Wrist angle
[19] D. Silvera-Tawil, D. Rye, M. Soleimani, and M. Velonaki, “Electrical estimation with a musculoskeletal model driven by electrical impedance
impedance tomography for artificial sensitive robotic skin: A review,” tomography signals,” IEEE Robotics and Automation Letters, vol. 6,
IEEE Sensors Journal, vol. 15, no. 4, pp. 2001–2016, 2014. no. 2, pp. 2186–2193, 2021.
[20] G. Ma, Z. Hao, X. Wu, and X. Wang, “An optimal electrical impedance [40] B. B. Atitallah, R. Barioul, A. Ghribi, D. Bouchaala, N. Derbel, and
tomography drive pattern for human-computer interaction applications,” O. Kanoun, “Electrodes placement investigation for hand gesture recog-
IEEE transactions on biomedical circuits and systems, vol. 14, no. 3, nition based on impedance measurement,” in 2020 17th International
pp. 402–411, 2020. Multi-Conference on Systems, Signals & Devices (SSD). IEEE, 2020,
[21] A. Adler, P. O. Gaggero, and Y. Maimaitijiang, “Adjacent stimulation pp. 1173–1177.
and measurement patterns considered harmful,” Physiological measure- [41] S. H. Yoon, K. Huo, Y. Zhang, G. Chen, L. Paredes, S. Chidambaram,
ment, vol. 32, no. 7, p. 731, 2011. and K. Ramani, “isoft: a customizable soft sensor with real-time contin-
[22] J. Hope, F. Vanholsbeeck, and A. McDaid, “Drive and measurement uous contact and stretching sensing,” in Proceedings of the 30th Annual
electrode patterns for electrode impedance tomography (eit) imaging of ACM Symposium on User Interface Software and Technology, 2017, pp.
neural activity in peripheral nerve,” Biomedical Physics & Engineering 665–678.
Express, vol. 4, no. 6, p. 067002, 2018. [42] S. Russo, R. Assaf, N. Carbonaro, and A. Tognetti, “Touch position
[23] G. Laput, R. Xiao, X. Chen, S. E. Hudson, and C. Harrison, “Skin detection in electrical tomography tactile sensors through quadratic
buttons: cheap, small, low-powered and clickable fixed-icon laser pro- classifier,” IEEE Sensors Journal, vol. 19, no. 2, pp. 474–483, 2018.
jectors,” in Proceedings of the 27th annual ACM symposium on User [43] M. Nawaz and H. Yan, “Saliency detection via multiple-morphological
interface software and technology, 2014, pp. 389–394. and superpixel based fast fuzzy c-mean clustering network,” Expert
[24] Y. Zhang, R. Xiao, and C. Harrison, “Advancing hand gesture recog- Systems with Applications, vol. 161, p. 113654, 2020.
nition with high resolution electrical impedance tomography,” in Pro- [44] M. Nawaz, R. Qureshi, M. A. Teevno, and A. R. Shahid, “Object
ceedings of the 29th Annual Symposium on User Interface Software and detection and segmentation by composition of fast fuzzy c-mean clus-
Technology, 2016, pp. 843–850. tering based maps,” Journal of Ambient Intelligence and Humanized
[25] A. Hirata, Y. Takano, Y. Kamimura, and O. Fujiwara, “Effect of the Computing, pp. 1–16, 2022.
averaging volume and algorithm on the in situ electric field for uniform [45] S. Khan, M. Nawaz, X. Guoxia, and H. Yan, “Image correspondence
electric-and magnetic-field exposures,” Physics in Medicine & Biology, with cur decomposition-based graph completion and matching,” IEEE
vol. 55, no. 9, p. N243, 2010. Transactions on Circuits and Systems for Video Technology, vol. 30,
[26] M. C. Corballis, “The gestural origins of language: Human language no. 9, pp. 3054–3067, 2019.
may have evolved from manual gestures, which survive today as a” [46] M. Nawaz, S. Khan, J. Cao, R. Qureshi, and H. Yan, “Saliency detection
behavioral fossil” coupled to speech,” American Scientist, vol. 87, no. 2, by using blended membership maps of fast fuzzy-c-mean clustering,” in
pp. 138–145, 1999. Eleventh International Conference on machine vision (icmv 2018), vol.
[27] P. Trigueiros, F. Ribeiro, and L. P. Reis, “Vision-based gesture recog- 11041. SPIE, 2019, pp. 565–572.
nition system for human-computer interaction,” Computational Vision [47] M. Nawaz, S. Khan, R. Qureshi, and H. Yan, “Clustering based one-to-
and Medical Image Processing IV: VIPIMAGE, vol. 2013, pp. 137–142, one hypergraph matching with a large number of feature points,” Signal
2013. Processing: Image Communication, vol. 74, pp. 289–298, 2019.
[28] M. Abdelwahed, A. Pitti, O. Romain, and F. B. Ouezdou, “Use of multi- [48] M. Nawaz, R. Xie, L. Zhang, M. Asfandyar, and M. Hussain, “Image
frequency electrical impedance tomography as tactile sensor for material super resolution by sparse linear regression and iterative back projec-
discrimination,” in 2020 5th International Conference on Advanced tion,” in 2016 IEEE International Symposium on Broadband Multimedia
Robotics and Mechatronics (ICARM). IEEE, 2020, pp. 588–594. Systems and Broadcasting (BMSB). IEEE, 2016, pp. 1–6.
[29] M. Oudah, A. Al-Naji, and J. Chahl, “Hand gesture recognition based [49] M. Nawaz, “Saliency detection and feature matching for object segmen-
on computer vision: a review of techniques,” journal of Imaging, vol. 6, tation in digital images,” Ph.D. dissertation, City University of Hong
no. 8, p. 73, 2020. Kong, 2020.
[30] A. S. Al-Shamayleh, R. Ahmad, M. A. Abushariah, K. A. Alam, and [50] M. Nawaz and H. Yan, “Saliency detection using deep features and
N. Jomhari, “A systematic literature review on vision based gesture affinity-based robust background subtraction,” IEEE Transactions on
recognition techniques,” Multimedia Tools and Applications, vol. 77, Multimedia, vol. 23, pp. 2902–2916, 2020.
no. 21, pp. 28 121–28 184, 2018. [51] A. Adler, J. H. Arnold, R. Bayford, A. Borsic, B. Brown, P. Dixon,
[31] D. Farina, “Member s, jiang n, rehbaum h, member s, holobar a, T. J. Faes, I. Frerichs, H. Gagnon, Y. Gärber et al., “Greit: a unified
graimann b, dietl h, aszmann oc. the extraction of neural information approach to 2d linear eit reconstruction of lung images,” Physiological
from the surface emg for the control of upper-limb prostheses: emerging measurement, vol. 30, no. 6, p. S35, 2009.
avenues and challenges,” IEEE Trans Neural Syst Rehabil Eng, vol. 22, [52] Gense tech ltd. [Online]. Available: https://www.gensetechnologies.com/
pp. 797–809, 2014. [53] F. Ucar and D. Korkmaz, “Covidiagnosis-net: Deep bayes-squeezenet
[32] J. Qi, G. Jiang, G. Li, Y. Sun, and B. Tao, “Surface emg hand gesture based diagnosis of the coronavirus disease 2019 (covid-19) from x-ray
recognition system based on pca and grnn,” Neural Computing and images,” Medical hypotheses, vol. 140, p. 109761, 2020.
Applications, vol. 32, no. 10, pp. 6343–6351, 2020. [54] Y. Zhang and C. Harrison, “Tomo: Wearable, low-cost electrical
[33] F. Botros, A. Phinyomark, and E. Scheme, “Emg-based gesture recog- impedance tomography for hand gesture recognition,” in Proceedings
nition: Is it time to change focus from the forearm to the wrist?” IEEE of the 28th Annual ACM Symposium on User Interface Software &
Transactions on Industrial Informatics, 2020. Technology, 2015, pp. 167–173.
[34] T. Boretius, J. Badia, A. Pascual-Font, M. Schuettler, X. Navarro,
K. Yoshida, and T. Stieglitz, “A transverse intrafascicular multichannel
electrode (time) to interface with the peripheral nerve,” Biosensors and
Bioelectronics, vol. 26, no. 1, pp. 62–69, 2010.
[35] R. Weir, P. Troyk, G. Demichele, D. Kerns, J. Schorsch, and H. Maas,
“Implantable myoelectric sensors (imes) for prosthesis control: Develop-
ment and testing,” IEEE Trans Biomed Eng, vol. 56, no. 1, pp. 159–71,
2009.

© 2022 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission.See https://www.ieee.org/publications/rights/index.html for more information.
Authorized licensed use limited to: ANNA UNIVERSITY. Downloaded on August 04,2022 at 08:20:15 UTC from IEEE Xplore. Restrictions apply.
This article has been accepted for publication in IEEE Sensors Journal. This is the author's version which has not been fully edited and
content may change prior to final publication. Citation information: DOI 10.1109/JSEN.2022.3193718
MEHMOOD et al.: HAND GESTURES CLASSIFICATION USING ELECTRICAL IMPEDANCE TOMOGRAPHY IMAGES 11

Dr. Mehmood Nawaz received the PhD degree Dr. Cao Peng received his B.Eng. and mas-
(electrical engineering) from City University of ter’s degrees from Xi’an Jiaotong University. His
Hong Kong and the MSc Degree (information Ph.D. was from The University of Hong Kong.
and communication engineering) from Shanghai He is an Assistant Professor at the Department
Jiaotong University, China. His BS degree (com- of Diagnostic Radiology, the University of Hong
puter engineering) from Baha-uddin-Zakariya Kong. He has up to 10 years of experience
University Multan, Pakistan. He was a postdoc at in medical imaging investigation of pathological
The University of Hong Kong in 2020-2021. He is changes in diseases, imaging reconstruction,
currently a Postdoc fellow in the Department of and software/hardware development. His engi-
Medical Engineering, The Chines University of neering and biomedical imaging background al-
Hong Kong. His research interests include graph low him to develop advanced imaging tools to
matching, image segmentation, image reconstruction, sensors fusion, satisfy preclinical and clinical needs.
shape matching, and pattern recognition, etc.

Dr. Russell Chan received his B.Eng. and


Ph.D. from The University of Hong Kong
(2011, biomedical engineering; 2016, electrical
and electronic engineering). He was a post-
doc at Stanford University (2017-2020, Neurol-
ogy and Neurological Sciences) and New York
University (2020-2021, Neuroscience Institute,
Tech4Health Institute and Ophthalmology), and
is a cofounder of Gense Technologies Ltd. Dr.
Chan’s research focus is the development and
application of state-of-the-art multi-modal and
multi-scale biomedical imaging and bioengineering to advance biotech-
nology and quality of life. These methodologies include functional
MRI, optoacoustic tomography (OAT), electrical impedance tomography
(EIT), and optogenetic neuromodulation. He is an elected Junior Fellow
of International Society of Magnetic Resonance in Medicine (ISMRM), a
highly selected and prestigious award by the leading MRI community,
and have published 14 journal papers and 63 conference papers,
including Proceedings of the National Academy of Sciences (PNAS) and
Neuron.

Anju Malik is a Ph.D. student in Electrical En-


gineering Department at the City University of
Hong Kong. She has received a Master’s Degree
(Pharmacology) from NMIMS University, India.
Her research interests include Ocular Domi-
nance Plasticity, Neuronal Oscillations, and Neu-
roscience.

Dr Tariq Khan is a Senior Research Associate


in Computer Vision at the School of Computer
Science and Engineering, UNSW. He served
as a Research Fellow in Machine Learning at
the School of Information Technology, Deakin
University. He has more than ten years of expe-
rience in computer vision and machine learning
as a researcher. He published over 65 peer-
reviewed articles, most of which in Q1 jour-
nals or in A*/A journals/conferences, which have
already been cited over 1213 times (Google
Scholar), boosting my h-index to 21 (Google Scholar). Many of his
papers were published in high-impact journals such as the IEEE
Transactions on Image Processing and Pattern Recognition, as well
as high-profile conferences such as WACV, Joint IAPR International
Workshops on Structural, Syntactic, and Statistical Pattern Recognition,
and ICONIP. His Scopus h-index is 18 with over 867 citations. In the
last 5 years (SciVal), in the topic Retina Image; Retina Blood Vessels;
Hypertension Retinopathy, he ranked number 1 in the world with 20 pa-
pers, a field-weighted citation impact of 1.99 (which means I have been
cited twice the global rate expected for my field) and a citation count
of 245. In the topics of Anisotropic Diffusion, Image Denoising, and
Partial Differential Equations, he is number 23 worldwide and number 1
in Australia. In the topic Fingerprint Recognition, Dermatoglyphics, and
Biometry, he is number 6 in Australia and 81 worldwide for publications
and citations.

© 2022 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission.See https://www.ieee.org/publications/rights/index.html for more information.
Authorized licensed use limited to: ANNA UNIVERSITY. Downloaded on August 04,2022 at 08:20:15 UTC from IEEE Xplore. Restrictions apply.

You might also like