Professional Documents
Culture Documents
This is the author's version which has not been fully edited and
content may change prior to final publication. Citation information: DOI 10.1109/JSEN.2022.3193718
© 2022 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission.See https://www.ieee.org/publications/rights/index.html for more information.
Authorized licensed use limited to: ANNA UNIVERSITY. Downloaded on August 04,2022 at 08:20:15 UTC from IEEE Xplore. Restrictions apply.
This article has been accepted for publication in IEEE Sensors Journal. This is the author's version which has not been fully edited and
content may change prior to final publication. Citation information: DOI 10.1109/JSEN.2022.3193718
2 IEEE SENSORS JOURNAL, VOL. XX, NO. XX, 2022
© 2022 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission.See https://www.ieee.org/publications/rights/index.html for more information.
Authorized licensed use limited to: ANNA UNIVERSITY. Downloaded on August 04,2022 at 08:20:15 UTC from IEEE Xplore. Restrictions apply.
This article has been accepted for publication in IEEE Sensors Journal. This is the author's version which has not been fully edited and
content may change prior to final publication. Citation information: DOI 10.1109/JSEN.2022.3193718
MEHMOOD et al.: HAND GESTURES CLASSIFICATION USING ELECTRICAL IMPEDANCE TOMOGRAPHY IMAGES 3
Fig. 2: The conductivity values of different body tissues in wrist region. From left to right, the frequency range increases from
10KHz to 350KHz but conductivity of tissues remain constant [25]. The vertical values show conductivity (s/m) and horizontal
values show the frequency range (KHz).
prosthesis. It successfully employs an array of electrodes The conventional approaches adopt finite element methods
enclosed on a wristband on the user’s forearm to perform (FEM), which is resulting in high computational cost [19].
electrical impedance tomography. Total eight electrodes are Some techniques are using low computational machine learn-
used to measure the bio-impedance of hand tissues.Despite ing algorithms for object segmentation and detection in images
the fact that training just takes a few minute, which is the [43], [44], [45], [46], [47], [48], [49], [50]. So, the high quality
drawback of this system. The early investigation in this system image acquiring on low computational cost is a main challenge
shows that the feature changes can be acquired due to the in EIT system.
electrode band location [36]. Our body tissues have different impedance value. For ex-
Electrical impedance tomography (EIT) is considered ample, muscles and blood veins have low impedance while
as a possible alternative technique for signal acquisition. skin and bones tissues are high in impedance as shown in
In [37], [38], the viability of EIT is studied for wearable Fig. 2. The most common approaches use specific frequency
devices to detect the hand motion, specifically, touching one range to measure the bio impedance. Some instruments use
finger with the other. These studies have limited use in multiple frequencies like MF-BIA (multi-frequency bioelec-
two-handed gesture touching applications. The estimation of trical impedance analysis). The most basic instruments are
wrist angle for gesture recognition applications is investigated based on a single-frequency measurement of the bioelectrical
in [39]. A comparative study for intra-electrode distance in impedance’s (SF-BIA) or bioimpedance spectroscopy (BIS).
EIT system is presented in [40], where the optimal distance is There are also several methods for assessing the bio
defined by estimating the change in real and imaginary parts impedance outcomes. The most significant are bioelectrical
of impedance measurements. impedance vector analysis and real-time analysis. The mus-
A study related to flexible EIT-based sensor for fingertip cles and blood have comparable resistance values and their
movement detection is reported in [41]; this approach is based impedance is not significantly important if we increase fre-
on 8 and 16 electrodes and uses a baseline update procedure quency upto 350 KHz. It is proven that it cannot be supposed
called iSoft. The use of opposite drive pattern is proposed in impedance plethysmography. In a different research, the
in [42] to identify the contact location for robotic application; researchers have used below 10 KHz frequency to achieve a
this technique based on electrical impedance tomography of constant blood and tissue impedance ratio. The impact of po-
8 and 16 electrodes with supervised quadratic classification larization processes of electrodes are examined on impedance
algorithms. This approach achieves better performance as measurement devices. The hand tissue resistance and capacity
compared to flexible EIT. But this study did not consider the over a broad range of frequencies are described in Fig. 2. The
optimization of data acquisition methods. Other EIT based different conductivity values of body tissues are very helpful
approaches [22]- [24] used additional use of electrodes to en- to reconstruct an instructive EIT image.
hance the image quality, which is a highly non-linear problem.
© 2022 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission.See https://www.ieee.org/publications/rights/index.html for more information.
Authorized licensed use limited to: ANNA UNIVERSITY. Downloaded on August 04,2022 at 08:20:15 UTC from IEEE Xplore. Restrictions apply.
This article has been accepted for publication in IEEE Sensors Journal. This is the author's version which has not been fully edited and
content may change prior to final publication. Citation information: DOI 10.1109/JSEN.2022.3193718
4 IEEE SENSORS JOURNAL, VOL. XX, NO. XX, 2022
Fig. 3: Illustrates the electrical impedance features of different gestures at wrist position. There are sixteen different gestures
with EIT feature maps. The right-side bar represents the impedance values from 0 to 1 (best viewed in color).
III. E LECTRICAL I MPEDANCE TOMOGRAPHY A PPROACH used for real-time image reconstruction. Many other image
reconstruction techniques are discussed in [7].
Electrical impedance tomography is a non invasive imaging
Reconstruction of images in the EIT system is a non-linear
technique which aims is to recover the conductivity of muscles
issue, however linear approximations are highly helpful. The
in region of interest from the surface using electrical measure-
presence of measurement noise and geometric uncertainty
ments. A typical two dimensional wrist shaped domain is used
in clinical experimental affects the image reconstruction ef-
for EIT data. Data acquisition and EIT image reconstruction
ficiency in EIT data. The linear algorithms also offer the
of different wrist tissues are discussed below.
advantage of images reconstruction, where the impacts of data
artifacts can be detected easily. So, the linear reconstruction
A. Electrical impedance of body tissues might be realized as a quick matrix multiplication. The linear
Different approaches are using bio-impedance or bio- EIT image reconstruction is represented by a matrix R that
capacitive sensing technique in medical application such as translates the measurements (y) to a reconstructed image (X).
computerized scales with body fat detection capabilities and
accurately capture and analyse the human movement [9], [22]. X = R × y. (1)
The research area of hand gestures classification is based on This section discusses the Gauss–Newton (GN) EIT image
bio-impedance that is calculated by Gauss-Newton method reconstruction technique, which has been used frequently
as discussed in [20]. These types of systems are equipped form the last decade for EIT system. This technique enables
with a single transmitter and receiver, which can operate on a the adoption of advanced regularized models of the inverse
single or multiple frequency with multiple electrode pattern (4, EIT issue, which may then express the answer as a linear
8, 16 electrodes) to get a consistence bio-impedance values. reconstruction matrix that enables fast real-time image recon-
The multiple electrodes based technique has been used in struction. The Graz consensus reconstruction algorithm for
different approaches like Cornelius et al. [6], which examines EIT (GREIT) contains the finite element models and has a
cross-sectional impedance among all four and eight pairs of systematic approach to optimize the linear reconstruction ma-
electrodes on the forearm of a user. This technique is limited trix in different clinical systems. It was proposed to reconstruct
to eight electrodes to recognize the gestures. Cheng et al. [5] the lung images in [51]. It mostly supports the minimum size
has proposed a neckband to test user neck impedance. The of the dataset, as discussed in [51]. It might be a dilemma
Neck-related actions, such as head movements, talk, coughing in EIT image reconstruction for large dataset training. While
and swallowing can be determined by this technique. This our proposed approach has been focused on the features of
technique has similar idea to our approach but include high the EIT image using Gauss-Newton (GN) technique with low
computational cost in real time features extraction. computational cost. The connection between (x) and (y) can
be linearized for modest changes to the reference conductivity
B. EIT Image Reconstruction (r).
To generate the 2D interior image, we used Gauss-Newton
Y = J × X + n, (2)
(GN) reconstruction approach, one of the most popular recon-
Nm ×Nn
struction algorithms for industrial applications. Compared to where J ∈ R shows the sensitivity matrix, X shows
other algorithms, it has low computational cost and widely reconstructed image, and n shows the measurements noise that
© 2022 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission.See https://www.ieee.org/publications/rights/index.html for more information.
Authorized licensed use limited to: ANNA UNIVERSITY. Downloaded on August 04,2022 at 08:20:15 UTC from IEEE Xplore. Restrictions apply.
This article has been accepted for publication in IEEE Sensors Journal. This is the author's version which has not been fully edited and
content may change prior to final publication. Citation information: DOI 10.1109/JSEN.2022.3193718
MEHMOOD et al.: HAND GESTURES CLASSIFICATION USING ELECTRICAL IMPEDANCE TOMOGRAPHY IMAGES 5
Fig. 4: Flow chart of gestures classification model based on ResNet-43. It follows the VGG model design with same number of
output channels. Each convolution layer has ReLU activation and batch normalization function. This kind of classifier required
the same shape of output and input layers. An augmented dataset of EIT hand gestures is used to train this classifier.
is assumed a white Gaussian noise. The J is calculated by for different EIT with identical channels. The regularization
finite element analysis (FEM) which depends on the reference matrix P can be used to represent the probability of image
conductivity, injection current, and electrodes model (EM). components and their interactions. The one step invariance
obtained as:
γ[Y ]σn
[J] = , (3)
γ[X]σm −1
1 1 1
where σn and σm are the foreground and background con- X= J T 2 V −1 J + 2 P −1 J T 2 V −1 y, (5)
σn σn σn
ductivity, respectively. This system is undetermined because
σn > σm . Regularization methods are necessary to compute −1
X = J T V −1 J + λ2 P −1 J T V −1 y, (6)
a conductivity change estimate x, that is true to both the
measurements y, and a priori reconstruction on an image. where λ is the regularization hyper-parameter, which
The GN use a generalized Tikhonvo reularization that is the controls the trade-off between the noise attenuation and
minimum of the sum of a quadratic norm for inverse problem
−1 T −1 image. The mtarix R =
resolution in the reconstructed
solution x′ . J T V −1 J + λ2 P −1 J V is the linear matrix of one
step inverse function. The R can be reconstructed in the data
2 2
∥y − Jx′ ∥P−1 + ∥x − ⃗x∥P−1 , (4) form or Wiener filter form to decrease computing time and
n x
enhance inverse accuracy and stability, which is calculated as:
whereP x − ⃗x is change of conductivity in different EIT
−1
images. n is the co-variance matrix of measurement noise −1
P−1 R = P J T JP J T + λ2 V , (7)
n. The x is diagonal matrix due to uncorrelated measure-
P−1
ment noise n with x = σi2 , where σ is noise variance where P becomes an identity matrix and employs zero-order
at measurment i. The expected co-variance of the
P imagePis Tikhonov regularization if image elements are considered to
denoted by x ∈ RnN ×nN . Covariance matrices n and x
P
be independent with identical variance. Because measured data
are often not computed directly, but are heuristically modeled are significantly more sensitive to boundary image compo-
from a priori assumptions as V = 2. Where n is the average nents, such solutions tend to shift reconstructed noise towards
measurement noise amplitude and x is the a priori amplitude of the border for EIT. P can be scaled in accordance with
conductivity change and V represents the measuring precision the sensitivity of each element. The obtained EIT raw data
(eqs. 5 and 6). Each diagonal element in uncorrelated noise contains materials and skin contact noise that is removed by
is proportional to the signal-to-noise ratio and (V = I) band pass filter as shown in Fig. 1. Finally, we get the 2D
© 2022 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission.See https://www.ieee.org/publications/rights/index.html for more information.
Authorized licensed use limited to: ANNA UNIVERSITY. Downloaded on August 04,2022 at 08:20:15 UTC from IEEE Xplore. Restrictions apply.
This article has been accepted for publication in IEEE Sensors Journal. This is the author's version which has not been fully edited and
content may change prior to final publication. Citation information: DOI 10.1109/JSEN.2022.3193718
6 IEEE SENSORS JOURNAL, VOL. XX, NO. XX, 2022
EIT image, which is the difference of reference (rest position B. Data acquisition procedure
gesture) and current hand gesture in EIT that is shown in Fig. Our investigation included two data collecting phases that
3. served various experimental goals. Phase one data is used to
measure user precision, required training volume, and user
accuracy (i.e., universality). Phase two data is used for the
IV. S YSTEM I MPLEMENTATION re-producibility assessment. All phases data is taken after a
short introduction about wrist protocols. All subjects wore a
We used bio sensor board and 16 electrode based wrist band
wrist band in their left hand. Our method requires conductive
that are manufactured by Gense Technologies Limited [52] to
gel like other electromyography (EMG) devices. Participants
collect the hand gestures data. The obtained data include bio
were then instructed to do one gesture at a time. The gestures
tissues conductivity values that are used to reconstruct the EIT
are retained by the participants until the laptop released a beep,
image. The deep learning based classifier is used to classify
which took few seconds to collect different features. During
the hand gestures (discussed in section IV).
data collection, participants received feedback (e.g graphical)
which shows the conductivity of electrodes with hand skin.
During phase one, participants do sixteen gestures one by
one with 20 seconds break among each gestures. After all
gestures, a single cycle of data collecting is completed. We
can acquire data based on frequency cycle or time based. But
in all experiments, we adopted time based strategy up to 60
seconds.
During phase two, a one minute break was then granted to
participants to remove the wrist band. After the break, the band
Fig. 5: The electrical impedance tomography data acquisition is reinstalled on the wrist (as close as feasible to the original
setup. (a) shows the wrist band position in left hand (b) shows place at hand). Participants performed the same gestures as
the EIT setup with Gense devise. This devise reconstruct previously.
the one dimensional impedance signal to two dimensional
image as shown on laptop screen. It is a real time EIT image C. Gestures sets
reconstruction. We divided a set of gestures into two sub sets like hand
gestures and pinch gestures. The hand gesture data contains
Rest, Left, Right, Point, Thumb, Stretch, and Fist gestures
as shown in the first row of Fig. 6. The pinch gesture data
A. Wrist band and EIT device contains finger gestures like Pinch, Index Pinch, Middle Pinch,
Ring Pinch, Little Pinch, Loser Pinch, Spider Pinch, Victory
The 16-electrode based belt is used in left hand as shown Pinch and Rock Pinch as shown in the second row of Fig.
in Fig. 5(a). It is made by sixteen electrodes that are equally 6. We represented a relaxation gesture as a neutral gesture in
spread as shown in Fig. 5(a). In order to establish a strong both data sets. So, the total number of pinch and hand gestures
contact between the electrodes and the skin of users, the belt are sixteen in our proposed technique.
elasticity has been adopted. This belt is flexible and easily
adjustable to any size of the arm. D. Gesture Classification
The EIT device is a beta version that is built by Gense
The hand gesture dataset is classified by using Bayesian-
Technologies Limited, as shown in Fig. 5(b). This device has
ResNet-18 based Convolution Neural Network. It is a Python-
a buid-in analog-to-digital converter that enables impedance
based framework uses Bayesian optimizer to enhance the
measurement with a precision of 0.1 Hz at a specified fre-
computing capacity of proposed method. the ResNet-18 CNN
quency range between 10 KHz to 350 KHz. We have used
model includes certain pre-trained weights that may be used
a 140 KHz excitement signal, which shows the consistence
immediately for feature extraction, prediction, and fine-tuning.
impedance values of the body tissues during the muscles
movements.
A. Experimental Study
We recruited twenty two people with a mean age of 28, all
are right handed. The research was completed in two parts,
and took around two hours. Since all our participants were Fig. 6: Gestures dataset: images in red doted lines are simple
right handed, the system was worn on the left wrist position hand gestures and other images are pinch gestures.
(watch position).
© 2022 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission.See https://www.ieee.org/publications/rights/index.html for more information.
Authorized licensed use limited to: ANNA UNIVERSITY. Downloaded on August 04,2022 at 08:20:15 UTC from IEEE Xplore. Restrictions apply.
This article has been accepted for publication in IEEE Sensors Journal. This is the author's version which has not been fully edited and
content may change prior to final publication. Citation information: DOI 10.1109/JSEN.2022.3193718
MEHMOOD et al.: HAND GESTURES CLASSIFICATION USING ELECTRICAL IMPEDANCE TOMOGRAPHY IMAGES 7
input into the correct shape for the addition operation. Figure
7 illustrates two different sorts of networks, with and without
1 × 1 convolution.
The ResNet-18 model contains the same first two layers as
the GoogLeNet, which includes a 7 × 7 convolutional layer
with 64 output channels and a stride of 2, followed by a 3 × 3
maximum pooling layer. The distinction between ResNet and
other convolutional networks is the batch normalization layer
that is added after each convolutional layer. GoogLeNet is
composed of four modules, each of which contains inception
blocks. ResNet employs four modules, each with the same
number of output channels, that are made up of residual
Fig. 7: ResNet Block with and without convolution blocks. The number of channels in the first module is equal
(1×1 CON V ). to the number of channels in the input. It is not essential to
reduce the height and width because a maximum pooling layer
with a stride of 2 has already been applied. The number of
In gesture classification, we used a dataset that includes channels in the first residual block of each succeeding module
different hand gestures images, such as Down, Up, Stretch, is doubled when compared to the previous module, and the
Victory, Pinch, Fist, Left, Right, Little, Ring, Index, Middle, height and width are halved.
Spider, Thumb, Point and Rock. The Bayesian-ResNet-18 Note that the first module has undergone special processing.
model is fast and straightforward that supports the proposed After that, we load ResNet with all of the modules. Each
framework on both CPUs and GPUs smoothly. module in this example has two residual blocks. Finally, we
add a global average pooling layer, similar to GoogLeNet,
E. Bayesian-ResNet-18 robust classifier followed by the output of the fully-connected layer. Each
module consists of four convolutional layers (excluding the
Fig. 4 presents the general design of gesture classifier 1 × 1 convolutional layer). There are 18 layers in total,
model based on Bayesian and ResNet-18 model. The proposed including the first 7 × 7 convolutional layer and the last fully
classifier has three major phases such as the offline data connected layer. As a result, this model is called ResNet-18.
augmentation in the raw data set, training of the Bayesian Different ResNet models, such as the deeper 152-layer model,
ResNet-18 model for optimisation, and the decision making can be created by different numbers of channels and residual
network. In the first phase, the offline data augmentation blocks. ResNet has a similar architecture to the GoogLeNet.
technique is used on EIT images due to uneven distributions The ResNet’s structure is more straightforward and easier to
samples. This method is preferred for smaller classes with change. As demonstrated in Figs. 4 and 7, all of these factors
fewer number of samples to increase the size of the classes contributed to ResNet’s rapid and widespread adoption.
by a transformation factor, resizing, and rotation, etc. The
2) Bayesian optimization: In both machine and deep learn-
augmented data set is split into three sub-sets as training,
ing algorithms, hyper-parameters play a major role since they
validation and testing. The second phase contains training
closely manage the actions of training algorithms and greatly
and optimization of the proposed classifier. This phase uses
impact the models’ performance. Therefore, it is a signifi-
training and validation data sets as an input [53]. For the test
cant task to optimize hyper-parameters, particularly in deep
phase, the decision making network uses specific test data set
learning of medical images. In general, there are two types of
to check the efficiency of the model.
optimized parameters searching like manual and automatic.
Our data set is based on reconstructed EIT images that is
Most of the models suggest manual searching for hyper-
different from the ImageNet data set. A good data set is always
parameters which is insufficient in big data set [30], [37].
helpful for a classifier to smooth its training. The optimal
decision-making part contains Bayesian optimizer, which is The tuning of the hyper-parameters is a problem in optimiz-
used to differeniat the gestures as shown in Fig. 4. For updating ing process. A Bayesian optimization is an effective approach
the optimization process, a validation error is used. to solve these kinds of problems [30], [39]. Bayesian opti-
1) ResNet-18 architecture: ResNet is based on the VGG-16 mization is based on a usual approximation, which is similar
model, which uses 3 × 3 convolutional layers. The residual to the idea of the likelihood of posterior. Here, observations of
block is made up of two 3 × 3 convolutional layers that all the algorithm are derived from the model assessments, where
have the same number of output channels. Each convolutional the online learning results are presented. This means that our
layer is followed by a batch normalizer layer and a ReLU network requires a training process in Bayesian optimization.
activation module. The input is then inserted just before the This model traces a function throughout the training, which we
final ReLU activation function, bypassing the two convolution know exclusively from the learning data. The major goal is to
phases in the process. In order to be combined together in this achieve the hyper-parameters, which make a learning outline
architecture, the outputs of the two convolutional layers must maximum [40] during the Bayesian optimization stage.
have the same form as the input. If the number of channels is
modified, a new 1×1 convolutional layer is needed to turn the
© 2022 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission.See https://www.ieee.org/publications/rights/index.html for more information.
Authorized licensed use limited to: ANNA UNIVERSITY. Downloaded on August 04,2022 at 08:20:15 UTC from IEEE Xplore. Restrictions apply.
This article has been accepted for publication in IEEE Sensors Journal. This is the author's version which has not been fully edited and
content may change prior to final publication. Citation information: DOI 10.1109/JSEN.2022.3193718
8 IEEE SENSORS JOURNAL, VOL. XX, NO. XX, 2022
Fig. 8: The data augmentation samples of sixteen different gestures. We applied six different types of data augmentation (
contrast, resize, re-scaling, illumination, cropping, and brightness). (best viewed in color).
© 2022 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission.See https://www.ieee.org/publications/rights/index.html for more information.
Authorized licensed use limited to: ANNA UNIVERSITY. Downloaded on August 04,2022 at 08:20:15 UTC from IEEE Xplore. Restrictions apply.
This article has been accepted for publication in IEEE Sensors Journal. This is the author's version which has not been fully edited and
content may change prior to final publication. Citation information: DOI 10.1109/JSEN.2022.3193718
MEHMOOD et al.: HAND GESTURES CLASSIFICATION USING ELECTRICAL IMPEDANCE TOMOGRAPHY IMAGES 9
VIII. ACKNOWLEDGMENT
Fig. 12: Quantitative analysis of different hand gestures with This work is partly supported by the Hong Kong Innova-
respect to precision, recall, and F-measure score. (best viewed tion and Technology Fund (PRP/014/20FX), and Hong Kong
in color). Research Grants Council (Project C1007-15G).
© 2022 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission.See https://www.ieee.org/publications/rights/index.html for more information.
Authorized licensed use limited to: ANNA UNIVERSITY. Downloaded on August 04,2022 at 08:20:15 UTC from IEEE Xplore. Restrictions apply.
This article has been accepted for publication in IEEE Sensors Journal. This is the author's version which has not been fully edited and
content may change prior to final publication. Citation information: DOI 10.1109/JSEN.2022.3193718
10 IEEE SENSORS JOURNAL, VOL. XX, NO. XX, 2022
[15] C. J. Roth, T. Becher, I. Frerichs, N. Weiler, and W. A. Wall, “Coupling [36] Y. Wu, D. Jiang, X. Liu, R. Bayford, and A. Demosthenous, “A
of eit with computational lung modeling for predicting patient-specific human–machine interface using electrical impedance tomography for
ventilatory responses,” Journal of Applied Physiology, vol. 122, no. 4, hand prosthesis control,” IEEE transactions on biomedical circuits and
pp. 855–867, 2017. systems, vol. 12, no. 6, pp. 1322–1333, 2018.
[16] D. Smyl, M. Pour-Ghaz, and A. Seppänen, “Detection and reconstruction [37] M. Zhang, Q. Dai, P. Yang, J. Xiong, C. Tian, and C. Xiang, “idial:
of complex structural cracking patterns with electrical imaging,” NDT Enabling a virtual dial plate on the hand back for around-device
& E International, vol. 99, pp. 123–133, 2018. interaction,” Proceedings of the ACM on Interactive, Mobile, Wearable
[17] M. Tang, W. Wang, J. Wheeler, M. McCormick, and X. Dong, “The and Ubiquitous Technologies, vol. 2, no. 1, pp. 1–20, 2018.
number of electrodes and basis functions in eit image reconstruction,” [38] Y. Lu, B. Huang, C. Yu, G. Liu, and Y. Shi, “Designing and evaluating
Physiological measurement, vol. 23, no. 1, p. 129, 2002. hand-to-hand gestures with dual commodity wrist-worn devices,” Pro-
[18] D. S. Tawil, D. Rye, and M. Velonaki, “Improved image reconstruction ceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous
for an eit-based sensitive skin with multiple internal electrodes,” IEEE Technologies, vol. 4, no. 1, pp. 1–27, 2020.
Transactions on Robotics, vol. 27, no. 3, pp. 425–435, 2011. [39] E. Zheng, J. Wan, L. Yang, Q. Wang, and H. Qiao, “Wrist angle
[19] D. Silvera-Tawil, D. Rye, M. Soleimani, and M. Velonaki, “Electrical estimation with a musculoskeletal model driven by electrical impedance
impedance tomography for artificial sensitive robotic skin: A review,” tomography signals,” IEEE Robotics and Automation Letters, vol. 6,
IEEE Sensors Journal, vol. 15, no. 4, pp. 2001–2016, 2014. no. 2, pp. 2186–2193, 2021.
[20] G. Ma, Z. Hao, X. Wu, and X. Wang, “An optimal electrical impedance [40] B. B. Atitallah, R. Barioul, A. Ghribi, D. Bouchaala, N. Derbel, and
tomography drive pattern for human-computer interaction applications,” O. Kanoun, “Electrodes placement investigation for hand gesture recog-
IEEE transactions on biomedical circuits and systems, vol. 14, no. 3, nition based on impedance measurement,” in 2020 17th International
pp. 402–411, 2020. Multi-Conference on Systems, Signals & Devices (SSD). IEEE, 2020,
[21] A. Adler, P. O. Gaggero, and Y. Maimaitijiang, “Adjacent stimulation pp. 1173–1177.
and measurement patterns considered harmful,” Physiological measure- [41] S. H. Yoon, K. Huo, Y. Zhang, G. Chen, L. Paredes, S. Chidambaram,
ment, vol. 32, no. 7, p. 731, 2011. and K. Ramani, “isoft: a customizable soft sensor with real-time contin-
[22] J. Hope, F. Vanholsbeeck, and A. McDaid, “Drive and measurement uous contact and stretching sensing,” in Proceedings of the 30th Annual
electrode patterns for electrode impedance tomography (eit) imaging of ACM Symposium on User Interface Software and Technology, 2017, pp.
neural activity in peripheral nerve,” Biomedical Physics & Engineering 665–678.
Express, vol. 4, no. 6, p. 067002, 2018. [42] S. Russo, R. Assaf, N. Carbonaro, and A. Tognetti, “Touch position
[23] G. Laput, R. Xiao, X. Chen, S. E. Hudson, and C. Harrison, “Skin detection in electrical tomography tactile sensors through quadratic
buttons: cheap, small, low-powered and clickable fixed-icon laser pro- classifier,” IEEE Sensors Journal, vol. 19, no. 2, pp. 474–483, 2018.
jectors,” in Proceedings of the 27th annual ACM symposium on User [43] M. Nawaz and H. Yan, “Saliency detection via multiple-morphological
interface software and technology, 2014, pp. 389–394. and superpixel based fast fuzzy c-mean clustering network,” Expert
[24] Y. Zhang, R. Xiao, and C. Harrison, “Advancing hand gesture recog- Systems with Applications, vol. 161, p. 113654, 2020.
nition with high resolution electrical impedance tomography,” in Pro- [44] M. Nawaz, R. Qureshi, M. A. Teevno, and A. R. Shahid, “Object
ceedings of the 29th Annual Symposium on User Interface Software and detection and segmentation by composition of fast fuzzy c-mean clus-
Technology, 2016, pp. 843–850. tering based maps,” Journal of Ambient Intelligence and Humanized
[25] A. Hirata, Y. Takano, Y. Kamimura, and O. Fujiwara, “Effect of the Computing, pp. 1–16, 2022.
averaging volume and algorithm on the in situ electric field for uniform [45] S. Khan, M. Nawaz, X. Guoxia, and H. Yan, “Image correspondence
electric-and magnetic-field exposures,” Physics in Medicine & Biology, with cur decomposition-based graph completion and matching,” IEEE
vol. 55, no. 9, p. N243, 2010. Transactions on Circuits and Systems for Video Technology, vol. 30,
[26] M. C. Corballis, “The gestural origins of language: Human language no. 9, pp. 3054–3067, 2019.
may have evolved from manual gestures, which survive today as a” [46] M. Nawaz, S. Khan, J. Cao, R. Qureshi, and H. Yan, “Saliency detection
behavioral fossil” coupled to speech,” American Scientist, vol. 87, no. 2, by using blended membership maps of fast fuzzy-c-mean clustering,” in
pp. 138–145, 1999. Eleventh International Conference on machine vision (icmv 2018), vol.
[27] P. Trigueiros, F. Ribeiro, and L. P. Reis, “Vision-based gesture recog- 11041. SPIE, 2019, pp. 565–572.
nition system for human-computer interaction,” Computational Vision [47] M. Nawaz, S. Khan, R. Qureshi, and H. Yan, “Clustering based one-to-
and Medical Image Processing IV: VIPIMAGE, vol. 2013, pp. 137–142, one hypergraph matching with a large number of feature points,” Signal
2013. Processing: Image Communication, vol. 74, pp. 289–298, 2019.
[28] M. Abdelwahed, A. Pitti, O. Romain, and F. B. Ouezdou, “Use of multi- [48] M. Nawaz, R. Xie, L. Zhang, M. Asfandyar, and M. Hussain, “Image
frequency electrical impedance tomography as tactile sensor for material super resolution by sparse linear regression and iterative back projec-
discrimination,” in 2020 5th International Conference on Advanced tion,” in 2016 IEEE International Symposium on Broadband Multimedia
Robotics and Mechatronics (ICARM). IEEE, 2020, pp. 588–594. Systems and Broadcasting (BMSB). IEEE, 2016, pp. 1–6.
[29] M. Oudah, A. Al-Naji, and J. Chahl, “Hand gesture recognition based [49] M. Nawaz, “Saliency detection and feature matching for object segmen-
on computer vision: a review of techniques,” journal of Imaging, vol. 6, tation in digital images,” Ph.D. dissertation, City University of Hong
no. 8, p. 73, 2020. Kong, 2020.
[30] A. S. Al-Shamayleh, R. Ahmad, M. A. Abushariah, K. A. Alam, and [50] M. Nawaz and H. Yan, “Saliency detection using deep features and
N. Jomhari, “A systematic literature review on vision based gesture affinity-based robust background subtraction,” IEEE Transactions on
recognition techniques,” Multimedia Tools and Applications, vol. 77, Multimedia, vol. 23, pp. 2902–2916, 2020.
no. 21, pp. 28 121–28 184, 2018. [51] A. Adler, J. H. Arnold, R. Bayford, A. Borsic, B. Brown, P. Dixon,
[31] D. Farina, “Member s, jiang n, rehbaum h, member s, holobar a, T. J. Faes, I. Frerichs, H. Gagnon, Y. Gärber et al., “Greit: a unified
graimann b, dietl h, aszmann oc. the extraction of neural information approach to 2d linear eit reconstruction of lung images,” Physiological
from the surface emg for the control of upper-limb prostheses: emerging measurement, vol. 30, no. 6, p. S35, 2009.
avenues and challenges,” IEEE Trans Neural Syst Rehabil Eng, vol. 22, [52] Gense tech ltd. [Online]. Available: https://www.gensetechnologies.com/
pp. 797–809, 2014. [53] F. Ucar and D. Korkmaz, “Covidiagnosis-net: Deep bayes-squeezenet
[32] J. Qi, G. Jiang, G. Li, Y. Sun, and B. Tao, “Surface emg hand gesture based diagnosis of the coronavirus disease 2019 (covid-19) from x-ray
recognition system based on pca and grnn,” Neural Computing and images,” Medical hypotheses, vol. 140, p. 109761, 2020.
Applications, vol. 32, no. 10, pp. 6343–6351, 2020. [54] Y. Zhang and C. Harrison, “Tomo: Wearable, low-cost electrical
[33] F. Botros, A. Phinyomark, and E. Scheme, “Emg-based gesture recog- impedance tomography for hand gesture recognition,” in Proceedings
nition: Is it time to change focus from the forearm to the wrist?” IEEE of the 28th Annual ACM Symposium on User Interface Software &
Transactions on Industrial Informatics, 2020. Technology, 2015, pp. 167–173.
[34] T. Boretius, J. Badia, A. Pascual-Font, M. Schuettler, X. Navarro,
K. Yoshida, and T. Stieglitz, “A transverse intrafascicular multichannel
electrode (time) to interface with the peripheral nerve,” Biosensors and
Bioelectronics, vol. 26, no. 1, pp. 62–69, 2010.
[35] R. Weir, P. Troyk, G. Demichele, D. Kerns, J. Schorsch, and H. Maas,
“Implantable myoelectric sensors (imes) for prosthesis control: Develop-
ment and testing,” IEEE Trans Biomed Eng, vol. 56, no. 1, pp. 159–71,
2009.
© 2022 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission.See https://www.ieee.org/publications/rights/index.html for more information.
Authorized licensed use limited to: ANNA UNIVERSITY. Downloaded on August 04,2022 at 08:20:15 UTC from IEEE Xplore. Restrictions apply.
This article has been accepted for publication in IEEE Sensors Journal. This is the author's version which has not been fully edited and
content may change prior to final publication. Citation information: DOI 10.1109/JSEN.2022.3193718
MEHMOOD et al.: HAND GESTURES CLASSIFICATION USING ELECTRICAL IMPEDANCE TOMOGRAPHY IMAGES 11
Dr. Mehmood Nawaz received the PhD degree Dr. Cao Peng received his B.Eng. and mas-
(electrical engineering) from City University of ter’s degrees from Xi’an Jiaotong University. His
Hong Kong and the MSc Degree (information Ph.D. was from The University of Hong Kong.
and communication engineering) from Shanghai He is an Assistant Professor at the Department
Jiaotong University, China. His BS degree (com- of Diagnostic Radiology, the University of Hong
puter engineering) from Baha-uddin-Zakariya Kong. He has up to 10 years of experience
University Multan, Pakistan. He was a postdoc at in medical imaging investigation of pathological
The University of Hong Kong in 2020-2021. He is changes in diseases, imaging reconstruction,
currently a Postdoc fellow in the Department of and software/hardware development. His engi-
Medical Engineering, The Chines University of neering and biomedical imaging background al-
Hong Kong. His research interests include graph low him to develop advanced imaging tools to
matching, image segmentation, image reconstruction, sensors fusion, satisfy preclinical and clinical needs.
shape matching, and pattern recognition, etc.
© 2022 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission.See https://www.ieee.org/publications/rights/index.html for more information.
Authorized licensed use limited to: ANNA UNIVERSITY. Downloaded on August 04,2022 at 08:20:15 UTC from IEEE Xplore. Restrictions apply.