Professional Documents
Culture Documents
Abstract—Besides revealing useful information, like gender, age, their value is often underrated by the user. In fact, mobile
existing impairments, the gait of every person is acknowledged to phones are usually not protected by any password or PIN, and,
be so distinctive to allow the personal identification and it is if they are, in most of the cases it is required only once at the
regarded as a valid biometric authentication, similarly to power-on and not after a recover from stand-by [14]. The main
fingerprinting and face recognition. Although the first analyses reason is that typing a password is an annoying task. Instead,
on the gait were conducted in laboratories with dedicated through gait recognition, the smartphone can recognize the user
equipment, portable sensors have been exploited as they become when he/she is walking, so no further authorization is required.
available thanks to the technology miniaturization. Aiming at an The other advantage, common to all the methods based on
even more unobtrusive analysis, recent proposals rely on the data
biometric characteristics such as fingerprinting, is the impos-
acquired from the 3-axis accelerometer embedded in most of the
smartphones commercially available on the market. Nevertheless
sibility of stolen or forgotten the login information, which can
the analysis must be tailored to the lower-grade accelerometer happen instead with a password. However, the authentication
and the limited computational capability of the smartphone. This based on accelerometer data should be combined with another
paper identifies the guidelines that the state-of-the-art research security mechanism in case the user is not moving.
proposes for the gait recognition through a smartphone and This paper identifies the common procedures and reviews
discusses the procedures that are found as more appropriate. the main techniques proposed for analyzing the gait with an
accelerometer embedded in a smartphone. The study is
Keywords- gait analysis; biometric authentication; mobile
phone; 3-axis accelerometer
experimentally supported with the acceleration data collected
with a Samsung Galaxy S5. The fundamental phases followed
I. INTRODUCTION by the main state-of-the-art approaches are listed in Fig. 1 and
are detailed in the remainder of the paper. The first step is the
Independent studies in medicine [1] and psychology [2] data collection: the information about the acceleration signal
recognize that each individual owns a distinctive walking style should be acquired by keeping the smartphone in a natural
that allows his recognition. The identification of that gait position, as discussed in Section II. In the preprocessing phase,
patterns has attracted much research [3]. Although the first the data are cleaned to enhance their quality and to remove
studies were conducted in laboratories equipped with dedi- irregularities, as described in Section III. The next step is the
cated facilities, the current trend is to use portable sensors, in cycle detection: Section IV explains how the repetitive patterns
particular 3-axis accelerometers [4], for analyzing the human are searched inside the data. These patterns are then processed
walk. Conforming to the paradigm of ubiquitous computing, during the analysis phase both in the time and in the frequency
many state-of-the-art researches propose to exploit the domain, as discussed in Section V and VI, respectively. The
accelerometer embedded in the majority of the smartphones presented techniques are discussed in Section VII and some
available on the market [5-13]. In fact, smartphones frequently conclusions are drawn in Section VIII.
include an accelerometer, in order to align the display when
II. DATA COLLECTION
the orientation of the smartphone changes or for videogames.
Almost all the solutions adopted for carrying the smart-
Although the accelerometers included in commercial phone during the experiments are similar. The smartphone is
smartphones may be low-grade with respect to ad-hoc sensors, usually placed at the hip of the user in one of these ways:
comparative tests acknowledge that they provide a satisfactory x it is worn on a belt [6, 10]
performance, so they can be regarded as a low-cost and viable
alternative [5]. In addition, the gait recognition can be an added x it is carried inside a holster or a pouch [8, 9]
value for the smartphone user, because it is regarded as a
promising biometric authentication and it can grant access to x it is put in the pants pocket [12, 13]
the smartphone functionalities in an unobtrusive way [6-12]. x it is externally tied in correspondence of the pants
Actually, a smartphone stores big amount of sensitive data, pocket [11].
such as the telephone book and e-commerce applications, but
This work has been partially sponsored by Project OPLON (Opportunities for active and healthy longevity), Call "Smart Cities and Communities", funded by
Ministero Istruzione, Università e Ricerca, Italy.
– 368 –
4th Mediterranean Conference on Embedded Computing MECO - 2015 Budva, Montenegro
– 369 –
4th Mediterranean Conference on Embedded Computing MECO - 2015 Budva, Montenegro
Another approach for evaluating the average cycle length A. Statistics of the cycles
relies on salience vectors [8, 9]. A minimum salience vector After the samplings of the accelerations are segmented
has as many entries as the acceleration samples: the i-th entry into cycles, a basic description of the gait can be obtained
counts how many values there are after the i-th sample from the statistics of the cycles [12]:
before another sample < is found. As a consequence, the x average maximum acceleration
entries in the minimum salience vector with a high value 1
correspond to significant minimums in the acceleration data. avg_max = max (5)
For instance, Fig. 3 plots the minimum salience vector
computed from the acceleration data along the X-axis reported where is the initial instant of the -th cycle
in Fig. 2. The entries with a value greater than minimum peak
height and at least as far as minimum peak distance are the x average minimum acceleration
candidate starting points of the cycles. Minimum peak height 1
and minimum peak distance are computed experimentally as a avg_min = min (6)
fraction of the interpolation frequency. The estimated cycle
length is the mean value of the distances between the candidate x average cycle length
starting points. Finally, the cycles are detected by means of the 1
maximum salience vector, which is defined in the same way as avg_length = − (7)
the minimum one, but counting the number of data before a
higher value. The peaks in the maximum salience vector x average cycle frequency, computed as the inverse of
greater than the minimum peak height and at least as far as the the average cycle length.
half of the estimated average cycle length are identified. The
cycles start at each local minimum before those peaks. B. Moments
The k-th moment of a random discrete variable about a
The initial and final instants of the cycles can be detected
by observing the peaks in the autocorrelation of the horizontal value is defined as:
component of the acceleration [12]. Details about the
autocorrelation are given in Section V-D. , = ( − ) = ( − ) (8)
– 370 –
4th Mediterranean Conference on Embedded Computing MECO - 2015 Budva, Montenegro
where is the probability mass function of . The importance The cross correlation of a signal with itself is called
of the moments of the acceleration in the gait analysis is due to autocorrelation. The signal at the instant t is compared with its
their useful indications about the distribution of the samplings. value at the instant + :
[( − )( − )]
The cycles differ in length, i.e., the time taken for a step is ( )= . (11)
not always the same. A basic indication of the gait variability,
Some information can be extrapolated by varying :
i.e. to which extent the cycles differ in length, can be obtained
x how quickly the signal changes along the time: if the
from the first two moments. The first moment about zero is the
signal varies slowly, i.e. the values of and are
mean . The second central moment, i.e., the moment about the
similar, then the autocorrelation is positive;
mean, is the variance . The standard deviation is the
square root of the variance. The gait variability is estimated by x the presence of periodic patterns, hidden by noise;
computing the coefficient of variation CV = / [5]. The
x the identification of the fundamental frequency of a
standard deviation is also considered per se as a discriminating signal that contains several harmonic frequencies
parameter of the gait [12]. instead of the noise component.
The third and fourth order moments are regarded as other By varying the time lag around the cycle length, a
two discriminant parameters of the acceleration waveform [6]. sequence of autocorrelation coefficients can be computed. The
The third central moment is the skewness, which measures the maximum value of that sequence provides an estimation of the
asymmetry of the data distribution about its mean. The fourth gait balance: the higher the maximum, the more balanced the
central moment is the kurtosis, which reveals if the data are gait is [5]. To speed up the computation of the sequence, each
peaked or flat with respect to a normal distribution. coefficient can be estimated as follows:
The histogram is an effective graphical representation of 1
both the skewness and the kurtosis: it is suggested to be ( )= ( − )( − ) (12)
( − )
concatenated as a vector and used for the gait identification [6,
12]. To this purpose, the range of values in the acceleration where is the number of acceleration data samples.
waveform is split into disjoint intervals and a histogram with as The numerator in (10) is referred to as the covariance
many bins as intervals is drawn. The height of each bin is given between and . A covariance matrix is built by comput-
by the number of values falling into the corresponding interval. ing the value of the covariance for all the possible values of .
The histogram is normalized by the length of the values, so it Such a matrix expresses all the second-order statistics about
displays their relative frequencies. and can be used to define its similarity with a template [13].
C. Root mean square (RMS) Another distinctive description of the acceleration waveform
is given by the variance vector formed by the elements along
The acceleration data collected during a walk tend to form a
the principal diagonal of the covariance matrix [13]: by
repetitive sequence of positive and negative values. A measure
definition, the covariance of with itself is the variance of .
of the magnitude of this waveform can be obtained by means
of RMS [5, 12], defined as follows: E. Dynamic time warping (DTW)
1 DTW is an algorithm for comparing two discrete signals
= . (9) = ( , , … , ) and = ( , , … , ) [15]. First, a
distance measure ( , ) needs to be defined to evaluate the
The RMS is an indicator of the gait stability: the higher the
RMS value, the lower the degree of stability is [5]. similarity of any two elements of the signals: the lower the
distance, the more similar the elements are. An x matrix is
D. Correlation built, where the value of the element at position ( , ) is equal
The use of the cross-correlation for the gait recognition is to ( , ). The goal of DTW is to find the warping path
based on the assumption that the shape of the acceleration through the matrix with the minimum cumulative distance.
waveform is unique for every person [6]. Instead of punctually The path starts at the element (1, 1) and ends at ( , ); it
comparing the values of two waveforms and at every includes only adjacent elements (horizontally, vertically or
instant, with the cross-correlation their similarity is evaluated diagonally), moving from left to right and from up to down.
by shifting one of them along the time domain: Finding the optimal warping path corresponds to computing
( − ) − the optimal match between and , with the following rules:
( )= . (10)
x the first element of is aligned with the first element
is referenced to as time lag. The range of ( ) is [-1, 1]. of , as well as the last element of the two signals;
The cross-correlation can be used to look for the presence of a
x a signal can be locally “warped” in the time dimension
pattern inside a longer signal or to compare an input waveform
to compensate a non-linear variation of the other one;
with a template of equal length [6].
x no element of the signals can be omitted in the match.
– 371 –
4th Mediterranean Conference on Embedded Computing MECO - 2015 Budva, Montenegro
– 372 –
4th Mediterranean Conference on Embedded Computing MECO - 2015 Budva, Montenegro
sine functions, expressed as complex exponentials. Like the results obtained in the reviewed experiments show the viability
DFT, a direct computation of (16) requires O(N2) operations, of the smartphone-based approach.
but there exist fast algorithms, i.e. O(N log N). The direct
application of the FFT for the DCT computation is also REFERENCES
possible, but O(N) pre- and post-processing steps are needed. [1] T. Öberg, A. Karsznia, and K. Öberg. "Basic gait parameters: reference
data for normal subjects, 10-79 years of age", Journal of rehabilitation
As pointed out for the DCT, the first coefficients of the research and development, vol. 30, issue 2, 1993, pp 210–223
DCT are the most discriminant. For the gait recognition, only [2] S. V. Stevenage, M. S. Nixon, and K. Vince, “Visual Analysis of Gait as
the first 40 coefficients are suggested to be analyzed [12]. a Cue to Identity”, Applied Cognitive Psychology, vol. 13, pp. 513–526,
Dec. 1999, doi: 10.1002/(SICI)1099-0720(199912)13:63.0.CO;2-8
VII. DISCUSSION [3] D. Gafurov, "A survey of biometric gait recognition: approaches,
security and challenges", in Annual Norwegian Computer Science
Some common guidelines can be found in the state-of-the- Conference, Nov. 2007
art proposals for recognizing the gait through the data collected [4] J.-A. Lee, S.-H. Cho, J.-W. Lee, K.-H. Lee, and H.-K. Yang, "Wearable
with the accelerometer embedded in a smartphone. First, the accelerometer system for measuring the temporal parameters of gait", in
data need to be selected and polished. The acceleration values 29th Annual International Conference of the IEEE Engineering in
Medicine and Biology Society (EMBS), pp.483–486, Aug. 2007, doi:
are sampled along three perpendicular axes, but, depending on 10.1109/IEMBS.2007.4352328
the smartphone orientation, some axes can reveal more
[5] S. Nishiguchi, M. Yamada, K. Nagai, S. Mori, Y. Kajiwara, T. Sonoda,
characterizing information, so the values of the other axes can K. Yoshimura, H. Yoshitomi, H. Ito, K. Okamoto, T. Ito, S. Muto, T.
be dropped. In addition, the measures include noise and the Ishihara, and T. Aoyama, "Reliability and validity of gait analysis by
earth’s gravitational force, which should be taken into account android-based smartphone", Telemedicine and e-Health, vol. 18, issue 4,
through filters and data normalization. The next phase aims at May 2012, pp 292–296, doi:10.1089/tmj.2011.0132
recognizing the periodicity of the data, since they refer to a [6] J. Mäntyjärvi, M. Lindholm, E. Vildjiounaite, S.–M. Mäkelä, and H.
Ailisto, "Identifying users of portable devices from gait pattern with
sequence of steps. The pattern corresponding to two steps is accelerometers", in Proceedings of the IEEE International Conference
called a cycle. The methods for identifying the cycles are based on Acoustics, Speech, and Signal Processing (ICASSP), vol.2,
on the search of local peaks or on the estimation of the cycle pp.ii/973–ii/976, Mar. 2005, doi: 10.1109/ICASSP.2005.1415569
length. Finally, the cycles are analyzed and compared with [7] M. Tamviruzzaman, S. I. Ahamed, C. S. Hasan, and C. O'brien, "ePet:
templates for recognition and authentication purposes. The when cellular phone learns to recognize its owner", in Proceedings of the
analyses are carried out both in the time and in the frequency 2nd ACM workshop on Assurable and usable security configuration
(SafeConfig), pp. 13-18, Nov. 2009, doi: 10.1145/1655062.1655066
domain. In the time domain, the distribution of the samples
along the time is investigated by looking at the magnitude of [8] M. Muaaz, and R. Mayrhofer, "An analysis of different approaches to
gait recognition using cell phone based accelerometers", in Proceedings
the collected values and by computing statistics about the of International Conference on Advances in Mobile Computing &
length of the cycles. The acceleration data are converted in the Multimedia (MoMM), ACM, pp. 293–300, Dec. 2013, doi:
frequency domain by means of a mathematical transform. 10.1145/2536853.2536895
Here, the gait is characterized by its frequency components. [9] C. Nickel, M. O. Derawi, P. Bours, and C. Busch, "Scenario test of
accelerometer-based biometric gait recognition", in 3rd International
In the gait recognition, the input sample is accepted if its Workshop on Security and Communication Networks (IWSCN), IEEE,
similarity with the template is higher than a threshold. Two pp.15–21, May 2011, doi: 10.1109/IWSCN.2011.6827712
kinds of errors can occur: false acceptance rate (FRR) and false [10] M.O. Derawi, C. Nickel, P. Bours, and C. Busch, "Unobtrusive user-
rejection rate (FRR). As the similarity threshold increases, FRR authentication on mobile phones using biometric gait recognition", in
decreases and FRR grows. The threshold when FRR is equal to 6th International Conference on Intelligent Information Hiding and
Multimedia Signal Processing (IIH-MSP), pp.306–311, Oct. 2010, doi:
FRR is called equal error rate (ERR). The lower the ERR, the 10.1109/IIHMSP.2010.83
higher the accuracy is. Although the gait recognition through a [11] H. M. Thang, V. Q. Viet, N. D. Thuc, and D. Choi, "Gait identification
smartphone is in its early stages, the results are promising: the using accelerometer on mobile phone," in International Conference on
values of ERR provided in the studies range from a minimum Control, Automation and Information Sciences (ICCAIS), Nov. 2012,
of 7% [6] to a maximum of 33.3% [8]. Nevertheless, a direct pp.344–348, doi: 10.1109/ICCAIS.2012.6466615
comparison of the proposed techniques is not possible because [12] H. M. Thang, N. D. Thuc, C. Luong, S. Do, and D. Choi, "Adaptive
they consider different scenarios. A fair comparison should be cross-device gait recognition using a mobile accelerometer", Journal of
Information Processing Systems, vol. 9, issue 2, Jun. 2013, pp 333–348,
based on a common database of acceleration samples, which is doi: 10.3745/JIPS.2013.9.2.333
not yet publicly available. [13] F. Juefei-Xu, C. Bhagavatula, A. Jaech, U. Prasad, and M. Savvides,
"Gait-ID on the move: Pace independent human identification using cell
VIII. CONCLUSIONS phone accelerometer dynamics," in IEEE 5th International Conference
This paper has discussed how to recognize the gait of a on Biometrics: Theory, Applications and Systems (BTAS), Sept. 2012,
pp. 8–15, doi: 10.1109/BTAS.2012.6374552
person through the data acquired from the 3-axis accelerometer
[14] F. Breitinger and C. Nickel, "User survey on phone security and usage",
embedded in a smartphone. Some common phases are in Proceedings of the Special Interest Group on Biometrics and
identified: acquisition, preprocessing, cycle detection and Electronic Signatures (BIOSIG), pp. 139–144, Sep. 2010
analysis. For each phase, the techniques adopted in the [15] M. Müller, "Information retrieval for music and motion", Springer-
literature are presented. Despite the low-grade sensor, the Verlag New York, USA, 2007, ch. 4 Dynamic Time Warping, pp. 69–84
– 373 –