Professional Documents
Culture Documents
Postolache2015 PDF
Postolache2015 PDF
THE 9 INTERNATION
NAL SYMPOSIUM ON ADVANCED TOPICS IN ELECT
TRICAL ENGINEERING
May 7-9, 2015
Bucharest, Romania
Abstract- A system for gait assessment baseed on smart insoles New systems and algorithhm based on accelerometers
instrumented with flexible sensors as part of ZigBee network [2,3,4], gyroscopes [5,6], inertial measurement units
nodes and Bluetooth inertial measurement nodes is presented. [7,8,9,10], force sensors [11, 122], GPS [13], smartphone apps
The system was developed to objectively reecord and measure
ground reaction force, acceleration and direcction of feet in order
[14], Kinect [15,16], TelosB seensor motes [17], cardioid and
to provide information to physiotherap pists for objective omni-directional microphones attached
a in pairs to walls [18],
evaluation of rehabilitation effectiveness. Gaait characterization radar [19,20] or laser technollogy [21] were designed and
is made using time domain and time-frequen ncy domain analysis presented for gait analysis. Thhe challenge is multiple. An
of the signals. A small, light and portab ble wireless sensor easy-to-use system for out of the lab or clinics gait
network for quantitative gait impairment measurements in a monitoring should: be simple and a quite often limited in the
more natural environment was designed. number of sensors for monitoriing of various gait parameters;
work, piezoresistive
Keywords: wearable wireless sensor netw include signal acquisition and processing for elimination or
sensors, gait analysis. interference reduction of environmental and
INTRODUCTION psychophysiological variablees on gait parameters
measurement; provide understtandable presentation of the
Gait analysis is mainly carried out by visual observation data. Wearable sensor systemss need to be easy to put on
or using laboratory-based instruments suuch as laboratory without feeling cumbersome duuring activities nor sensitive to
video/optical cameras, floor sensors, senssors placed on the likely variations on daily wearinng after taking off frequently -
body or integration of these technologies. Such technologies a video based system often posses intrusion on privacy and is
are designed mainly for hospital and laborratory research and difficult to install to monitor vaariety of activities in different
are expensive both in equipment and personnel p support. locations. Safety use and meeasurements, the cost of the
Moreover, these gait lab technologies have h limitation of system and technology accessibbility are also issues that must
exploring the impact of type of surface onn gait alteration or be addressed.
examining gait on ample walking distancees. It is also known This paper presents the initial design of a low cost
that when a patient is examined in a specially arranged hardware and software plaatform developed with the
environment the motor performance may not n be the same as integration of a user-friendly graphical
g user interface (GUI)
that in a more natural environment such as home or daily which facilitates the real time acquisition
a of ground reaction
environments. Evidence on gait patterrn changes when force, acceleration and directtion of feet, and automatic
subjects walk outside a gait laboratory environment was detection representation of gaiit impairments. The paper is
published [1]. It is the gait in everyday lifee that matters most organized as follows: Sections II I and III present the hardware
to evaluate whether a treatment is eff ffective or not in and the software parts of the meeasurement system; Section IV
improving patients' movements. Thus, it is definitely describes the experimental testss performed; Section V and VI
desirable the usage of technologies foor long term gait present several experimental ressults and conclusions.
monitoring able: to identify adverse rehabbilitation outcomes,
as well as risk factors associated with poor outcome; to SYSTEM HARDWARE
A
provide and share information for indiividuals with gait Fig. 1 shows the system impplemented for gait monitoring.
impairments, their family and friends, andd physiotherapists; Each insole includes three flexible piezorezistive force
to allow in-home physiotherapy tailored specifically to the (FlexF) sensors, a resistance to voltage converter and an
patients’ needs, functioning and disabbility; to increase Atmel microcontroller platform m having a 10 bits analog to
effectiveness of various interventionns provided by digital converter. Two requirem ments were considered when
physiotherapists.
FlexF sensors were disposed on the insole: extraction of
Recently, technology development haas produce motion
meaningful values of forces associated
a with gait, and gait
and position sensors small in size and low weight, with
information representation usinng a reduced number of forces
wireless communication suitable for easyy and reliable gait
assessment and monitoring of subjects outside a gait lab. sensors.
E
978-1-4799-7514-3/15/$31.00 ©2015 IEEE 321
3D gyroscopes, and 3D magnetom meters. The Shimmer module is
based on a 24MHz MSP430 CPU C and includes a Bluetooth
transceiver, being the overall pow
wer consumption of the module
very low.
A. Insole Sensing Module
The implemented smart insooles include sets of ultra-thin,
flexible, 445N measuremennt range Flexiforce A201
piezorezistive sensors. Metrollogical characteristics of the
used FlexF sensors are: lineariity error ±3%; repeatability
±2.5% of full scale; hysteresis < 4.5 % of full scale. Before
the implementation of the insole sensing module, tests were
done for static and dynamic chharacterization of the sensors.
Tests were performed usingg a pneumatic cylinder, a
pneumatic tester with accuracy of about 0.7 kPa (0.1 psi) for
a measuring range between 0 annd over 200 kPa (30 psi), and a
precision balance with 20 g accuracy. The pressure was
Fig. 1. Gait Assessment System Block Diagram: FleexF SensM - Flexiforce applied over the FlexF sensor using
u a double acting compact
sensing module; F_AcqC - force acquisition and coommunication module; cylinder operating in a pressuree range between 100 and 1000
Shim3IMU - Shimmer 3 inertial measurement unit; FAss Coord - Force kPa. A static characteristic of thhe FlexF sensor experimentally
Assessment Network Coordinator; end nodes of the network - Fright node obtained is presented in Fig. 3.
and Fleft node.
It is important to underline that during calibration a thin
The human gait involves unique paatterns called gait elastomer was inserted betweenn the sensing area of the FlexF
phases, namely stance and swing phase ussually divided into sensor and the pneumatic cyllinder piston rod in order to
eight functional patterns developed by the Rancho Los provide a uniform pressure distrribution over the sensitive part
Amigos gait analysis committee, as: of the sensor. In Fig. 4 is represented the dynamic response of
1) Stance phase: initial contact, loading ressponse, mid stance, FlexF sensor when 2 differentt thicknesses of polyurethane
terminal stance, pre swing; rubber were applied over the FlexF F sensing area. From the
2) Swing phase: initial swing, mid swing, teerminal swing. curves that are represented in Fig.
F 4, it can be concluded that
The FlexF sensors were placed underneatth the calcaneus, the even if an excessive polyurethhane rubber thickness is used
head of the 1st metatarsal and the head of the 4tth metatarsal. During (e=3 mm), the time constantt (τ) associated with FlexF
resistance variations does noot impose significant delays
relatively to the dynamic variations of the kinematic
parameters that are associatedd with walking. Contact force
variation during gait is exppressed by the variation of
resistance of the FlexF sensors. Taking into account the
necessity to convert this variaation into voltage variation to
be acquired by the F_AcqC nodes n attached to each leg, a
three channel resistance--to-voltage converter was
implemented.
5
Conductance (uS)
Fig. 2. Fundamental gait phases. Top view: repressentation of leg and foot
position; bottom view: foot contact regions. 1
322
processing speed. The module memory includes 1kB
EEPROM, 2kB SRAM and 32kB FLASH. In the considered
system two acquisition and wireless communication modules
were implemented each with three force measuring channels.
The communication between the network end nodes and
the coordinator is done through ZigBee wireless
communication protocol. Each end node includes an XBee®
802.15.4 module coupled to each Arduino FIO platform and
one XBee modem is connected to the Gait Assessment Base
Station through XBee to USB interface. In this case the base
station works as coordinator for the implemented ZigBee
wireless network. A remote control, data storage and
advanced processing software was developed in LabVIEW
and implemented at the base station level.
Fig. 4. FlexF sensor dynamic characteristic
323
between right and left stance phase are represented through to perform normal gait and after this with left and right leg
graphical representation of VFr1 and VFl1, VFr3 and VFl3. dragging. Foot dragging can be caused by inadequate muscle
Time domain and time-frequency domain signal processing stimulation required for maximum knee flexion during swing
modules were implemented in LabVIEW. Step length, stride phase. Low knee flexion during swing phase results in foot
length, cadence, speed of gait were analyzed. Changes in gait dragging on the ground when walking. Signal from force
pattern are represented using Poincaré plot (where time sensors and from IMUs sensors were acquired, stored,
interval between two successive steps is plotted against next displayed during gait. Gait analysis using information on step
time interval of two successive steps) and short time Fourier length, stride length, cadence, speed, Poincaré plot and short
spectrogram. time Fourier spectrogram was carried out.
The gait pattern is visualized through the spectrogram of RESULTS AND DISCUSSIONS
the foot forces signals, where the spectrogram is performed
The force signals evolution during normal walking from right
using short-time Fourier transform (STFT). STFT provides
and left foot force signals (VFr1, VFr3 – right foot forces;
time-frequency representation and is defined by:
VFl1, VFl3 - left foot forces) are represented in Fig. 8. The
ஶ signals were acquired at a rate of 20 S/s. Fig. 8 shows the
ܵܶݎܶܨሺݐǡ ݂ሻ ൌ ିஶ ݆ݏܨሺ ݐ ߬ሻݓሺ߬ሻ݁ ିଶగఛ ݀߬ (1) periodicity of the signals and their reduced variation
amplitudes, underlining the reduced variations of the contact
where t is time, f is frequency, Fsj is the acquired force signal force and degree of symmetry between left and right foot
(s-foot id, l-left or r- right, j-insole force sensor order j=1..3, movement.
Participants were asked to walk at their comfortable pace
along a pre-defined 10 meters path, in indoor conditions. The change in pattern of force signal during abnormal gait
After confirming the comfort of the subjects, they were asked 3
to perform normal gait, and after this with left and right leg
2,5
dragging. Foot dragging can be caused by inadequate muscle
2
stimulation required for maximum knee flexion during swing
phase. Low knee flexion during swing phase results in foot 1,5
sensors and from IMUs sensors were acquired, stored, and 0,5
324
that the left leg dragging can be characterized by lower
frequencies values - lower step cycle and cadence- irregular
distribution of maximum spectral power and higher values of
spectrogram energy (orange-red represented) that reflect
lower speed walking and more time spent in support gait
phase.
2,5
1,5
0,5
-0,5
20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40
Time(s)
a)
3
2,5
1,5
0,5
-0,5
0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20
Time(s)
b)
Fig. 9. The force voltage signals from metatarsal and calcaneus area for
simulated foot dragging (VFr1 – right force signal in purple, VFl1- left force
signal in magenta, VFr3 – right force signal in orange, VFl3 – left force
signal in yellow): a) right leg dragging; b) left leg dragging
Fig.11. STFT spectrogram gait signature associated with Fr3 and Fl3 insole
sensors in normal (top) and abnormal (bottom) gait.
a) b)
3
2,5
1,5
0,5
-0,5
Fig.10. Pointcaré plots: normal gait (top), left leg dragging(bottom) 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40
Time(s)
c)
During monitoring of feet force signals simultaneous Fig.12. Gait assessments based on Shimmer accelerometers and flexible force
acquisition of the accelerations were carried out. The sensors. a) left leg; b) right leg (ax – blue line, ay-red line, az-green line); c)
acquired x, y and z acceleration components are represented force voltage signals from right and left foots during the dragging test (VFr1,
VFl1,VFr3, VFl3 voltage signals associated with force measurement
in Fig. 12. Using the IMUs, information on acceleration, channels).
speed gait and direction can be obtained as well as
information on swing phase of gait whereas information on
325
stance phases of gait is directly obtained through force signal [7] D. Novak, P. Reberšek, T. Beravs, J. Podobnik, M. M. De Rossi, M.
Donati, T. Lenzi, N. Vitiello, M.C. Carrozza. “Early recognition of gait
acquisition. Thus, a thorough description of gait phases can initiation and termination using wearable sensors”. The Fourth IEEE
be obtained. RAS/EMBS International Conference on Biomedical Robotics and
Biomechatronics, pp. 1937-1942, June 2012.
CONCLUSION [8] J. Klucken, J. Barth, P. Kugler, J. Schlachetzki, T. Henze. “Unbiased
In the present work a set of wearable smart sensing nodes that and mobile gait analysis detects motor impairment in Parkinson’s
disease”. PLoS ONE, vol. 8, no.2, pp.e56956, 2013
include flexible piezoresistive sensors with acquisition and [9] R. S. Hundza, W. R. Hook, C. R. Harris, S. V. Mahajan, P. A. Leslie, C.
ZigBee wireless communication modules is presented. The A. Spani, L. G. Spalteholz, B. J. Birch, D. T. Commandeur, and N. J.
data from the sensing nodes are represented in time domain Livingston. “Accurate and reliable gait cycle detection in Parkinson’s
and time-frequency domain for normal and abnormal gait disease”. IEEE Transactions on Neural Systems and Rehabilitation
Engineering, vol. 22, no. 1, pp. 127-137, January 2014.
characterization. The results underscore the potential of the [10] M. Giuberti, G. Ferrari, L. Contin, V. Cimolin, C. Azzaro, G. Albani,
designed and implemented system to objectively characterize and A. Mauro. “Assigning UPDRS scores in the leg agility task of
the gait changes during a rehabilitation process and for Parkinsonians: Can it be done through BSN-based kinematic
monitoring user mobility activities in daily life. High gait variables”? IEEE Internet of Things Journal, vol.2, pp. 41-51, February
2015.
variability associated with gait impairments requires wearable [11] A.M. Howell, T. Kobayashi, T. Rosenbaum Chou, W. Daly, M.
systems for analysis of a higher number of strides which may Orendurff, and S. J. Morris Bamberg. “A laboratory insole for analysis
provide a more stable estimation of mean values changes in of sensor placement to determine ground reaction force and ankle
gait during physiotherapy. moment in patients with stroke”. 34th Annual International Conference
of the IEEE EMBS , pp. 6394-6397, August 2012.
[12] Z. Zhang, S. Poslad , “Improved Use of Foot Force Sensors and Mobile
Phone for Mobility Activity Recognition”, IEEE Sensors Journal, vol.
ACKNOWLEDGMENT 14, no. 12,, pp. 4340 -4347, December 2014.
[13] D. Ireland, S. McBride, J. Liddle, and H. Chenery. “Towards
This work was supported by the Instituto de Telecomunicações and
quantifying the impact of Parkinson’s disease using GPS and lifespace
Fundação para a Ciência e Tecnologia - project EHR-Physio: assessment”. 6th International Conference on Biomedical Engineering
Electronic Health Records-Needs, Requirements and Barriers in and Informatics (BMEI 2013), pp. 564-569, 2013.
Physiotherapy, PTDC/DTP-DES/1661/2012. Additional support for [14] M. Milosevic, E. Jovanov, and A. Milenkovi. “Quantifying Timed-Up
and-Go test: a smartphone implementation”. IEEE International
performed research was provided by IT-IUL/ISCTE-IUL. Conference on Body Sensor Networks (BSN), pp.1-6, May 2013.
[15] Y.Z. Chong, S.J. Yong, and J. Yunus. “Development of cost-effective
human motion analysis system for children with movement disorders”.
REFERENCES IEEE Conference on Biomedical Engineering and Sciences, pp. 607-
611, 2014.
[1] B. Najafi, J. L. Helbostad, R. Moe-Nilssen, W. Zijlstra, and K. Aminian. [16] J. Cancela, M. T. Arredondo, and O. Hurtado.” Proposal of a
"Does walking strategy in older people change as a function of walking KinectTM-based system for gait assessment and rehabilitation in
distance?" Gait Posture, vol. 29, pp. 261-266, Feb 2009. Parkinson’s disease”. IEEE EMBS International Conference, pp. 4519-
[2] J. Cancela, M. Pastorino, M. T. Arredondo, and O. Hurtado. “A 4522, August 2014.
telehealth system for Parkinson’s disease remote monitoring. The [17] A. Jamthe, S. Chakraborty, S. K. Ghosh, and D. P. Agrawal. “An
PERFORM approach”. 35th Annual International Conference of the implementation of wireless sensor networks in monitoring of
IEEE EMBS, pp. 7492-7495, July 2013. Parkinson's patients using received signal strength indicator”. IEEE
[3] E. Sejdiü, K.A. Lowry, J. Bellanca, M. S. Redfern, and Jennifer S. International Conference on Distributed Computing in Sensor Systems,
Brach. “A comprehensive assessment of gait accelerometry signals in pp. 442-447, 2013.
time, frequency and time-frequency domains”. IEEE Transactions on [18] M. U. Bin Altaf, T. Butko, B-H Juang. Acoustic Gaits: gait analysis
Neural systems and Rehabilitation Engineering, vol, 22, no. 3, pp. 603- with footstep sounds. IEEE Transactions on Biomedical Engineering,
612, 2014 2015.
[4] T. Liu, Y. Inoue, K. Shibata, Y. Hirota, and K. Shiojima. “A mobile [19] O. Postolache, M. Ribeiro, P.S. Girao, M. J.D. Pereira, G. Postolache.
force plate system and its application to quantitative evaluation of “Unobtrusive sensing for gait rehabilitation assessment”.
normal and pathological gait”. IEEE/ASME International Conference PervasiveHealth Proc 8th Iternational Conference on Pervasive
on Advanced Intelligent Mechatronics, pp. 272-277, July 2010. Computing Technologies for Healthcare, pp. 386-389, 2014.
[5] A. Salarian, P. R. Burkhard, F. J. G. Vingerhoets, B. M. Jolles, and K. [20] F. Wang, M. Skubic, M. Rantz, P.E. Cuddihy.”Quantitative gait
Aminian. “A novel approach to reducing number of sensing units for measurement with pulse-Doppler radar for passive in-home gait
wearable gait analysis systems”. IEEE Transactions on Biomedical assessment”. IEEE Trans Biomed Eng, vol.61, n. 9, pp. 2434-2443,
Engineering, vol.60, no.1, pp.72-77, January 2013. 2014.
[6] J. Barth, C. Oberndorfer, P. Kugler, D. Schuldhaus, J. Winkler, J. [21] S. Piérard, S. Azrour, and M. Van Droogenbroeck. “Design of a reliable
Klucken, B. Eskofier. “Subsequence dynamic time warping as a method processing pipeline for the non-intrusive measurement of feet
for robust step segmentation using gyroscope signals of daily life trajectories with lasers”. IEEE International Conference on Acoustic,
activities”. IEEE EMBS 35th Annual International Conference, Speech and Signal Processing (ICASSP), pp. 4399-4403, 2014.
pp.6744-6747, July, 2013. .
326