You are on page 1of 4

A Wearable Sensor System for Neonatal Seizure Monitoring

Hongyu Chen, Xiao Gu, Zhenning Mei, Ke Xu, Kai Yan, Chunmei Lu, Laishuan Wang, Feng Shu,
Qixin Xu, Sidarto Bambang Oetomo, and Wei Chen, Senior Member, IEEE

infant seizures EEG signals are weak and illegible, which


Abstract—A novel wearable sensor system for seizure


monitoring of neonates comprised of smart clothing, video makes them likely to be overlooked [5]. In addition, several
recording and cloud platform is presented. Textile electrodes related research has been trying to develop Electrocardiogram
and Inertial Measurement Unit (IMU) are embedded in the (ECG) based techniques to distinguish neonates with epileptic
smart clothing to obtain ECG signal and motion signal whereby seizure from healthy ones [6]. The movement information
epileptic seizure detection algorithm is performed. Moreover, a aspect remains as a research niche in the field of automatic
video monitoring module provides real-time information about diagnosis of neonatal seizure [7].
patients. The cloud platform receives the pre-processed data
and enables remote monitoring, centralized signal processing In clinical practice, diagnosis based on the observation on
and data management. Comparison with commercial EEG and/or video recording by experienced clinicians is
instruments shows that the smart clothing is capable of time-consuming and limited by the inter-observer variability
acquiring high-quality signals. Pilot tests under disinfection due to its subjective nature [8] [9]. Moreover, EEG monitoring
operations at Children’s Hospital of Fudan University confirm in neonates is available only in a dedicated environment like
clinical feasibility of the proposed system. The scalability and the Neonatal Intensive Care Unit (NICU). Furthermore, cup
modularity of the unobtrusive wearable front end and the surface electrodes and gel electrodes used for monitoring may
design of system architecture based on cloud enable the whole cause skin lesions. The deployment of electrodes with wires
system with great potential in clinical practice and home connected to monitoring devices may also interfere with the
monitoring scenarios. movement of infant and lead to missing detection. Therefore, a
I. INTRODUCTION new seizure monitoring approach is needed with the
advantages of high accuracy and comfort for neonates.
Epileptic seizure is an important clinical sign of brain Considering the rapid developments in the field of sensor and
dysfunction that occurs more commonly during infancy wireless communication technology in recent decades, a new
compared to childhood [1]. Seizures often manifest as concept of unobtrusive monitoring of infants using wearable
repetitive motion of an arm, hand, leg and eye and sometimes sensor system has been reported [10] [11] [12] [13].
are accompanied by the contraction of muscles at a fluctuant
velocity in opposite directions [2]. An overall occurrence rate In this study, a wearable sensor system is presented aiming
of seizure about 1~5% in neonates is reported. As for to provide an intelligent auxiliary diagnosis for neonates at
the preterm infants, it is about 6~13%, higher than that high risk of seizures. The system consists of smart clothing, a
among normal newborns [2] [3]. Furthermore, about half of video recording module and a cloud platform. Textile
the neonates diagnosed with convulsion have various types of electrodes replace the gel electrodes to circumvent possible
brain dysfunction, with an overall mortality rate as high as skin damage. Inertial Measurement Units (IMUs) are
30% [4]. embedded to obtain movement information whose potential in
automatic seizure detection is not well exploited yet. Given
Hitherto, the Electroencephalogram (EEG) is the gold the feasibility that has been confirmed by a pilot study on data
standard for neonatal epilepsy diagnosis, but for some kinds of collection, transmission and management, the unobtrusive
wearable frontend together with the video recording module
Hongyu Chen is with the Center for Intelligent Medical Electronics, and cloud platform enables the application in both hospital and
School of Information Science and Technology, Fudan University, Shanghai, home-based scenarios.
China, and the Department of Industrial Design, Eindhoven University of
Technology, Netherlands. (E-mail: chenhongyudesign@outlook.com ). In this paper, the overall system architecture and detailed
Xiao Gu, Zhenning Mei, and Ke Xu are with the Center for Intelligent information about system implementation is presented
Medical Electronics, School of Information Science and Technology, Fudan together with the results of signal quality tests and clinical
University, Shanghai, China. (E-mail: 14307130126@fudan.edu.cn; feasibility tests. The broader application potential of system is
16210720037@fudan.edu.cn; 14307130144@fudan.edu.cn ) also discussed.
Kai Yan, Chunmei Lu, Laishuan Wang are with the Children’s Hospital of
Fudan University, Shanghai, China.( E-mail: laishuanwang@163.com ) II. SYSTEM DESIGN
Feng Shu and Qixing Xu are with the Shanghai Lvcheng Information
Technology Co., Ltd. (Email: feng.shu@outlook.com; djixqx@163.com ) A. Design requirements
Sidarto Bambang Oetomo is with the Department of Industrial Design,
Eindhoven University of Technology, and the Department of Neonatology, We launched the design procedure of the system from
Maxima Medical Center, Netherlands. (E-mail: requirement design first based on previous research [14]. To
S.BambangOetomo@mmc.nl) overcome the limitations of the diagnostic procedures for
Wei Chen is with the Center for Intelligent Medical Electronics, School of neonates at risk for seizures we propose the following
Information Science and Technology, Fudan University, and Shanghai Key
requirements:
Laboratory of Medical Imaging Computing and Computer Assisted
Intervention, Shanghai China (Phone: +86-021-65643781; E-mail:
w_chen@fudan.edu.cn).

978-1-5090-6244-7/17/$31.00 ©2017 IEEE 27


 Continuous monitoring and recording of vital sign for III. System implementation and prototype
both daily use and automatic detection with minimal
In this section, the detailed information about system
disturbance to neonates.
implementation is elucidated. The overall system consists of
 Continuous monitoring of body movements two major parts, data acquisition and cloud platform. As for
data acquisition, ECG, motion data and video information are
 Automatic seizure detection algorithm and warning obtained by smart clothing and video recorder and transmitted
with events logged. to upper computer. Cloud platform with software and the
 Data management for further use, like retrospective algorithms embedded in is in charge of data storage, analysis,
analysis and longitudinal study. and feedback.

 User-friendly interfaces for both professional A. Prototype jacket


clinicians at hospitals and inexperienced users at The smart clothing as a wearable front end is made of
home without interference with existing electrical cotton in a double-layer manner, as illustrated in Fig. 2. Two
devices. silver textile electrodes (Shieldex Berlin RS) are sewn at the
mid lateral sides of the upper chest with two IMUs
 The skin-contacting part can be sterilized. (Invensense MPU9250) deployed near cuff between two
 Video monitoring for confirming the diagnosis. layers, respectively. The analog potential difference sensed by
textile electrodes is preprocessed by a commercially available
B. System architecture analog front end ADS1292 (TI). The difference is amplified
To meet the requirements mentioned above, the proposed by the onboard amplifier and then converted to a digital signal
solution is described below. by a 24-bit high accurate Analog Digital Converter (ADC).
The corresponding digital signal and the motion signal
A complete process of monitoring is composed of three obtained from MPU9250 (Invense) are transferred to local
steps, data collection, data transmission, and data analysis and microcontroller unit (MCU) MSP430 via Serial Peripheral
feedback. As the system sketch shown in Fig. 1, data Interface (SPI). Signal conditioning is performed on the MCU
collection is achieved by smart clothing (see below) and video including filtering and data packing. Therefore, transmission
recorder, whereby smart clothing collects ECG signals and bandwidth needed in the following stage can also be reduced
motion signals, and video camera records video information. substantially.
The data generated by smart clothing are transmitted to mobile
terminal via Bluetooth, while the video recording is Figure 2. Prototype jacket.
transmitted to mobile terminal via Wireless Local Area
Network (WLAN).
Figure 1. System architecture

All the preprocessed data are sent to the upper computer


(usually, a mobile terminal) synchronously via Bluetooth
(CC2564). All the modules are integrated into a toy-like box
for the convenience of daily nursing and replacement. The
smart clothing as a whole is modularized, with the belt where
the textile electrodes are embedded in and the toy-like module
all detachable. It is convenient for replacement of specific
The cloud platform receives all the data uploaded from the parts and subsequent cleaning and disinfection after each use.
mobile terminals for concentrated processing and storage. An
authorized user can get access to the cloud platform and B. Video recording module
download data with timestamps to any mobile terminal or The video recording module provides real-time
microcomputer with software kit installed. The software information about the monitored patient. Video information
provides real-time display of physiological signals and video enables remote monitoring, which is not only suitable for
recordings as well as alarms when infant seizure is detected. home care scenarios, but also reduce the workload of clinical
staff. In particular, in current clinical practice, video
information is important as a reference. Physicians determine
the occurrence of seizures afterward with the help of EEG
waveform combined with video information. Thus, the video
28
recording is indispensable for event annotation on signal All these data are periodically uploaded to the cloud
waveforms, which is the premise of the development of platform, which is capable of doing further offline analysis
automatic diagnostic methods. and management for which the timeliness is not of high
priority, such as more complicated algorithms, longitudinal
C. Seizure detection algorithm modeling and individual electronic medical record. Multiple
Motion signal and ECG signal are utilized for seizure monitoring tasks can share the resources of cloud platform.
detection. Any authorized user can get access to the database, view the
As for the motion signal, a simple moving average data and analysis results on any convenient terminal.
algorithm with fixed threshold is deployed. As shown in Fig. 3, IV. EXPERIMENT AND RESULTS
N is the length of the moving window and Θ is the threshold to
determine the motion with abnormal intensity caused by A. Signal quality test on ECG
seizure. A similar algorithm provided promising results in We compare the ECG signals acquired by textile
tests on pediatric patients with frontal lobe seizures which electrodes on our prototype with that collected simultaneously
result in marked motor manifestations, like bicycle pedaling or by a commercial instrument Shimmer3 with adhesive gel
uncontrolled arm movements [15]. Its sensitivity to seizures of electrodes at LA-RA lead at a sampling frequency of 250Hz.
infants needs to be verified with clinical tests. The length of the signal is about ten minutes.
As for ECG signal, Hjorth parameter, a normalized slope Morphology of waveforms, power spectral density (PSD)
descriptor (NSD) about waveform, which is usually used in of signal from prototype and shimmer3 (after elimination of
EEG analysis but also used in several related research for powerline interference at 50 Hz and then filtered by a low pass
infant seizure detection as time-domain feature [16], is used filter with passband frequency at 70Hz and stopband
due to its low computation cost for further classification. frequency at 80 Hz by MATLAB) together with two signal
Figure 3. Flow Chart of Algorithms.
quality indicators (SQI) defined in [17] are compared.
Figure 5. ECG waveforms of prototype and Shimmer device.

D. Cloud platform and user interface


The collected data are transmitted to local mobile terminal
as described in Part II. The user can view the collected
physiological signals and video through the software installed
in the mobile terminal with the automatic diagnosis algorithms.
The software displays the waveforms of physiological signals
and video signal collected in real-time, together with the
real-time heart rate and the inter-beat (RR) interval histogram
which visualize the Heart Rate Variability (HRV). When a
seizure is detected by the algorithm, an alarm is raised with an
event logged.
Figure 6. PSD of prototype and standard instrument
Figure 4. The GUI of software

29
TABLE I. SIGNAL QUALITY INDICATORS V. DISCUSSION AND CONCLUSION
Prototype System Shimmer3 A novel wearable sensor system for seizure monitoring of
pSQI 0.9049 0.5731 neonates with good modularity and scalability is presented.
baseSQI 0.9759 0.9943 More clinical trials are needed to validate the performance
of the algorithms, the maximum endurance of power supply
and sensitization aspects. Data fusion techniques and
The comparison of waveforms reveals the similarity of optimization algorithm will be explored in the future with the
signal quality in a visual manner. The comparisons of PSD help of clinical data.
and SQI show the similarity of signal in frequency domain.
The system can be improved by adding more sensors in the
The results manifest that the system acquires signals with
comparable quality with the commercial instrument. existing modalities and beyond. The robustness of the system
may be thus enhanced by data fusion techniques. And an
B. Signal quality test on motion signal algorithm with higher performance is anticipated.
Experiments on adults were carried out to validate the The system is ambitious to serve as an effective auxiliary
motion analysis part of our system. The prototype and diagnostic method to the benefit of existing condition. Given
shimmer 3 were attached to the left wrist as is shown in fig 7. the characteristics mentioned above, it is also prospective in
A standardized protocol was followed, where different types fields like general movement assessment (GMA), early
of movements, including mimicking tonic and clonic seizures,
intervention and home monitoring.
typing, handshaking, arm swing, etc. Measurement time of
each movement was 30 seconds. Fig. 7 shows the comparison
References
of the mean square values of 3-axis accelerations, which
confirmed the comparable data quality of the prototype. [1] R. N. Douglas, et al. “Recognition and Classification of Seizures in
Further clinical trials will validate its sensitivity and Infants.” in Epilepsia, vol. 38, 1997, pp. 553–560.
[2] J. M. Rennie. “Neonatal Seizures.” in European Journal of Pediatrics.
specificity on neonatal seizure detection. vol. 156, 1997, pp. 83-87.
Figure 7. Motion signals acquired by prototype and standard instrument [3] R. R. Clancy “Summary Proceedings from the Neurology Group on
Neonatal Seizures”. in Pediatrics, 117(2), 2006, pp.23-27.
[4] B. R. Tharp, “Neonatal Seizures and Syndromes”, in Epilepsia, vol. 43,
2002, pp. 2-10J.
[5] Q.Wang, et al. "Clinical characteristics and video EEG analysis of 60
convulsive neonates." Chinese Journal of Child Health Care 24.2
(2016): 210-212.
[6] Koichi Fujiwara, et al. “Epileptic Seizure Prediction Based on
Multivariate Statistical Process Control of Heart Rate Variability
Features”, in IEEE Transactions on Biomedical Engineering, 63(6),
2016, pp.1321-1332.
[7] H. Chen, et al. “A Review of Wearable Sensor Systems for Monitoring
Body Movements of Neonates”, in Sensors, 16(12), 2016, pp.2134-.
[8] B. Greene, et al. “A comparison of quantitative EEG features for
neonatal seizure detection”, in Clinical Neurophysiology, 119(6), 2008,
pp.1248-1261.
[9] K. Cuppens, et al. “Towards automatic detection of movement during
C. Safety tests before application in the NICU sleep in pediatric patients with epilepsy by means of video recordings
and the optical flow algorithm”, in Proceedings of the 4th European
Safety tests were carried out before applying the prototype Congress of the International Federation for Medical and Biological
for clinical trials. Together with a doctor, head nurse and Engineering (MBEC 2008), vol.22. pp. 784-789.
engineer, the hygiene and allergy risks are analyzed. The [10] W. Chen, et al. “Sensor intergration for perinatology research.”, in
performance of the prototype jacket together with electrodes International Journal of Sensor Networks,9(1),2010, pp. 38-49.
and circuits maintain the stability after 15 times of daily [11] S. Bouwstra, et al. “Designing for Reliable Textile Neonatal ECG
disinfection operation in NICU at Children’s Hospital of Monitoring using Multi-sensor Recordings” in the Proceedings of
IEEE EMBS 2011, 2011(4) pp.2488-2491.
Fudan University. No obvious active and/or passive
[12] H. Chen, et al. “Neonatal seizure detection with wearable sensor
interference with devices was observed. system”, in WISHWELL’16 in conjunction with IE 16, vol. 38, 2016.
Figure 8. Desinfection test at Children’s Hospital of Fudan University [13] G. Fortino, et al. “Enabling effective programming and flexible
management of efficient body sensor network Applications”, in IEEE
Transactions on Human-machine Systems, 43 (1), 2013, pp.115-133.
[14] R. Gravina, et al. “Cloud-based activity-aaService cyber-physical
framework for human activity monitoring in mobility”, in Future
Generation Computer Systems, doi:10.1016/j.future.2016.09.006.
[15] Ann-Sofie, et al. “Accelerometers used for the detection of nocturnal
frontal lobe seizures in pediatric patients”, in Proceedings of
ECUMICT, 2010, pp. 331-342.
[16] M.B. Malarvili and Mostefa Mesbah, “Newborn Seizure Detection
based on Heart Rate Variability”, in IEEE Transactions on Biomedical
Engineering, 56(11), 2009, pp.2594-2603.
[17] Q. Li, et al. “Robust heart rate estimation from multiple asynchronous
noisy sources using signal quality indices and a Kalman filter”, in
Physio. Meas., 29(1), 2008, pp.15-32.

30

You might also like