Professional Documents
Culture Documents
Abstract- The Internet of Things (IoT) with smartphone exists challenging problems in which the need to identify all
technologies contains vast applications in solving the problems of the possible patterns that can lead to cardiac injury is
of heart diseases in patients needing care. With wireless sensors pertinent to saving lives.
and smart devices, remote monitoring can identify the real-time Historically, seniors living all around the world have
physical status of heart patients during normal physical
been known to be late adapters to the world of technology
activities. In this research, we designed and developed an
embedded sensory system with a low power communication compared to younger generations, but their movement into
module to discreetly collect electrocardiogram (ECG) and body digital life is continuing to expand. Recent statistics indicates
accelerations using a smartphone in a common environment. A that 77% of the elderly have a phone and among that
wearable sensor is utilized to monitor the ECG patterns and the population, 18% are using smartphone devices [4]. As self-
smartphone’s built-in sensors; specifically, we use its contained devices, smartphones present a common
accelerometer and GPS sensors to measure the body commodity and software environment for developing
acceleration and location information of the user. various cardiac arrest or heart attack detection systems [5].
Experimentation and verification are conducted on a number Ideally, integrated sensors along with ECG monitoring can
of test subjects with different test scenarios including sitting,
automatically detect a risk of injury due to heart variability
walking, jogging, and running. Using signal classification and
machine learning techniques, we show that it is possible to [6-7]. In combination with recent studies and advancements
design a multisensory system that allows accurate classification in mobile technology, it is feasible to assume that the elderly
and authentic prediction of heart rate quality. will continue to increase their smartphone use. However, the
Keywords- IoT, Cardiac, CPS, Biotechnology, Multisensory. existing cardiac monitoring systems can only detect a risk to
a heart injury after it has already occurred. Subsequently, the
I. INTRODUCTION system sends an alarm to the caregivers and loving ones. The
The increase in popularity for wearable technology has ideal way to reduce the number of risks is to alert the users
opened the door for an Internet of Things (IoT) specific about their abnormal heart rate and the possibility of an
solution to healthcare. The advancement of low-power imminent cardiac injury.
Cyber-Physical System (CPS) and wireless communications The objective of this paper is to present a multisensory
has brought a dramatic increase in the number of devices we holistic system that can collect heart rates and body
carry. By capturing heart-rate data, many wearable platforms accelerations. We implemented an embedded sensory
provide users' activity and exercise summaries that can be system with a Low Power (LP) communication module to
affectively applied to determine the impact on health collect Body Area Sensor (BAS) data using a smartphone.
management. By 2050, it is estimated that more than one in This study introduces the use of signal processing and
five people will be of age 65 or older [1]. Heart diseases in machine learning techniques for sensor data analytics for
the elderly appear to be of very common occurrence, as sudden cardiac arrest prediction. Our proposed system will
opposed to other age demographics. In fact, approximately be useful not only for the elderly, but has utility in identifying
one-third to one-half of the elderly population experience heart disease among children, physical rehabilitation
multiple heart attacks or cardiac arrest events on a yearly patients, and for human behavior analysis research.
basis [2]. Furthermore, series of studies have shown that A. Major Contributions
ubiquitous heart rate sensing can offer benefits in affective This paper presents our unique methods to use smart
clinical-grade services [3]. Our research strives to address devices as the platform for developing an embedded IoT
this problem by analyzing the ECG and body motion signals system to predict heart abnormality; smart devices naturally
to detect events that will ultimately lead to a cardiac risk combine detection and communication components. Our
prediction. Since abnormal ECG patterns can lead to a heart major contributions are as follows:
attack, our system identifies abnormality in ECG patterns to
• First, we developed an integrated embedded smart
alert the user regarding a potential risk. Heart problems have
IoT system for heart abnormality prediction.
huge consequences in an aging society, as they raise
• Second, we proposed a real-time health assistance
tremendous concerns relating to the deterioration in the
system with a wearable ECG and smartphone accelerometer
quality of a human being’s life, as well as drastic increases
for users as a unique application for predicting cardiac
in the cost of healthcare.
abnormality.
Although there has been a great deal of research on
automatic heart attack detection, the area involving risk of
heart attack prediction is still currently under study. There
282
the right part of the chest, and the blue lead to the left part of phone as a response to a data-send request. It will also
the chest. Figure 1 shows the basic connections of the system manage the Bluetooth communication by coordinating with
architecture. the LP Bluetooth chip that [30], essentially, equips the
Arduino with the ability to connect to the smartphone
application. The system reads the smartphone sensor value
through the smartphone heart collector interface.
To avoid reading inaccurate values from the Arduino,
we use a delay between each reading and read from the same
analog pin twice and send the second reading. We send
different symbols before the sensor readings to be able to
parse the data at the receiving end (android application).
283
ECG pattern and body accelerations for a fixed period of real people to verify the detection accuracy of the proposed
time. The system can also monitor variations of the body system. The IoT device for data collection is shown in Figure 5.
accelerations and ECG patterns with graphical representation
on a smartphone which is shown is Fig. 3(b). We used our
prototype application for data collection and for evaluating
our system.
284
ECG Signals First, we use differencing, then we apply a smoothing
High-Frequency Component Removal with a window size of 5. Next, we sort all the peaks in the
For dynamic features, we perform the following processed signal and take the largest N numbers where N is
operations on the signal: differencing, filtering, frequency the number of beats in that window, then average those N
domain conversion, and peak detection, as shown in Figure peaks. We create an array of zeros and add ones in the places
7. First, we use differencing to flatten out parts of the signal where the value in the processed signal is higher than the
that do not vary greatly in magnitude. The result will then calculated average value of the peaks. To get the QRS
contain peaks that are significantly higher in magnitude than duration for a certain beat, we count the consecutive ones and
the portions of the signal, which typically leave the QRS divide by the sampling frequency. Figure 8 shows the
peaks more visible. A smoothing operation is then performed original signal at the top, the processed signal at the bottom,
on the absolute value of the differenced signal with a window and both bounded by the array of zeros and ones created to
of 20 points. To measure the heart-rate, we take the Fourier highlight the QRS duration.
transform of the processed signal. Then, we find the location We can observe all the patterns that an ECG signal can
of the maximum peak, which is the frequency of occurrence have and see under what conditions some of the
for that peak, indicating the QRS. characteristics would be missing or changing. Table III
shows the different ECG features and the average values
calculated from the data collected using our device.
TABLE III. AVERAGE FEATURES FROM ECG SIGNALS.
Sitting Walking Jogging Running
Avg. Heart rate 70.624 79.270 91.027 121.945
(b/min)
Avg. R-R Interval 0.880 0.775 0.663 0.496
(sec)
Avg. QRS Peak 0.982 0.943 0.852 0.820
(volts)
Avg. T-wave Peak 0.801 0.799 0.789 0.734
(volts)
Avg. QRS Duration 0.082 0.071 0.085 0.070
(sec)
One major feature that we extracted from the recorded
ECG signals is a person’s heart-rate or beats per minute. This
can be calculated using several techniques including taking
the number of QRS peaks in a given time, using an
autocorrelation technique, or using the Fourier transform.
Figure 7. Noise reduction from ECG signal using smoothing
We can determine the heart-rate from the autocorrelation of
To get the QRS and T-wave voltages, we start by an ECG signal by a series of simple steps.
observing all the peaks in the signal window available, then Prediction Algorithm
sort them. Using the number of beats, N, calculated earlier, After extracting all features from the sensors, we
we take the largest N numbers as the QRS values and the combined the analyzed results and apply a prediction
second N numbers as the T wave values. The Length algorithm. Our prediction process includes collecting the
Transform is then used to get the QRS duration. ECG as well as accelerometer data and then extracting the
features from both sensors. These features are then provided
as an input to our algorithm that is trained by previously
stored datasets. In our data analysis, we used Naive Bayes
classification technique to classify normal and abnormal
ECG patterns, as it produces highly accurate results and is
easy to implement [32-34].
The probability of a heart risk in relation to ECG
signals represents the posterior probability in this equation.
The posterior probability is what the equation will equal to
and how we will determine a prediction of heart risk to the
user. The probability of heart risk alone is the class prior
probability and will be multiplied with the product of the
likelihood. The likelihood, which is the probability of every
ECG signal in relation to the heart rate, will utilize each
measurement that the ECG signals detect to give us an
accurate heart risk prediction. The algorithm provided proof
Figure 8: Length Transform to find QRS duration of a high accuracy in prediction as shown in Figure 9.
285
REFERENCES
[1] United Nations, Department of Economic and Social Affairs,
Population Division, “World Population Ageing 2009,” pp.
66-71.
[2] United States, Heart Association and Stroke Association,
“Heart Disease and Stroke Statistics – At-a-Glance,” 2015
[3] A. Smith, “Older Adults and Technology Use”, Internet,
Science and Technology, PewResearchCenter, April 3, 2014.
[4] J. -V. Lee and Y. -D. C. a. K. T. Chieng, "Smart Elderly Home
Monitoring System with an Android Phone," International
Journal of Smart Home, vol. 7, pp. 17-32, May 2013.
[5] UH, Wanaskar, P., Ghadge, V., Girmev, P., Deshmukh, K.,
Kokane (2016) Intelligent Heart attack prediction system
using big data. International Journal of Advanced Research
in Computer and Communication Engineering 5: 723–725.
[6] M., Peltokangas,; J., Verho, ; A., Vehkaoja. Night-time
EKG and HRV monitoring with bed sheet integrated textile
electrodes. IEEE Trans. Inf. Technol. Biomed. 2012, 16,
935–942.
Figure 9. The heart-rate variations for sitting, walking, jogging, [7] C. K. Lee, S. K. Yoo, Yoon J Park, Nam Hyun Kim, Kee Sam
and running class using Naïve Bayes classifier Jeong and Byung Chae Lee "Using Neural Network to
The use of both the heart rate and the horizontal Recognize Human Emotions from Heart Rate Variability and
Skin Resistance" in 2005 IEEE Engineering in Medicine and
energy from body accelerations clearly separates the four Biology 27th Annual Conference, Shanghai, pp. 5523-5525,
different classes with minimum overlap. Based upon the 2005.
output of the algorithm, we make one of two decisions. If the
[8] Patients Like Me, https://www.patientslikeme.com/, [15 May,
probability of an imminent heart attack is high and an 2019].
abnormality is detected, then we alert the user as well as the [9] G., Wolgast, C. Ehrenborg, A. Israelsson, J. Helander, E.
caregiver; if the data looks normal, then the system keeps Johansson, and H. Månefjord, “Wireless body area network for
reading data from both sensors in real-time. heart attack detection,” in IEEE Antennas and Propagation
VI. CONCLUSIONS Magazine), vol. 58, pp. 84–92, IEEE, 2016.
[10] O., Vermesan, P., Friess, Internet of Things: Converging
The IoT sensors along with their wide-distribution have
Technologies for Smart Environments and Integrated
revealed the possibilities of actualizing ubiquitous healthcare Ecosystems, River Publishers Series In Communications,
applications. Given the recent interest in wearable devices 2013.
from the clinical research community, we foresee that, in the [11] IEEE Standards Association (IEEE-SA), Internet of Things
near future, there will be an even more diverse set of (IoT) Ecosystem Study, IEEE 2015.
healthcare sensors integrated into wearable IoT devices. In [12] M., Chen, et al. “Smart Clothing: Connecting Human with
this paper, we have developed an embedded IoT system to Clouds and Big Data for Sustainable Health Monitoring” in
monitor heart abnormality and body accelerations using a SpringerLink, Springer, Dordrecht, 7 July 2016.
smartphone. We use an ECG sensor system to detect the [13] B. Durga Sri, K.Nirosha, M. Padmaja, (2017), Healthcare
abnormality in users’ ECG patterns. The results from Analysis Using Hadoop, International Journal Of Current
multisensory data showed that our approach provides a high Engineering And Scientific Research (IJCESR), 2394–0697.
rate of classification accuracy in distinguishing between [14] Qardiocore,https://www.getqardio.com/qardiocore-wearable-
normal and abnormal ECG patterns. ecg-ekg-monitor-iphone/, [ Last Accessed: 15 May, 2019]
To test the permanence and long-term feasibility of our [15] K., Nirosha, Durga sree. B, Dr. Sheikh Gouse. (2016),
approach in the future, we plan to test our system with data iHOME: Bio-Health Intelligent Mobile System Using
from the people who suffer from chronic heart problems. IoT, International Journal of Innovations in Engineering and
Additionally, the system can be used in smart home Technology (IJIET) ISSN 2319–158.
monitoring systems for future wireless technologies. [16] E. Pino, L. Ohno–Machado, E. Wiechmann, and D. Curtis,
“Real–time ecg algorithms for ambulatory patient
ACKNOWLEDGMENT monitoring,” AMIA Annu Symp Proc, 2005.
We would like to thank the Electrical and Computer
Engineering department at Miami University for funding the [17] F-T., Sun, et al. “Activity-Aware Mental Stress Detection
project. This especially includes Ms. Tina Carico and Mr. Using Physiological Sensors” in Mobile Computing,
Applications, and Services, pp. 211–230, 2012.
Jeff Peterson. This paper is based on the MS thesis work by
[18] A. Sano and R. W. Picard, "Stress Recognition Using
the author, Mohamed ElSaadany [35]. Wearable Sensors and Mobile Phones" in 2013 Humaine
Association Conference on Affective Computing and
Intelligent Interaction, Geneva, pp. 671-676, 2013.
286
[19] F. Agrafioti, D. Hatzinakos and A. K. Anderson, "ECG Pattern Interaction” in Lecture Notes in Computer Science Human–
Analysis for Emotion Detection" in IEEE Transactions on Computer Interaction, pp. 29–38, 2007.
Affective Computing, vol. 3, no. 1, pp. 102-115, Jan.-March [28] K, K., Bang, “System and Method for Recognizing User’s
2012. Emotional State Using Short-Time Monitoring of
[20] M., Swan “Sensor Mania! The Internet of Things, Wearable Physiological Signals”, US 7,547,279 B2, 2009.
Computing, Objective Metrics, and the Quantified Self 2.0” in
Journal of Sensor and Actuator Networks, vol. 1, no. 3, pp. [29] A., Savran, et al. "Emotion Detection in the Loop from Brain
217–253, 2012. Signals and Facial Images" in Proceedings of the
[21] K. R., Evenson, et al. “Systematic Review of the Validity and eNTERFACE 2006 Workshop, 2006. VTLS. 25 June 2018.
Reliability of Consumer-Wearable Activity Trackers” in [30] https://www.adafruit.com/product/2746, [ Last Accessed: 15
International Journal of Behavioral Nutrition and Physical May, 2019]
Activity, vol. 12, no. 1, 18 Dec. 2015. [31] T., Vyacheslav, (2010), Signal Processing Noise, Electrical
[22] V. Pertrushi “System and Method for a Telephonic Emotion Engineering and Applied Signal Processing Series, CRC
Detection That Provides Operator Feedback”, US 6,480,826 Press. 688 pages. ISBN 9781420041118
B2, 2012. [32] K. A. I., Aboalayon, W. S. Almuhammadi, and M. Faezipour,
[23] K.H. Kim, S.W. Bang, S.R. Kim “Emotion recognition system “A comparison of different machine learning algorithms using
using short-term monitoring of physiological signals” in single channel eeg signal for classifying human sleep stages,”
Medical and Biological Engineering and Computing, May 01, in 2015 Long Island Systems, Applications and Technology,
2004. pp. 1–6, IEEE, 2015.
[24] H. Gao, A. Yüce and J. P. Thiran "Detecting emotional stress [33] C. Michael. “The Naïve Bayes Model, Maximum-Likelihood
from facial expressions for driving safety" in 2014 IEEE Estimation, and the EM Algorithm.” (2012).
International Conference on Image Processing (ICIP), Paris, [34] T.,H.,M., Prerana, N.,C., Shivaprakash, N., Swetha
pp. 5961-5965, 2014. (2015) Prediction of heart disease using machine learning
[25] J., Anttonen, V., Surakka “Emotions and heart rate while algorithms- Naïve Bayes, Introduction to PAC Algorithm,
sitting on a chair” in Proceedings of the SIGCHI Conference Comparison of Algorithms and HDPS. International Journal
on Human Factors in Computing Systems (CHI '05). ACM, of Science and Engineering 3: 90–99.
New York, NY, USA, 491-499. [35] ElSaadany, Mohamed. "A Novel Iot-Based Wireless System
[26] M. G. N., Calvo, “Detection of emotional faces: Salient To Monitor Heart Rate." Electronic Thesis or Dissertation.
physical features guide effective visual search” in Journal of Miami University, 2017. OhioLINK Electronic Theses and
Experimental Psychology: General, 137(3), 471-494, 2008. Dissertations Center. 15 May 2019.
[27] B., Armando, et al. “Non-Intrusive Physiological Monitoring
for Automated Stress Detection in Human-Computer
287