Professional Documents
Culture Documents
net/publication/337414007
CITATIONS READS
0 216
5 authors, including:
Some of the authors of this publication are also working on these related projects:
All content following this page was uploaded by Tommy Sugiarto on 21 November 2019.
Abstract: By measuring intensity using metabolic equivalent (MET) values, we can classify physical activity (PA) as
sedentary, light, moderate, or vigorous. Wearable accelerometers, which have been widely used to collect data
related to PA, can be used to measure intensity. Furthermore, improvements in deep learning, especially
convolutional neural networks (CNNs), which automatically extract features from data can facilitate classification.
Therefore, CNN was adopted in this study to evaluate its performance in classifying PA by extracting features from
wearable accelerometers placed on five locations and based on ground truth from MET values. We prepared a
temporal window (TW) and sliding window (SW) to evaluate model performance and determine which of these
considerably influenced the performance of the CNN. After determining the optimal TW and SW, we further
evaluated which sensor placement location influenced the network the most. A 5-s TW with a 20-frame SW and
sensor placed on the sternum demonstrated the optimal results followed by the sensor placed on the right wrist.
Keywords: Physical activity intensity; MET; wearable accelerometer; convolutional neural network; window size
were again averaged among all participants and this of precision and recall, as in Eq. (4), in which FP and FN
resulting mean was the MET value used for analysis. represent false positives and false negatives,
We used the leave one subject out (LOSO) method to respectively.
evaluate the performance of our model. Therefore, we
𝑇𝑃+𝑇𝑁
used 11 out of 12 participants’ data as a training 𝐴𝑐𝑐𝑢𝑟𝑎𝑐𝑦 = (1)
𝑇𝑃+𝐹𝑃+𝑇𝑁+𝐹𝑁
dataset, and the remaining participant constituted the
validation and test datasets at a ratio of 7:3. We avoided 𝑇𝑃
𝑃𝑟𝑒𝑐𝑖𝑠𝑖𝑜𝑛 = (2)
imbalanced data by selecting only one resting activity 𝑇𝑃+𝐹𝑃
for each participant. We used seed number of 7 to keep 𝑇𝑃
the randomness same. 𝑅𝑒𝑐𝑎𝑙𝑙 = (3)
𝑇𝑃+𝐹𝑁
Fig. 4: Loss curve of the best model. Fig. 5: Accuracy curve of the best model.
participants when jogging. Previous reported which The dimension information for the validation and test
identified jogging as vigorous showed the range of age datasets are presented in Table 3, in which the first
of the participants is different from ours [5]. Running column states the number of samples, second shows
activity is suggested to be included in future studies in the product of the TW and sampling frequency, and
order to obtain PA intensity in vigorous level. third present the number of features extracted from the
five tri-axial Axivity AX3 accelerometers.
Table 2. True Labels for Classification
Activity MET [SD*] PA class 3.3 Model Performance
Slow walking 3.34 [0.32] Light The model architecture presented in this study was
Fast walking 5 [0.6] Moderate obtained from the result of 1s TW size without an SW
Jogging 6.88 [0.5] Moderate and has exhibited accuracy, precision, recall, and F1
Resting 1.39 [0.17] Sedentary score of 0.9. The average performance of the model
Lying 1.4 [0.12] Sedentary evaluated through LOSO validation was used to observe
Sitting 1.47 [0.14] Sedentary the influence of TW and SW size on model performance.
Standing 2.57 [0.5] Light
Climbing stairs 4.26 [0.51] Moderate Table 4. Model’s Performance: Test Scores of 1s
*
standard deviation TW size
SW size Acc. Prec. Recall F1-score
3.2 Datasets (frames) [SD] [SD] [SD] [SD]
We obtained a sufficient number of samples from just 0 .92 [.06] .91 [.09] .91 [.09] .9 [.11]
12 participants, unlike [27], which obtained 31688 20 .94 [.06] .93 [.09] .93 [.09] .93 [.09]
samples (constituting the training and test datasets) 50 .93 [.07] .92 [.1] .92 [.1] .91 [.12]
from 100 participants. The number of training samples
with a 1-s of TW and 0-, 20-, and 50-frames SWs were Table 5. Model’s Performance: Test Scores of 2s
21880, 109048, and 43672, respectively. With a 2-s TW TW size
and 0-, 20-, and 50-frames SWs were 10940, 108608, SW size Acc. Prec. Recall F1-score
43496, respectively. Finally, a 5-s TW and with 0-, 20-, (frames) [SD] [SD] [SD] [SD]
and 50-frames SWs were 4376, 107288, and 42968 0 .94 [.06] .93 [.09] .93 [.09] .92 [.11]
samples, respectively. 20 .96 [.05] .95 [.07] .95 [.07] .95 [.07]
50 .95 [.06] .94 [.09] .94 [.09] .93 [.11]
Table 3. Input Dimension of Validation and Test
Dataset Table 6. Model’s Performance: Test Scores of 5s
TW SW Validation TW size
Test Dataset
(s) (frames) Dataset SW size Acc. Prec. Recall F1-score
0 1400, 100, 15 600, 100, 15 (frames) [SD] [SD] [SD] [SD]
1 20 6977, 100, 15 2991, 100, 15 0 .94 [.06] .92 [.1] .92 [.1] .91 [.12]
50 2794, 100, 15 1198, 100, 15 20 .98 [.03] .97 [.04] .97 [.04] .97 [.04]
0 700, 200, 15 300, 200, 15 50 .96 [.06] .95 [.09] .95 [.09] .94 [.11]
2 20 6949, 200, 15 2979, 200, 15
50 2783, 200, 15 1193, 200, 15 In Table 4-6, the results obtained with 20- and 50- frame
0 280, 500, 15 120, 500, 15 SWs were not substantially more accurate than those
5 20 6865, 500, 15 2943, 500, 15 obtained without an SW. This is obtained by observing
50 2749, 500, 15 1179, 500, 15 the difference between the accuracy values with SW
and without SW for each TW size as we considered at
The 16th International Confernce on Automation Technology (Automation 2019),
November 22-24, 2019, Taipei, Taiwan
‘Accuracy of physical activity recognition from a wrist- activity with a single accelerometer’, Journal of Applied
worn sensor’, Physiotherapy, 2017, 103, pp. e47 Physiology, 2009, 107, (3), pp. 655-661
7 Mannini, A., Intille, S.S., Rosenberger, M., Sabatini, 20 Ellis, K., Kerr, J., Godbole, S., Lanckriet, G., Wing, D.,
A.M., and Haskell, W.: ‘Activity Recognition Using a and Marshall, S.: ‘A random forest classifier for the
Single Accelerometer Placed at the Wrist or Ankle’, prediction of energy expenditure and type of physical
Medicine and Science in Sports and Exercise, 2013, 45, activity from wrist and hip accelerometers’,
(11), pp. 2193-2203 Physiological Measurement, 2014, 35, (11), pp. 2191-
8 Schneller, M.B., Bentsen, P., Nielsen, G., Brond, J.C., 2203
Ried-Larsen, M., Mygind, E., and Schipperijn, J.: 21 Khan, A.M.: ‘Recognizing physical activities using the
‘Measuring Children's Physical Activity: Compliance axivity device’, in Editor (Ed.)^(Eds.): ‘Book
Using Skin-Taped Accelerometers’, Medicine and Recognizing physical activities using the axivity device’
Science in Sports and Exercise, 2017, 49, (6), pp. 1261- (2013, edn.), pp.
1269 22 Kongsvold, A.M.: ‘Validation of the AX3
9 Lv, M., Xu, W., and Chen, T.: ‘A hybrid deep accelerometer for detection of common daily activities
convolutional and recurrent neural network for complex and postures’, NTNU, 2016
activity recognition using multimodal sensors’, 23 Payey, T.G., Gilson, N.D., Gomersall, S.R., Clark, B.,
Neurocomputing, 2019, 362, pp. 33-40 and Trost, S.G.: ‘Field evaluation of a random forest
10 Wang, J., Chen, Y., Hao, S., Peng, X., and Hu, L.: ‘Deep activity classifier for wrist-worn accelerometer data’,
learning for sensor-based activity recognition: A Journal of Science and Medicine in Sport, 2017, 20, (1),
survey’, Pattern Recognition Letters, 2019, 119, pp. 3- pp. 75-80
11 24 Radu, V., Tong, C., Bhattacharya, S., Lane, N.D.,
11 Ordonez, F.J., and Roggen, D.: ‘Deep Convolutional Mascolo, C., Marina, M.K., and Kawsar, F.:
and LSTM Recurrent Neural Networks for Multimodal ‘Multimodal Deep Learning for Activity and Context
Wearable Activity Recognition’, Sensors (Basel), 2016, Recognition’, Proceedings of the ACM on Interactive,
16, (1) Mobile, Wearable and Ubiquitous Technologies, 2018,
12 Vaha-Ypya, H., Vasankari, T., Husu, P., Suni, J., and 1, (4), pp. 1-27
Sievanen, H.: ‘A universal, accurate intensity-based 25 Hammerla, N.Y., Halloran, S., and Plötz, T.: ‘Deep,
classification of different physical activities using raw convolutional, and recurrent models for human activity
data of accelerometer’, Clinical Physiology and recognition using wearables’, arXiv preprint
Functional Imaging, 2015, 35, (1), pp. 64-70 arXiv:1604.08880, 2016
13 Crouter, S.E., Flynn, J.I., and Bassett Jr, D.R.: 26 Vepakomma, P., De, D., Das, S.K., and Bhansali, S.:
‘Estimating physical activity in youth using a wrist ‘A-Wristocracy: Deep learning on wrist-worn sensing
accelerometer’, Medicine and science in sports and for recognition of user complex activities’, in Editor
exercise, 2015, 47, (5), pp. 944 (Ed.)^(Eds.): ‘Book A-Wristocracy: Deep learning on
14 Trost, S.G., Loprinzi, P.D., Moore, R., and Pfeiffer, wrist-worn sensing for recognition of user complex
K.A.: ‘Comparison of accelerometer cut points for activities’ (2015, edn.), pp. 1-6
predicting activity intensity in youth’, Medicine and 27 Chen, Y., and Xue, Y.: ‘A Deep Learning Approach to
science in sports and exercise, 2011, 43, (7), pp. 1360- Human Activity Recognition Based on Single
1368 Accelerometer’, in Editor (Ed.)^(Eds.): ‘Book A Deep
15 Van Loo, C.M., Okely, A.D., Batterham, M.J., Hinkley, Learning Approach to Human Activity Recognition
T., Ekelund, U., Brage, S., Reilly, J.J., Trost, S.G., Based on Single Accelerometer’ (2015, edn.), pp. 1488-
Jones, R.A., and Janssen, X.: ‘Wrist accelerometer cut- 1492
points for classifying sedentary behavior in children’, 28 Zeng, M., Nguyen, L.T., Yu, B., Mengshoel, O.J., Zhu,
Medicine and science in sports and exercise, 2017, 49, J., Wu, P., and Zhang, J.: ‘Convolutional Neural
(4), pp. 813 Networks for human activity recognition using mobile
16 Welch, W.A., Bassett, D.R., Thompson, D.L., Freedson, sensors’, in Editor (Ed.)^(Eds.): ‘Book Convolutional
P.S., Staudenmayer, J.W., John, D., Steeves, J.A., Neural Networks for human activity recognition using
Conger, S.A., Ceaser, T., Howe, C.A., Sasaki, J.E., and mobile sensors’ (2014, edn.), pp. 197-205
Fitzhugh, E.C.: ‘Classification Accuracy of the Wrist- 29 Staudenmayer, J., Pober, D., Crouter, S., Bassett, D.,
Worn Gravity Estimator of Normal Everyday Activity and Freedson, P.: ‘An artificial neural network to
Accelerometer’, Medicine and Science in Sports and estimate physical activity energy expenditure and
Exercise, 2013, 45, (10), pp. 2012-2019 identify physical activity type from an accelerometer’,
17 van Hees, V.T., Golubic, R., Ekelund, U., and Brage, S.: Journal of Applied Physiology, 2009, 107, (4), pp.
‘Impact of study design on development and evaluation 1300-1307
of an activity-type classifier’, Journal of Applied 30 Noor, M.H.M., Salcic, Z., and Wang, K.I.K.: ‘Adaptive
Physiology, 2013, 114, (8), pp. 1042-1051 sliding window segmentation for physical activity
18 Sasaki, J.E., Hickey, A.M., Staudenmayer, J.W., John, recognition using a single tri-axial accelerometer’,
D., Kent, J.A., and Freedson, P.S.: ‘Performance of Pervasive and Mobile Computing, 2017, 38, pp. 41-59
Activity Classification Algorithms in Free-Living Older
Adults’, Medicine and Science in Sports and Exercise,
2016, 48, (5), pp. 941-950
19 Bonomi, A.G., Plasqui, G., Goris, A.H.C., and
Westerterp, K.R.: ‘Improving assessment of daily
energy expenditure by identifying types of physical