You are on page 1of 11

This article has been accepted for publication in IEEE Access.

This is the author's version which has not been fully edited and
content may change prior to final publication. Citation information: DOI 10.1109/ACCESS.2024.3380432

Date of publication xxxx 00, 0000, date of current version xxxx 00, 0000.
Digital Object Identifier 10.1109/ACCESS.2017.DOI

Advancing Healthcare and Elderly


Activity Recognition: Active Machine
and Deep Learning for Fine-Grained
Heterogeneity Activity Recognition
SIDRA ABBAS1 , GABRIEL AVELINO SAMPEDRO2,3 , SHTWAI ALSUBAI4 , STEPHEN OJO5 ,
AHMAD ALMADHOR6 , ABDULLAH AL HEJAILI7 , LUBOMIRA STRAZOVSKA8
1
Department of Computer Science, COMSATS University Islamabad, Islamabad, Pakistan
2
Faculty of Information and Communication Studies, University of the Philippines Open University, Los Baños 4031, Philippines
3
Center for Computational Imaging and Visual Innovations, De La Salle University, 2401 Taft Ave., Malate, Manila 1004, Philippines
4
College of Computer Engineering and Sciences, Prince Sattam bin Abdulaziz University, AlKharj, Saudi Arabia
5
Department of Electrical and Computer Engineering, College of Engineering Anderson, Anderson, 29621 South Carolina, USA
6
Department of Computer Engineering and Networks, College of Computer and Information Sciences, Jouf University, Sakaka 72388, Saudi Arabia
7
Faculty of Computers & Information Technology, Computer Science Department, University of Tabuk, Tabuk 71491, Saudi Arabia
8
Faculty of Management, Comenius University in Bratislava, Odbojárov 10, 82005 Bratislava 25, Slovakia
Corresponding author: lubomira.strazovska@fm.uniba.sk, sidraabbas@ieee.org

ABSTRACT
This research explores how technology can be used to understand and identify activities among elderly
individuals. By utilizing HAR70+ data and applying methods like Active Learning (AL), Machine Learning
(ML), and Deep Learning (DL), this research aims to predict various activities performed by older adults.
Moreover, the study leverages the HAR70+ dataset, providing insight into the daily activities of older
individuals and AL-based ML and DL techniques to construct predictive models for these activities.
The research experiments are presented systematically, summarizing the outcomes of various machine-
learning models across three iterative experiments. This research explored a diverse array of ML algorithms,
including Random Forest (RF), Extreme Gradient Boosting (XGBoost), Logistic Regression (LR), K-
Nearest Neighbors (KNN), Stochastic Gradient Descent (SGB) and DL methods such as Deep Neural
Networks (DNN) and Long Short-Term Memory networks (LSTM) for experimentation. This research
trained models on 7 activities: walking, shuffling, climbing stairs (up and down), standing, sitting, and
lying down, and 4 activities separately: standing, sitting, walking, and lying down, using the same method.
Results reveal that LSTM achieved the best accuracy of 0.98 for 7 activities and 0.95 using RF on 4
actives, showing the potential of DL and ML techniques, particularly when integrated with AL, to enhance
activity recognition rate, patient care, optimize medication strategies and improve the well-being of elderly
individuals.

INDEX TERMS Active Learning (AL), Elderly Activity Recognition, Human Activity Recognition (HAR),
Healthcare, Deep Learning (DL), Machine Learning (ML), Lifestyle and Technology

I. INTRODUCTION trum of daily physical behaviors exhibited by older individ-


Older adults’ well-being and quality of life have ascended to uals is a healthcare priority and a foundation for furthering
the forefront of healthcare and gerontology research in an era their independence, enhancing their overall happiness and
characterized by a rapid global demographic shift towards an prolonging their healthy years[5]. Moreover, Human Activity
aging population[1]. Likewise, physical function and health Recognition (HAR) has emerged as an essential field in the
differ among older adults, and regular physical activity is ongoing search to improve the lives of older adults[6]. Most
crucial for maintaining function and independence in older importantly, it offers the tantalizing prospect of automating
age[2], [3], [4]. Subsequently, recognizing the diverse spec- the classification and continuous monitoring of the myriad

VOLUME 4, 2016 1

This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 License. For more information, see https://creativecommons.org/licenses/by-nc-nd/4
This article has been accepted for publication in IEEE Access. This is the author's version which has not been fully edited and
content may change prior to final publication. Citation information: DOI 10.1109/ACCESS.2024.3380432

Author et al.: Preparation of Papers for IEEE TRANSACTIONS and JOURNALS

activities that fill the daily lives of older individuals. Never- readers will thoroughly examine AL techniques that have
theless, realizing the potential of robust HAR models tailored proven successful in the domain of HAR. The paper expertly
to the nuances of older adult behavior remains a complex navigates readers through the optimal application of these
endeavor. This study tackles this challenge head-on. AL strategies, each enhancing recognition and adaptability.
This study explores the potential of AL techniques within Ultimately, the paper concludes with a compelling evaluation
the context of HAR for older adults. Furthermore, HAR holds of these strategies’ significant influence on identifying daily
potential for older adults, whose daily activities span a wide physical behaviors in older adults.
spectrum from sedentary tasks like reading to dynamic move- At its core, this study adds valuable information to what
ments like walking or exercising[7]. However, developing is already known about caring for older adults and using
accurate and adaptable HAR models for this demographic is a technology in healthcare. Moreover, a smart learning ap-
formidable challenge. Moreover, older adults exhibit consid- proach makes computer models better understand and adapt
erable activity variability, and collecting labeled data for such to the various things older people do daily. Overall, this could
a diverse range of behaviors can be difficult; this is where AL lead to more personalized healthcare, which works better and
enters the equation[8]. In addition, by judiciously selecting improves life for older folks and their families.
which instances to label interactively, AL can alleviate the
data labeling burden, enhance model performance, and adapt A. CONTRIBUTIONS
the HAR system to the specific behaviors and contexts that • Innovative Adaptation of AL: Our research focuses
older adults encounter daily. This study investigates the mar- on applying active learning methodologies to enhance
riage of AL and HAR paradigms to advance the recognition the performance of ML and DL models to recognize
and understanding of daily physical behaviors among older activities in the elderly.
adults. • Comprehensive Model Evaluation and Fine-Tuning:
Existing literature has employed sensor-based and vision- The paper presents a detailed analysis involving various
based approaches to classify daily physical behaviors in older models, including KNN, LR, NB, RF, SGD, XGBoost,
adults. Most importantly, studies have discussed context- DNN, and LSTM. The fine-tuning of these models using
aware activity recognition systems, emphasizing specialized the HAR70+ dataset with AL is a distinctive aspect of
models and datasets tailored to the elderly demographic[9]. our work. This comprehensive evaluation demonstrates
While the existing literature provides valuable insights, there our commitment to rigorously testing and improving
still needs to be a gap in leveraging AL techniques to classify predictive abilities.
daily physical behaviors in older adults. Moreover, AL, when • Superior Performance Metrics: The research findings
integrated, has the potential to enhance recognition systems’ indicate a significant increase in accuracy, precision, and
accuracy and adaptability. Specifically, this study addresses recall improvements compared to the base paper. We
this gap by introducing AL techniques into the classification achieved higher accuracy and superior F1 scores, espe-
process. This approach is intended to improve the precision cially in activities such as walking, sitting, and lying,
and adaptability of recognizing daily physical behaviors in showcasing the effectiveness of our proposed approach.
the elderly demographic. Moreover, the primary contribu- • Potential Impact on Elderly Well-being: Beyond the
tions of our study lie in the seamless integration of sensor- technical contributions, our study highlights the poten-
based data with AL strategies to train ML and DL models. tial impact on the well-being of elderly individuals. The
AL is an ML and DL technique at the forefront of this blend of ML, DL, and AL, as presented in this research,
study. Subsequently, it fundamentally alters how ML and demonstrates a commitment to enhancing the quality of
DL models learn from data[10]. Furthermore, in traditional life for seniors, a critical aspect that distinguishes our
ML and DL, models passively feed labeled data for train- work in the broader context.
ing, often requiring vast amounts of meticulously labeled
samples[11]. Likewise, AL, however, introduces an interac- II. RELATED WORK
tive dimension[12]. Moreover, instead of merely consuming This section explored and examined the scholarly research
labeled data, it empowers the model to actively query the about the recognition of routine physical activities among el-
most informative, uncertain, or ambiguous data points for derly individuals[14], [15]. Furthermore, regular physical ac-
labeling, efficiently focusing its learning efforts where they tivity is essential for maintaining function and independence
matter most. This approach is especially advantageous in the in older adults, and recognizing their diverse daily physical
realm of HAR. AL can be very helpful when recognizing behaviors is crucial for enhancing overall happiness and
different behaviors in older adults. In addition, this study prolonging healthy years[16]. Likewise, an inactive lifestyle
acts as a vital conduit, bridging two significant domains: can lead to declining mobility, muscle strength, and car-
ML/DL and the multidimensional healthcare needs of older diovascular health, making older adults more susceptible to
adults[13]. Likewise, the focus here is on AL, a methodology chronic conditions and loss of health. Hence, accurately clas-
that addresses the trifecta of challenges common in HAR sifying and monitoring their daily activities carries serious
for this demographic—data scarcity, model generalization, implications for healthcare interventions, tailored exercise
and adaptability. Similarly, Within the pages of this paper, programs, and lifestyle adjustments that can promote well-
2 VOLUME 4, 2016

This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 License. For more information, see https://creativecommons.org/licenses/by-nc-nd/4
This article has been accepted for publication in IEEE Access. This is the author's version which has not been fully edited and
content may change prior to final publication. Citation information: DOI 10.1109/ACCESS.2024.3380432

Author et al.: Preparation of Papers for IEEE TRANSACTIONS and JOURNALS

being and active aging. Subsequently, numerous studies have This paper bridges the activity recognition and AL do-
delved into sensor-based activity recognition for older adults. mains for older adults. By integrating sensor-based and
These researches often involve wearable devices equipped vision-based approaches with AL strategies, this study aims
with accelerometers, gyroscopes, and other sensors[17], [18]. to enhance the accuracy and efficiency of recognizing daily
These sensors capture motion and activity data, enabling the physical behaviors in older adults. Hence, this innovative
recognition of various physical behaviors[19]. For instance, approach leverages the strengths of both domains, offering
researchers have employed wearable sensors to monitor the potential for more effective, adaptable, and cost-efficient
gait patterns, detect falls, and distinguish between standing, eldercare solutions.
sitting, and walking activities[20], [21]. In other words,
these advancements have shown great promise in improv- III. METHODOLOGY
ing the safety and well-being of older adults, especially This study took a methodical approach to improve how
those living independently. As well as in parallel, vision- activities are recognized in older adults, with the main goal of
based systems have garnered attention as a means of activity adding AL methods. The dataset is called "HAR70+," it holds
recognition[22], [23]. These systems can track and classify important data about activities older adults do daily[30].
activities in real-time using cameras and computer vision This dataset includes walking, shuffling, going up and down
algorithms[24]. For instance, researchers have demonstrated stairs, standing, sitting, and lying down. Likewise, the study
the capability of vision-based systems in identifying gestures, developed models for 7 activities: walking, shuffling, climb-
recognizing specific activities such as cooking or exercise, ing stairs (up and down), standing, sitting, and lying down,
and even assessing overall mobility and health and have also along with 4 activities: standing, sitting, walking, and lying.
incorporated a deep neural network that integrates convo- Each activity is carefully labeled to help this study’s learning
lutional layers with long short-term memory to recognize process. Moreover, the study starts with carefully preparing
human activities[25]. These approaches offer a non-intrusive the "HAR70+" dataset, a vital step in preparing it for model
means of monitoring daily activities, particularly relevant in training. Furthermore, this involved cleaning up the data to
eldercare. remove inconsistencies, addressing missing information, and
AL, a pivotal aspect of this paper, has been explored adjusting features to ensure they were in the right scale or for-
extensively in ML and DL. AL involves smart strategies for mat. The research conducted an in-depth look at the dataset’s
selecting which data points to label, aiming to maximize characteristics through exploratory data analysis. This helped
learning efficiency[26]. The principle is that ML/DL models gain insights into the dataset and guided the decisions as the
can achieve high performance with less labeled data by study progressed. In addition, in a significant move toward a
choosing the most informative or uncertain data points for la- better understanding older adults’ daily activities, this study
beling. This approach has proven valuable in domains where collected and organized data relating to their most common
data labeling can be resource-intensive or impractical. Fur- actions. These actions encompass everyday movements like
thermore, AL has found applications across diverse domains, walking, shuffling, climbing stairs (up and down), standing,
from natural language processing to image classification. For sitting, and lying down. Likewise, recognizing the impor-
instance, in text classification, AL has been used to optimize tance of these activities in older adults’ lives, this study
the labeling of documents for sentiment analysis, reducing aimed to consolidate and structure the data associated with
the labeling burden on human annotators[27]. Similarly, in these routine actions. This simplified the study and analysis
image classification tasks, AL strategies have effectively process and provided a clearer view of how older adults
selected the most informative images for model training. navigate their daily lives. This well-organized data is valuable
These successful applications underscore the adaptability and for enhancing healthcare for older adults, making it more
potential of AL techniques. individualized and effective in promoting their overall well-
Various academic studies on classifying daily physical being.
behavior in older adults have made significant contributions Figure 1 outlines the steps and approach used in this re-
to the field[28], [29]. Specific studies focusing on Classifying search. In addition, this study explored feature engineering to
Daily Physical Behavior in Older Adults have contributed enable effective learning and model generalization. The uti-
significantly to the field. Moreover, these studies have ad- lized classifiers and their respective parameters in this study
dressed the unique challenges of recognizing and categoriz- are presented in Table 1. Subsequently, from the raw sensor
ing the diverse spectrum of daily physical activities in older data in the "HAR70+" dataset, this study extracted relevant
individuals. By developing specialized models and datasets features that encapsulated the essence of each activity. Fea-
tailored to the elderly demographic, they have opened the ture selection and extraction techniques were applied, giving
door for more accurate and context-aware activity recog- the machine-learning models a solid foundation to build their
nition systems[9]. Building upon the insights gained from understanding. Subsequently, Recursive Feature Elimination
this body of research, this paper seeks to enhance further was employed for feature selection for enhanced model per-
the field’s understanding and approach by incorporating AL formance, iteratively removing less important features. In
techniques into classifying daily physical behaviors among addition, Principal Component Analysis served as a feature
older adults. extraction technique, transforming the original features into
VOLUME 4, 2016 3

This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 License. For more information, see https://creativecommons.org/licenses/by-nc-nd/4
This article has been accepted for publication in IEEE Access. This is the author's version which has not been fully edited and
content may change prior to final publication. Citation information: DOI 10.1109/ACCESS.2024.3380432

Author et al.: Preparation of Papers for IEEE TRANSACTIONS and JOURNALS

FIGURE 1: Employed Methodology

TABLE 1: Classifier Parameters Term Memory Networks. These models were trained on the
Classifier Parameters labeled data from the "HAR70+" dataset, and their perfor-
DNN - Hidden Layers: 2 mance was rigorously assessed using established metrics.
- Units per Layer: 64
- Activation: ReLU
Specifically, the "HAR70+" dataset was thoughtfully divided
LSTM - Units: 64 into training and testing sets, a common practice to evaluate
- Return Sequences: True model performance while guarding against overfitting. Ad-
- Activation: Relu
SGD - loss: log
ditionally, this study employed cross-validation techniques
- Max iteration: 1000 to ensure the performance of the used models[31]. Figure 2
NB - GaussianNB(all default) shows the LSTM architecture. It includes an LSTM layer
KNN - KNeighborsClassifier(all default) with 64 units, followed by a flattened layer, and concludes
LR - LogisticRegression(all default)
XGBoost - Max Depth: 3 with two dense layers: one with 64 units and a ’relu’ ac-
- Learning Rate: 0.1 tivation function and another with seven units and ’soft-
RF - Number of Trees: 100 max’ activation. Moreover, the model is compiled with the
- Max Depth: None
’Adam’ optimizer and uses ’categorical_crossentropy’ as the
loss function for multiclass classification, while accuracy is
monitored during training. Figure 3 shows an architecture
uncorrelated principal components to reduce dimensionality with an input, flattened, and dense layers. More precisely, the
while preserving essential information. Moreover, one of deep learning model (1,6) input shape was chosen based on
our study’s defining aspects is applying AL strategies to dataset characteristics and DL architecture demands. Given
the "HAR70+" dataset. More precisely, AL empowers the the nature of the input data, a one-dimensional input shape
models to select which data points to label autonomously to comprising six features has been chosen to maximize the
maximize learning efficiency. This iterative process enables model’s efficacy in capturing crucial temporal patterns. This
the models to continually improve their performance as they configuration seamlessly aligns with the data structure, em-
identify the most informative data samples for labeling. The powering the model to learn and accurately represent the
study utilized three distinct iterations. Furthermore, for the input features. Subsequently, the study has fine-tuned these
modeling phase, the research explored various ML algo- models by adjusting hyperparameters and configurations to
rithms, including RF, XGBoost, LR, KNN, SGD and Neural optimize their performance. This iterative process improved
Networks, such as Deep Neural Networks and Long Short-
4 VOLUME 4, 2016

This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 License. For more information, see https://creativecommons.org/licenses/by-nc-nd/4
This article has been accepted for publication in IEEE Access. This is the author's version which has not been fully edited and
content may change prior to final publication. Citation information: DOI 10.1109/ACCESS.2024.3380432

Author et al.: Preparation of Papers for IEEE TRANSACTIONS and JOURNALS

Algorithm 1 Activity Recognition Algorithm

1: Data Collection: HAR70+ dataset


2: Data = C(DHAR70+ )
3: Preprocessing (Data)
4: PData ← Missing Data Handling (Data)
5: PData ← Categorical Encoding (PData )
6: PData ← Numerical Normalization (PData )
7: AL Technique: Begin labeled dataset with seed in-
stances
8: for each iteration do
9: Compute uncertainty scores:
U ← UncertaintyScores(D, θ)
10: Select most uncertain samples:
S ← SelectMostUncertain(U, δ)
11: Obtain original labels for samples in
S: L ← GetOriginalLabels(S)
12: Update labeled dataset: D ← D ∪ (S, L)
13: Retrain model on updated labeled dataset:
θ ← RetrainModel(D, θ)
14: Evaluate model performance on testing set:
Performance ← EvaluateModel(model, testing_set)
15: end for
16: Examine model performance metrics:
Metrics ← GetModelMetrics(Performance)
17: Obtain confusion matrix and ROC curve:
M ← GenerateMetricsPlots(Performance)
FIGURE 2: LSTM Architecture

the initial architecture choices and resulted in a refined con-


figuration, as shown in Figure 2 and Figure 3. This configu- IV. RESULTS AND EXPERIMENTATION
ration has shown increased performance on key metrics. The This study presents a comprehensive analysis of experiments
research adopted an approach infused with AL and followed using various ML and DL models to recognize daily physical
an iterative path. Initially, models were trained on a limited behaviors in older adults based on the "HAR70+" dataset.
labeled dataset from the "HAR70+" dataset. Subsequently, The primary objective was to identify the most effective
the models actively identified uncertain or informative sam- model for this critical task while thoroughly examining the
ples from the "HAR70+" dataset for additional labeling. consistency and reliability of each approach. Table 2 displays
This dynamic process facilitated a deeper understanding of the experimental results for all iterations on seven activities.
complex activities over successive iterations. To determine Subsequently, KNN was the first model examined. Across
the effectiveness of the models, the study employed standard three iterations, this study consistently achieved an accuracy
evaluation metrics such as accuracy, F1 score, precision, and of 93%. Moreover, this highlights the robustness of the
recall[32]. These metrics provided comprehensive insights KNN model in maintaining high accuracy levels, making it a
into how well the models recognized the daily physical be- promising choice for activity recognition. Further analysis is
haviors of older adults using the "HAR70+" dataset. In sum, needed to explore precision and recall metrics to understand
in the results and analysis, the study presented the outcomes its performance better.
of the experiments on the "HAR70+" dataset, shedding light LR was next in line, producing an accuracy of 76% across
on how AL techniques impacted the accuracy and efficiency all iterations. Although LR offers stable performance, it
of activity recognition for older adults. Moreover, the discus- lags behind KNN in accuracy. Precision and recall values
sion involved the broader implications of these findings in the indicate potential limitations in capturing the intricate details
context of eldercare and healthcare technology. Moreover, of older adults’ daily behaviors. Moreover, The Naive Bayes
also acknowledged the approach’s limitations and identified model, with an accuracy of 81% across iterations, demon-
promising avenues for future research. Overall, the presented strated competitive performance compared to LR. Further-
methodology, intertwined with the "HAR70+" dataset and more, it exhibited higher precision, suggesting proficiency in
AL, includes a comprehensive approach to improving the correctly classifying positive instances. However, a slightly
lives of older individuals. lower recall indicates room for improvement in capturing all
relevant activities. In addition, the RF model proved to be
VOLUME 4, 2016 5

This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 License. For more information, see https://creativecommons.org/licenses/by-nc-nd/4
This article has been accepted for publication in IEEE Access. This is the author's version which has not been fully edited and
content may change prior to final publication. Citation information: DOI 10.1109/ACCESS.2024.3380432

Author et al.: Preparation of Papers for IEEE TRANSACTIONS and JOURNALS

TABLE 2: Experimental Results on 7 activities(All Itera-


tions)
Model Accuracy F1 Score Precision Recall
KNN
Iteration 1 0.9350 0.9453 0.9412 0.9342
Iteration 2 0.9342 0.9236 0.9513 0.9365
Iteration 3 0.9364 0.9327 0.9253 0.9333
LR
Iteration 1 0.7632 0.6853 0.6854 0.7639
Iteration 2 0.7642 0.6864 0.6853 0.7701
Iteration 3 0.7665 0.6875 0.6754 0.7642
Naive Bayes
Iteration 1 0.8143 0.8153 0.8411 0.8117
Iteration 2 0.8175 0.8156 0.8454 0.8232
Iteration 3 0.8164 0.8144 0.8463 0.8245
RF
Iteration 1 0.9401 0.9284 0.9353 0.9365
Iteration 2 0.9343 0.9263 0.9374 0.9363
Iteration 3 0.9346 0.9237 0.9364 0.9364
SGD
Iteration 1 0.7586 0.6841 0.6873 0.7553
Iteration 2 0.7564 0.6885 0.6884 0.7563
Iteration 3 0.7574 0.6864 0.6863 0.7574
XGBoost
Iteration 1 0.9364 0.9196 0.9238 0.9364
Iteration 2 0.9325 0.9164 0.9264 0.9325
Iteration 3 0.9357 0.9166 0.9263 0.9353
DNN
Iteration 1 0.9736 0.9767 0.9713 0.9799
Iteration 2 0.9735 0.9775 0.9781 0.9763
Iteration 3 0.9842 0.9886 0.9813 0.9834
LSTM
Iteration 1 0.9815 0.9876 0.9831 0.9823
Iteration 2 0.9834 0.9886 0.9895 0.9845
Iteration 3 0.9899 0.9996 0.9922 0.9913
FIGURE 3: DNN Architecture

highly effective in its performance, showing an impressive formance of various models. More specifically, ROC curves
best accuracy of 94%. Its consistency and effectiveness make offer a valuable means of evaluating a model’s capability to
it a strong candidate for activity recognition. More precisely, differentiate between positive and negative classes. Overall, a
the closely aligned F1 Score, precision, and recall values larger area under the curve indicates enhanced discriminatory
underscore its suitability for this task. Conversely, the SGD power. Hence, in this analysis, KNN and LSTM exhibit
model exhibited lower accuracy at 75%. Precision, recall, superior performance compared to other models, as evident
and F1 Score values could have been more optimal, implying in the figure. Lastly, experiments with XGBoost showed an
that more suitable choices may exist for this particular task. accuracy of 93%, closely matching the RF model’s perfor-
In addition, LSTM was the best model, with an average mance. This suggests that both models offer similar accuracy
accuracy, f1score, precision, and recall in the range of 98- levels and provide flexibility in selecting the most appropriate
99%, respectively. model for specific use cases. In summary, this study’s ex-
Figure 4 illustrates the confusion matrices for the classi- tensive experimentation highlights the potential of KNN, RF,
fiers utilized in this research. It can be noticed that classes 1, and XGBoost as models for recognizing daily physical be-
2, and 3 are confused mostly by almost all of the classifiers. haviors in older adults. While KNN maintains good accuracy
The rationale is that these classes resemble class 0 (walk- and consistency, RF and XGBoost offer competitive accuracy
ing). Subsequently, Figure 5 presents the Receiver Operating levels, making them preferable for more complex scenarios.
Characteristic (ROC) curves for a range of models practiced The choice of the most suitable model depends on the spe-
in this research. These graphical representations serve as cific needs and priorities of eldercare and healthcare tech-
a means to assess the effectiveness of binary classification nology applications. Further analysis, including fine-tuning
models. Moreover, ROC curves describe the balance between and feature engineering, is recommended to optimize model
True Positive and False Positive rates across various model performance and advance the field of eldercare research.
thresholds or decision boundaries. Essentially, they allow Table 3 displays performance metrics for an AL-based
measuring how well a model can distinguish between posi- xgboost model, including precision, recall, F1-score, and
tive and negative classes, with a higher area under the curve support values for multiple classes. Moreover, it shows good
signifying better discriminatory ability[33]. Specifically, in performance in Class 5 and Class 6.
this context, the ROC curves provide insight into the per- Furthermore, Table 4 presents performance metrics for an
6 VOLUME 4, 2016

This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 License. For more information, see https://creativecommons.org/licenses/by-nc-nd/4
This article has been accepted for publication in IEEE Access. This is the author's version which has not been fully edited and
content may change prior to final publication. Citation information: DOI 10.1109/ACCESS.2024.3380432

Author et al.: Preparation of Papers for IEEE TRANSACTIONS and JOURNALS

(a) AL-LR (b) AL-RF (c) AL-SGD

(d) AL-XGBoost (e) AL-KNN (f) AL-DNN

(g) AL-LSTM
FIGURE 4: Confusion Matrix of all classifiers

TABLE 3: Xgboost performance based on AL TABLE 4: SGD performance based on AL


Class Precision Recall F1-Score Support Class Precision Recall F1-Score Support
Class 0 0.92 0.96 0.94 173950 Class 0 0.80 0.68 0.96 173950
Class 1 0.59 0.03 0.06 10201 Class 1 0.00 0.00 0.00 10201
Class 2 0.76 0.12 0.21 772 Class 2 0.00 0.00 0.00 772
Class 3 0.84 0.06 0.12 922 Class 3 0.00 0.00 0.00 922
Class 4 0.86 0.91 0.88 68474 Class 4 0.07 0.37 0.04 68474
Class 5 1.00 1.00 1.00 76490 Class 5 0.96 0.95 0.97 76490
Class 6 1.00 1.00 1.00 35702 Class 6 0.96 0.95 0.97 35702
Accuracy - - 0.93 366511 Accuracy - - 76 366511
Macro Avg 0.85 0.58 0.60 366511 Macro Avg 0.42 0.42 0.40 366511
Weighted Avg 0.92 0.93 0.92 366511 Weighted Avg 0.68 0.76 0.68 366511

AL-based SGD model, with lower precision, recall, and F1- several classes, leading to a strong overall performance and
score in most classes, resulting in a lower weighted average accuracy.
F1-score. Table 6 offers performance metrics for an AL-based Naive
Table 5 shows performance metrics for an AL-based RF Bayes model. Class 5 shows high precision and F1 scores,
model, achieving high precision, recall, and F1-score in while other classes have relatively lower performance met-
VOLUME 4, 2016 7

This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 License. For more information, see https://creativecommons.org/licenses/by-nc-nd/4
This article has been accepted for publication in IEEE Access. This is the author's version which has not been fully edited and
content may change prior to final publication. Citation information: DOI 10.1109/ACCESS.2024.3380432

Author et al.: Preparation of Papers for IEEE TRANSACTIONS and JOURNALS

(a) AL-LR (b) AL-RF (c) AL-KNN

(d) AL-XGBoost (e) AL-DNN (f) AL-NB

(g) AL-LSTM
FIGURE 5: ROC curves of all classifiers

TABLE 5: RF performance based on AL TABLE 6: Naive Bayes performance based on AL


Class Precision Recall F1-Score Support Class Precision Recall F1-Score Support
Class 0 0.92 0.97 0.95 173950 Class 0 0.94 0.72 0.82 173950
Class 1 0.65 0.09 0.15 10201 Class 1 0.07 0.04 0.05 10201
Class 2 0.86 0.12 0.22 772 Class 2 0.00 0.00 0.00 772
Class 3 0.85 0.06 0.12 922 Class 3 0.00 0.00 0.00 922
Class 4 0.90 0.91 0.90 68474 Class 4 0.56 0.95 0.71 68474
Class 5 1.00 1.00 1.00 76490 Class 5 0.97 0.94 0.96 76490
Class 6 1.00 1.00 1.00 35702 Class 6 0.90 0.95 0.93 35702
Accuracy - - 94 366511 Accuracy - - 81 366511
Macro Avg 0.88 0.59 0.63 366511 Macro Avg 0.49 0.52 0.49 366511
Weighted Avg 0.93 0.94 0.92 366511 Weighted Avg 0.85 0.81 0.81 366511

rics.
are shown in Table 8. Subsequently, Class 5 and Class 6
Table 7 offers performance metrics for an AL-based LR
achieve perfect F1-score, recall, and precision, producing
model. The model performs strongly for Classes 5 and 6,
a high weighted average F1-score, indicating overall good
while other classes have lower precision, recall, and F1-score
performance.
values.
The performance metrics for a KNN model based on AL
8 VOLUME 4, 2016

This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 License. For more information, see https://creativecommons.org/licenses/by-nc-nd/4
This article has been accepted for publication in IEEE Access. This is the author's version which has not been fully edited and
content may change prior to final publication. Citation information: DOI 10.1109/ACCESS.2024.3380432

Author et al.: Preparation of Papers for IEEE TRANSACTIONS and JOURNALS

TABLE 7: LR performance based on AL TABLE 9: Experimental Results on 4 activities(All Itera-


Class Precision Recall F1-Score Support
tions)
Class 0 0.68 0.96 0.80 173950 Model Accuracy F1 Score Precision Recall
Class 1 0.00 0.00 0.00 10201 Random Forest
Class 2 0.00 0.00 0.00 772 Iteration 1 0.9537 0.9533 0.9535 0.9533
Class 3 0.00 0.00 0.00 922 Iteration 2 0.9539 0.9535 0.9537 0.9539
Class 4 0.37 0.04 0.07 68474 Iteration 3 0.9541 0.9539 0.9543 0.9544
Class 5 0.97 0.97 0.97 76490 Logistic Regression
Class 6 0.95 0.98 0.96 35702 Iteration 1 0.7629 0.6798 0.6227 0.7629
Accuracy - - 76 366511 Iteration 2 0.7631 0.6801 0.6323 0.7789
Macro Avg 0.43 0.42 0.40 366511 Iteration 3 0.7643 0.6833 0.6116 0.7644
Weighted Avg 0.69 0.76 0.69 366511 Xgboost
Iteration 1 0.9479 0.9477 0.9476 0.9489
TABLE 8: The performance of KNN based on AL. Iteration 2 0.9501 0.9488 0.9516 0.9381
Iteration 3 0.9367 0.9501 0.9433 0.9519
Class Precision Recall F1-Score Support KNN
Class 0 0.93 0.95 0.94 173950 Iteration 1 0.9483 0.9497 0.9497 0.9496
Class 1 0.42 0.19 0.26 10201 Iteration 2 0.9419 0.9442 0.9334 0.9436
Class 2 0.62 0.22 0.32 772 Iteration 3 0.9487 0.9321 0.9423 0.9432
Class 3 0.62 0.13 0.22 922 Naive Bayes
Class 4 0.88 0.91 0.90 68474 Iteration 1 0.8273 0.8311 0.8821 0.8232
Class 5 1.00 1.00 1.00 76490 Iteration 2 0.8232 0.8211 0.8932 0.8242
Class 6 1.00 1.00 1.00 35702 Iteration 3 0.8233 0.8331 0.8732 0.8212
Accuracy - - 0.93 366511 SGD
Macro Avg 0.78 0.63 0.66 366511 Iteration 1 0.7548 0.6723 0.6140 0.7531
Weighted Avg 0.93 0.93 0.93 366511 Iteration 2 0.7631 0.6832 0.6239 0.7552
Iteration 3 0.7523 0.6842 0.6142 0.7411
LSTM
Iteration 1 0.9431 0.9429 0.9428 0.9431
A. PERFORMANCE ANALYSIS OF ACTIVITY Iteration 2 0.9439 0.9442 0.9531 0.9401
RECOGNITION CLASSIFIERS ACROSS FOUR Iteration 3 0.9441 0.9424 0.9445 0.9411
DNN
CATEGORIES Iteration 1 0.9443 0.9460 0.9459 0.9463
The classification study reveals diverse performance out- Iteration 2 0.9471 0.9453 0.9554 0.9458
Iteration 3 0.9432 0.9465 0.9354 0.9467
comes among various classifiers for the activity recognition
task in four activities: standing, sitting, walking, and lying.
Table 9 presents the results on 4 activities. Moreover, RF medication strategies, and improve the well-being of elderly
demonstrates good accuracy, consistently achieving 95%, individuals. Hence, the findings presented in this study have
with precision, recall, and F1 score metrics of around 95%. showcased the potential to enhance the quality of life for
Conversely, LR exhibits a comparatively lower accuracy of seniors using the blend of ML, DL and AL.
76%, accompanied by modest precision, recall, and F1 score
values of around 67%. Likewise, Xgboost proves highly TABLE 10: Accuracy Comparison in Literature for 4 Activi-
effective with an average accuracy of 94% across all iter- ties: Standing, Sitting, Walking, Lying
ations, maintaining precision, recall, and F1 score metrics Activities [30] ALRF
at around 94%, respectively. Subsequently, KNN showcases F1 Score F1 Score
good performance, consistently achieving an accuracy of Sitting 0.93 0.998
Walking 0.95 0.961
94% with precision, recall, and F1 score metrics around 93%
Standing 0.89 0.892
to 94%. Naive Bayes delivers an accuracy of 82%, while Lying 0.86 0.999
SGD lags with 76%, both displaying balanced precision,
recall and F1 score metrics. In addition, the deep learning
models, LSTM and DNN, exhibit competitive accuracy val- V. CONCLUSION AND FUTURE WORK
ues of 94%, respectively, with high precision, recall, and This study mainly focused on models with lots of labeled
F1 score metrics. Overall, comprehensive insights into each data. In the future, it might be worth looking into methods
classifier’s strengths and weaknesses aid informed decision- where the model can learn even when there is not a lot
making for deploying activity recognition systems. of labeled data available. Finally, testing the models in real
Table 10 compares the accuracy results between the cur- healthcare settings to see how they affect the health and well-
rent study and base study [30] on a HAR dataset (HAR70+). being of older adults would be an important step in future
The current study reports a higher accuracy than the base. research. This study explored recognizing what older adults
The proposed approach achieved better F1 scores on walking, do daily to improve healthcare and monitor their well-being.
sitting, and lying while achieving almost equal results on Using a dataset called "HAR70+" that shows what older
standing activity. Results reveal the potential of DL and adults do daily, this research used ML and DL techniques to
ML techniques, particularly when integrated with AL, to build strong models for predicting these activities. The study
enhance activity recognition rate and patient care, optimize used models like KNN, LR, NB, RF, SGD, XGBoost, and
VOLUME 4, 2016 9

This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 License. For more information, see https://creativecommons.org/licenses/by-nc-nd/4
This article has been accepted for publication in IEEE Access. This is the author's version which has not been fully edited and
content may change prior to final publication. Citation information: DOI 10.1109/ACCESS.2024.3380432

Author et al.: Preparation of Papers for IEEE TRANSACTIONS and JOURNALS

LSTM, which all showed good results. Across three tries, [14] M. J. Aartsen, C. H. Smits, T. Van Tilburg, K. C. Knipscheer, and
the models showed different accuracy, F1 scores, recall, and D. J. Deeg, “Activity in older adults: cause or consequence of cognitive
functioning? a longitudinal study on everyday activities and cognitive
precision. Based on the results, the LSTM model performed performance in older adults,” The Journals of Gerontology Series B:
the best, with an average accuracy of 98%. In sum, this study Psychological Sciences and Social Sciences, vol. 57, no. 2, pp. P153–
shows that training ML and DL models that understand what P162, 2002.
[15] C. Röcke, M. Luo, P. Bereuter, M. Katana, M. Fillekes, V. Gehriger,
older adults do is important, which can help improve their A. Sofios, M. Martin, and R. Weibel, “Charting everyday activities in later
healthcare and support. Hence, more work is needed, but this life: Study protocol of the mobility, activity, and social interactions study
study shows that ML and DL can make a big difference in (moasis),” Frontiers in Psychology, vol. 13, p. 1011177, 2023.
[16] A. Moradell, J. A. Casajús, L. A. Moreno, G. Vicente-Rodríguez, and
older adults’ lives. This study can be expanded and improved A. Gómez-Cabello, “Effects of diet—exercise interaction on human health
in various ways. Firstly, including a more diverse group of across a lifespan,” 2023.
older adults from different backgrounds and locations could [17] Y. Kaya and E. K. Topuz, “Human activity recognition from multiple
sensors data using deep cnns,” Multimedia Tools and Applications, pp. 1–
make the model better understand daily routines. Likewise, 24, 2023.
Collecting data on more activities that older adults commonly [18] L. Calisti and E. Lattanzi, “Real-time energy-efficient sensor libraries for
do, such as cooking, cleaning, and leisure, could provide wearable devices,” 2023.
[19] W. Taylor, S. A. Shah, K. Dashtipour, A. Zahid, Q. H. Abbasi, and M. A.
a more complete picture of their daily lives. Additionally, Imran, “An intelligent non-invasive real-time human activity recognition
wearable technology with better sensors, like accelerometers system for next-generation healthcare,” Sensors, vol. 20, no. 9, p. 2653,
and gyroscopes, could provide richer data for recognizing ac- 2020.
[20] R. Ganesan and Y. BevishJinila, “Sensor-based fog-cloud integrated hu-
tivities. Trying out another machine, deep, and reinforcement man fall detection system using regression-based gait pattern recognition,”
learning methods helps build more models that recognize 2023.
complex patterns in what older adults do. [21] M. K. MacLean, R. Z. U. Rahman, N. Kerse, L. Taylor, L. Rochester, and
S. Del Din, “Walking bout detection for people living in long residential
care: A computationally efficient algorithm for a 3-axis accelerometer on
REFERENCES the lower back,” 2023.
[22] H. Shahverdi, M. Nabati, P. Fard Moshiri, R. Asvadi, and S. A. Ghorashi,
[1] R. Owen, K. Berry, and L. J. Brown, “Enhancing older adults’ well-being “Enhancing csi-based human activity recognition by edge detection tech-
and quality of life through purposeful activity: A systematic review of niques,” Information, vol. 14, no. 7, p. 404, 2023.
intervention studies,” The Gerontologist, vol. 62, no. 6, pp. e317–e327, [23] D. R. Beddiar, B. Nini, M. Sabokrou, and A. Hadid, “Vision-based
2022. human activity recognition: a survey,” Multimedia Tools and Applications,
[2] K. M. Mathieson, J. J. Kronenfeld, and V. M. Keith, “Maintaining func- vol. 79, no. 41-42, pp. 30509–30555, 2020.
tional independence in elderly adults: The roles of health status and [24] A. G. D’Sa and B. Prasad, “A survey on vision based activity recognition,
financial resources in predicting home modifications and use of mobility its applications and challenges,” in 2019 Second International Conference
equipment,” The Gerontologist, vol. 42, no. 1, pp. 24–31, 2002. on Advanced Computational and Communication Paradigms (ICACCP),
[3] K. F. Reid and R. A. Fielding, “Skeletal muscle power: a critical determi- pp. 1–8, IEEE, 2019.
nant of physical functioning in older adults,” Exercise and sport sciences [25] K. Xia, J. Huang, and H. Wang, “Lstm-cnn architecture for human activity
reviews, vol. 40, no. 1, p. 4, 2012. recognition,” IEEE Access, vol. 8, pp. 56855–56866, 2020.
[4] J. Angulo, M. El Assar, A. Álvarez-Bustos, and L. Rodríguez-Mañas, [26] G. S. S. Lin, W.-W. Tan, H.-J. Tan, C.-W. Khoo, and K. I. Afrashtehfar,
“Physical activity and exercise: Strategies to manage frailty,” Redox bi- “Innovative pedagogical strategies in health professions education: active
ology, vol. 35, p. 101513, 2020. learning in dental materials science,” International journal of environmen-
[5] A. D. Beswick, R. Gooberman-Hill, A. Smith, V. Wylde, and S. Ebrahim, tal research and public health, vol. 20, no. 3, p. 2041, 2023.
“Maintaining independence in older people,” Reviews in Clinical Geron- [27] U. Ahmed, J. C.-W. Lin, and G. Srivastava, “Deep hierarchical attention
tology, vol. 20, no. 2, pp. 128–153, 2010. active learning for mental disorder unlabeled data in aiomt,” ACM Trans-
[6] A. Hayat, F. Morgado-Dias, B. P. Bhuyan, and R. Tomar, “Human ac- actions on Sensor Networks, vol. 19, no. 3, pp. 1–18, 2023.
tivity recognition for elderly people using machine and deep learning [28] A. O. Jimale and M. H. Mohd Noor, “Subject variability in sensor-based
approaches,” Information, vol. 13, no. 6, p. 275, 2022. activity recognition,” Journal of Ambient Intelligence and Humanized
[7] W. W. Hoeger, S. A. Hoeger, C. I. Hoeger, and A. L. Fawson, Lifetime Computing, vol. 14, no. 4, pp. 3261–3274, 2023.
physical fitness and wellness. Cengage Learning, 2018. [29] A. Snoun, T. Bouchrika, and O. Jemai, “Deep-learning-based human ac-
[8] G. Dhiman, A. V. Kumar, R. Nirmalan, S. Sujitha, K. Srihari, N. Yuvaraj, tivity recognition for alzheimer’s patients’ daily life activities assistance,”
P. Arulprakash, and R. A. Raja, “Multi-modal active learning with deep Neural Computing and Applications, vol. 35, no. 2, pp. 1777–1802, 2023.
reinforcement learning for target feature extraction in multi-media image [30] A. Ustad, A. Logacjov, S. Ø. Trollebø, P. Thingstad, B. Vereijken, K. Bach,
processing applications,” Multimedia Tools and Applications, vol. 82, and N. S. Maroni, “Validation of an activity type recognition model
no. 4, pp. 5343–5367, 2023. classifying daily physical behavior in older adults: The har70+ model,”
[9] K. T. Chui, B. B. Gupta, M. Torres-Ruiz, V. Arya, W. Alhalabi, and I. F. Sensors, vol. 23, no. 5, p. 2368, 2023.
Zamzami, “A convolutional neural network-based feature extraction and [31] Z. Xiong, Y. Cui, Z. Liu, Y. Zhao, M. Hu, and J. Hu, “Evaluating
weighted twin support vector machine algorithm for context-aware human explorative prediction power of machine learning algorithms for materials
activity recognition,” Electronics, vol. 12, no. 8, p. 1915, 2023. discovery using k-fold forward cross-validation,” Computational Materials
[10] R. Monarch and R. Munro, Human-in-the-Loop Machine Learning: Active Science, vol. 171, p. 109203, 2020.
learning and annotation for human-centered AI. Simon and Schuster, 2021. [32] M. Sokolova, N. Japkowicz, and S. Szpakowicz, “Beyond accuracy, f-
[11] A. Hamza, U. Hayat, W. Hussain, and A. Mumtaz, “Machine learning score and roc: a family of discriminant measures for performance evalua-
based classification of crystal system using rendered images from x- tion,” in Australasian joint conference on artificial intelligence, pp. 1015–
ray diffraction (xrd) dataset,” in 2023 3rd International Conference on 1021, Springer, 2006.
Artificial Intelligence (ICAI), pp. 64–69, IEEE, 2023. [33] K. Hajian-Tilaki, “Receiver operating characteristic (roc) curve analy-
[12] A. Sauer, R. B. Gramacy, and D. Higdon, “Active learning for deep sis for medical diagnostic test evaluation,” Caspian journal of internal
gaussian process surrogates,” Technometrics, vol. 65, no. 1, pp. 4–18, medicine, vol. 4, no. 2, p. 627, 2013.
2023.
[13] Y. Wei, Y. Lil, M. Xu, Y. Hua, Y. Gong, K. Osawa, and E. Tanaka,
“A real-time and two-dimensional emotion recognition system based on
eeg and hrv using machine learning,” in 2023 IEEE/SICE International
Symposium on System Integration (SII), pp. 1–6, IEEE, 2023.

10 VOLUME 4, 2016

This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 License. For more information, see https://creativecommons.org/licenses/by-nc-nd/4
This article has been accepted for publication in IEEE Access. This is the author's version which has not been fully edited and
content may change prior to final publication. Citation information: DOI 10.1109/ACCESS.2024.3380432

Author et al.: Preparation of Papers for IEEE TRANSACTIONS and JOURNALS

SIDRA ABBAS has received her BS degree from ABDULLAH AL HEJAILI is a lecturer in Com-
the Department of Computer Science, COMSATS puter Science at University of Tabuk. He received
University, Islamabad, Pakistan. Her research in- a bachelor’s degree in computer science from
terests include but are not limited to computer Tabuk Teachers College, KSA, in 2007 and a mas-
forensics, machine learning, criminal profiling, ter’s degree in computer science from CLU, USA,
software watermarking, intelligent systems, and in 2011. He is studying for a Ph.D. in an informat-
data privacy protection. ics school at the University of Sussex. His research
interests include technology-enhanced learning,
image processing, virtual and augmented reality,
motion capture, and education applications.

GABRIEL AVELINO SAMPEDRO is working


with University of the Philippines Open University
Faculty of Information and Communication Stud-
ies: Laguna, Calabarzon, PH. His current research
work includes Internet of Things and Artificial
Intelligence.

SHTWAI ALSUBAI is currently an Assistant Pro-


fessor of computer science with Prince Sattam
bin Abdulaziz University. His research interests LUBOMIRA STRAžOVSKA works as a docent
include model-driven development for emerging at Comenius University, Faculty of Management,
technologies, big data processing and analytics, Department of Economics and Finance. She stud-
and graph transformation theory and its applica- ied at the Faculty of Philosophy of the Comenius
tions in machine learning and AI. University in Bratislava and the Faculty of Busi-
ness of the University of Economics in Bratislava.
He has long been devoted to management and
artificial intelligence in research and publishing
activities. At the same time, he also conducts final
theses on these topics. She was the author of the
first monograph on family business in Slovakia. She is the author of many
valuable scientific outputs on the mentioned topics. In publishing, she is
the author and co-author of several university textbooks and texts and
professional articles focused on the economic activity of small and medium-
AHMAD S. ALMADHOR received the B.S.E. sized enterprises.
degree in computer science from Aljouf University
(formerly Aljouf College), Aljouf, Saudi Arabia,
in 2005 and the M.E. degree in computer science
and engineering from University of South Car-
olina, Columbia, SC, USA, in 2010 and the Ph.D.
degree in electrical and computer engineering at
the University of Denver, Denver, CO, USA, in
2019. From 2006 to 2008, he was a Teaching
Assistant and College of Sciences manager, then
a lecturer from 2011 to 2012, all at Aljouf University, Aljouf, Saudi Arabia.
Then, I became a Senior Graduate Assistant and Tutor Advisor at the Univer-
sity of Denver in 2013 2019. He is currently an Assistant Professor of CEN
and VD of Computer and Information Science College at Jouf University,
Saudi Arabia. His research interests include AI, Blockchain, Networks,
Smart and Microgrid cyber security, and integration. Image processing,
Video Surveillance systems, PV, EV, Machine, and Deep learning. Dr.
Almadhor’s awards and honors include the Aljouf University Scholarship
(Royal Embassy of Saudi Arabia in D.C.), Aljouf’s Governor Award for
Excellency, and others.

VOLUME 4, 2016 11

This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 License. For more information, see https://creativecommons.org/licenses/by-nc-nd/4

You might also like