You are on page 1of 35

Journal of Building Engineering 42 (2021) 102824

Contents lists available at ScienceDirect

Journal of Building Engineering

Assessment of construction workers’ perceived risk using physiological data


from wearable sensors: A machine learning approach
By Gaang Lee a, Byungjoo Choi b, *, Houtan Jebelli c, SangHyun Lee d
a PhD Candidate, Tishman Construction Management Program, Department of Civil and Environmental Engineering, University of Michigan, 2350 Hayward St., G.G. Brown
Building, Ann Arbor, MI, 48109, United States
b Assistant Professor, Department of Architect, Ajou University, 206 World Cup-ro, Suwon Si, Gyeonggi-do, 16499, South Korea
c Assistant Professor, Department. of Architectural Engineering, Pennsylvania State University, 104 Engineering Unit A, University Park, PA, 16802, United States
d Professor, Tishman Construction Management Program, Department of Civil and Environmental Engineering, University of Michigan, 2350 Hayward St., G.G. Brown

Building, Ann Arbor, MI, 48109, United States

ARTICLE INFO ABSTRACT

Keywords: Considering that workers' safe or unsafe behaviors are responses to their perceived risk when working, under-
Construction safety standing workers' perceived risk is vital for safety management in the construction industry. Existing tools for
Perceived risk measuring workers' perceived levels of risk mainly rely on post-hoc survey-based assessments, which are limited
Wearable sensor
by their lack of continuous monitoring ability, lack of objectivity, and high cost. To address these limitations, this
Physiological signals
study develops an automatic method to recognize construction workers’ perceived levels of risk by using physio-
Machine learning
logical signals acquired from wristband-type wearable biosensors in conjunction with a supervised-learning al-
gorithm. The performance of the model was examined with physiological signals acquired from eight construc-
tion workers performing their daily work. The model achieved a validation accuracy of 81.2% for distinguishing
between low and high levels of perceived risk. This study provides a new means of continuous, objective, and
non-invasive method for monitoring construction workers' perceived levels of risk.

1. Introduction cluding EU countries [7,8], Canada [9], China [10,11], and Australia
[12,13].
Despite significant advances in construction technologies, construc- Studies have reported that the vast majority of accidents can be at-
tion safety records have not improved significantly [1]. Unacceptable tributed to workers' unsafe behaviors [14–16]. Based on an investiga-
injury rates in the construction industry have been a worldwide phe- tion of 75,000 accident cases, Heinrich et al. [17] reported that more
nomenon for a long time [2]. In the US, the construction industry has than 80% of occupational accidents could be attributed mainly to hu-
reported the highest number of fatalities among all industries for man errors. Haslam et al. [18] conducted a focus group study on 100
decades. The US construction industry reported 971 and 1008 fatalities construction accidents and found that more than 70% of these accidents
in 2017 and 2018, respectively (US Bureau of Labor Statistics 2019), could be attributed to human factors. Suraji et al. [19] examined more
which accounted for more than 20% of all work-related deaths in the than 500 construction accidents recorded by the Health and Safety Ex-
country [3]. The rate of fatal injuries was 2.7 times higher than the all- ecutive (HSE) of the United Kingdom and reported that approximately
industry average rate of 3.5 [4]. Given that the construction industry 80% of the construction accidents were mainly caused by workers’ un-
accounts for only 4.3% of the US workforce [5], this disproportionate safe behaviors. Workers' safety behaviors can be understood as the re-
rate of incidents is one of the primary concerns in the US construction sult of interactions between workers' decision-making processes and
industry. Severe construction-related accidents occur in other countries unsafe work conditions [20]. Workers exposed to a potential hazard
as well. In 2017, for example, 579 fatal occupational injuries were perceive the risk and determine their response to that risk. If a worker
recorded in the Korean construction industry, amounting to almost 30% believes that the perceived risk has a great potential to cause significant
of all fatalities across all industries in the country [6]. Moreover, the fa- harm, the worker may select an appropriate proactive behavior (i.e.,
tal injury rate was 1.8 times higher than the average of all industries risk compensation behavior). If not, they ignore the potential hazard
[6]. Similar patterns have been observed in many other countries, in- and may commit unsafe acts. As such, risk perception is a key process

* Corresponding author.
E-mail addresses: gaang@umich.edu (B.G. Lee), bchoi@ajou.ac.kr (B. Choi), hjebelli@psu.edu (H. Jebelli), shdpm@umich.edu (S. Lee).

https://doi.org/10.1016/j.jobe.2021.102824
Received 4 March 2021; Received in revised form 10 May 2021; Accepted 31 May 2021
Available online 7 June 2021
2352-7102/© 2021 Elsevier Ltd. All rights reserved.
B.G. Lee et al. Journal of Building Engineering 42 (2021) 102824

through which workers' cognitive processes interact with unsafe work significant modifications. However, System 2 (i.e., conscious process
conditions, and these interactions determine their safety behaviors. system) plays a major role in the decision-making process when System
Given the significance of perceived risk for understanding safety be- 1 (i.e., automatic activation) encounters a difficulty [56]. As such, both
haviors, sustained efforts have been made to measure workers' per- systems should be considered to understand the risk perception process.
ceived risk levels at construction sites. These efforts have mainly relied Especially, System 1 (i.e., automatic activation) may play a pivotal role
on the behavioral psychology perspective. In other words, self- in the risk perception of construction workers given that risk perception
reporting perception surveys are commonly administered to measure is an immediate response to potential hazards encountered during
workers' perceived risk levels [21,22]. Although psychological data are work.
easy to work with, they suffer from several limitations in terms of con- However, the post hoc survey-based method, which is the prevalent
tinuous monitoring, objectivity, and high cost [23–25]. Survey-based method for measuring risk perception, may not be capable of capturing
methods have several limitations in terms of assessing the dynamic the response of System 1 (i.e., automatic activation) in the risk percep-
changes in perceived risk during work. Moreover, the volatility of an in- tion process. Studies have measured risk perception based on workers'
dividual's memory may degrade the reliability of self-reported measure- subjective assessments of the probability and severity of potential inci-
ments. In this sense, there has been increasing interest in continuous dents at the construction sites where they work [29]. The respondents
and objective methods to assess construction workers' perceived risk were asked to provide an overall assessment of the risk levels based on
levels without interfering with their work [26]. To address these limita- their memory of work. In this process, it was suggested that the respon-
tions, this study attempts to use a new data source, physiological signals dents should recall their work experiences and analyze them to deter-
acquired from wearable biosensors, to assess construction workers' per- mine the overall risk of the project. Although these approaches are use-
ceived risk levels. With this background, the present study aims to de- ful for assessing the overall risk perceptions of the workers at a site from
velop and test a viable method to assess workers' perceived risk levels the perspective of System 2, they are ineffective for measuring immedi-
by using physiological signals collected from wearable biosensors. ate and automatic responses (i.e., the response from System 1) to haz-
ards during the work. Moreover, considering the dynamic and uncon-
2. Research background trolled nature of construction environments, an overall assessment of
the hazards of a project by using the survey-based method may not be
2.1. Risk perception and construction safety adequate for understanding the changes in construction workers' risk
perceptions over time as they work at the site. Therefore, it is necessary
Risk perception generally refers to one's subjective judgment and to develop a new method to continuously measure workers' immediate
evaluation of the probability and severity of adverse outcomes owing to responses (i.e., the response of System 1) to the hazards encountered
a hazard that one is exposed to Refs. [27–29]. Because subjective as- during work. Furthermore, asking workers to respond to the question-
sessment (i.e., risk perception) determines workers' responses to haz- naire during work hours may interfere with their ongoing work (Jebelli
ards (i.e., safety behaviors), risk perception is the key to understanding et al., 2019c), and the reliability of the responses strongly depends on
workers' safety behaviors [30,31]. In the same vein, risk perception has the accuracy of the respondents’ memories and reconstruction of their
been mentioned in multiple theoretical models of safety behaviors. experiences, which are not uniform across the respondents [23,57].
Wickens [32] presented an information-processing model that included Therefore, any new risk perception assessment method should be non-
four cognitive phases, namely sensory processing, perception, response invasive and objective, in addition to being capable of continuously
selection, and response execution, to explain how individuals respond monitoring the responses of System 1 (i.e., automatic activation).
to their environment. Similarly, Endsley [33] suggested a model of situ-
ation awareness (SA) that comprised three steps of “perception of ele- 2.2. Risk perception and physiological signals
ments in the environment, comprehension of the current situation, and
projection of future status” to demonstrate an individual's decision- An individual's automatic and unconscious response to a hazard
making process in dynamic situations. The SA model has been widely (i.e., the response of System 1) stimulates the sympathetic part of the
used in various domains to represent an individual's decision-making autonomic nervous system [58,59]. When the sympathetic nervous sys-
process in hazardous environments [34,35]. Albert et al. [36] presented tem is aroused by a perceived risk, it induces physiological changes in
an injury-prevention model that performs hazard recognition, risk per- the body, such as heightened cardiovascular system activity, sweat
ception, risk management, and injury prevention. Moreover, Choi and gland innervation, and thermoregulatory changes [60–62]. Expanding
Lee [37] developed an agent-based model of construction workers' on the aforementioned physiological processes, changes in the patterns
safety behaviors that considers three major steps in the safety decision- of physiological signals related to the activities of the sympathetic ner-
making process: risk perception, risk assessment, and safety behaviors. vous systems can provide useful information on individuals' risk per-
In addition to construction workers' safety behaviors, risk perception ceptions. Several studies have reported the potential for measuring
has been studied in various contexts such as drivers' [38,39], bicyclists' physiological responses to assess individuals' perceived risk levels
[40], pedestrians' [41] safety behaviors, as well as airline pilots' [42] [63,64].
safety and evacuation behaviors [43,44]. The relationship between risk Among various physiological signals, this study focused on electro-
perception and safety behaviors is supported by multiple studies in the dermal activity (EDA), photoplethysmogram (PPG), and skin tempera-
literature [35,45–50]. ture (ST), which can be obtained using wristband-type wearable biosen-
According to the dual-processing theory, there are two different sors. Wristband-type wearable biosensors were used in this study owing
modes of decision-making processes: System 1 and System 2 [51–53]. to their mobility, non-invasiveness, and ease of wearing [65]. EDA
System 1 refers to a rapid, unconscious, and automatic way of thinking refers to “the variations in the electrical properties of the skin in re-
that requires little or no effort on the part of an individual to arrive at a sponse to sweat secretion” [66]. The changes in skin conductance or
conclusion. On the other hand, in System 2, thinking is slow, conscious, skin potential are continuously measured by applying a low, constant
and deliberate, demanding a high level of mental effort [51,54]. While voltage to the skin through two electrodes to non-invasively measure
a multiple names have been suggested for the two systems, there is a EDA (Braithwaite et al., 2013). When an individual perceives risk, the
consensus on the distinction between the two systems [55]. Both sys- sympathetic division of the autonomic nervous system triggers the post-
tems play different roles in the decision-making process. System 1 runs ganglionic sudomotor fibers that innervate the sweat glands [67,68].
automatically and continuously provides suggestions to System 2. Sys- Therefore, changes in EDA signals have been widely measured to un-
tem 2 generally adopts the suggestions provided by System 1 without derstand individuals' risk perception in various contexts [26,69–71].

2
B.G. Lee et al. Journal of Building Engineering 42 (2021) 102824

The composite EDA signals can be decomposed into Electrodermal lected physiological data and attempted to understand construction
Level (i.e., EDL, tonic component) and Electrodermal Response (i.e., workers' physical status, such as physical workload [79,103] and fa-
EDR, phasic component) which have different time scales (Braithwaite tigue [85]. While these studies have extended the potential of using
et al., 2013, [72]. The tonic components represent the baseline drift of wearable sensors to improve construction safety, few attempts have
EDA signals while the phasic components reflect short-term fluctua- been made to understand workers' mental status related to safety in
tions which are the results of immediate response to the external stimuli construction projects. Although a few studies have focused on under-
[73,74]. standing mental statuses such as mental workload [104–106], vigilance
PPG provides information on activities of the cardiovascular system [25,107], and hazard recognition [108], they have used wearable EEG
by detecting variations of blood volume in the microvascular tissues sensors or portable eye-tracking glasses, which have some limitations in
[75]. PPG sensor measures changes in the intensity of infrared lights the applicability of ongoing work. There has been a notable paucity of
emitted from the sensor via reflection or transmission through the mi- research on assessing construction workers' perceived risk from physio-
crovascular tissue [76]. The reflection or transmission rate is associated logical signals collected using least invasive means such as the use of
with the blood volume of the microvascular tissues which is affected by wristband-type wearable biosensors, which have high applicability in
cardiovascular system [77]. Electrocardiography (ECG) has also been practice. Although our earlier work investigated the feasibility of using
used to monitor cardiac activity, but the PPG sensor is commonly used EDA signals to assess the risk perceptions of workers [26], a statistically
in wristband-type wearable biosensors because of the simplicity and significant correlation between EDR and perceived risk may not be di-
convenience of the technology [78]. If the sympathetic division of the rectly applicable for determining construction workers' perceived risk
autonomic nervous system is aroused by perceived risk, it innervates during their work. Moreover, the quality of the physiological signals
the heart-related activities [65]. The changes in the heart-related activi- collected from on-site construction workers by using wearable biosen-
ties bring variations of blood volume in microvascular vessels which sors may be lower than that of the signals collected using traditional
can be monitored by PPG sensors. Therefore, previous studies calcu- sensors in controlled laboratory environments because of the lower
lated metrics related to the cardiovascular system [e.g., heart rate (HR) sampling frequency and the higher proportion of artifacts [65,77].
and heart rate variability (HRV)] using PPG data [79]. Also, previous Therefore, the present study aimed to develop and test an automatic
researchers have shown significant relationship between metrics from method to recognize workers' risk perceptions by using wristband-type
activities of cardiovascular system (HR, HRV, etc.) and individuals’ risk wearable biosensors that can continuously capture workers' physiologi-
perception [41,80–83]. Also, the peripheral skin temperature (ST) is af- cal signals without interrupting their on-site tasks. The developed
fected by changes in the blood volumes in microvascular tissues method is expected to contribute to the existing body of knowledge on
[84,85]. As such, ST could be indicative of cardiac activities induced by construction safety by providing a new means to overcome the limita-
the aroused sympathetic nervous system [86–88]. tions of survey-based methods used for measuring the perceived risk.
Survey-based methods used in previous studies to measure workers'
3. Knowledge gaps and research objectives perceived risk have limitations in terms of continuous monitoring, reli-
ability of measurement, and interruption of ongoing work. Further-
The measurement of physiological signals enables us to overcome more, the use of the survey-based method is limited to capturing work-
the aforementioned limitations of the post hoc survey-based assessment ers' responses of System 1 (i.e., automatic activation), which plays a
to understand construction workers' risk perception. First of all, the pivotal role in the safety decision-making process. An in-depth under-
physiological signals can provide more meaningful information about standing of construction workers’ perceived risk acquired through the
construction workers' risk perception because they are indicative of the developed method will pave the way for the identification and manage-
response of System 1 (i.e., automatic activation) [41,89] which is in ment of risks in construction projects. To achieve the research objec-
line with the mechanism of construction workers’ risk perception tive, a supervised machine learning model is trained and validated us-
process but not well understood by previous methods. Also, various ing a broad range of features extracted from EDA, PPG, and ST to recog-
sensors that continuously measure these physiological signals help us nize workers' risk perceptions. Moreover, several filtering methods
capture the changes in workers' risk perceptions over time due to the (e.g., high-pass filter, band-pass filter, hamper filter, and moving aver-
dynamic nature of their work environments. Such continuous measure- age filter) are employed to improve the quality of the collected physio-
ment allows us to avoid the pitfalls of the snapshot approaches. Third, logical signals.
since the signal processing schemes and analysis methods are built
upon objective algorithms, there is no room for deterioration of the 4. Methods
analysis results owing to self-reporting bias.
Despite the advantages of physiological signals in terms of address- Fig. 1 represents an overview of the process for assessing construc-
ing the limitations of the existing measurement methods, the hardware tion workers' perceived risks by using the physiological signals col-
limitations of traditional sensors make it very challenging to use physi- lected from wearable biosensors. First, PPG, EDA, and ST signals are
ological signals in construction sites [65]. Wired connections to palms collected using wristband-type biosensors worn by on-site construc-
or fingers for measuring the physiological signals may interfere with tion workers. Moreover, the authors simultaneously video-recorded
the tasks of construction workers. Most previous studies on the mea- the workers' activities. The collected signals were labeled low- and
surement of physiological signals to understand risk perception have high-risk activities based on the recorded videos. After eliminating ar-
been conducted in controlled lab environments [90]. Recently, owing tifacts in the signals by using several filtering methods and decompos-
to recent advancement of wearable biosensors, they can possibly over- ing the EDA into EDL and EDR, signal features that represent the char-
come the limitations of traditional sensors. Wireless, portable, and af- acteristics of the physiological signal patterns were extracted in the
fordable sensors can facilitate the noninvasive and continuous collec- time and frequency domains. Thereafter, a machine learning model
tion of physiological signal data from construction workers since the for assessing the construction workers' perceived risk was trained and
use of these sensors do not require the interruption of construction tested by applying supervised learning algorithms.
workers' ongoing work [89,91]. Moreover, there has been a dramatic
growth in research related to the use of wearable sensors for developing 4.1. Data collection
safety insights. Such studies have mainly focused on collecting data on
physical or kinematic movements to recognize workers' unsafe postures To develop a machine learning model for recognizing on-site con-
[92–99] and unsafe work conditions [100–102]. A few studies have col- struction workers' risk perceptions, physiological data (i.e., EDA, PPG,

3
B.G. Lee et al. Journal of Building Engineering 42 (2021) 102824

Fig. 1. Overview of process for recognizing construction workers' risk perceptions.

and ST) were collected from eight construction workers (two carpen- participate in our study. The consent form provided information about
ters, one floor finisher, four electricians, and one foreman). The data the subjects’ rights, our research objective, and the data collection pro-
collection procedure was approved by the Institutional Review Board of cedure. The subjects were told that they could withdraw from the study
the University of Michigan. The subjects' ages ranged between 20 and at any point in time. Moreover, all subjects were asked whether they
50 years (M = 32.37, SD = 8.57), and their job experience ranged have any clinical issues that could affect their on-site work. None of the
from 3 to 25 years (M = 10.25 SD = 6.72). Table 1 summarizes the de- subjects reported such problems.
mographic information of the subjects. Before collecting the physiologi- The physiological data were collected from the workers by using E4
cal data, the research team members distributed informed consent wristband-type biosensors (manufactured by Empatica, Cambridge,
forms to all subjects and asked them to sign the form if they agreed to Massachusetts), which can simultaneously collect EDA, PPG, and ST
data. These sensors recorded EDA and ST with sampling rates of 4 Hz
and measured PPG data with a sampling frequency of 64 Hz. Each sub-
Table 1 ject was asked to wear the sensor and perform their daily on-site tasks
Summary of subjects’ information. for half of the workday (i.e., about 4 h per worker). Before starting the
Age (years) Job Experience (Years) Height (cm) Weight (kg) data collection, each participant was given adequate time to familiarize
themselves with wearing the sensor. In the meantime, a member of the
Mean 32.37 10.25 181.5 88.88
SD 8.57 6.72 7.14 12.92
research team ascertained whether the sensor was properly located and
Min 20 3 163 66 operational. The placement of the cameras was carefully selected to
Max 50 25 189 109 minimize interruption of the ongoing work, and at least 3 m of distance

4
B.G. Lee et al. Journal of Building Engineering 42 (2021) 102824

between the subjects and the cameras were ensured to minimize any the collected physiological signals. To attenuate noises in the EDA sig-
emotional influence of the subjects caused by cameras. Additionally, nals, a high-pass filter with a cutoff frequency of 0.05 Hz was applied to
through a consent form, all subjects were informed that the collected suppress low-frequency noises resulting from variations in the imped-
data would be used only for research purposes and would not be shared ance of the EDA sensor electrodes or environmental conditions such as
with others. As a result, the subjects exhibited a natural response during temperature and humidity [26,110]. A moving average filter with a six-
the session, even though they were aware of the cameras at the begin- data-point window was additionally applied to alleviate the high-
ning of the data collection. Furthermore, the data collected during the frequency noises introduced due to users’ motions and electromagnetic
first 10 min of the session were excluded in the analysis to minimize the interference [111]. For PPG, a band-pass filter was used in the range of
effects of the subjects' awareness of the video recording. To prevent any 0.5–4.0 Hz to attenuate both low-frequency (e.g., flicker noise) and
discontinuity in data collection, the research team member checked the high-frequency (e.g., LED shot noise and ambient light noises) noises
status of each sensor after every hour. Moreover, each subject's activi- [112]. To suppress noise in the ST signals, which can be mainly as-
ties were video-recorded using GoPro Hero + handheld cameras for la- cribed to unstable contact between the infrared thermopile temperature
beling the data. reader and human skin, the authors applied a hamper filter (Jebelli et
al., 2018a).
4.2. Data preprocessing
4.3. Feature extraction
After the field data collection, the authors labeled the collected
physiological signals into two classes—low and high perceived risk—by After labeling the physiological signals and suppressing noise, the
using the recorded videos; this step was essential for training and vali- authors extracted different features to understand the patterns in the
dating the classification models for recognizing the perceived risk. It is signals corresponding to different levels of workers' perceived risk. As
almost impractical to ascertain the ground truth about workers' per- the first step in feature extraction, EDA was decomposed into EDL and
ceived risk from the data collected as they perform their tasks. There- EDR. EDL represents changes in the baseline, while EDR reflects sponta-
fore, the authors used the collected data that clearly corresponded to neous fluctuations in EDA [73]. In general, EDL is considered to show
low and high risks under the assumption that workers would perceive the trend in sympathetic activity [113]. EDR typically manifests as a
low and high risk in such obvious moments. First, two data sources (i.e., steep incline toward the peak and a gradual decline toward the base-
the physiological signals and the video recordings) were synchronized line, and it well reflects the short-term sympathetic response to an ex-
based on the time recorded by the wearable biosensors and videos. Two ternal stimulus [114]. Both EDL and EDR are important for understand-
research team members with more than 5 years of field experience on ing people's perceived risk levels because people can perceive risk by
construction sites separately watched the videos and assessed the risks inferring potential risks from underlying conditions as well as by actu-
in the subjects' activities at every second (i.e., 1 Hz) based on their ex- ally observing attention-grabbing events [115], which might be re-
perience and knowledge. Activities that require additional actions to flected in EDL and EDR, respectively. For example, in the case that a
protect workers (e.g., work at height, wearing glasses) were labeled as worker performs a task at a height, they can perceive risk by being at
high-risk activities. Next, data corresponding to inconsistent labeling the elevated position owing to their anticipation of the accidents that
results by these two team members were excluded from the subsequent can occur from that position, without the occurrence of any actual spe-
analysis. The most common high-risk activity was working on a ladder cific event. Moreover, workers can feel at risk owing specific events
to complete tasks such as installing lights or attaching plasterboard to happening on or around them, such as a misstep, falling of an object,
the ceiling. Moreover, tasks involving the use of dangerous tools (e.g., and vibration of a ladder. Therefore, the authors extracted features
plasterboard saw and electric cutter) were labeled as high-risk (Fig. 2). from both EDL and EDR.
In contrast, the data collected during the activities in which the workers Then, the continuous EDL, EDR, PPG, and ST signals were seg-
performed ordinary jobs on the ground, walked and talked with mented with a moving window with 25% shift (i.e., 75% overlap). To
coworkers, or rested were labeled as low-risk (Fig. 2). Consequently, a determine the optimal length of the window to recognize the level of
total of 47,544 labeled data were used to train and validate the classifi- perceived risk, different window lengths were tested from 10 s to 300 s.
cation model. Also, Cohen's Kappa was calculated to determine if there From the segmented signal data points, the authors extracted a total of
was an agreement between the two team members' assessment of the 52 features (i.e., eight features from EDL, 19 features from EDR, 21 fea-
risk levels of the activities. There was a substantial agreement between tures from PPG, and four features from ST). Since the main underlying
the two team members' risk assessment with a κ = 0.869 (95% CI, mechanism bridging the perceived risk and the variations in the col-
0.864 to 0.874). lected physiological signals is the sympathetic arousal in the autonomic
One notable hurdle in the analysis of the physiological signals col- nervous system [60–62], this study selected 52 features that have
lected using wearable biosensors from uncontrolled fields is the signifi- demonstrably been useful for understanding the stimulation of the sym-
cant noise contained in the signals [109]. Because noise can consider- pathetic part of the autonomic nervous system [116–118]. Table 2 sum-
ably distort the measurement of perceived risk by skewing the features marizes the extracted features. Specifically, 20 time-domain features
extracted from the signals, several denoising techniques were applied to and 7 frequency-domain features from EDL and EDR, 16 time-domain

Fig. 2. Example of high and low-risk.

5
B.G. Lee et al. Journal of Building Engineering 42 (2021) 102824

Table 2 formance. From the results of the preliminary analysis, four algorithms
Features extracted from EDA, PPG, and ST signals. (i.e., Gaussian support vector machine (GSVM), K-nearest neighbors
Signal Feature Features (KNN), decision tree (DT), and bagging tree (BT)) were selected. These
Type algorithms have been widely used and have shown good performance
for physiological-signal-based monitoring of sympathetic-arousal-
EDA Time From EDL: Mean, Standard deviation, Median, Maximum,
Domain Cumulative maximum, Cumulative minimum, Minimum-to-
related human responses such as stress [123–125]. These supervised
maximum, Peak-to-root mean square, Kurtosis, machine learning algorithms optimize the classification model in the
From EDR: Standard deviation, Median, Maximum, Cumulative training phase by minimizing their own objective functions, which rep-
maximum, Cumulative minimum, Minimum-to-maximum, resent how many errors the model generates with the training labeled
Peak-to-root mean square, Kurtosis, Integral, Normalized
data [126]. The process of minimizing the objective functions is differ-
average power, Normalized root mean square
Frequency From EDL: Mean frequency, Median frequency
ent in every machine learning algorithm. To validate the performance
Domain From EDR: Mean frequency, Median frequency, Spectral power of the trained classification models, 10-fold cross-validation was per-
between 0.1 and 0.2 Hz, Spectral power between 0.2 and formed because this validation method has been widely used to mea-
0.3 Hz, and Spectral power between 0.3 and 0.4 Hz sure the performance of the classification models in previous studies on
PPG Time Maximum, Cumulative maximum, Cumulative minimum,
measuring human psychophysiological variables, such as stress, emo-
Domain Minimum-to-maximum, Peak-to-root mean square, Kurtosis of
PPG, Mean of rise time, Pulse height minimum, Pulse height tions, and physical exertion, by using physiological signals
maximum, Heart rate, Respiration rate, Average of NN [123,124,127]. In the 10-fold cross-validation, the dataset was first di-
intervals, Standard deviation of NN Intervals, Root mean vided into 10 equal-sized subsets. Nine of the 10 subsets were used to
square of the sequential differences of intervals, Proportion of train a model, and the remaining subset was used to validate the perfor-
NN intervals over 20 ms, Proportion of NN intervals over
50 ms
mance of the trained model. The training and validation were repeated
Frequency Low-frequency power, High-frequency power, Low frequency 10 times so that all subsets were used for validation. Furthermore, since
Domain to high frequency ratio, Mean frequency, Median frequency of the number of low-risk data points (i.e., 33,860) was greater than that
PPG of high-risk data points, the low-risk data points were first randomly
ST Time Mean, Standard deviation of ST
undersampled to balance the two classes before conducting the ten-fold
Domain
Frequency Mean frequency, Median frequency of ST
cross-validation. To ensure that the resultant validation accuracy
Domain showed the general performance, not the performance in a randomly
undersampled data set, this undersampling-cross validation procedure
features and 5 frequency-domain features from PPG, and 2 time- was repeated ten times, and the averaged accuracy is reported.
domain features and 2 frequency-domain features from ST signals were Specifically, this study applied the 10-fold cross-validation method
extracted. without shuffling to minimize the dependency between the training and
After feature extraction, the authors selected the most meaningful the validation sessions, even though the 10-fold cross-validation
features out of the 52 extracted features. Feature selection is required to method with shuffling is more widely used to validate supervised ma-
not only reduce the computational cost and the time required to mea- chine learning models (Fig. 3). The physiological signals considered in
sure risk perception, which is important in practice, but also to improve this study were time-series data, in which the neighboring data points
reliability by reducing the risk of overfitting [119]. As the feature selec- are not clearly independent of each other [128–131] because features
tion method, the binary particle swarm optimization method, a type of in the data points do not vary drastically between neighboring data
wrapper method, was applied [120]. While filter methods evaluate the points in time-series data. Therefore, if training and validation sessions
usefulness of features individually, wrapper methods can evaluate a are conducted without consideration of the temporal sequence by shuf-
subset of features in a task [121]. Since understanding sympathetic- fling before session division (X ̃_t: arranged in the validation session, X ̃_
arousal-related psychophysiological responses such as risk perception (t±1): arranged in the training session), the validation session is not
requires multiple features from different physiological signals, not an truly unseen when training classification models (a in Fig. 3). In this
individual feature, wrapper methods could provide better performance setup, where training and validation sessions are not clearly indepen-
in this study. Specifically, the authors applied the binary particle swarm dent of each other, the performance of the trained model in the valida-
optimization method because this method has shown better perfor- tion session might be considerably superior to that in a general setup,
mance than the other wrapper methods (e.g., forward selection and where training and validation sessions are clearly independent. This
backward elimination methods), especially when the number of test performance overestimation due to the dependency between the train-
features is large as in the case of this study, by overcoming the limita- ing and validation sessions reduces the reliability of the test of general-
tions of the latter, such as high computational cost, long duration, and ization ability of the model [129,131].
stagnation in local optima in the case of the evolutionary computation
technique [119]. The parameters of the binary particle swarm opti- 5. Results
mization method were set following previous studies [120,122] that
have analyzed biosignals to understand different status of human body To test the performance of the classifiers and find the optimal win-
(population size: 30, maximum number of iterations: 100, cognitive dow length, the authors trained and validated multiple classifiers by
learning factor: 2, social learning factor: 2, maximum inertia weight: changing the window length from 10 s to 300 s in increments of 10 s.
0.9, minimum inertia weight: 0.4, and maximum velocity: 6). Fig. 4 displays the changes in the validation accuracy of the classifiers
with changes in window length. GSVM outperformed the other algo-
rithms across window lengths and at the maximum point of validation
4.4. Perceived risk classification
accuracy (GSVM: 0.812, KNN: 0.788, DT: 0.707, and BT: 0.771). This
result is consistent with those of previous studies on detecting the sym-
With the extracted and selected features, the authors trained classifi-
pathetic-arousal-inducing human responses by using physiological sig-
cation models to recognize the level of perceived risk by applying su-
nals [65,110,132]. Regardless of learning algorithms, the validation ac-
pervised learning algorithms. To select the appropriate supervised
curacy remains rather low (0.627–0.680) when the window length is
learning algorithms, the authors tested a wide range of algorithms (e.g.,
smaller than 60 s. Then, it gradually increases as the window length in-
linear, quadratic, and Gaussian discriminant analysis; logistic regres-
creases up to 210 s, which is the maximum point of validation accu-
sion; Gaussian naïve Bayes; and linear, quadratic, and cubic support
racy. After the maximum point, the validation accuracy decreases
vector machine) on 25% of the entire dataset and compared their per-

6
B.G. Lee et al. Journal of Building Engineering 42 (2021) 102824

Fig. 3. Comparison between 10-fold cross-validation with and without shuffling.

Table 4
Features selected by the binary particle swarm optimization.
Signal Feature Selected Features
Type

EDA Time From EDL: Mean, Median, Maximum, Cumulative maximum,


Domain Cumulative minimum, Minimum-to-maximum, Peak-to-root
mean square
From EDR: Median, Cumulative maximum, Cumulative
minimum, Minimum-to-maximum, Peak-to-root mean square,
Integral, Normalized root mean square
Frequency From EDL: Mean frequency
Domain From EDR: Mean frequency,
PPG Time Cumulative maximum, Cumulative minimum, Kurtosis of PPG,
Domain Mean of rise time, Pulse height minimum, Pulse height
maximum, Standard deviation of NN Intervals, Root mean
square of the sequential differences of intervals, Proportion of
NN intervals over 20 ms
Frequency High-frequency power, Mean frequency of PPG
Fig. 4. Validation accuracy of the classifier for different window lengths. Domain
ST Time Mean, Standard deviation of ST
rapidly relative to its slow incline from 60 to 210 s. The highest valida- Domain
tion accuracy (0.812 with GSVM at 210 s) is comparable to the results
of other similar studies involving the detection of sympathetic-arousal- spectively. The precision of a class indicates the proportion of correctly
inducing human responses (e.g., stress) by using physiological signals classified data points in the total data points classified into the class.
[110,123,124]. Moreover, given that the authors applied a more rigor- The recall of a class refers to the proportion of correctly classified data
ous validation method (i.e., cross-validation without shuffling) than the points in the number of actual data points of the class. The trained clas-
traditional methods, this result can be more promising than those of the sifier has a higher precision for high perceived risk than that for low
previous studies. perceived risk and a lower recall for high perceived risk than that for
Tables 3 and 4 are the confusion matrix of the classification model low perceived risk. This means that the trained classifier is pickier when
trained with GSVM at the optimal window length (210 s) and the list of classifying data points under high perceived risk instead of low per-
the 29 features selected by the binary particle swarm optimization, re- ceived risk. Consequently, it classifies very few data points under high
perceived risk, but these points are mostly correctly classified.

Table 3 6. Discussion
Confusion matrix for distinguishing between low and high-stress levels.
Predicted Actual Risk Level Recent wearable biosensing technologies have the potential to con-
Risk Level tribute to construction safety because they can be used to assess con-
Low High Precision F-score struction workers' perceived risk levels during their work. However, the
lower sampling frequency and significant artifacts in the physiological
Low 0.425 0.113 0.790 0.819 signals collected using wearable biosensors in the field have limited
High 0.075 0.387 0.838 0.805
their application in construction sites. To address this gap, the authors
Recall 0.851 0.774 Accuracy = 0.812

7
B.G. Lee et al. Journal of Building Engineering 42 (2021) 102824

applied advanced signal processing and machine learning techniques in stress and physical exertion are phasic variables that change rapidly
conjunction with wearable biosensors to train and validate classifiers to even due to small external stimuli, such as sudden acoustic noises and
detect the level of perceived risk. The trained classifiers yielded an ac- physical load on hands, the long window length might not be able to
curacy of 0.812, which indicates that construction workers’ perceived capture their rapid fluctuations. By contrast, the level of perceived risk
risk levels during work can be detected using wearable biosensors. tends to be sustained for a certain duration, and it usually changes at a
The authors validated the classifiers by using the cross-validation slower pace than stress and physical exertion because workers' traits
method without shuffling. According to previous studies, the cross- can be considered static within a relatively short period (e.g., a day and
validation method without shuffling is considerably less accurate than a month) and the overall work conditions in construction contexts do
the traditional cross-validation method with shuffling for the same clas- not rapidly change in general. This coincides with the authors’ observa-
sifier, but the former has better validation performance in assessing the tions during data collection. Once the subjects started a task under a
generalization ability of the classifier when time-series data are used particular condition, they continued for at least a couple of minutes.
[129,131,133]. To examine the difference in validation accuracy be- However, this result does not necessarily mean that 210 s is a context-
tween the cross-validation methods with and without shuffling, the au- independent optimal window length for monitoring the perceived risk
thors validated the classifiers using both the cross-validation methods level. Different contexts (e.g., other manufacturing jobsites and sports)
by changing the window length. The results are shown in Fig. 5. The could have different optimal window lengths depending on their dis-
validation accuracy continuously increases with small fluctuations as tinct work conditions.
the window length increases, which differs significantly from the result Lastly, the authors trained the classifiers by using only one physio-
obtained with the cross-validation method without shuffling. This is not logical signal to investigate the usefulness of each signal for monitoring
reasonable because every task that involves detecting a status has an the perceived risk. Because ST alone is insufficient for understanding
optimal window length, which is determined based on the duration for sympathetic arousal, which is the underlying mechanism for monitor-
which the status is reflected in the signals and the frequency with which ing perceived risk by using physiological signals [65,135], only EDA
the status shows up [134]. This continuous increase in the validation and PPG were tested in this study. As a result, the performance of each
accuracy may be explained by the effect of overlap between the neigh- signal was comparable to the performance achieved when all the sig-
boring data points that occurs when a moving window is employed. The nals were used together (Fig. 6). This result is not consistent with those
authors observed 75% overlap in the moving window, which means if of previous studies, in which the accuracy was notably higher when
the window length was 100 s, the neighboring data points shared 75 s multiple physiological signals were used at once (e.g., EDA and PPG)
of signals. In this regard, as the window length increases, the length of than when one signal was used [65,125]. The results of previous studies
overlap between the neighboring data points increases as well, thus are supported by the fact that different physiological signals contain
raising the dependency between the data points. As mentioned earlier, noise from different sources based on the recording mechanisms used
the dependency between adjacent data points leads to overestimation and the related body organs [125]. Although a substantial amount of
of the performance of the tested classifiers. This result indicates that the noise was alleviated by the denoising process, residual noise can signifi-
traditional cross-validation method with shuffling can overestimate the cantly distort the signal in several time frames. Thus, dependence on
performance of the trained classifiers, especially when the indepen- one signal alone cannot guarantee the performance of the trained classi-
dence between neighboring data points is not guaranteed, as in the case fiers, whereas multiple signals can complement each other because it is
of time-series data. unlikely that different noise factors of multiple signals occur simultane-
The results of this study show that GSVM outperforms the other su- ously. By contrast, owing to the relatively long window length for de-
pervised learning algorithms in recognizing risk perception by using tecting the perceived risk, the effects of residual noise on each data
physiological signals. This might be because of the robust performance point can be minor in this study, even when using only one physiologi-
of GSVM in controlling the overfitting and outlier issues that are com- cal signal. Although several seconds of a signal are distorted by the
mon when using multiple physiological signals [110]. Moreover, 210 s residual noise not filtered out by the denoising process, the features ex-
was found to be the optimal window length for recognizing the level of tracted from the long window length might not be affected considerably
perceived risk when applying GSVM to physiological signals. This win- by the relatively minor distortion. This intersection between the num-
dow length is rather long given that the optimal length for the monitor- ber of signals and the window length is observed in Fig. 6. When the
ing of other psychophysiological variables, such as stress and physical window length is relatively short, shorter than 50 s, the models trained
exertion, is 10–30 s [65,132]. This notable difference in optimum win- using only one single signal (i.e., EDA or PPG) yield a notably lower val-
dow length compared to those of other psychophysiological variables idation accuracy than those trained using all the signals together.
might be ascribed to the fact that risk perception is a cognitive process Meanwhile, when the window length is longer than 50 s, the difference
determined by interaction between workers' traits (e.g., prior knowl- in validation accuracy between the models trained using only one sig-
edge and experience) and the overall working conditions. Because

Fig. 5. Comparison of validation accuracy between the 10-fold cross-validation


methods with and without shuffling. Fig. 6. Validation accuracy when using only EDA and PPG, separately.

8
B.G. Lee et al. Journal of Building Engineering 42 (2021) 102824

nal and those trained using all signals together is considerably smaller. ological signals acquired from wristband-type wearable biosensors. To
This implies that if the long window length is applied, the perceived achieve the objective, the authors developed and validated a supervised
risk can be successfully detected with only a reasonable unimodal wear- machine learning model by using a broad range of features extracted
able biosensor without the need for advanced multimodal sensors. from the physiological signals (i.e., PPG, EDA, and ST). The perfor-
In this study, the authors found that workers' perceived risk levels mance of the model was examined using more than 30 h worth of phys-
could be monitored even as they worked, through the combination of iological signals acquired from eight construction workers over the
wearable biosensing and advanced signal processing and machine course of their daily work. The developed GSVM model achieved a vali-
learning techniques. However, a couple of limitations also should be ac- dation accuracy of 81.2% in terms of distinguishing between low and
knowledged. First, the data collected in this study may not adequately high levels of perceived risk. The results indicate that the physiological
reflect the environmental variability (e.g., temperature, humidity, and signals collected from wearable biosensors can feasibly be used e to rec-
radiation) because the data collection process lasted only two days. ognize construction workers' perceived risk levels during work. This
Give that environmental variability is essential to generalize the trained study contributes to the literature by providing a new means of continu-
model, especially in the construction context where people work under ous, objective, and non-invasive monitoring of construction workers'
diverse environmental conditions, future studies should adequately in- perceived risk levels. Given the limitations of previous methods to mea-
corporate environmental variability in the data collection process. sure workers' perceived risk levels, the proposed method extends our
Moreover, owing to the individuals' uniqueness in terms of their physio- understanding of construction workers' perceived risk at construction
logical response, the proposed risk perception recognition method sites. Continuous measurement of construction workers' perceived risk
could be subject-dependent. However, this study attempted to collect could provide valuable information for improving construction safety
data in naturalistic work environments in construction projects. The management practices. Although the recognition of workers' perceived
data were collected from diverse types of workers in terms of trade, risk levels may not help identify all potential hazards at construction
field experience, age, etc., to extend the generalizability of the results. sites, it would be useful for identifying immediate and substantial haz-
The demographic variables of subjects did not show any significant re- ards encountered by workers during work. Safety managers will be able
lationship with the proportion of high-risk activities and the patterns of to localize hazardous activities by integrating workers' perceived risk
physiological signals, implying that the demographic characteristics of levels and location information. This will help the safety managers to
each participant may not reduce the significance of the results of this determine the priority of on-site safety supervision in large construction
study. However, since workers' personal characteristics other than the sites. Furthermore, the integration of workers' perceived risk levels with
demographic characteristics (e.g., psychological and physiological other information, such as location, types of activities, age, and gender,
traits) can induce individual variability in their physiological responses will be helpful for characterizing various hazards in construction pro-
to a perceived risk, it is important for future studies to apply advanced jects.
transfer learning algorithms to computationally buffer individual dif-
ferences in physiological responses, thereby improving the generaliz- CREdiT author statement
ability of the model. Finally, the labeling methods applied in this study
may be limited in fully measuring a worker's subjective assessment of Gaang Lee: Formal analysis, Writing-Original draft preparation,
risk at each moment. It is possible that a worker may not show signifi- Byungjoo Choi: Conceptualization, Data curation, Writing-Original
cant changes in the patterns of physiological signals in high-risk activi- draft preparation, Houtan Jebelli: Data curation, Writing-Reviewing
ties if he/she is used to working in high-risk situations. Surveys or inter- and Editing, SangHyun Lee: Conceptualization, Supervision, Writing-
views regarding a worker's subjective assessment of the risk levels of Reviewing and Editing.
his/her activities can be a data collection method to study the effects of
adaptation on perceived risk. However, it is impractical to record each Declaration of competing interest
worker's subjective assessment of the risk level at every second. Addi-
tionally, a subjective assessment of the risks may not be capable of cap- The authors declare that they have no known competing financial
turing the response of System 1 (i.e., immediate and automatic re- interests or personal relationships that could have appeared to influ-
sponse), which is the main focus of this study. Furthermore, a self- ence the work reported in this paper.
reported data collection method may be vulnerable to various biases
such as courtesy bias, demand characteristics, and social desirability Acknowledgement
bias. The ultimate goal of this study is to identify the risk levels that
each worker experiences using physiological signals acquired from This work was supported by the National Research Foundation of
wearable biosensors. This study applied the concept of perceived risk to Korea (NRF) grant funded by the Korea government (MSIT) (No.
link the physiological signals and the risk levels of the activities. In this 2020R1G1A1004797). The authors wish to thank their industry part-
sense, this study focuses more on labeling the risk levels of worker ac- ners for their help in data collection, as well as anonymous participants
tivities by a third party rather than asking the workers for their subjec- who participated in the data collection.
tive assessment of the risk levels. The study employed two independent
construction experts to assess the risk levels of the activities to acquire References
more reliable data labels. The results of the calculation to determine in-
[1] C.-S. Park, H.-J. Kim, A framework for construction safety management and
ter-rater reliability indicate that there is a substantial agreement be-
visualization system, Autom. ConStruct. 33 (2013) 95–103, https://doi.org/10.
tween the two team members' risk assessment. Therefore, the labeling 1016/j.autcon.2012.09.012.
process in this study is a viable approach to achieving the research ob- [2] H. Yang, D. a. S. Chew, W. Wu, Z. Zhou, Q. Li, Design and implementation of an
jective. The results of the developed model also show the potential of identification system in construction site safety for proactive accident prevention,
Accid. Anal. Prev. 48 (2012) 193–203, https://doi.org/10.1016/j.aap.2011.06.
wearable biosensors in identifying the risk levels of construction worker 017.
activities during their ongoing work. [3] Occupational Safety and Health Administration (OSHA), Construction’s Fatal Four,
Department of Labor, 2020 https://www.osha.gov/data/commonstats. (Accessed
10 August 2020).
7. Conclusion [4] Us Bureau of Labor Statistics, National Census of Fatal Occupational Injuries in
2018, US Department of Labor, 2019 https://www.bls.gov/news.release/pdf/cfoi.
In this study, the objective was to develop an automatic method for pdf. (Accessed 10 August 2020).
[5] US Census Bureau, Department of Labor, 2019 Employment by major industry
recognizing construction workers’ perceived risk levels by using physi-
https://www.bls.gov/emp/tables/employment-by-major-industry-sector.htm.

9
B.G. Lee et al. Journal of Building Engineering 42 (2021) 102824

(Accessed 10 August 2020). estimating construction safety through mental workload assessment, Autom.
[6] Korean Statistical Information Service (KOSIS), Number and rate of occupational ConStruct. 63 (2016) 173–183, https://doi.org/10.1016/j.autcon.2015.12.018.
incidents by industry, Ministry of Employment and Labor, 2020 http://kosis.kr/ [35] S. Hasanzadeh, B. Esmaeili, M.D. Dodd, Examining the relationship between
statHtml/statHtml.do?orgId=118&tblId=DT_11806_N000&conn_path=I3. construction workers’ visual attention and situation awareness under fall and
(Accessed 10 August 2020). tripping hazard conditions: using mobile eye tracking, J. Construct. Eng. Manag.
[7] A. Pousette, M. Törner, Effects of systematic work preparation meetings on safety 144 (7) (2018) 04018060, https://doi.org/10.1061/(ASCE)CO.1943-7862.
climate and psychosocial conditions in the construction industry, Construct. 0001516.
Manag. Econ. 34 (6) (2016) 355–365, https://doi.org/10.1080/01446193.2016. [36] A. Albert, M.R. Hallowell, B.M. Kleiner, Experimental field testing of a real-time
1189584. construction hazard identification and transmission technique, Construct. Manag.
[8] M. Grill, A. Pousette, K. Nielsen, R. Grytnes, M. Törner, Safety leadership at Econ. 32 (10) (2014) 1000–1016, https://doi.org/10.1080/01446193.2014.
construction sites: the importance of rule-oriented and participative leadership, 929721.
Scand. J. Work. Environ. Health (4) (2017) 375–384, https://doi.org/10.5271/ [37] B. Choi, S. Lee, An empirically based agent-based model of the sociocognitive
sjweh.3650. process of construction workers’ safety behavior, J. Construct. Eng. Manag. 144 (2)
[9] Y. Chen, B. Mccabe, D. Hyatt, Impact of individual resilience and safety climate on (2017) 04017102, https://doi.org/10.1061/(ASCE)CO.1943-7862.0001421.
safety performance and psychological stress of construction workers: a case study [38] J. Lu, X. Xie, R. Zhang, Focusing on appraisals: how and why anger and fear
of the ontario construction industry, J. Saf. Res. 61 (2017) 167–176, https://doi. influence driving risk perception, J. Saf. Res. 45 (2013) 65–73, https://doi.org/10.
org/10.1016/j.jsr.2017.02.014. 1016/j.jsr.2013.01.009.
[10] Z. Zhou, Y.M. Goh, Q. Li, Overview and analysis of safety management studies in [39] E.L. Harbeck, A.I. Glendon, Driver prototypes and behavioral willingness: young
the construction industry, Saf. Sci. 72 (2015) 337–350, https://doi.org/10.1016/j. driver risk perception and reported engagement in risky driving, J. Saf. Res. 66
ssci.2014.10.006. (2018) 195–204, https://doi.org/10.1016/j.jsr.2018.07.009.
[11] B. Shao, Z. Hu, Q. Liu, S. Chen, W. He, Fatal accident patterns of building [40] M. Cristea, P. Delhomme, The effects of co-presence on risk perception and
construction activities in China, Saf. Sci. 111 (2019) 253–263, https://doi.org/10. intention to engage in risky behaviors, J. Saf. Res. 56 (2016) 97–103, https://doi.
1016/j.ssci.2018.07.019. org/10.1016/j.jsr.2015.12.006.
[12] R.W. Allison, C.K.H. Hon, B. Xia, Construction accidents in Australia: evaluating [41] D. Herrero-Fernández, P. Macía-Guerrero, L. Silvano-Chaparro, L. Merino, E.C.
the true costs, Saf. Sci. 120 (2019) 886–896, https://doi.org/10.1016/j.ssci.2019. Jenchura, Risky behavior in young adult pedestrians: personality determinants,
07.037. correlates with risk perception, and gender differences, Transport. Res. F Traffic
[13] S. Baradan, S.U. Dikmen, O. Akboga Kale, Impact of human development on safety Psychol. Behav. 36 (2016) 14–24, https://doi.org/10.1016/j.trf.2015.11.007.
consciousness in construction, Int. J. Occup. Saf. Ergon. 25 (1) (2019) 40–50, [42] M. Ji, X. You, J. Lan, S. Yang, The impact of risk tolerance, risk perception and
https://doi.org/10.1080/10803548.2018.1445069. hazardous attitude on safety operation among airline pilots in China, Saf. Sci. 49
[14] J. Mullen, Investigating factors that influence individual safety behavior at work, (10) (2011) 1412–1420, https://doi.org/10.1016/j.ssci.2011.06.007.
J. Saf. Res. 35 (3) (2004) 275–285, https://doi.org/10.1016/j.jsr.2004.03.011. [43] J.K. Riad, F.H. Norris, R.B. Ruback, Predicting evacuation in two major disasters:
[15] J.W. Garrett, J. Teizer, Human factors analysis classification system relating to risk perception, social influence, and access to resources 1, J. Appl. Soc. Psychol.
human error awareness taxonomy in construction safety, J. Construct. Eng. Manag. 29 (5) (1999) 918–934, https://doi.org/10.1111/j.1559-1816.1999.tb00132.x.
135 (8) (2009) 754–763, https://doi.org/10.1061/(ASCE)CO.1943-7862. [44] M. Choi, M. Park, H.-S. Lee, S. Hwang, K. Anderson, S. Lee, 2016. Understanding
0000034. the role of dynamic risk perception during fire evacuations using agent-based
[16] A. Perlman, R. Sacks, R. Barak, Hazard recognition and risk perception in modeling, Construction research congress (2016) 1669–1679, https://doi.org/10.
construction, Saf. Sci. 64 (2014) 22–31, https://doi.org/10.1016/j.ssci.2013.11. 1061/9780784479827.167.
019. [45] A. Oliver, A. Cheyne, J.M. Tomás, S. Cox, The effects of organizational and
[17] H.W. Heinrich, D. Petersen, N. Roos, Industrial Accident Prevention, McGraw-Hill, individual factors on occupational accidents, J. Occup. Organ. Psychol. 75 (4)
New York, 9780070280588, 1959. (2002) 473–488, https://doi.org/10.1348/096317902321119691.
[18] R.A. Haslam, S.A. Hide, A.G.F. Gibb, D.E. Gyi, T. Pavitt, S. Atkinson, A.R. Duff, [46] D.P. Gilkey, C.L.D. Puerto, T. Keefe, P. Bigelow, R. Herron, J. Rosecrance, P. Chen,
Contributing factors in construction accidents, Appl. Ergon. 36 (4) (2005) Comparative analysis of safety culture perceptions among homesafe managers and
401–415, https://doi.org/10.1016/j.apergo.2004.12.002. workers in residential construction, J. Construct. Eng. Manag. 138 (9) (2012)
[19] A. Suraji, A.R. Duff, S.J. Peckitt, Development of causal model of construction 1044–1052, https://doi.org/10.1061/(ASCE)CO.1943-7862.0000519.
accident causation, J. Construct. Eng. Manag. 127 (4) (2001) 337–344 (2001)127: [47] D.A. Patel, K.N. Jha, Neural network model for the prediction of safe work
4(337), https://doi.org/10.1061/(ASCE)0733-9364. behavior in construction projects, J. Construct. Eng. Manag. 141 (1) (2015)
[20] J. Wang, P.X.W. Zou, P.P. Li, Critical factors and paths influencing construction 04014066, https://doi.org/10.1061/(ASCE)CO.1943-7862.0000922.
workers’ safety risk tolerances, Accid. Anal. Prev. 93 (2016) 267–279, https://doi. [48] M. Namian, A. Albert, C.M. Zuluaga, M. Behm, Role of safety training: impact on
org/10.1016/j.aap.2015.11.027. hazard recognition and safety risk perception, J. Construct. Eng. Manag. 142 (12)
[21] T. Aven, On how to define, understand and describe risk, Reliab. Eng. Syst. Saf. 95 (2016) 04016073, https://doi.org/10.1061/(ASCE)CO.1943-7862.0001198.
(6) (2010) 623–631, https://doi.org/10.1016/j.ress.2010.01.011. [49] Y. Feng, P. Wu, G. Ye, D. Zhao, Risk-compensation behaviors on construction sites:
[22] I. Rodríguez-Garzón, V. Lucas-Ruiz, M. Martínez-Fiestas, A. Delgado-Padial, demographic and psychological determinants, J. Manag. Eng. 33 (4) (2017)
Association between perceived risk and training in the construction industry, J. 04017008, https://doi.org/10.1061/(ASCE)ME.1943-5479.0000520.
Construct. Eng. Manag. 141 (5) (2014) 04014095, https://doi.org/10.1061/ [50] M. Namian, A. Albert, J. Feng, Effect of distraction on hazard recognition and
(ASCE)CO.1943-7862.0000960. safety risk perception, J. Construct. Eng. Manag. 144 (4) (2018) http://ascelibrary.
[23] D.M. Dejoy, Behavior change versus culture change: divergent approaches to org/doi/10.1061/%28ASCE%29CO.1943-7862.0001263 04018008.
managing workplace safety, Saf. Sci. 43 (2) (2005) 105–129, https://doi.org/10. [51] S. Chaiken, Y. Trope, Dual-process Theories in Social Psychology, Guilford Press, 1-
1016/j.ssci.2005.02.001. 57230-421-9, 1999.
[24] H. Guo, Y. Yu, T. Xiang, H. Li, D. Zhang, The availability of wearable-device-based [52] K.E. Stanovich, R.F. West, Individual differences in reasoning: implications for the
physical data for the measurement of construction workers’ psychological status rationality debate?, Behav. Brain Sci. 23 (5) (2001) 645–665, https://doi.org/10.
on site: from the perspective of safety management, Automation in Construction, 1017/S0140525X0028343X.
2017, https://doi.org/10.1016/j.autcon.2017.06.001. [53] J.S.B.T. Evans, In two minds: dual-process accounts of reasoning, Trends Cognit.
[25] D. Wang, J. Chen, D. Zhao, F. Dai, C. Zheng, X. Wu, Monitoring workers’ attention Sci. 7 (10) (2003) 454–459, https://doi.org/10.1016/j.tics.2003.08.012.
and vigilance in construction activities through a wireless and wearable [54] E.R. Smith, J. Decoster, Dual-process models in social and cognitive psychology:
electroencephalography system, Autom. ConStruct. 82 (2017) 122–137, https:// conceptual integration and links to underlying memory systems, Pers. Soc.
doi.org/10.1016/j.autcon.2017.02.001. Psychol. Rev. 4 (2) (2000) 108–131, https://doi.org/10.1207/
[26] B. Choi, H. Jebelli, S. Lee, Feasibility analysis of electrodermal activity (EDA) S15327957PSPR0402_01.
acquired from wearable sensors to assess construction workers’ perceived risk, Saf. [55] J.S.B.T. Evans, Dual-processing accounts of reasoning, judgment, and social
Sci. 115 (2019) 110–120, https://doi.org/10.1016/j.ssci.2019.01.022. cognition, Annu. Rev. Psychol. 59 (1) (2008) 255–278, https://doi.org/10.1146/
[27] T. Rundmo, Safety climate, attitudes and risk perception in norsk hydro, Saf. Sci. annurev.psych.59.103006.093629.
34 (1) (2000) 47–59, https://doi.org/10.1016/S0925-7535(00)00006-0. [56] D. Kahneman, Thinking, Fast and Slow, Macmillan, 9780374275631, 2011.
[28] I.W.H. Fung, V.W.Y. Tam, T.Y. Lo, L.L.H. Lu, Developing a risk assessment model [57] R. Larson, M. Csikszentmihalyi, The Experience Sampling Method. Flow and the
for construction safety, Int. J. Proj. Manag. 28 (6) (2010) 593–600, https://doi. Foundations of Positive Psychology, Springer, 2014, pp. 21–34, https://doi.org/
org/10.1016/j.ijproman.2009.09.006. 10.1007/978-94-017-9088-8_2.
[29] M. Hallowell, Safety risk perception in construction companies in the pacific [58] R.O. Phillips, A. Fyhri, F. Sagberg, Risk compensation and bicycle helmets, Risk
northwest of the USA, Construct. Manag. Econ. 28 (4) (2010) 403–413, https:// Anal. 31 (8) (2011) 1187–1195, https://doi.org/10.1111/j.1539-6924.2011.
doi.org/10.1080/01446191003587752. 01589.x.
[30] J. Covan, Safety Engineering, John Wiley & Sons, 0-471-55612-2, 1995. [59] M. Schmidt-Daffy, Velocity versus safety: impact of goal conflict and task difficulty
[31] A. Tixier, M. Hallowell, A. Albert, L. Van Boven, B. Kleiner, Psychological on drivers’ behaviour, feelings of anxiety, and electrodermal responses, Transport.
antecedents of risk-taking behavior in construction, J. Construct. Eng. Manag. 140 Res. F Traffic Psychol. Behav. 15 (3) (2012) 319–332, https://doi.org/10.1016/j.
(11) (2014) 04014052, https://doi.org/10.1061/(ASCE)CO.1943-7862.0000894. trf.2012.02.004.
[32] C.D. Wickens, Engineering Psychology and Human Performance Merrill, 1984 [60] C. Dettmers, D. Fatepour, H. Faust, F. Jerusalem, Sympathetic skin response
Columbus. (ISBN: 1317351320, 9781317351320). abnormalities in amyotrophic lateral sclerosis, Muscle Nerve 16 (9) (1993)
[33] M.R. Endsley, Toward a theory of situation awareness in dynamic systems, Hum. 930–934, https://doi.org/10.1002/mus.880160907.
Factors 37 (1) (1995) 32–64, https://doi.org/10.1518/001872095779049543. [61] M. Nitzan, A. Babchenko, B. Khanokh, D. Landau, The variability of the
[34] J. Chen, X. Song, Z. Lin, Revealing the “invisible gorilla” in construction: photoplethysmographic signal - a potential method for the evaluation of the

10
B.G. Lee et al. Journal of Building Engineering 42 (2021) 102824

autonomic nervous system, Physiol. Meas. 19 (1) (1998) 93–102, https://doi.org/ workers using physiological measurements, Autom. ConStruct. 82 (2017) (2017)
10.1088/0967-3334/19/1/008. 154–165, https://doi.org/10.1016/j.autcon.2017.03.003.
[62] K. Budidha, P.A. Kyriacou, Photoplethysmography for quantitative assessment of [86] W. Harris, R.J. Wagnon, The effects of chiropractic adjustments on distal skin
sympathetic nerve activity (sna) during cold stress, Front. Physiol. 9 (2019) 1863- temperature, J. Manipulative Physiol. Therapeut. 10 (2) (1987) 57–60.
1863, https://doi.org/10.3389/fphys.2018.01863. [87] K.H. Kim, S.W. Bang, S.R. Kim, Emotion recognition system using short-term
[63] D. Crundall, P. Chapman, N. Phelps, G. Underwood, Eye movements and hazard monitoring of physiological signals, Med. Biol. Eng. Comput. 42 (3) (2004)
perception in police pursuit and emergency response driving, J. Exp. Psychol. 419–427, https://doi.org/10.1007/BF02344719.
Appl. 9 (3) (2003) 163–174, https://doi.org/10.1037/1076-898X.9.3.163. [88] D. Dias, J. Paulo Silva Cunha, Wearable health devices-vital sign monitoring,
[64] Y. Ba, W. Zhang, A.H.S. Chan, T. Zhang, A.S.K. Cheng, How drivers fail to avoid systems and technologies, Sensors 18 (8) (2018) 2414, https://doi.org/10.3390/
crashes: a risk-homeostasis/perception-response (rh/pr) framework evidenced by s18082414.
visual perception, electrodermal activity and behavioral responses, Transport. Res. [89] C.R. Ahn, S. Lee, C. Sun, H. Jebelli, K. Yang, B. Choi, Wearable sensing technology
F Traffic Psychol. Behav. 43 (2016) 24–35, https://doi.org/10.1016/j.trf.2016.09. applications in construction safety and health, J. Construct. Eng. Manag. 145 (11)
025. (2019) 03119007, https://doi.org/10.1061/(ASCE)CO.1943-7862.0001708.
[65] H. Jebelli, B. Choi, S. Lee, Application of wearable biosensors to construction sites. [90] W. Ritter, Measuring Psychophysiological Signals in Every-Day Situations, 2019,
I: assessing workers’ stress, J. Construct. Eng. Manag. 145 (12) (2019) 04019079, pp. 720–728 Berlin, Heidelberg, https://doi.org/10.1007/978-3-642-02710-9_80.
https://doi.org/10.1061/(ASCE)CO.1943-7862.0001729. [91] I. Awolusi, E. Marks, M. Hallowell, Wearable technology for personalized
[66] M. Benedek, C. Kaernbach, A continuous measure of phasic electrodermal activity, construction safety monitoring and trending: Review of applicable devices, Autom.
J. Neurosci. Methods 190 (1) (2010) 80–91, https://doi.org/10.1016/j.jneumeth. ConStruct. 85 (2018) 96–106, https://doi.org/10.1016/j.autcon.2017.10.010.
2010.04.028. [92] J. Chen, J. Qiu, C. Ahn, Construction worker’s awkward posture recognition
[67] W. Kennedy, G. Wendelschafer-Crabb, T. Brelje, Innervation and vasculature of through supervised motion tensor decomposition, Autom. ConStruct. 77 (2017)
human sweat glands: an immunohistochemistry-laser scanning confocal 67–81, https://doi.org/10.1016/j.autcon.2017.01.020.
fluorescence microscopy study, J. Neurosci. 14 (11) (1994) 6825–6833, https:// [93] M.F. Antwi-Afari, H. Li, Y. Yu, L. Kong, Wearable insole pressure system for
doi.org/10.1523/JNEUROSCI.14-11-06825.1994. automated detection and classification of awkward working postures in
[68] T. Nishiyama, J. Sugenoya, T. Matsumoto, S. Iwase, T. Mano, Irregular activation construction workers, Autom. ConStruct. 96 (2018) 433–441, https://doi.org/10.
of individual sweat glands in human sole observed by a videomicroscopy, Auton. 1016/j.autcon.2018.10.004.
Neurosci. 88 (1) (2001) 117–126, https://doi.org/10.1016/S1566-0702(01) [94] W. Umer, H. Li, W. Lu, G.P.Y. Szeto, A.Y.L. Wong, Development of a tool to
00229-6. monitor static balance of construction workers for proactive fall safety
[69] B. Studer, L. Clark, Place your bets: psychophysiological correlates of decision- management, Autom. ConStruct. 94 (2018) 438–448, https://doi.org/10.1016/j.
making under risk, Cognit. Affect Behav. Neurosci. 11 (2) (2011) 144–158, autcon.2018.07.024.
https://doi.org/10.3758/s13415-011-0025-2. [95] H. Chen, X. Luo, Z. Zheng, J. Ke, A proactive workers’ safety risk evaluation
[70] M.P. Jones, P. Chapman, K. Bailey, The influence of image valence on visual framework based on position and posture data fusion, Autom. ConStruct. 98
attention and perception of risk in drivers, Accid. Anal. Prev. 73 (2014) 296–304, (2019) 275–288, https://doi.org/10.1016/j.autcon.2018.11.026.
https://doi.org/10.1016/j.aap.2014.09.019. [96] X. Li, S. Han, M. Gül, M. Al-Hussein, Automated post-3d visualization ergonomic
[71] M. Tagliabue, M. Sarlo, Affective components in training to ride safely using a analysis system for rapid workplace design in modular construction, Autom.
moped simulator, Transport. Res. F Traffic Psychol. Behav. 35 (2015) 132–138, ConStruct. 98 (2019) 160–174, https://doi.org/10.1016/j.autcon.2018.11.012.
https://doi.org/10.1016/j.trf.2015.10.018. [97] L. Zhang, M.M. Diraneyya, J. Ryu, C.T. Haas, E.M. Abdel-Rahman, Jerk as an
[72] G. Lee, B. Choi, H. Jebelli, C.R. Ahn, S. Lee, Wearable biosensor and collective indicator of physical exertion and fatigue, Autom. ConStruct. 104 (2019) 120–128,
sensing-based approach for detecting older adults’ environmental barriers, J. https://doi.org/10.1016/j.autcon.2019.04.016.
Comput. Civ. Eng. 34 (2) (2020) 04020002, https://doi.org/10.1061/(ASCE)CP. [98] A.A. Akanmu, J. Olayiwola, O. Ogunseiju, D. Mcfeeters, Cyber-physical postural
1943-5487.0000879. training system for construction workers, Autom. ConStruct. 117 (2020) 103272,
[73] A. Greco, G. Valenza, A. Lanata, E.P. Scilingo, L. Citi, Cvxeda: a convex https://doi.org/10.1016/j.autcon.2020.103272.
optimization approach to electrodermal activity processing, IEEE (Inst. Electr. [99] K. Kim, Y.K. Cho, Effective inertial sensor quantity and locations on a body for
Electron. Eng.) Trans. Biomed. Eng. 63 (4) (2016) 797–804, https://doi.org/10. deep learning-based worker’s motion recognition, Autom. ConStruct. 113 (2020)
1109/TBME.2015.2474131. 103126, https://doi.org/10.1016/j.autcon.2020.103126.
[74] G. Lee, B. Choi, C.R. Ahn, S. Lee, Wearable biosensor and hotspot analysis-based [100] K. Yang, C.R. Ahn, M.C. Vuran, S.S. Aria, Semi-supervised near-miss fall detection
framework to detect stress hotspots for advancing elderly’s mobility, J. Manag. for ironworkers with a wearable inertial measurement unit, Autom. ConStruct. 68
Eng. 36 (3) (2020) 04020010, https://doi.org/10.1061/(ASCE)ME.1943-5479. (2016) 194–202, https://doi.org/10.1016/j.autcon.2016.04.007.
0000753. [101] H. Kim, C.R. Ahn, T.L. Stentz, H. Jebelli, Assessing the effects of slippery steel
[75] J. Allen, Photoplethysmography and its application in clinical physiological beam coatings to ironworkers’ gait stability, Appl. Ergon. 68 (2018) 72–79,
measurement, Physiol. Meas. 28 (3) (2007) R1–R39, https://doi.org/10.1088/ https://doi.org/10.1016/j.apergo.2017.11.003.
0967-3334/28/3/R01. [102] M.F. Antwi-Afari, H. Li, S. Anwer, S.K. Yevu, Z. Wu, P. Antwi-Afari, I. Kim,
[76] S. Arberet, M. Lemay, P. Renevey, J. Solà, O. Grossenbacher, D. Andries, C. Sartori, Quantifying workers’ gait patterns to identify safety hazards in construction using
M. Bertschi, Photoplethysmography-based ambulatory heartbeat monitoring a wearable insole pressure system, Saf. Sci. 129 (2020) 104855, https://doi.org/
embedded into a dedicated bracelet, Proceedings of the Computing in Cardiology 10.1016/j.ssci.2020.104855.
2013, 978-1-4799-0886-8, 2013, pp. 935–938. [103] Y. Yu, H. Li, W. Umer, C. Dong, X. Yang, M. Skitmore, Y.L. Wong Arnold,
[77] T. Tamura, Y. Maeda, M. Sekine, M. Yoshida, Wearable photoplethysmographic Automatic biomechanical workload estimation for construction workers by
sensors—past and present, Electronics 3 (2) (2014) 282–302, https://doi.org/10. computer vision and smart insoles, J. Comput. Civ. Eng. 33 (3) (2019) 04019010,
3390/electronics3020282. https://doi.org/10.1061/(ASCE)CP.1943-5487.0000827.
[78] S. Hwang, J. Seo, H. Jebelli, S. Lee, Feasibility analysis of heart rate monitoring of [104] H. Li, D. Wang, J. Chen, X. Luo, J. Li, X. Xing, Pre-service fatigue screening for
construction workers using a photoplethysmography (PPG) sensor embedded in a construction workers through wearable eeg-based signal spectral analysis, Autom.
wristband-type activity tracker, Autom. ConStruct. 71 (2016) 372–381, https:// ConStruct. 106 (2019) 102851, https://doi.org/10.1016/j.autcon.2019.102851.
doi.org/10.1016/j.autcon.2016.08.029. [105] X. Xing, H. Li, J. Li, B. Zhong, H. Luo, M. Skitmore, A multicomponent and
[79] S. Hwang, S. Lee, Wristband-type wearable health devices to measure construction neurophysiological intervention for the emotional and mental states of high-
workers’ physical demands, Autom. ConStruct. 83 (2017) 330–340, https://doi. altitude construction workers, Autom. ConStruct. 105 (2019) 102836, https://doi.
org/10.1016/j.autcon.2017.06.003. org/10.1016/j.autcon.2019.102836.
[80] J. Mesken, M.P. Hagenzieker, T. Rothengatter, D. De Waard, Frequency, [106] J. Li, H. Li, W. Umer, H. Wang, X. Xing, S. Zhao, J. Hou, Identification and
determinants, and consequences of different drivers’ emotions: an on-the-road classification of construction equipment operators’ mental fatigue using wearable
study using self-reports, (observed) behaviour, and physiology, Transport. Res. F eye-tracking technology, Autom. ConStruct. 109 (2020) 103000, https://doi.org/
Traffic Psychol. Behav. 10 (6) (2007) 458–475, https://doi.org/10.1016/j.trf. 10.1016/j.autcon.2019.103000.
2007.05.001. [107] D. Wang, H. Li, J. Chen, Detecting and measuring construction workers’ vigilance
[81] B.J. Powers, E.Z. Oddone, J.M. Grubber, M.K. Olsen, H.B. Bosworth, Perceived and through hybrid kinematic-EEG signals, Autom. ConStruct. 100 (2019) 11–23,
actual stroke risk among men with hypertension, J. Clin. Hypertens. 10 (4) (2008) https://doi.org/10.1016/j.autcon.2018.12.018.
287–294, https://doi.org/10.1111/j.1751-7176.2008.07797.x. [108] S. Hasanzadeh, B. Dao, B. Esmaeili, M.D. Dodd, Role of personality in construction
[82] E. Rubaltelli, S. Scrimin, U. Moscardino, G. Priolo, G. Buodo, Media exposure to safety: investigating the relationships between personality, attentional failure, and
terrorism and people’s risk perception: the role of environmental sensitivity and hazard identification under fall-hazard conditions, J. Construct. Eng. Manag. 145
psychophysiological response to stress, Br. J. Psychol. 109 (4) (2018) 656–673, (9) (2019) 04019052, https://doi.org/10.1061/(ASCE)CO.1943-7862.0001673.
https://doi.org/10.1111/bjop.12292. [109] K.T. Sweeney, T.E. Ward, S.F. Mcloone, Artifact removal in physiological
[83] J. Zhou, X. Jia, G. Xu, J. Jia, R. Hai, C. Gao, S. Zhang, The relationship between signals—practices and possibilities, IEEE Trans. Inf. Technol. Biomed. 16 (3)
different types of alarm sounds and children’s perceived risk based on their (2012) 488–500, https://doi.org/10.1109/TITB.2012.2188536.
physiological responses, Int. J. Environ. Res. Publ. Health 16 (24) (2019) 5091, [110] H. Jebelli, S. Hwang, S. Lee, EEG-based workers’ stress recognition at construction
https://doi.org/10.3390/ijerph16245091. sites, Autom. ConStruct. 93 (2018) 315–324, https://doi.org/10.1016/j.autcon.
[84] M. Garbey, N. Sun, A. Merla, I. Pavlidis, Contact-free measurement of cardiac pulse 2018.05.027.
based on the analysis of thermal imagery, IEEE (Inst. Electr. Electron. Eng.) Trans. [111] I.-V. Bornoiu, O. Grigore, A study about feature extraction for stress detection,
Biomed. Eng. 54 (8) (2007) 1418–1426, https://doi.org/10.1109/TBME.2007. Proceedings of the Advanced Topics in Electrical Engineering (ATEE), 2013 8th
891930. International Symposium on, 978-1-4673-5980-1, 2013, pp. 1–4.
[85] A. Aryal, A. Ghahramani, B. Becerik-Gerber, Monitoring fatigue in construction [112] A. Caizzone, A. Boukhayma, C. Enz, Comprehensive noise analysis in ppg read-out

11
B.G. Lee et al. Journal of Building Engineering 42 (2021) 102824

chains, Proceedings of the Noise and Fluctuations (ICNF), 2017 International mental stress detection using physiological sensors, Proceedings of the
Conference on, 978-1-5090-2760-6, 2017, pp. 1–4. International Conference on Mobile Computing, Applications, and Services, 2010,
[113] W. Boucsein, Electrodermal Activity, Springer Science & Business Media, 978-1- pp. 282–301, https://doi.org/10.1007/978-3-642-29336-8_16.
4614-1125-3, 2012. [125] P. Karthikeyan, M. Murugappan, S. Yaacob, Multiple physiological signal-based
[114] M. Benedek, C. Kaernbach, Decomposition of skin conductance data by means of human stress identification using non-linear classifiers, Elektronika ir
nonnegative deconvolution, Psychophysiology 47 (4) (2010) 647–658, https:// elektrotechnika 19 (7) (2013) 80–86, https://doi.org/10.5755/j01.eee.19.7.2232.
doi.org/10.1111/j.1469-8986.2009.00972.x. [126] C.M. Bishop, Pattern Recognition and Machine Learning Springer, 978-0-387-
[115] G. Hawkes, J. Houghton, G. Rowe, Risk and worry in everyday life: comparing 31073-2, 2006.
diaries and interviews as tools in risk perception research, Health Risk Soc. 11 (3) [127] C. Setz, B. Arnrich, J. Schumm, R. La Marca, G. Tröster, U. Ehlert, Discriminating
(2009) 209–230, https://doi.org/10.1080/13698570902906439. stress from cognitive load using a wearable eda device, IEEE Trans. Inf. Technol.
[116] J. Choi, B. Ahmed, R. Gutierrez-Osuna, Development and evaluation of an Biomed. 14 (2) (2010) 410–417, https://doi.org/10.1109/TITB.2009.2036164.
ambulatory stress monitor based on wearable sensors, IEEE Trans. Inf. Technol. [128] J.P. Donate, G.G. Sanchez, A.S. De Miguel, Time series forecasting. A comparative
Biomed. 16 (2) (2012) 279–286, https://doi.org/10.1109/TITB.2011.2169804. study between an evolving artificial neural networks system and statistical
[117] R.R. Singh, S. Conjeti, R. Banerjee, Assessment of driver stress from physiological methods, Int. J. Artif. Intell. Tool. 21 (2012) 01 1250010, https://doi.org/10.
signals collected under real-time semi-urban driving scenarios, Int. J. Comput. 1142/S0218213011000462.
Intell. Syst. 7 (5) (2014) 909–923, https://doi.org/10.1080/18756891.2013. [129] I. Mozetič, L. Torgo, V. Cerqueira, J. Smailović, How to evaluate sentiment
864478. classifiers for twitter time-ordered data?, PloS One 13 (3) (2018), https://doi.org/
[118] R. Zangróniz, A. Martínez-Rodrigo, J.M. Pastor, M.T. López, A. Fernández- 10.1371/journal.pone.0194317.
Caballero, Electrodermal activity sensor for classification of calm/distress [130] M. Süzen, A. Yegenoglu, Generalised Learning of Time-Series: Ornstein-Uhlenbeck
condition, Sensors 17 (10) (2017) 2324, https://doi.org/10.3390/s17102324. Processes, 2019 arXiv preprint arXiv:1910.09394 https://arxiv.org/abs/1910.
[119] B. Xue, M. Zhang, W.N. Browne, Particle swarm optimization for feature selection 09394.
in classification: a multi-objective approach, IEEE transactions on cybernetics 43 [131] S. Coniglio, A.J. Dunn, A.B. Zemkoho, Infrequent Adverse Event Prediction in Low
(6) (2012) 1656–1671, https://doi.org/10.1109/TSMCB.2012.2227469. Carbon Energy Production Using Machine Learning, 2020 arXiv preprint arXiv:
[120] J. Too, A.R. Abdullah, N. Mohd Saad, W. Tee, EMG feature selection and 2001.06916 https://arxiv.org/abs/2001.06916.
classification using a pbest-guide binary particle swarm optimization, [132] H. Jebelli, B. Choi, S. Lee, Application of wearable biosensors to construction sites.
Computation 7 (1) (2019) 12, https://doi.org/10.3390/computation7010012. II: assessing workers’ physical demand, J. Construct. Eng. Manag. 145 (12) (2019)
[121] S. Das, Filters, wrappers and a boosting-based hybrid for feature selection, 04019080, https://doi.org/10.1061/(ASCE)CO.1943-7862.0001710.
Proceedings of 18th International conference of on Machine learning (2001) 74–81 [133] C. Bergmeir, J.M. Benítez, On the use of cross-validation for time series predictor
https://dl.acm.org/doi/10.5555/645530.658297. evaluation, Inf. Sci. 191 (2012) 192–213, https://doi.org/10.1016/j.ins.2011.12.
[122] H. Akbari, M.T. Sadiq, M. Payan, S.S. Esmaili, H. Baghri, H. Bagheri, Depression 028.
detection based on geometrical features extracted from SODP shape of EEG signals [134] O. Banos, J.-M. Galvez, M. Damas, H. Pomares, I. Rojas, Window size impact in
and binary PSO, Trait. Du. Signal 38 (1) (2020) 13–26. human activity recognition, Sensors 14 (4) (2014) 6474–6499, https://doi.org/10.
[123] F.-T. Sun, C. Kuo, H.-T. Cheng, S. Buthpitiya, P. Collins, M. Griss, Activity-aware 3390/s140406474.
mental stress detection using physiological sensors, Proceedings of the [135] C.H. Vinkers, R. Penning, J. Hellhammer, J.C. Verster, J.H. Klaessens, B. Olivier, C.
International Conference on Mobile Computing, Applications, and Services, 2010, J. Kalkman, The effect of stress on core and peripheral body temperature in
pp. 282–301, https://doi.org/10.1007/978-3-642-29336-8_12. humans, Stress 16 (5) (2013) 520–530, https://doi.org/10.3109/10253890.2013.
[124] F.-T. Sun, C. Kuo, H.-T. Cheng, S. Buthpitiya, P. Collins, M. Griss, Activity-aware 807243.

12

You might also like