Professional Documents
Culture Documents
Dipartimento di Ingegneria Industriale e dellInformazione, Universit di Pavia, via Ferrata 3, 27100 Pavia, Italy
Fraunhofer FIRST, Kekulestr. 7, 12489 Berlin, Germany
a r t i c l e
i n f o
Article history:
Available online 28 June 2013
Keywords:
Embedded systems
Automotive
Pervasive adaptive systems
Postural comfort
a b s t r a c t
REFLECT project aimed at developing new concepts and means for pervasive-adaptive systems. The
reective approach puts together different know-hows in affective and physiological computing, software engineering, physics and pragmatic expertise into a unique endeavour to design and develop usercentric systems that control the specic environment and react relative to users emotional, cognitive and
physical situation. REFLECTs core philosophy is to mimic the natural process of adaptation by implementing a biocybernetic loop that senses, diagnoses and analyses the user situation in a concrete settings
and reacts accordingly. To show how these concepts have been put into practice, the document describes
in detail how the seat adaptation system of the Comfort Loop has been developed in an automotive
environment. After giving a brief overview of the project as a whole, the paper deals with the denition
of sitting comfort and discomfort, then it presents the idea of the seat adaptation system, whose implementation in a real environment is extensively reported together with the description and discussion of
the experimental phase. In the last section comments from the nal review process are reported, and new
lines of research deploying REFLECT ndings are outlined.
2013 Elsevier B.V. All rights reserved.
1. Introduction
Funded by the European Unions 7th Framework Programme
(FP7), REFLECT (REsponsive FLExible Collaborating ambienT) is a
research project that ran from January 1st 2008 to March 31st
2011. The following research centres (seven) and companies
(two) formed the project consortium: Fraunhofer FIRST (Berlin,
Germany), Ludwig-Maximilians-University (Munich, Germany),
Liverpool John Moores University (Liverpool, United Kingdom),
University of Groningen (The Netherlands), University of Pavia
(Pavia, Italy) and Institut Mihajlo Pupin (Belgrade, Serbia), Ferrari
S.p.A. (Maranello, Italy), Philips Research (Eindhoven, The Netherlands). The project was coordinated by Fraunhofer FIRST, in the
person of Dr. Nikola erbedzija. The aim of REFLECT was to develop
new concepts and means for pervasive-adaptive systems, by
researching ways of sensing users and their mood and intentions.
Different aspects have been taken into account: emotional state
(e.g. annoyance), cognitive engagement (e.g. high mental workload) and physical conditions and actions (e.g. postural comfort).
All these together with human behavioural patterns form the personal awareness of the system. Additionally, information about the
Corresponding author. Tel.: +39 0382 985371; fax: +39 0382 985373.
E-mail addresses: gianmario.bertolotti@unipv.it (G.M. Bertolotti), andrea.
cristiani@unipv.it (A. Cristiani), nikola@rst.fraunhofer.de (N. erbedzija).
0141-9331/$ - see front matter 2013 Elsevier B.V. All rights reserved.
http://dx.doi.org/10.1016/j.micpro.2013.06.004
1064
xCOP t
Pn
i1 P i t xi
P
n
i1 P i t
yCOP t
Pn
i1 P i t yi
P
n
i1 P i t
where Pi(t) is the pressure value detected by the ith sensor at time t,
xi is the ith sensors horizontal coordinate, yi is the ith sensors vertical coordinate.
Another useful parameter for studying the in-chair movements
is the COP speed: this value turned out to be helpful in our application, where a prolonged monitoring of the movement is needed.
Eqs (3) and (4) provide the COP speed along longitudinal (X) and
lateral (Y) directions:
vx
COP
vy
COP
dxCOP t
dt
dyCOP t
dt
q
v COP t v 2xCOP t v 2yCOP t
REFLECTive Middleware
Accelerometer
UP mat
UP Controller
Seat
1065
1066
experience is the goal; hence the seat adaptation system has to react promptly. Finally, but not less important, the seat adaptation
strategy can use information coming from other REFLECT biocybernetic loops, such as emotional and cognitive, because of their possible implication in posture changes. As reported in literature, in
fact, cognitive load can affect standing postural control [2931],
and emotional states may have implications in human body posture [32]. So it is reasonable to assume that sitting posture control
can be in some way affected by them.
4. System implementation
As described above, the system control is mainly constituted by
sensors, actuators and a microcontroller capable of acting on the
seat according to the acquired signals. The developed system is
able to share information with the other loops within the REFLECTive framework. A pressure sensor mat has been developed in order to have the capability of reading pressures at seat/driver
interface. The choice of developing the sensor instead of using a
pressure system available in the market is mainly due to the need
of having complete access to data, as well as to share them within
REFLECTive framework. Fig. 2 shows the UP seat mat, made for
this project. It consists in a 4 5 matrix of Force Sensing Resistors
(FSRs) by Interlink Electronics Inc. (Camarillo, CA, USA). A FSR is a
polymer thick lm device which exhibits a decrease in resistance
with an increase in the force applied to the active surface [33]. The
FSRs used have a square-shaped active area of 6.25 cm2; the centre-to-centre horizontal distance is 5 cm, while the centre-to-centre vertical distance is 4 cm. Two sheets of imitation leather are
applied on both sides of the device to protect the 20 FSR, the interconnections and other passive components needed for the conditioning of the signal. A LIS302DL 3-axis digital accelerometer (ST
Microelectronics) [34], xed on one side of the seat, has been used
to measure vertical, lateral, and longitudinal accelerations. It has
been connected to the system through a synchronous serial communication. The UP controller uses the data provided by LIS302DL
to calculate, on the basis of a simple peak-detection algorithm, the
number of bumps per minute.
The latter is one of the parameters the seat adaptation strategy
and the road surface identication are based on. When needed, the
control system acts on the drivers posture through a set of actuators. They are inatable air cushions (named barilotti) built inside the car seat. An air pump is connected to these barilotti.
Fig. 3 shows a functional block diagram of the pneumatic circuit,
in which it is possible to note, besides the above-mentioned components, ve pneumatic valves. The UP controller can inate/deate each couple of cushions by acting, through digital
commands, on the pneumatic pump and the ve valves, in proper
combinations. This is possible thanks to a proper circuit which connects the UP controller to seat pump and valves. As presented schematically in the text box above, there are three couples of barilotti:
one (A) positioned in the seat, the second one (B) at the sides of the
backseat, the others (C and D) also in the backseat, but in the centre
(lumbar/mid-back region). In the rst implementation of the seat
adaptation strategy, in order to reduce the number of variables,
only the seat inating air cushions A and B are used. Furthermore,
only ON/OFF conditions are considered, the ON state meaning barilotti completely inated, while in the OFF state barilotti are completely deated. The seat adaptation strategy is managed by UP
controller that acts on the car seat accordingly to the signals provided by mat sensors pressure and accelerometer. The core of the
UP controller is a PIC24F16KA102. This is a 16-bit microcontroller
by Microchip Technology Inc [35], provided with several peripherals (see Table 1 for some details about its features), which allows
us to accomplish every task needed. Even if an 8-bit microcontroller could have been enough to fulll the nal application requirements, we decided to base our system on a more powerful device,
in order to leave open the possibility of adding more complex
features later on. In the current version of the system, the microcontroller sends data to the REFLECTive framework which is in
charge for deciding whether a seat adaptation is to be performed.
Nevertheless, it would be possible to implement a seat adaptation
strategy (or part of it) directly on the microcontroller if required in
stand-alone applications (or for delegating the microcontroller to
take decisions related to critical events that need a prompt
response1).
Moreover, the PIC24F16KA102 has interesting features in terms
of power saving techniques. In our application, the average current
consumption of the system (sensors and microcontroller), when
the microcontroller is in Run Mode at 8 MHz, is 6.24 mA.
As mentioned before, the UP controller can acquire signals from
sensors, perform elaborations on the acquired data, manages the
actuators, according to commands coming from the REFLECTive
framework. To perform these operations, an algorithm in ANSI C
language was developed by means of the MPLAB Integrated Development Environment (IDE) by Microchip. The communication between the REFLECTive framework and the UP controller is based
on a detailed commands list which has been dened on purpose.
These commands, sent to the UP controller by means of an asynchronous serial transmission, allow to: act on the actuators according with the rules; obtain information about the state of the
actuators; get data acquired from the sensors. The REFLECTive
framework uses the information provided by UP controller to put
into effect the comfort loops rules, and to show the system state
and the main sensor signals to the driver, through the REFLECTive
Comfort Loop interface. In the vehicle demonstrator, this application runs on three Ultra Mobile PCs (UMPCs). Each UMPC, through
its own user interface (Fig. 4) provides various kind of information:
1
Current implementation of the system does not take into account this kind of
events as the response time of the system is approximately 3 s when a seat inating is
needed, and 1s when a seat deating is needed. This is mainly due to the response
time of the actuators built in the car seat used in the demonstrator.
1067
Fig. 3. Schematic of electromechanical and pneumatic actuators, with legends and list of activation combinations (the two pictures refer to the same seat).
Table 1
PIC24F16KA102 main features.
Parameter name
Value
Architecture
CPU speed (MIPS)
Memory type
Program memory (KB)
RAM bytes
Operating voltage range (V)
I/O pins
Pin count
Internal oscillator
Current consumption (uA)
16-bit
16
Flash
16
1536
1.83.6
24
28
8 MHz, 32 kHz
3050 (at 8 MHz in Run mode)
195 (at 1 MHz in Run mode)
0.02 (in Deep Sleep mode)
0.025 (in Sleep mode)
2-UART, 1-SPI, 1-I2C
1-A/D 9 10-bit @ 500(ksps)
2
1/1
3 16-bit
Yes
1068
Both for Study 1 and 2, the subjects were asked to seat at a desk,
and to execute a typical ofce task (i.e. reading a text, searching for
an online document); each of them performed the following sitting
tests:
sitting for 60 min on a highly uncomfortable wooden chair
(Fig. 6a) and
sitting for 60 min on a standard ofce chair with a foam-lled
cushion (Fig. 6b).
1069
Fig. 6. The chairs used in the tests: (a) wooden seat and (b) foam cushion seat.
r2 t
n1
X
Pi t lt2
i0
where Pi(t) is the pressure value detected by the ith sensor at time t,
and l(t) is the mean pressure dened by
lt
n1
X
Pi t
i0
In Fig. 9, the COP speed modulus (dotted line) and the pressure
variance (solid line) waveforms, related to the same epoch of a trial
performed by one of the subjects, are presented. After about
45 min sitting on the wooden seat, the subject made two ICMs
(see COP speed modulus peaks in Fig. 9). About 6.5% increasing
in pressure variance can be seen in the 2 min lasting between
them: this phenomenon reects what already mentioned previously: the ICM, probably, is an unconscious action performed when
there are pressure peaks in localised areas of the body, mainly after
sitting for a certain amount of time on a hard surface. The increasing of pressure variance is due to the fact that pressures are not
homogeneously distributed at the buttock/seat interface. This nding seems to suggest that ICMs can be anticipated by monitoring
the pressure variance signal. This hypothesis is at the basis of a
new research which is being carried on at the University of Pavia
at time of writing: the nal objective is to develop a system for
the improvement of wheelchair users comfort.
In order to study the effects of vertical accelerations on a drivers posture, and to test the use of inating air cushions to modify
the latter, a Ferrari California seat (provided by Ferrari) was
mounted on a vibrating platform. Twelve subjects (three females,
nine males) participated in the study. Their mean age, height and
weight ( standard deviation) were, respectively, 33.9 8.4 years,
175.6 7.5 cm, 74.0 13.6 kg. None of them reported any musculoskeletal or neurological conditions that precluded their participation in the study.
Subjects were placed in the Ferrari car seat on the vibration
platform, as shown in Fig. 10. Each subject tested two experimental
congurations, with seat cushions deated and with cushions
inated.
Pressure maps at the buttock/seat interface were recorded
using the Pliance X system. COP speed components over time were
calculated for each session acquisition. Vibration was provided by
a dynamic vibrating platform made available by courtesy of Structural Mechanics Department of Pavia University. In order to produce the vibration, the software that drives the vibration
platform was fed by a le containing acceleration values previously
recorded in a car during a drive on a paved road at 50 km/h.
1070
Fig. 7. COP speed signals of a subject sitting on: (a) a uncomfortable wooden seat (solid line) and (b) on a seat with a foam cushion (dotted line).
Type of seat
W
oo
d
am
oo
10
10
20
p=0,0129
15
am
30
20
Fo
p=0,0359
Results of Study 2
(1 subject, 2 conditions, 10 trials/condition)
40
Fo
Results of Study 1
(10 subjects, 2 conditions, 1 trials/condition)
Type of seat
Fig. 8. Results from Study 1 (left) and 2 (right): bar plots of number of ICMs (mean SEM) vs. seat type.
Fig. 9. Comparison between pressure variance and COP speed modulus of the same trial.
by inated cushions, which help the pilot in compensating vibrations. Therefore, we could conclude that acting on the air inating
cushions of the seat has an effect on the sitting behaviour of a subject exposed to vertical vibrations.
x 10 2
air cushions or bubbles), where each sensor positioned on the correspondent active element. In this way, when uncomfortable postures of the subject lying on the bed are detected, the mattress
shape could be modied for improving the lying comfort. For this
application, however, the way in which discomfort is detected
should be slightly modied: while in-chair movements can be used
as indicators of discomfort in awake subjects, we cannot rely on
them with subjects sleeping on a bed. Even worse if the user cannot move as he/she is ill and lies 24 h a day on a hospital bed, for
instance. Nevertheless, a REFLECTive system can easily be
adapted to cope with new requirements: the system architecture
would remain similar, the only difference being that a different
parameter (e.g. the variance of pressure data, as presented in Section 5) and different thresholds would be used for triggering the
bed adaptation. A REFLECTive hospital bed could be viewed as
a means for improving the postural comfort of patients in general,
but, also, it could play a role in reducing decubitus ulcers, a worldwide health care concern affecting tens of thousands of patients,
which is mainly caused by prolonged localised contact stresses
[37].
20
Tribute
15
10
te
d
Acknowledgment
fla
de
in
fla
te
Fig. 10. A subject during a trial on the Ferrari California seat mounted on the
vibrating platform.
1071
Fig. 11. Bar plots of area covered by COP speed (mean SEM) vs. seat condition.
This work has been partly supported by the EU Seventh Framework Programme project REFLECT (Pr. No. FP7-215893).
References
scientic literature dealing with sitting comfort estimation, and results of experiments conducted during the project.
REFLECT, as a whole, was rated as excellent by the reviewers,
after the nal review meeting held in Maranello (Italy) in April
2011, for giving signicant contributions to the state-of-the art
across a wide range of disciplines: from adaptive software architectures to user sensing, modelling and reective interfaces. Moreover, the automotive demonstrator, implementing the Comfort
loop and other biocybernetic loops, was much appreciated for giving clear indications of the potential of the concepts and concrete
implementations developed during the life-cycle of the project.
As for the comfort loop and the seat adaptation system presented
in this paper, the technical report underlined the fact that the concepts developed were very relevant to environments such as the
car demonstrator or ofce environments, as physical sensors and
algorithms were developed to measure user comfort. It has to be
underlined that our seat adaptation system has been conceived
as a demonstrator of research results achieved during the REFLECT
project. The development of a production version of the proposed system was beyond the aim of the project and issues related
with its possible integration in a car (e.g. the use of standardized
buses, for communication between devices) have not been
addressed.
The authors foresee the possibility to improve and extend the
seat adaptation system in order to be used for applications that
are not necessarily connected to the automotive domain. In fact,
the same idea can be used as a starting point for developing an
adaptive bed. Such a system should integrate a matrix of pressure sensing elements and a matrix of active elements (i.e. inating
1072
[14] G. Kyung, M.A. Nussbaum, Driver sitting comfort and discomfort (Part II):
Relationships with and prediction from interface pressure, Int. J. Ind. Ergon. 38
(56) (2008) 526538.
[15] S. Na, S. Lim, H.S. Choi, M.K. Chung, Evaluation of drivers discomfort and
postural change using dynamic body pressure distribution, Int. J. Ind. Ergon. 35
(12) (2005) 10851096.
[16] M.B. Parkinson, D.B. Chafn, M.P. Reed, Center of pressure excursion capability
in performance of seated lateral-reaching tasks, Clin. Biomech. (Bristol, Avon)
21 (1) (2006) 2632.
[17] H.Z. Tan, L.A. Slivovsky, A. Pentland, A sensing chair using pressure distribution
sensors, IEEE/ASME Trans. Mechatronics 6 (3) (2001) 261268.
[18] M. Stinson, A. Porter-Armstrong, P. Eakin, Pressure mapping systems:
reliability of pressure map interpretation, Clin. Rehabil. 17 (5) (2003) 504.
[19] W. Cho, H. Choi, Center of pressure (COP) during the postural balance control
of high-heeled woman, IEEE Eng. Med. Biol. Soc. Conf. Proc. 3 (2005) 2761
2764.
[20] D.H.K. Chow, A.C.S. Cheng, A.D. Holmes, J.H. Evans, The effects of release height
on center of pressure and trunk muscle response following sudden release of
stoop lifting tasks, Appl. Ergon. 34 (6) (2003) 611619.
[21] S. Corazza, T.R. Andriacchi, Posturographic analysis through markerless
motion capture without ground reaction forces measurement, J. Biomech. 42
(3) (2009) 370374.
[22] T.R. Han, N.J. Paik, M.S. Im, Quantication of the path of center of pressure
(cop) using an f-scan in-shoe transducer, Gait Posture 10 (3) (1999) 248254.
[23] M.K. Lebiedowska, M. Syczewska, Invariant sway properties in children, Gait
Posture 12 (3) (2000) 200204.
[24] L. Chiari, P. Morasso, L. Rocchi, Analisi posturograca, Bioingegneria della
postura e del movimento, 2003, pp. 375412.
[25] J. Cholewicki, G.K. Polzhofer, A. Radebold, Postural control of trunk during
unstable sitting, J. Biomech. 33 (12) (2000) 17331737.
[26] N.M. Dunk, J.P. Callaghan, Gender-based differences in postural responses to
seated exposures, Clin. Biomech. (Bristol, Avon) 20 (10) (2005) 11011110.
[27] S. Scena, R. Steindler, Methods for sitting posture evaluation: static posture
and applications, Strain 44 (6) (2008) 423428.
[28] G.M. Bertolotti, A. Cristiani, R. Lombardi, M. Stanojevic, M. Ribaric, N.
Tomaevic, D5.3 Third Year Report: Evaluation of Case Studies, REFLECT
Responsive Flexible Collaborating Ambient, FP7 Project, 2011.
[29] G. Andersson, J. Hagman, R. Talianzadeh, A. Svedberg, H. Larsen, Effect of
cognitive load on postural control, Brain Res. Bull. 58 (1) (2002) 135139.
[30] M. Schmid, S. Conforto, L. Lopez, T. DAlessio, Cognitive load affects postural
control in children, Exp. Brain Res. 179 (3) (2007) 375385.
[31] E. Fraizer, S. Mitra, Methodological and interpretive issues in posturecognition dual-tasking in upright stance, Gait Posture 27 (2) (2008) 271279.
[32] N. Bianchi-Berthouze, P. Cairns, A. Cox, C. Jennett, W. Kim, On posture as a
modality for expressing and recognizing emotions, in: Emotion and HCI
Workshop at BCS HCI London, 2006.
[33] Interlink Electronics, Force Sensing Resistor (FSR), 2011. <http://
www.interlinkelectronics.com/Force-Sensing-Resistor>.
[34] STMicroelectronics, LIS302DL MEMS Motion Sensor, 2008. <http://
www.st.com/internet/com/TECHNICAL_RESOURCES/TECHNICAL_LITERATURE/
DATASHEET/CD00135460.pdf>.
[35] Microchip
Technology
Inc.,
PIC24F16KA102,
2009.
<http://
www.microchip.com/wwwproducts/Devices.aspx?dDocName=en539800>.
[36] G.M. Bertolotti, A. Cristiani, R. Lombardi, D5.2 Second Year Report: Creation
and Evaluation Phase, REFLECT Responsive Flexible Collaborating Ambient,
FP7 Project, 2010.