Professional Documents
Culture Documents
1
Irina Mocanu, 2Cosmin Marian 3
Lucia Rusu, 4Raluca Arba
Computer Science Department Faculty of Economics and Business
University Politehnica of Bucharest Babes Bolyai University of Cluj-Napoca
Bucharest, Romania Cluj-Napoca, Romania
1
irina.mocanu@cs.pub.ro, 2cosmin1611@gmail.com 3
lucia.rusu@econ.ubbcluj.ro, 4raluca.arba@econ.ubbcluj.ro
Abstract—This paper describes an application that aims to The weight loss by burning a number of calories over
stimulate physical activity adapted to elderly people. The a period of time. The recommendation is 30 minutes
application is implemented as a game with two avatars: user and of exercise a day for at least five days a week. This
trainer. The user avatar must reproduce the movements of the begins with daily activities: take the stairs instead of
trainer’s avatar. The similarity between two movements is taking the elevator, several steps in a walking
computed using Dynamic Time Warping. Also the speed of the program.
trainer is adapted to the user’s movements using cross-
correlation. Thus the game can stimulate for a long time ability to combat many health problems, from
physically activity. The preliminary evaluations with ten people cardiovascular disease to depression. Physical activity
have shown that the system can be an effective tool that engages allows blood to flow through arteries and veins
users into physical activity. vigorously, reducing the risk of cardiovascular
disease, reduce the risk of developing type 2 diabetes,
Keywords—exergame; Dynamic Time Warping; cross
stroke, depression and arthritis.
correlation; adaptation;
Improved mood. Exercise stimulates the release of
I. INTRODUCTION endorphins in the brain that are known producer of
Exercises play an important role in the overall condition of "runner's high". Releasing tension and stress through
the elderly. A structured exercise program may lead to a rapid exercise can boost self-esteem and confidence.
recovery in severe disease (stroke, fractures, surgery) and even
major benefits for the elderly with less severe disease. The an energy boost efficiency caused by oxygen
purpose of the exercise is to regain tone and normal weight and throughout the body. As the heart and lungs working
reduce comorbidities that affect obese patients, such as: in sync, enabling a flow body and restoring good
cardiovascular disease, diabetes, osteoporosis [1]. blood flow to muscles and tissues energy. Regular
exercise increases endurance and muscle strength,
Activities of Daily Living (ADL) are defined as activities allowing muscles and bones become stronger0
carried out regularly. While walking is a form of exercise with
several implications, this does not present a comprehensive sleep better. The body is released from stress and
application form to the effort of the human body. Even if the allows relaxed state of mind. A relaxed mind will gain
ADL can include washing the car, cleaning the house and the benefits of sleep: immune function, good memory,
gardening, cooking, washing dishes are not considered exercise relax the body and muscles and the body works better.
that would require sufficient human body. Patients should seek Also there are some (especially age-related) factors that
a structured exercise program to accelerate further their goals induce a progressive diminution of physical activity: the
of increasing mobility, muscle mass, stamina and eventually to discomfort caused by some health problems, the lack of
weight loss (if applicable). enthusiasm (apathy), social conformism. Moreover, these
A good program is well structured exercise any program factors act as a negative feed-back system (this means that the
tailored to the patient's lifestyle and physical, which includes less physical activity someone performs, the bigger these
any activity of daily program leading to a target heart rate of at factors become) and lead to a chronic sedentariness. Most
least 120 beats per minute (bpm). This is the recommended existing exergames are made for children or young adults, and
intensity level over a period of 30-45 minutes. If health they have many features that do not suit to the elderly.
problems arise (sweating, fatigue or breathing) and is sufficient Exergames for elderly should follow basic requirements for
for 5-10 minutes three times a week. Persevering over time, games, adapted for the abilities of the users.
will gradually build endurance and can reach a goal of 30-45 This paper presents a game that increase physical activity
minutes of exercise [1], [2]. through a game with movements adapted to the user’s speed of
We present six benefits of structured exercise combined reactions.
with daily activities, maintaining a decent balance between The rest of the paper is organized as follows: Section II
both [2], [3]: describes other games with physical exercises for elderly
people or used in the rehabilitation domain. Game description
978-1-5090-3899-2/16/$31.00 ©2016 IEEE.
in given in Section III. Section IV presents evaluation of the patients from trying to complete tasks. Jewel Mine is a
proposed game. Conclusion and future work are described in rehabilitation therapy tool customized to overcome these
section V. issues. Developed at the Game Based Rehab Lab, part of
the MedVR Group (http://medvr.ict.usc.edu/research/) at
II. RELATED WORKS University of Southern California Institute for Creative
Mobility problems are very common for elderly people and Technologies (ICT), this video game-based application targets
lead to reduced quality of life and limitations in everyday balance training and upper limb reaching exercises and is
activities and social participation. Game-based technologies, designed to motivate people with orthopedic and neurological
social play, personalization and persuasive technologies can injury or impairments, including stroke, traumatic brain injury,
motivate the elderly to perform exercises that are beneficial to spinal cord injury and balance issues associated with aging.
them. GameUP, developed in the AAL project GameUP [12]
A new way to use video games is to include them in sustains mobility of seniors over 65 years for the advancement
training, education and learning. This is called serious games. of older persons’ mobility [13]. The GameUp project created
Serious games can be described as ”a mental contest, played seven mini exergames training mobility, strength, and balance
with a computer in accordance with specific rules, that uses on Kinect for Windows and a mobility tracker from the
entertainment to further government or corporate training, company Fitbit is also used for promoting endurance. Kinect
education, health, public policy, and strategic communication enables users to control and interact with their screen without
objectives” [7]. An important feature with serious games is that using a gamepad, but simply with an easy interface using
they provide the opportunity to experience in real-life gestures and spoken commands. Thus, playing freely without
situations and adventures one may otherwise not be able to being bonded to traditional gamepads makes the game console
enjoy. Exergames are a type of serious video games that user-friendly and more suitable for older persons. Fitbit, with
combine traditional game play with physical activity. The its integrated altimeter and tri-axial accelerometer accurately
combination of movement and amusement is used to stimulate captures all daily activities. It tracks the number of steps taken,
exercise and engage people to be more physically active in a stairs climbed, distance traveled and calories burned every day.
fun and motivating way. A lot of research has been done within It’s low weight and small size, and it can easily and discreetly
this topic, and results show that exergames can have a positive be attached to clothing. The aim of this tracker is to empower
effect on users health [8], [9]. and encourage the patient, by delivering real-time feedback
that helps him/her be more active. The exergames consist of 7
Paper [10] discuss important issues that need to be taken mini-games, including balance, mobility, and strengthening
into account when developing games for elderly. Elderly often exercises:
suffer from decline in visual acuity, decreased audition,
mobility changes and cognitive functions’ decline. In addition, Exercise 1 called “plucking game” is a
many elderly are not familiar with technology. The writers strengthening exercise for abductor muscles. The
suggest that it should be possible to customise the game for patient has to spread apart one leg on the side.
every player’s special needs.
Exercise 2 “apple-picking game”, exercise 4
Font, size and colour should be adjustable, and information “chicken-picking game” and exercise 7 “star-
should be provided in different multimedia alternatives, like picking game” are balance exercises where the
text, voice and images. The objects should be of sufficient size patient has to catch the falling objects and put
and the elements should not move too fast. The overall them in the correct receptacle. These three balance
interface should be as simple as possible, without the need to exercises are based on the same training principle
remember information given earlier in the gaming process, and where the patient has to move sideways.
it should be given sufficient information and guidance
throughout the whole game. Games should also provide Exercise 3 called “growing game” is a
motivating messages to encourage the player. strengthening exercise for the calf muscles. The
patient has to stand on his toes to water the flower.
Some examples of wellbeing and motivational applications
and games for healthcare based on Kinect and/or other sensors Exercise 5 called “harvesting game” is a
are given bellow: strengthening and mobility exercise for the trunk.
It trains the torso rotation. The patient has to rotate
Jewel Mine [11] is a rehabilitation therapy tool customized his trunk in order to cut the corn with the scythe.
to overcome health issues. Jewel Mine was created using the
Microsoft Kinect for Windows SDK and is part of a series of Exercise 6 called “pumping game” is a
game-based research prototypes using off-the-shelf video game strengthening exercise for quadriceps muscles
hardware to explore the potential of interactive games to where the patient has to perform squats in order to
improve therapy in home and clinical settings. Video game pump water into a glass.
systems are increasingly being used for rehabilitation. Evergreen Fitness System [14] is a game-based prototype
However, games designed for entertainment do not always developed to train older adult’s balance, especially lower limb
meet clinical needs. They can be too challenging for people strength by exercises (knee marching, side hip raise, lunges,
with impairments to complete or they can encourage the wrong partial squats, wide squats and standing knee flexion). The
type of movements. Negative feedback often discourages system is based on the Kinect sensor, gestures are used to
select the menu while body motions are required as part of the For seniors, doctors prohibit certain types of exercises:
exercises. Immediate feedback, such as smiling face, ding isometric exercises, anaerobic exercises, exercises with heavy
sound and entertaining background music is provided to weight, exercises in the head goes below horizontal front trunk,
increase interaction. Six exercises are designed for improving exercises with sudden changes of position.
balance: An important rule consists in elimination of seeking maximal
and submaximal muscular efforts for long periods, which are
Exercise 1 (knee marching): strengthen ankles and impossible in old age, and risky use [3], [4].
hips; improve dynamic or moving balance.
There are some easy exercises that can be performed by
Exercise 2 (side hip raise): strengthen side hip any elderly: training mild aerobics, squats, lifting light weights,
muscles; maintain lower body endurance to better push-ups performed on the wall, flexing side of the leg linkage
walk and side step around objects. peaks, stretching lumbar, stretches upper body. Although
Exercise 3 (lunges): strengthen quadriceps and generally are considered valid, even these contraindications to
hips; improve the ability to get out of a chair and certain conditions for elders: hemiparesis, paresis, recent
balance. operations, etc [5], [6].
Exercise 4 (partial squats) and Exercise 5 (wide These physical exercises must be defined in order to guide,
squats): increase hip flexibility, quadriceps monitor, and encourage elderly people to perform them:
strength and hip flexor strength: steady body for The discomfort sensation can be attenuated by
better balance and safety. choosing adapted exercises, in accord with physical
Exercise 6 (standing knee flexion): strengthen capabilities, and by progressively increase the
hamstring muscles; help with standing balance difficulty - we’ll have three type of exercises: low,
moderate and high. The exercises will be based on a
Out in nature [15] is a simplified exergame concept for set of movements of the whole body representing
senior citizens, which focuses on physical activity in general, standard activities concerning physical training
and balance and muscle strength in particular. The game is exercises (e.g. straight arms pumps: lateral and upper,
designed for elderly people, around 70 years old and was lateral arm circle, lateral lunge, squats);
created based on the seniors’ feedback. Users can choose
exercises according to different muscle groups and balance The apathy can be surpassed using adequate visual
challenges, and then, a specific exercise is chosen depending and audio stimuli: virtual animated models, rewards,
on their own preference or the recommendation from their encouragements, musical sequences, etc.;
physiotherapists. The design of the exergame shows clear goals The level of the exercise will be adapted permanently in
for training muscle strength and balance. One of the exercise is speed. We propose a Physical Activity Trainer (PAT) that is
focused on balance and muscle strength, where the task is to implemented like a game that helps users to perform physical
pick apples. This activity requires players to stretch their body activities. The game consists of two avatars: the avatar of the
to reach ripe apples (balance) and put them in a basket on the user and the avatar of the trainer. Based on a kineto-therapist
ground. recommendation we’ll register a set of exercises with different
Paper [16] presents a mobile based exergaming system levels of difficulty. Each user will be registered with a personal
that targets children of different ages and that aims to profile (containing medical information and recommendation
encourage them to do running and jumping exercises in an of the type for the physical exercises). When the game starts,
enjoyable manner. The system uses a heart monitor that allow the user can choose a type of the exercise according with his
interacting with a special game that can adapt to the user’s profile. The trainer avatar will be animated based on the
performance. recorded exercises with the speed associated with the selected
level. The user will perform the recommended exercises, his
Home-based rehabilitation system has potential to offer avatar will be animated, and the system will compute a score
greater accessibility and thus increase consistent uptake. In (comparing the user movements and the trainer movements).
[17] is presented an effective home-based rehabilitation Also the speed of the game will be continuously adapted based
offering outcomes similar to those obtained through hospital- on the user response. In this paper we’ll focus on the game
based rehabilitation under the supervision of a therapist. The description (animated avatars: user and trainer) and on the
system uses Kinect with Dynamic Time Warping method and evaluation and adaptation of the user’s exercises. We consider
fuzzy logic for exercise evaluation. the profile of the users already set up. Both user and trainer are
represented on the screen using 3D avatars.
III. SYSTEM DESCRIPTION
All exercise programs are customized to the particular elder A. Component description
disease, so they are easily understood and executed. The A study performed in the AAL Project Join-In [17]
program includes muscle exercises active, moderate, consistent concluded that although it is not perfect, the Microsoft Kinect
with 75% load capacities cardiovascular system, respecting the is the most suitable device for exergames for elderly. This is
principle of Rusk (1977) "little and often" and especially the also the best tool to capture the movements properly and thus
basic principle of recovery geriatric "maximum effect - ensuring that exercises are performed correctly. Also it offers
minimal risk" [3]. all three types of information that is needed in such an
application: infrared video stream, depth stream, skeleton The video containing only the depersonalized kineto-therapist’s
tracking. The color video stream can be ignored due privacy silhouette become the model for the subjects.
concerns, since there are voices that warn about the importance
For each exercise we’ll store (i) exercise name, (ii) exercise
of hiding unnecessary details such as clothes, face, and
description, (iii) exercise category, (iv) difficulty level, (v)
environment. The coordinators of the joins (as in Fig. 1) are
relevant joints for the exercise, (vi) repeating time. For
provided by the Kinect One sensor, as described in [18].
example – exercise rotation arms is recorded exercise
description: starting position: stand up straight, your feet
slightly apart and exercise routine – put your hands on the
shoulders and rotate simultaneous your elbows four times
forward and then four times backwards. All these information
will be stored into the Exercise Database from the Data
Repository. Each exercise will have an associated XML file
containing the joints coordinates. Based on the solution from
[19] numerical information regarding the coordinates of the
joints in each video frame are recorded in a XML file (Fig. 3).
These numbers can be used to determine the similarity between
real-time movements (performed by the user) and pre-recorded
movements (that will be performed by the avatar).
Thus the cross correlation function gives a judgment index Fig. 8. Angle variation.
of correlation between two signals in the frequency domain.
Also we can obtain a correlation coefficient that is merely a IV. EXPERIMENTAL RESULTS
ratio, with its meaning given in Table 1. The system is implemented using Unity 3D engine. A
screenshot of the game is presented in Fig. 9 (first one contains
TABLE I. CORRELATION COEFFICIENT a syncronised movement and the other one a movement with a
delay).
Values of correlation coefficient
Slight correlation 0.00–±0.30
Actual correlation ±0.30–±0.50
Significant correlation ±0.50–±0.80
High correlation ±0.80–±1.00