Professional Documents
Culture Documents
1 s2.0 S1052305717304378 Main PDF
1 s2.0 S1052305717304378 Main PDF
Robot-assisted therapy is regarded as an effective and reliable method for the de-
livery of highly repetitive training that is needed to trigger neuroplasticity following
a stroke. However, the lack of fully adaptive assist-as-needed control of the robotic
devices and an inadequate immersive virtual environment that can promote active
participation during training are obstacles hindering the achievement of better
training results with fewer training sessions required. This study thus focuses on
these research gaps by combining these 2 key components into a rehabilitation
system, with special attention on the rehabilitation of fine hand motion skills. The
effectiveness of the proposed system is tested by conducting clinical trials on a
chronic stroke patient and verified through clinical evaluation methods by mea-
suring the key kinematic features such as active range of motion (ROM), finger
strength, and velocity. By comparing the pretraining and post-training results, the
study demonstrates that the proposed method can further enhance the effective-
ness of fine hand motion rehabilitation training by improving finger ROM, strength,
and coordination. Key Words: Stroke rehabilitation—robot assisted therapy—assist-
as-needed control—virtual reality—rehabilitation gaming system—clinical assessment.
© 2018 National Stroke Association. Published by Elsevier Inc. All rights reserved.
Journal of Stroke and Cerebrovascular Diseases, Vol. 27, No. 1 (January), 2018: pp 221–228 221
222 X. HUANG ET AL.
facilitate repetition, intensity, and task-oriented training,
all of which promote voluntary active motion. There-
fore, VR-based RT offers the potential to specifically
promote and/or enhance functional movement recovery.7
VR systems can provide safe, ecological, and individu-
alized 3-dimensional environments where patients can
perform specific actions to achieve a goal. Another ad-
vantage of a VR intervention is that patients can perceive
such interventions as enjoyable exercise games rather than
treatment methods and, thereby, increase motivation and
treatment compliance.8 VR can also be used as an as-
sessment method by recording and objectively measuring
the performance of patients and their behavioral re-
sponses within the virtual world. VR-based RT thus has
the potential to utilize motor learning principles in re-
lation to task-oriented training. However, the intensity
and dose–response aspects of a VR game–based inter-
vention training with evidence-based efficacy and clear
objectives and outcomes need to be further determined.9
The aim of this study was to further evaluate the ef- Figure 1. Training conducted on a stroke patient using Amadeo.
fectiveness of the developed VR-based RT treatments with
an adaptive control method deployed in a robotic train- this constant assistive force intensity can be excessive to
ing device. In addition, the study explores more effective that required for the movement of the finger. As a result,
methods to transform the achieved improvements to the the patient may end up following the finger slides pas-
performance of ADL tasks in real life. Special attention sively, which makes the training task less challenging and
is paid to fine hand motion rehabilitation, which in- compromises the effectiveness of the training. In order
volves small, precise, and coordinated movements of the to achieve optimal training results and to reduce the re-
fingers and requires the integration of muscular, skele- quired training sessions and associated costs, a
tal, and neurological functions. This is because fine hand reinforcement learning neural network–based AAN adap-
motion is vital for more delicate ADL tasks such as eating, tive control was designed and validated through computer
drinking, and personal hygiene and is necessary for the simulation and experimental work. The notion of the AAN
improvement of the QOL of stroke patients. control method is to provide exact assistive force inten-
sity along the intended motion trajectory only when it
Materials and Methods is needed, thus keeping the training challenging and en-
RT Platform gaging. This is achieved by observing the force and position
feedback state at the current time-step and making pre-
In this study, a 5 degrees of freedom hand rehabilita- dictions of the next time-step state based on the feedback
tion robotic device named Amadeo (Tyromotion GmbH, data. A detailed design and online learning process of
Graz, Austria)10,11 was used as the experimental plat- the proposed AAN control method can be found in Huang
form. Amadeo (Tyromotion GmbH) can provide position- et al.12
based passive and active assistive training modes that
emphasize the flexion and extension of each finger. The Participant
moving finger slides are attached to the fingers using a
small magnetic disc and an adhesive tape for connec- Considering the final evaluation, comparisons and con-
tion to the robot. The slides then transfer, bend, or stretch clusions will be based on the performance of the patient
movements to the fingers. The VR-based RGS is imple- during clinical tests; the condition of the subject before
mented with Amadeo (Tyromotion GmbH), which is the study may affect the outcome of the rehabilitation
composed of a finger rehabilitation robot and a PC with process. Thus, it is important to set unified require-
LCD displaying the virtual scenarios in front of the user ments for recruited patients to ensure that they start with
as shown in Figure 1. similar conditions. The Fugl-Meyer Assessment (FMA) and
The major limitation of Amadeo’s (Tyromotion GmbH) the Motor Assessment Scale (MAS) were used to assess
standard training protocol is that it provides position control patients’ abilities during the evaluation sessions. In order
with constant assistive force intensity regardless of the to maintain consistency, we defined the following inclu-
actual need of the patient. In clinical practice, patients sion requirements for the recruited subjects:
with different levels of active mobility skills require various 1) Age range: 50-75 (patients around the same age were
levels of assistive support. Also, even for the same patient, preferred).
EFFECTS OF ADAPTIVE CONTROL AND VIRTUAL REALITY ON ROBOT-ASSISTED REHABILITATION 223
2) Severity of impairment: motor abilities suggested
by MAS score:
In section 6 (upper arm): 3-5;
Section 7 (hand movements): 2-4.
3) Language spoken: English
4) Good cognition: suggested by the Rowland Uni-
versal Dementia Assessment Scale or Mini Mental
State Examination score of 26 (out of 30) or more.
The general inclusion principle is to allow space where
the patients can experience the expected changes during
the training sessions. Therefore, patients with a “medium
level” of hand motor skills were preferred. Also, at the
beginning of all sessions, we needed to confirm that pa-
tients who met these suggested inclusion criteria were
capable of operating the Amadeo (Tyromotion GmbH)
robotic device under guidance, otherwise they were not
included. More specifically, subjects with the following
conditions would not be included for this study (exclu-
sion criteria):
(1) non–stroke-caused functional deficits of an arm
and hand motor function or a history of more than
one stroke clinically;
(2) other neurological disorders such as Parkinson’s
disease;
(3) severe cognitive dysfunction;
(4) visual and hearing impairment;
Figure 2. Flow diagram of intervention process and protocol. Abbrevia-
(5) contracture or deformities in the UE; tions: FMA, Fugl-Meyer Assessment; MAS, Motor Assessment Scale; ROM,
(6) previous history of epilepsy. range of motion.
The exclusion criteria were kept to a minimum in order
to evaluate the feasibility of using RT among a variety
of patients. As a result, 1 54-year-old male stroke patient of “active mode therapy” in which the hand motion is
was found to satisfy the criteria; he suffered from hemiple- assisted by the robot; and 10 minutes of games that in-
gia caused by a stroke 52 months prior to the start of cluded active training in a simulated environment.
this study. The patient had limited movability in his right Intervention Phase B: 6 weeks of the proposed train-
arm, and his right-hand function was severely compro- ing protocol. After intervention Phase A, the patient was
mised by the stroke. The patient signed a written informed subjected to a novel dynamic adaptive assistive force based
consent to participate and a written informed consent for on a reinforcement learning neural network control al-
the publication of his clinical results. gorithm and the newly developed VR training games.
Each session included 10 minutes of “passive mode” train-
Intervention ing, 10 minutes of “adaptive AAN mode” training, and
10 minutes of a “new VR-based RGS” training.
The patient undertook a total of 18 weeks of training In the “new task-oriented VR-based RGS” for inter-
using the Amadeo (Tyromotion GmbH) hand rehabilita- vention Phase B, task-oriented interactive VR games such
tion robot, with 1 session per day and 3 days per week as object manipulation and simulated cooking scenarios
(a total of 54 training sessions) with each training session were used to enhance active participation and to promote
lasting for 30 minutes (1620 minutes in total). The re- the transformation of the acquired motor skills into abil-
search aim of this study was to investigate whether the ities to perform ADLs in real life. The process and training
patient is able to continue improving even after the po- protocols of the clinical trials is shown in Figure 2.
tential progress (if any) of Amadeo’s (Tyromotion GmbH) At the end of each session, the active range of motion
standard training protocol. Thus, the intervention was de- (ROM) and force intensity of fingers (both extending and
signed to have 2 separate phases. The training protocols grasping) were examined using Amadeo (Tyromotion
were as follows: GmbH) embedded sensors. Three clinical tests were con-
Intervention Phase A: 12 weeks of Amadeo (Tyromotion ducted at the beginning of all sessions (week 0), at the
GmbH) standard training protocol consisting of 10 minutes end of the 12 weeks of training, and at the end of all
of “passive mode training” in which the hand is stimu- the 18 weeks of RT training. During these tests, fine hand
lated in continuous passive motion therapy; 10 minutes motor skills of each subject were assessed using standard
224 X. HUANG ET AL.
clinical evaluation procedures: the FMA hand score and the object in the game is controlled by feedback posi-
the MAS. tion signal or force signal.
Figure 3. VR-based RGS and transferring VE. (A) Flying bird VR game. (B) Spaceship VR game. (C) Transferring VE-simulated supermarket.
(D) Transferring VE kitchen and cooking scenario. Abbreviations: VE, virtual environment; VR, virtual reality.
EFFECTS OF ADAPTIVE CONTROL AND VIRTUAL REALITY ON ROBOT-ASSISTED REHABILITATION 225
strength and active ROM in the context of a functional measured using the embedded position and force sensor
reaching movement. The subject is required to reach and of Amadeo (Tyromotion GmbH). The FMA and the MAS
grasp a simulated object and perform certain ADL tasks were chosen because they are widely used and easy to
(i.e., buy cooking ingredients, open the oven, set the alarm conduct and administer.13
clock) with the paretic hand. Prior to each training session, The FMA is a performance-based index designed to
the game settings are calibrated so as to be customized assess motor function and balance in patients following
to the participant’s active ROM of the affected fingers. a stroke. FMA has been used clinically as well as in re-
Participants are instructed to pick up virtual cooking in- search to determine disease severity, describe motor
gredients from a supermarket shelf (see Fig 3, C) with a recovery, and plan and assess treatment interventions. The
limited amount of virtual money and then to use the pur- FMA assesses isolated voluntary and synergistic move-
chased ingredients to cook a turkey in a simulated kitchen ment patterns, grasp, and reflex activity. Scoring in the
setting (see Fig 3, D). FMA is made on the basis of observing the subject’s ability
To achieve these tasks, the screen is divided into 5 ver- to complete certain predefined tasks, and a 3-point scale
tical sections, denoting the realm of 5 independent fingers. is used to measure performance (0 = unable; 1 = partial;
When the subject’s finger reaches the position of an object, 2 = performs fully) on 7 test items (total possible score = 14
corresponding actions are triggered if the detected force points) in the hand subsection. A higher FMA score in-
is larger than the preset adjustable threshold value, which dicates higher motor ability.14
can be adjusted according to the actual abilities of a certain As the secondary outcome measure, the MAS is a
subject. The real-time position and orientation and the performance-based scale developed to assess everyday
flexion and abduction of each of the fingers are trans- motor function. In contrast to the FMA, the MAS employs
lated into 2-dimensional movement. Moreover, the objects a task-oriented approach to evaluate the performance of
are placed at different heights to accommodate the active specific functional tasks rather than isolated patterns of
ROM of each finger. movement. The MAS hand movement is scored on a
7-point scale from 0 to 6, where 6 indicates the optimum
Results and Analysis motor behavior. During testing, subjects are required to
perform each task 3 times, and the best result is recorded.
A number of parameters associated with fine hand
motion rehabilitation including spasticity, reflexes, level
of voluntary control, and function movement were evalu- Results
ated. Kinematic measurements, including hand movement
The effectiveness of the proposed method is verified
speed and movement duration, were calculated using data
through the performance of the patient by comparing the
collected by the robot.
pretraining and post-training results. Four widely used
clinical measurement methods were also used to compare
Clinical Assessment Methods
the results. In order to ensure the validity and consis-
Considering the focus on fine hand motion rehabili- tency of the data, each test was repeated 3 times, and
tation in this study, and the conclusion would be drawn the mean value of the readings was chosen as the mea-
based on the pretraining and post-training performance sured score. All measurement data are presented as
of the subject, choosing suitable quantitative evaluation mean ± standard deviation along with the statistical sig-
methods with a focus on fine hand movements was thus nificance (P value). The results are shown in Table 1.
critical in this research. Four evaluation methods satis- As it can be seen from Table 1, the test results show
fying these requirements were chosen to assess the outcome improvements in all of the 4 measurement methods. Sig-
of the rehabilitation, namely active range of movement nificant improvements are observed between the first and
(ROM), active force output, FMA hand subsection, and second assessments, and mild improvements are achieved
MAS Hand Movement Score. Active ROM and force were between the second and third assessments. As suggested
Force (N)
Assessment Flexion Extension ROM (%) FMA-hand (0-14) MAS-hand movements (0-6) P value
Abbreviations: FMA, Fugl-Meyer Assessment; MAS, Motor Assessment Scale; ROM, range of motion.
226 X. HUANG ET AL.
by the FMA, the hand score has improved from 4.3 to
9.3 in Phase A, and the improvement continues to 11.0
at the third assessment in Phase B. The MAS hand move-
ment score measures changed from 2.3 to 4.6 in 12 weeks
and slightly increased to 5.3 in 18 weeks, in comparison
with the score measured at Phase A.
Between the results obtained in Phases A and B (sug-
gested by the second and third assessments), apart from
the improvement in force, ROM, FMA, and MAS scores,
the statistical changes are also worth noticing. It can also
be observed that the standard deviation and statistical
significance (P value) are dropped, which means smaller
variations and more consistency. This can be inter-
preted as that the patient can perform the training tasks
more smoothly and with fewer variables within each test.
Figure 5. Output force evolvement.
Statistical Analysis
and the results were recorded. Therefore, for each of these
As mentioned in section 2, 3 clinical assessments were
evaluation methods, there are 54 data sets available for
conducted using the FMA and the MAS at weeks 0, 12,
a more detailed analysis. More importantly, the data not
and 18. According to the recorded data, the FMA and
only provide a comparison between pretraining and post-
the MAS are shown in Figure 4.
training but also give information on when during the
As can be seen from Figure 4, the performance of the
training the change actually occurred. Therefore, this assists
subject improved in both Phase A (weeks 0-12) and Phase
in identifying the exact optimal length of the training
B (weeks 12-18), and this trend can be seen using both
session required in future studies.
FMA and MAS evaluation methods. However, the mag-
As can be seen in the force output in Figure 5, both
nitude of the improvement between Phase A and Phase
the flexion (grasping) and extension (extending) output
B is not the same. Actually, the slope of recovery trend
force graphs indicate growth in both Phase A and Phase
in Phase A is roughly twice that of Phase B, indicating
B. The fitted lines suggest that after a fast and obvious
that the progress in Phase A is more obvious than that
rise at the beginning of Phase A, the growing momen-
in Phase B. However, due to the limitation that there are
tum seems to halt into a stage where there is almost no
only 3 data sets available for the FMA and MAS assess-
improvement in the latter half of Phase A after 24 tests
ments, we cannot identify during which sessions these
(week 8). And this trend continues until the beginning
improvements occurred. Active ROM and force output
of Phase B. However, the curve follows a similar but less
data analyses are thus needed to conduct a more de-
obvious pattern, and the growth almost stabilizes in the
tailed conclusion.
latter half of Phase B as well. This trend can be seen in
At the end of each training session, finger flexion and
both flexion and extension lines. The efficiency of the pro-
extension force and active ROM tests were performed,
posed rehabilitation methods was further examined by
analyzing the active ROM testing results, as shown in
Figure 6.
The ROM analysis shows a significant improvement
in the first half of Phase A; however, after 6 weeks (18
tests) since the beginning of the training sessions, the
growth slows down gradually to be almost flat. In Phase
B (after 36 tests), the ROM initially improves slowly but
stabilizes around 79 after 4 weeks (48 tests shown in the
graph) since the introduction of the proposed hybrid re-
habilitation training protocol.
From the above results, we can interpret that a more
intuitive and engaging training protocol, as adopted in
Phase B, can fulfill the task of providing AAN control
as well as the task-oriented VR-based immersive train-
ing for the subject. It can promote further achievement
(shown in Phase B) after the halted growth using the
Figure 4. FMA and MAS assessment results. Abbreviations: FMA, Fugl- Amadeo (Tyromotion GmbH) standard training proto-
Meyer Assessment; MAS, Motor Assessment Scale. col (as shown in Phase A). However, we have to admit
EFFECTS OF ADAPTIVE CONTROL AND VIRTUAL REALITY ON ROBOT-ASSISTED REHABILITATION 227
Compared with previous studies, where only acute
(within 1 month after stroke)19,20 or subacute (1-6 months)21
patients were included, this case study was based on a
chronic patient (>6 months). A similar rehabilitation
treatment22 conducted on chronic stroke patients was found
to potentially contribute toward increased upper limb motor
recovery. Thus, the findings of this research would be of
interest to chronic stroke patients as well as the re-
search groups exploring this category of patients. However,
in any benchmarking between methods, the assump-
tion and criteria used in the studies, such as intervention
time, number of training sessions per week, duration of
training sessions, type of stroke, affected brain side, time
poststroke, VR tasks, feedback, and severity of lesion, may
affect the final outcome and should be taken into account.
Figure 6. Active ROM assessment results. Abbreviation: ROM, range Finally, we also need to note that the test results are
of motion. based on 1 subject only, which makes it difficult to totally
rule out invalid test data. Therefore, larger-scale clinical
trials, following the same inclusion and exclusion crite-
that the improvement in Phase B is also limited because rion, should be conducted on more stroke patients to enable
there are physical limitations in the stroke patient that the collection of more clinical test data and the estab-
hindered him to achieve further improvements in both lishment of a confirmed conclusion. Further studies should
Phase A and Phase B. also explore whether the outcome achieved through the
proposed method can be maintained over a long period.