Professional Documents
Culture Documents
PII: S2590-1095(23)00002-2
DOI: https://doi.org/10.1016/j.arrct.2023.100255
Reference: ARRCT 100255
Please cite this article as: Mariana Vita Milazzotto Neves MSc , Leonardo Furlan PhD ,
Felipe Fregni MD, PhD , Linamara Rizzo Battistella MD, PhD , Marcel Simis MD, PhD , Robotic-
assisted gait training (RAGT) in stroke rehabilitation: a pilot study, Archives of Rehabilitation Research
and Clinical Translation (2023), doi: https://doi.org/10.1016/j.arrct.2023.100255
This is a PDF file of an article that has undergone enhancements after acceptance, such as the addition
of a cover page and metadata, and formatting for readability, but it is not yet the definitive version of
record. This version will undergo additional copyediting, typesetting and review before it is published
in its final form, but we are providing this version to give early visibility of the article. Please note that,
during the production process, errors may be discovered which could affect the content, and all legal
disclaimers that apply to the journal pertain.
Mariana Vita Milazzotto Neves, MSc1 , Leonardo Furlan, PhD1 , Felipe Fregni, MD,
PhD2 , Linamara Rizzo Battistella, MD, PhD1 , Marcel Simis, MD, PhD1
Competing interests
The authors declare that they have no competing interests.
Funding
This work was supported by Núcleo de Apoio a Pesquisa – Núcleo de Estudos
Avançados em Reabilitação (NAP – NEAR). The researchers received support from the
São Paulo Research Foundation (FAPESP – SPEC, grant #2017/12943-8).
Authors' contributions
MVMN collected the data. MS analysed and interpreted the data. MVMN wrote the first
draft of the manuscript. LF extensively revised the first draft of the manuscript. FF,
LRB and MS revised and approved all subsequent versions of the manuscript. All
authors read and approved the final version of the manuscript.
Acknowledgements
The authors are grateful to Margarida H. Miyazaki (executive director of IMREA),
Mariane Tateishi, Katia Lina Miyahara (Clinical Director of IMREA), Artur César
Aquino dos Santos, Maria Cecília dos S. Moreira and Denise V. M. Ayres (Directors of
Physiotherapy Service) and the physiotherapy group from IMREA.
Corresponding author
Marcel Simis (marcel.simis@hc.fm.usp.br), Rua Domingo de Soto, 100 - Jardim Vila
Mariana, São Paulo - SP, 04101-300, +55 (11) 51807800.
1
Robotic-assisted gait training (RAGT) in stroke rehabilitation: a pilot study
Abstract
Objective: To compare the effects of two types of robotic-assisted gait training (RAGT)
Interventions: RAGT with either an exoskeleton (Lokomat) (mean age = 53.8; 30%
male; mean duration of stroke = 17.8 months) or an end-effector (G-EO) (mean age =
50.5; 77.8% male; mean duration of stroke = 13.11) delivered 3 times per week (36
sessions total).
Main Outcome Measures: The following tests/scales were employed before and after
Walk Test (10MWT), 6-Minute Walk Test (6MWT), Trunk Impairment Scale (TIS),
Dynamic Gait Index (DGI), Berg Balance Scale (BBS) and ability to climb stairs (time
Results: There were 5 dropouts, all from the G-EO group. At the end, 10 participants in
the Lokomat and 9 in the G-EO group completed the intervention. From pre- to post-
patients improved only on the TUG, DGI and BBS. Most patients showed
improvements above the relative smallest real difference (SRD%) in the TUG, 10MWT
and 6MWT.
aspects of walking function. However, this study had a small sample, was retrospective,
2
non-randomized, and had a significant number of drop-outs, therefore its findings
should be interpreted carefully. Future studies are needed for investigating potential
List of Abbreviations
1. Background
Stroke is a major cause of death and disability worldwide (1). After stroke, many
patients are left with gait impairments which restrict their physical independence and
life. For instance, the literature suggests that approximately 20-40% of patients remain
dependent or have no walking function six months after a stroke (2). Therefore,
3
developing effective rehabilitation strategies to restore or improve walking after stroke
is of paramount importance.
Current clinical practice guidelines recommend that people with stroke perform
walking function, in terms of either walking speed or distance (3). In daily clinical
practice, however, offering patients the opportunity to practice walking at such aerobic
intensities is rather challenging, for both the patients themselves and the therapists, who
often need to provide manual support and guidance. Another challenge is to give any
opportunity at all of task-specific training to patients with very limited mobility and
balance, who cannot stand and/or walk independently. One way to overcome these
Two types of RAGT device have been most frequently employed in walking
that moves the patients’ lower limbs over the treadmill according to pre-programed gait
patterns. End-effectors, on the other hand, are composed of a body weight support
system and two footplates that move the patients’ feet simulating gait patterns (4).
A recent Cochrane meta-analysis (5) showed that people with stroke who
receive RAGT in addition to physiotherapy are 2 times more likely to achieve walking
independence than patients receiving only physiotherapy or usual care (OR 2.01, 95%
CI [1.51-2.69]). Moreover, RAGT was shown to be safe and acceptable among patients.
The authors of that review also found that the type of RAGT device used
but that end-effectors may be better suited for achieving higher walking speeds (in
4
meters per second) and capacities (meters walked in 6 minutes) (5). This finding
corroborates the results of a previous network meta-analysis, which showed that end-
effectors, but not exoskeletons improve both walking speed and distance (6). However,
the specific benefits of each of these devices need to be better understood (5).
Determining whether exoskeletons and end-effectors are superior to one another has
important implications for clinical practice since their costs are substantially different.
the two RAGT devices in terms of their ability to improve walking as well as to
them.
2. Methods
institution (NCT02432521). The present research has been approved by the Ethics
Committee for Analysis of Research Projects (CAPPesq) from the University of São
Paulo’s Faculty of Medicine and written consent was obtained from each participant.
The use of the data for this ancillary study was properly approved by the ethics
committee and provided for in the consent form. Patients were recruited from the stroke
5
The inclusion criteria were: age over 18 years, clinical and neuroimaging-based
diagnosis of stroke, more than 1 month since the stroke and clinical stability. The
exclusion criteria were: musculoskeletal pain or deformities that could interfere with the
Patients were evaluated by a physiatrist who prescribed RAGT without specifying the
type of device (exoskeleton or end-effector). The allocation was not randomized and
was mainly based on the scheduling availability of the RAGT device and therefore was
were considered mild (see below). Because patients who are more severely impaired
(e.g., FAC score < 2) cannot be promptly treated with end-effector devices, they were
2.4. Intervention
The RAGT devices used were the G-EOa (end-effector) and the Lokomat b (exoskeleton).
The intervention was delivered 3 times per week in a total of 36 sessions. A team of
trained and certified clinicians was responsible for the training with the two devices.
6
For the G-EO device, the protocol consisted of 20 minutes of training. Patients
practiced gait and stair climbing (up and down). The first 5 minutes of the protocol
consisted of a warm-up phase, during which patients were instructed to walk at a pre-
determined speed according to their walking test’s result. For the Lokomat device, the
trained physiotherapist. Vital signs were monitored before, during and after training
with both devices, and gait speed and weight bearing were adjusted at the individual
During their period of RAGT, all patients took part in the conventional stroke
2.5. Assessments
Patients were assessed for their functional status before and after the 36 sessions of
RAGT. Demographic data and history were obtained at the initial assessment and from
the patients’ records. The following functional tests/scales were used: Functional
(10MWT), 6-Minute Walk Test (6MWT), Trunk Impairment Scale (TIS), Dynamic Gait
Index (DGI), Berg Balance Scale (BBS) and ability to climb stairs (ACS; time to climb
six steps of 15cm each). These tests/scales are widely employed in post-stroke walking
7
Statistical analysis was performed with STATAc. Due to our small sample, non-
parametric tests were used. To test for within-group changes, the Wilcoxon signed rank
test was used. The level of significance was set at p < 0.05 (two-sided). Patients who
could not perform the assessments at baseline were excluded from these analyses.
in TUG, 10MWT and 6MWT from pre- to post-RAGT. “Real improvements” means
improvements that exceed random measurement error and therefore reflect true
improvements were real, we used relative smallest real difference (SRD%) threshold
values that have been published for TUG, 10MWT and 6MWT (7). Relative
improvements ([change score/baseline score] x 100) equal to or higher than 23, 22 and
13% were considered real improvements in TUG, 10MWT and 6MWT, respectively
(7). Patients who could perform these tests after, but not before treatment, were also
3. Results
Twenty-four patients took part in the present study. Five patients from the G-EO group
did not complete the 36 sessions of training. Two of these patients were discharged due
because of knee pain and one due to an arm fracture at home. Of the remaining patients
who completed the study, most were mildly impaired, 10 received RAGT with Lokomat
The number of patients who could not perform the functional assessments at
baseline were four for DGI (two G-EO and two Lokomat), one for BBS (G-EO), one for
TIS (Lokomat), two for TUG (one G-EO and one Lokomat), two for 10MWT (one G-
8
EO and one Lokomat), three for 6MWT (one G-EO and two Lokomat) and four for ACS
(two G-EO and two Lokomat). Two patients from the G-EO group who were not able to
perform the assessments before treatment became able to perform it after RAGT; one
became able to perform the TUG test and the other the ACS test.
whereas in the Lokomat group, patients improved only on TUG, DGI and BBS (Table
3).
Table 4.
4. Discussion
We analyzed the data from people with stroke who underwent walking rehabilitation in
our institution in order to compare the exoskeleton (Lokomat) and end-effector (G-EO)
types of RAGT devices, in terms of their ability to improve walking function. From
employed, whereas Lokomat patients improved only on TUG, DGI and BBS. This
seeming difference between the two systems might be the result of an inflated type I
error rate due to uncorrected multiple testing, leading to false-positive findings in the G-
EO group. However, it is also possible that differences in the training provided by each
For instance, the RAGT provided by the end-effector might have facilitated the
standing up movement of the TUG test through better control and/or strengthening of
the hip and knee extensor muscles. For example, walking training with end-effectors
might impose greater knee extension demands than with exoskeletons (8). Moreover, the
9
stair climbing training provided by the G-EO device might have contributed to increase
hip and knee extension control and/or strength to a greater extent. However, these
With regards to the ACS test, patients in the G-EO group had a moderate effect-
size (0.63) whereas those in the Lokomat had a small effect-size (0.10). The G-EO
device essentially trains movements that are similar to the ones applied in the ACS test,
which is an adapted test used in our institution to measure the time in seconds that
patients take to climb 6 steps of 15cm each. This feature of the training could have
facilitated the transfer of training effects, hence leading to greater improvements in the
ACS test. This argument is theoretically supported by the principle of the ‘specificity of
training effects’, which states that the effects of training are specific to the muscles,
movements or tasks that were trained (9). Further support to this hypothesis comes from
the empirical observation of Hesse and colleagues, who found comparable activation
patterns for the quadriceps muscle of people with stroke during real and end-effector-
The finding that G-EO but not Lokomat patients showed statistically significant
improvements in walking speed and capacity, as assessed through the 10MWT and
6MWT, respectively, is in keeping with the results from previous meta-analyses (5,6).
speed after training with a wearable/mobile powered exoskeleton (10). The reasons for
this apparent difference have not yet been clarified and there is great heterogeneity
among studies (5), so further research addressing this issue is currently needed. It is
possible that peculiarities of the training regime with end-effectors are driving these
differences between the two types of RAGT device. For instance, as suggested by our
results, end-effector training might induce greater improvements in hip, knee, and trunk
10
strength and control, as well as in overall balance, as revealed by the results from the
TUG, TIS, BBS, and ACS tests/scales. Moreover, it is also possible that a higher
proportion of males and of patients at a lower chronicity level in the G-EO group have
was similar between the G-EO and Lokomat groups. The finding that some patients did
not show real improvements after RAGT may be related to the fact that most of our
sample was in the chronic phase of stroke (> 6 months). Besides, all patients had had
their stroke for more than 3 months, which is considered the period of greatest plasticity
and recovery (11). On the other hand, the fact that most patients from both groups
together showed real improvements (Table 4) demonstrates that meaningful gains are
still possible in the chronic phase of stroke through intensive task-specific training and
The observation that both groups improved on the DGI and BBS from baseline
stroke for balance training, which is a critical component of any comprehensive walking
rehabilitation program. It is likely that the lack of improvement in the TIS that was
observed in the Lokomat, but not in the G-EO group, was due to the lower trunk control
Overall, our results show that both end-effectors and exoskeletons improve
TUG, DGI, BBS and ACS. Moreover, it seems that for at least some walking-related
effect-sizes for some of the tests/scales. These results could have important implications
11
for clinical practice, as the costs associated with these two types of RAGT devices are
substantially different.
Notably, severely impaired patients (e.g., FAC score < 2) were not included in
our study because they do not promptly tolerate G-EO training well, unless they are
RAGT device should also be taken into account. In a previous publication, we identified
that the main contraindications for RAGT were cardiovascular diseases, skin ulcers and
the presence of spasticity (14). Other authors have reported additional contraindications,
such as use of a cardiac pacemaker, artificial joint replacement in hip/knee joints (up to
two years after implantation), osteoporosis, leg length differences, scoliosis, psychotic
illnesses and body weight greater than 150 kg (13). The adverse events commonly
associated with RAGT have been described in detail by others and include, for instance,
Our findings should be interpreted with caution since they come from a case series type
of study and not from a randomized clinical trial. Thus, we cannot exclude the influence
of allocation bias, even though group assignment was mainly determined by the
scheduling availability of each device, and not by clinical criteria. Besides, assessors
were not blind for the type of RAGT device used by the patients, which might also have
biased our findings. Moreover, all drop-outs were from the G-EO group. Three of these
patients had drop-out reasons likely unrelated to the intervention. The other two patients
were discharged due to knee pain. The exclusion of these two patients from the analyses
12
might have biased our results in favour of the G-EO device, if these patients were to
show no improvements or even deterioration of function due to knee pain. Even though
the RAGT provided by both the exoskeleton and end-effector devices was well
tolerated, with no major side effects, some features of the training with the G-EO device
might have contributed to this problem. However, this issue needs to be addressed in
future studies to confirm this hypothesis. Finally, as we did not perform any adjustments
Although our study has limitations, its results are important for a better
understanding of the effects of therapies and for planning future studies. Conducting
ancillary studies has been recommended to reduce costs and optimize the benefits of
5. Conclusions
Our results suggest that both end-effectors and exoskeletons may improve clinically
relevant aspects of walking function, as assessed through the tests/scales TUG, DGI,
BBS and ACS. However, this study had a small sample, was retrospective, non-
randomized, and had a significant number of drop-outs, therefore its findings should be
interpreted carefully. Future studies are needed for investigating potential differences in
clinical results, side effects, contraindications and cost effectiveness between these two
Suppliers
13
c. StataCorp LLC, Texas, USA.
References
1. Johnson, C. O., Nguyen, M., Roth, G. A., Nichols, E., Alam, T., Abate, D., Abd-
Allah, F., Abdelalim, A., Abraha, H. N., Abu-Rmeileh, N. M., Adebayo, O. M.,
Adeoye, A. M., Agarwal, G., Agrawal, S., Aichour, A. N., Aichour, I., Aichour,
M. T. E., Alahdab, F., Ali, R., … Murray, C. J. L. (2019). Global, regional, and
national burden of stroke, 1990–2016: a systematic analysis for the Global
Burden of Disease Study 2016. The Lancet Neurology, 18(5), 439–458.
https://doi.org/10.1016/S1474-4422(19)30034-1
2. Kwakkel, G., & Kollen, B. J. (2013). Predicting activities after stroke: What is
clinically relevant? International Journal of Stroke, 8(1), 25–32.
https://doi.org/10.1111/j.1747-4949.2012.00967.x
3. Hornby, T. G., Reisman, D. S., Ward, I. G., Scheets, P. L., Miller, A., Haddad,
D., Fox, E. J., Fritz, N. E., Hawkins, K., Henderson, C. E., Hendron, K. L.,
Holleran, C. L., Lynskey, J. E., & Walter, A. (2020). Clinical Practice Guideline
to Improve Locomotor Function Following Chronic Stroke, Incomplete Spinal
Cord Injury, and Brain Injury. In Journal of Neurologic Physical Therapy (Vol.
44, Issue 1). https://doi.org/10.1097/NPT.0000000000000303
4. Mehrholz, J., & Pohl, M. (2014). Rehabilitation robotics, orthotics, and
prosthetics: lower limb. In M. Selzer, S. Clarke, L. G. Cohen, G. Kwakkel, & R.
Miller (Eds.), Textbook of Neural Repair and Rehabilitation (pp. 190–197).
Cambridge University Press. https://doi.org/10.1017/CBO9780511995590.020
5. Mehrholz, J., Thomas, S., Kugler, J., Pohl, M., & Elsner, B. (2020).
Electromechanical-assisted training for walking after stroke. Cochrane
Database of Systematic Reviews.
https://doi.org/10.1002/14651858.CD006185.pub5
6. Mehrholz, J., Pohl, M., Kugler, J., & Elsner, B. (2018). OriginalArbeit:
Verbesserung der Gehfähigkeit nach Schlaganfall. Deutsches Arzteblatt
International, 115(39), 639–645. https://doi.org/10.3238/arztebl.2018.0639
7. Flansbjer, U. B., Holmbäck, A. M., Downham, D., Patten, C., & Lexell, J.
(2005). Reliability of gait performance tests in men and women with
hemiparesis after stroke. Journal of Rehabilitation Medicine, 37(2), 75–82.
https://doi.org/10.1080/16501970410017215
8. Hesse, S., Waldner, A., & Tomelleri, C. (2010). Innovative gait robot for the
repetitive practice of floor walking and stair climbing up and down in stroke
patients. Journal of NeuroEngineering and Rehabilitation, 7(1), 1–10.
https://doi.org/10.1186/1743-0003-7-30
9. Carr, J., & Shepherd, R. (2011). Neurological Rehabilitation, Optimizing Motor
Performance (2nd Edition). Churchill Livingstone.
10. Infarinato, F., Romano, P., Goffredo, M., Ottaviani, M., Galafate, D., Gison, A.,
Petruccelli, S., Pournajaf, S., & Franceschini, M. (2021). Functional gait
recovery after a combination of conventional therapy and overground robot-
assisted gait training is not associated with significant changes in muscle
activation pattern: An emg preliminary study on subjects subacute post stroke.
Brain Sciences, 11(4), 1–12. https://doi.org/10.3390/brainsci11040448
14
11. Zeiler, S. R., & Krakauer, J. W. (2013). The interaction between training and
plasticity in the poststroke brain. Current Opinion in Neurology, 26(6), 609–
616. https://doi.org/10.1097/WCO.0000000000000025
12. Ward NS, Brander F, Kelly K. Intensive upper limb neurorehabilitation in
chronic stroke: outcomes from the Queen Square programme. J Neurol
Neurosurg Psychiatry. 2019;90(5):498-506. doi:10.1136/jnnp-2018-319954
13. Reichl, S., Weilbach, F., & Mehrholz, J. (2020). Implementation of a gait center
training to improve walking ability and vital parameters in inpatient neurological
rehabilitation- a cohort study. Journal of NeuroEngineering and Rehabilitation,
17(1), 1–9. https://doi.org/10.1186/s12984-020-00669-3
14. Abstracts of Scientific Papers and Posters Presented at the 13 th ISPRM World
Congress, Kobe, Japan, June 9-13, 2019. (2020). The Journal of the
International Society of Physical and Rehabilitation Medicine, 3(6), 489.
https://doi.org/10.4103/2349-7904.294561
15. Filippo, T. R. M., De Carvalho, M. C. L., Carvalho, L. B., De Souza, D. R.,
Imamura, M., & Battistella, L. R. (2015). Proximal tibia fracture in a patient
with incomplete spinal cord injury associated with robotic treadmill training.
Spinal Cord, 53(12), 875–876. https://doi.org/10.1038/sc.2015.27
16. Nelson, E. K., Piehler, B., Rauch, A., Ramsay, S., Holman, D., Asare, S., Asare,
A., & Igra, M. (2013). Ancillary study management systems: A review of needs.
BMC Medical Informatics and Decision Making, 13(1), 1.
https://doi.org/10.1186/1472-6947-13-5
15
Table 1. Demographics of the patients who completed the study.
16
Table 2. Comparison ‘G-EO Baseline’ vs ‘G-EO Post-training’.
16, 17,
TIS 0.50 0.032 9
10 – 17.5 12.5 – 22
12, 16,
DGI 0.63 0.018 7
11 – 15 14 – 17
40.5, 49.5,
BBS 0.63 0.012 8
31.3 – 51.3 44.5 – 55
17
Table 3. Comparison ‘Lokomat Baseline’ vs ‘Lokomat Post-training’.
19, 20,
TIS 0.45 0.056 9
16.5 – 19 17.5 – 21
13.5, 16,
DGI 0.58 0.019 8
10.3 – 21.3 15 – 22.8
44.5, 46.5,
BBS 0.48 0.032 10
33.8 – 51 37.8 – 53.3
18
Table 4. Percentages of participants who had a “real improvement’ (95% CI).
19