You are on page 1of 14

1

Neuromechanical model-based control of bi-lateral


ankle exoskeletons: biological joint torque and
electromyogram reduction across walking conditions
Guillaume Durandau, Member, IEEE, Wolfgang Rampeltshammer, Student Member, IEEE, Herman van der
Kooij, Member, IEEE, and Massimo Sartori, Member, IEEE
arXiv:2108.00980v1 [cs.RO] 2 Aug 2021

Abstract—To enable the broad adoption of wearable robotic that enables exoskeletons to operate as a natural extension of
exoskeletons in medical and industrial settings, it is crucial the human neuromusculoskeletal system. Despite advances in
they can effectively support large repertoires of movements. We materials [5], soft actuation [6] and ergonomics [7], wearable
propose a new human-machine interface to drive bilateral ankle
exoskeletons during a range of “unseen” walking conditions robotic exoskeletons are limited in their ability of seamlessly
that were not used for establishing the control interface. The assisting a broad range of walking conditions in unforeseen
proposed approach uses person-specific neuromechanical models and unstructured environments. Exoskeletons currently do not
of the human body to estimate biological ankle torques in account for changes in walking speed, ground elevation as well
real-time from electromyograms (EMGS) and joint angles. A as transitions across these conditions or dexterous challenging
low-level controller based on a disturbance observer translates
biological torque estimates into exoskeleton commands. We call tasks such as moonwalking [3]. Progress has been hampered
this ”neuromechanical model-based control” (NMBC). NMBC by the lack of robust and intuitive HMIs.
enabled five individuals to voluntarily control exoskeletons across Current HMIs do not enable humans to voluntarily control
two walking speeds performed at three ground elevations with exoskeletons in an intuitive way. Rather, they predominantly
no need for predefined torque profiles, nor a priori chosen neuro- operate within a priori defined conditions, i.e. by relying on a
muscular reflex rules, or state machines as common in literature.
Furthermore, a single subject case study was carried out on a finite set of pre-computed torque, angle profiles [4], [8]–[12]
dexterous moonwalk task, showing reduction in muscular effort. or a priori chosen neuromuscular reflexive rules [13], [14] trig-
NMBC enabled reducing biological ankle torques as well as eight gered at pre-determined gait phases. Pre-defined joint torque
ankle muscle EMGs both within (22% for the torque; 13% for profiles can be further optimized to an individual via human-
the EMG) and between walking conditions (22% for the torque; in-the-loop optimization methods, which reduce metabolic
13% for the EMG) when compared to non-assisted conditions.
Torque and EMG reduction in novel walking conditions indicated cost of transport [10], [12] or electromyograms (EMG) [15].
the exoskeleton operated symbiotically as an exomuscle controlled However, optimal profiles are still specific to a pre-selected
by the operator’s neuromuscular system. This will open new walking condition and require tens of minutes to be found,
avenues for systematic adoption of wearable robots in out-of- during which the human is exposed to sub-optimal joint torque
the-lab medical and occupational settings. perturbations [12], thereby limiting clinical viability. State
Index Terms—Ankle, EMG, HMI, Model-based Control, Neu- machines are often used for switching between pre-defined
romechanical Modelling, Walking, Wearable Exoskeleton. profiles (i.e. to support selected speeds and ground eleva-
tion) [4], [11], but cannot provide continuous support across
I. I NTRODUCTION transitions and are prone to misclassification and inadequate
assistance during unknown locomotion conditions.
W EARABLE robotic exoskeletons have great potentials
for enhancing human mobility. That is, promoting
motor function recovery within neurorehabilitation training [1]
Most experiments performed on exoskeletons do not investi-
gate the transition between walking tasks [3]. Some studies in-
vestigated multiple walking conditions like McCain et al [16]
or protecting from work-related musculoskeletal injuries in
who proposed an EMG based controller with speed adaptation
occupational settings (i.e. factory or in-home scenarios) [2].
but did not show a metabolic reduction during tested walking
In this context, the ability of assisting functional movements
tasks. Other studies investigated different walking conditions
such as walking is a central target. Walking underlies a
but did not investigate performance in the transition phase [4].
sophisticated interplay between neurons, muscles and skeletal
Joint angle proportional controllers based on the difference
segments. Placing assistive exoskeletons in parallel to an
between bi-lateral hip joint angles showed promising results
already complex biological system makes the problem of
for level ground walking as well as ramp and stairs climbing
walking assistance an open challenge [3], [4]. Advances in
[17]. However, such methods suffer from lack of flexibility
human-machine interfaces (HMIs) are crucial for opening up
and generalizability as they are based on a two-legged inverted
a robust and intuitive communication and control channel
pendulum, limited in representing walking dynamics.
The study was supported by the H2020 ERC Starting Grant INTERACT This, limits exoskeletons applicability to pre-defined move-
(803035) and by the H2020 ICT-10 Project SOPHIA (871237). The authors ments and prevents translation of these methods outside of the
are with the Department of Biomechanical Engineering, Technical Medical
Centre, University of Twente, Enschede 7522 NB, The Netherlands (e-mail: lab, ultimately impacting user’s acceptance.
g.v.durandau@utwente.nl, m.sartori@utwente.nl). Proportional myoelectric controllers [16], [18] have been
2

Muscle Activation Parameter


F:Calibration Experimental
Normalization Stage Joint Torque
Ajustment
Muscle-Tendon Optimization
Filter
B:Surrogates Length C:Musculotendon
Stage Dynamics Stage
A:Input Stage Moment arm Muscle-Tendon
EMG Force

Joint Angle
Spring Model τexo
Spring
DOB Biological
Deflection τdist Joint Predicted
Support Torque Joint Torque
Motor PD +
Mechanical τm Feedforward τsupport Ratio D:Moment
Assistance
E:Assistance Stage Computation Stage

Fig. 1. Schematic representation of the neuromechanical model-based control and the experimental setup with A) being the input stage that records EMGs
and joint angles, B) the 3D musculoskeletal geometry surrogate stage that transforms joint angles into muscle-tendon lengths and muscle moment arms, C)
the muscle-tendon dynamics stage that transforms muscle-tendon lengths and EMGs into muscle forces, D) the moment computation stage that transforms
muscle forces and moment arms into joint torques (see section II-A. for an in-depth explanation on the previous stage), E) the assistance stage that transforms
joint torques into mechanical assistance to the user (see section II-C, D and E) and F) the calibration stage that personalizes the muscle-tendon dynamics
stage to the user (see section II-B). The experimental setup consists of the Zero-G system (on top, blue) that prevents falling, the backpack (on the back on
the user, black) where the battery and computer unit are situated, the ankle exoskeleton (on the ankle of the user, black and grey), the EMG sensors (on the
leg of the user, red) and the IMU suit (on the leg of the user, orange).

proposed to assist the user continuously and proportionally to 4 knee-ankle joint angular positions across both legs) into a
recorded EMGs. However, these methods rely on direct EMG lower 2-dimensional set of ankle plantar-dorsi flexion torque
control where a few EMGs (e.g. typically one EMG per leg) profiles.
are directly used as exoskeleton control commands. This does This article builds on top of a previously published con-
not take into account the highly non-linear transformations ference case study [19]. The main goal of this case study
that take place between EMG onset and mechanical joint was to present the use of a real-time neuromusculoskeletal
torque generation due to the inherent non-linear behaviour model to support one walking condition with an exoskeleton.
of muscle-tendon unit as well as the dynamic interplay of In this paper, we presented the results of one subject and
multiple muscles acting on one joint. Moreover, given that net a single walking task with limited performance metrics. The
joint torques are contributed by many muscles, the use of a present study goes one step further and presents in detail the
few EMG sensors, with no explicit modelling of the EMG- calibration used that allows our framework to be versatile for
to-force transformations, does not enable accurate estimates multiple users and walking tasks, which removes the need for
of biological joint function. As a result, these methods have different models for each individual walking condition. Fur-
not shown conclusive results in terms of robustness and thermore, we present an interface between a stable and passive
generalization across tasks and individuals [3]. torque controller and an EMG-driven neuromusculoskeletal
In this study, we propose an HMI that decodes realistic es- which allows to efficiently assist walking in various conditions.
timates of ankle joint torques from leg EMGs and joint angles We also demonstrate beneficial biomechanical assistance on
across a broad range of walking conditions, i.e. two ground different walking conditions, including transitions between
elevations times three walking speeds, including transitions walking conditions with the same controller, with no need
across these conditions. Furthermore, to show the efficacy to re-calibrate the model, differently from state of the art
of the developed controller, a single subject case study was techniques, which rely on other approaches (state machine or
carried out involving a dexterous task, i.e. moonwalking. machine learning) for switching between controllers or pre-
The proposed HMI uses a person-specific neuromechanical computing assistance patterns.
model of the human leg to simulate in real-time all trans- This method based on the Hill-type muscle model has
formations that take place from EMG onset to joint torque been previously used to control prostheses [20] and exoskele-
generation. This is a data-driven model-based, sensor-fusion tons [21]–[26]. Most of the previous work on lower-limb
procedure that effectively fuses a higher-dimensional multi- exoskeletons consisted on position tracking tasks during seated
modal set of wearable sensor signals (i.e., 8 leg EMGs and position [21], [25], [26] or very slow locomotion for only one
3

joint [23]. None of the previous studies has applied EMG-


driven neuromusculoskeletal modelling to a large repertoire A B

Normalised Muscle Force (-)

Normalised Muscle Force (-)


of walking conditions and transitions to show muscle effort 2.0 Active force length curve
reduction. Passive force length curve 1.5
1.5 Sum
Biological torque estimates are subsequently fed into a low 1.0
level controller based on a disturbance observer [27] to effec- 1.0

tively translate model-based torque estimates into exoskeleton 0.5


0.5

motor commands while following the voluntary motion of the


0.0 0.0
user (also see supplementary movie 1). We call this HMI 0.0 0.5 1.0 1.5 −2 −1 0 1 2
Normalised Muscle Length (-) Normalised Muscle Velocity (-)
approach, ”neuromechanical model-based control” or NMBC.

Normalised Tendon Force (-)


1.5
Because, muscle activations and resulting mechanical forces
are derived directly from measured EMGs, NMBC makes no
1.0
assumptions on how muscles activate, i.e. there is no need
for choosing finite sets of muscle reflexes rules or optimal
0.5
activation criteria that would be valid in certain conditions
only [4]. 0.0
0.00 0.04 0.08
We hypothesized that the calibration procedure and integra- Tendon Strain (-)
tion with a torque controller with apparent passivity enables D C

estimating joint torque across a broad range of ”unseen”


walking conditions, i.e. walking conditions that were not used Fig. 2. Normalized force relationships and Hill-type muscle model schematics
used in the neuromechanical model-based control detailing the modelled
to calibrate the model. Moreover, we hypothesised that, when A) normalized muscle fiber active force-length and passive force-length
used to control the bi-lateral exoskeleton, NMBC would lead relationships, B) normalized muscle fiber force-velocity relationship, C) elastic
to biological joint torque and EMG reduction across different tendon force-strain relationship D) the Hill-type muscle representation.
(unseen) walking conditions. From this, we can formulate two
research questions: (I) Can biological torque amplitudes be
reduced when assisted by a NMBC controlled exoskeleton muscle-tendon units (see Section III for the definitions of the
for all tested locomotion conditions and transitions (primary muscle-tendon units and EMG used).
outcome)?; (II) Can EMG amplitude be reduced when assisted To update the kinematic-dependent states of the virtual
by a NMBC controlled exoskeleton for all tested locomotion muscle-tendon units, the muscle-tendon operating length needs
conditions and transitions (secondary outcome)?; to be known. Muscle-tendon length cannot be easily recorded
Here, we first describe the structure of NMBC as well directly but can be computed as a function of joint angles
as that of the wearable bilateral ankle exoskeleton employed using three-dimensional musculoskeletal geometry models.
in this study. Then, we present the experimental procedures To assure a real-time computationally efficient estimation of
for testing the efficacy of our proposed approach as well muscle-tendon length, we employed B-splines as previously
as the quantitative analyses and results emerging from the presented [28]. This allows for the computation of muscle-
performed experiments. Finally, we discuss the implications tendon lengths as a function of joint angles. B-spline co-
and limitations of the study and future work. efficients for each muscle-tendon unit are computed using
nominal length values generated via OpenSim [29]. Muscle-
II. M ETHODS tendon units’ length and activation estimates are used to
compute the resulting muscle-tendon force via personalized
Fig. 1 represents our proposed NMBC scheme. Each con- Hill-type muscle models (Fig. 1-C, Musculotendon dynamics
stituent block is detailed in the remainder of this section. stage) (See Annex 2 in supplementary material). These consist
of a non-linear spring (tendon) in series with three elements
A. High-level control via neuromechanical modelling representing the muscle fibers: an active contractile element,
To assure voluntary and continuous torque control, ex- in parallel with a non-linear spring and a linear damper (i.e.
oskeleton commands are computed as a direct function of the muscle fiber passive elements) [30].
estimated subject’s biological joint torque. EMGs are recorded, As previously stated, from joint angles the whole length
amplified and filtered via hardware directly by the surface of an individual muscle-tendon unit is obtained but the con-
electrodes using proprietary signal detection and acquisition stituent muscle fiber length is needed to compute muscle fiber
system (AxonMaster 13E500, Ottobock, Germany) (Fig. 1-A, forces. For this, the Brent–Dekker root-solver iterative method
input Stage). Filtered EMGs are normalized using pre-recorded [31] is used to solve for the equilibrium between muscle force
maximal voluntary contractions to compute muscle excitation. and tendon force. Tendon force is obtained using the passive
The tasks used for maximal voluntary contraction recording tendon force-strain relationship (fig. 2-C) (See Annex 3 in
are static co-contraction for the plantar and dorsiflexion as supplementary material).
well as dynamic calf rises and front foot rises. Each task Finally, muscle forces are projected onto the ankle joint
is repeated three times. Filtered and normalized EMGs are plantar-dorsiflexion via the moment arms to obtain joint
subsequently converted into muscle activations (See Annex 1 torque. The moment arm is obtained via the partial derivative
in supplementary material) and used to drive a set of virtual relative to a joint angle using the B-spline algorithm previously
4

introduced and the principle of virtual work (See Annex 4 in encoders (20 b Aksim, RLS (Renishaw), Kemnda, Slovenia)
supplementary material). which are transmitted to the control computer via the Everest
Net drive. The backpack contains the control computer, a
B. Model personalization NUC (Intel, Santa Clara, USA) that executes the controller
in TwinCAT 3 (Beckhoff Automation, Verl, Germany) in real-
A generic musculoskeletal geometry model is scaled lin-
time with a sampling frequency of 1 kHz. Additionally, the
early to each individual using the open-source software Open-
backpack contains two batteries, supplying the computer and
Sim [29] and 3D motion capture data of body landmarks (bony
actuators with power. The backpack has a weight of 10 kg.
areas) recorded during a static standing pose. During this
procedure, we linearly adjust muscle-tendon bone-wrapping
and origin insertion points as well as the center of mass D. Low-level torque control via disturbance observers
values and positions of the anatomical segments, to match an The Symbitron ankle exoskeleton interacts with its user by
individual’s anthropometry. This scaled model is used to create controlling the interaction torque between user’s leg and the
a multidimensional B-Spline function per muscle-tendon unit exoskeleton module, i.e. the spring torque τexo . This torque is
as described in Section II-A for the computation of subject- computed from the measured spring deflection and a linear
specific muscle tendon lengths and moment arms. model of the actuator’s spring (Fig. 1-E). The interaction
Four parameters are calibrated for each muscle in the model torque is controlled via a disturbance observer controller
including: A the EMG shape factor, LTSlack the tendon slack recently developed for lower limb exoskeletons [27]. The con-
length, LMOpt the optimal fiber length and FIso
M ax
the maximal troller fulfils three purposes: it increases the bandwidth of the
isometric muscle force. This calibration is based on a two steps actuator to 30 Hz, it lowers the actuator’s apparent impedance,
procedure. First, a previously presented pre-tuning procedure i.e. it makes the actuator as mechanically transparent as
[32] is employed to identify initial values for LM T
Opt and LSlack possible, and it guarantees unconditional interaction stability
(See Annex 5 in supplementary material). with any environment. Unconditional interaction stability is
After initial values for LM T
Opt and LSlack are found, all especially important for an ankle exoskeleton to avoid non-
four muscle parameters (A, FIso , LOpt , and LTSlack ) are
M ax M passive behavior, i.e. oscillations, during impacts such as heel
optimized to enable the subject-specific model to fuse recorded strikes and changes in the environment such as between swing
EMGs and joint angles into joint torque profiles over a range and stance phase. This unconditional interaction stability was
of locomotion trials. This is based on a simulated annealing achieved by adapting the disturbance observer, and has been
procedure [33] that minimizes the error between the estimated practically proven with the actuators used in the Symbitron
torque by the model and the experimental torque derived via exoskeleton in [34]. It was found that the low-level torque
inverse dynamics (Fig. 1-F) (See Annex 6 in supplementary controller was able to achieve a precise torque tracking with
material). The parameters boundaries are varying between - a root mean squared error of 1.8 N.m.
3 and 0 for the EMG shape factors A, between 0.5 and 1.5 The controller consists of an inner loop PD controller
M ax with feedforward term, that increases the actuator’s torque
for the normalized maximal isometric muscle forces FIso
after normalization and between ±2.5% for the optimal fiber bandwidth, and an outer loop disturbance observer (DOB)
lengths LMOpt and between ±5% tendon slack lengths LSlack
T that lowers the actuator’s apparent impedance, while keeping
from the values found during pre-tuning. it passive. The DOB computes the torque caused by distur-
bances, such as impacts during heel strike, or voluntary motion
C. Bi-lateral ankle exoskeleton of the subject, and subtracts that disturbance torque τdist from
the desired reference torque τsupport , which is the estimated
In this study, the left and right ankle modules of the Symbi-
joint torque from the NMBC multiplied by a support ratio,
tron exoskeleton with upgraded electronics were used [34] to
to eliminate the effect of the disturbance on the interaction
assist bi-lateral plantar-dorsiflexion during locomotion. Each
torque τexo . This disturbance rejection makes the actuator as
ankle module weighs 5Kg. The active degree of freedom is
transparent as possible while keeping its interaction with the
actuated with a rotary series elastic actuator (SEA), which
environment stable. The resulting torque τm is sent to the
transmits the desired interaction forces via a push-pull rod
motor as a reference.
from its distal location to the ankle joint. The SEA consists of
a motor (Tiger Motor U8-10(Pro), T-Motor, Nancheng, China)
that is connected to a harmonic drive (LCSG20, Leader Drive, E. Assistance
Jiangsu, China) with a gear ratio of 1:100. The harmonic To assure timely and voluntary exoskeleton torque control
drive is connected to the output of the motor with a custom a tight integration between high and low-level control is
rotary spring with a stiffness of 1534 Nm/rad. The actuator required. For this, the estimated biological joint torque is sent
can deliver a controlled peak torque of 100 Nm and has a from the subject-specific NMBC to the exoskeleton low-level
maximum output speed of 5 rad/s. The motor is controlled controller via the Ethercat real-time communication protocol.
via an Everest Net drive (Ingenia, Barcelona, Spain), which The low-level controller multiplies biological torque estimates
communicates with the control computer via EtherCAT. Motor by a support ratio that varies between 0 and 1, with 0
position is measured via a rotational encoder (16 b MHM, meaning that the exoskeleton acts in minimal impedance and
IC Haus, Bodenheim, Germany). Additionally, the actuator 1 signifying 100% of assistance given, i.e. the exoskeleton
measures the spring deflection and joint position with two assists with the same amount of torque as generated by the
5

subject’s biological joint. The maximal torque delivered by 0.2


0.2 0.2 0.1 A

Gas. Med.

Gas. Lat.

Tib. Ant.
EMG (-)

EMG (-)

EMG (-)

EMG (-)
Soleus
the exoskeleton is limited to a maximum of 40 N.m to assure

EMG
the safety of the subject and the integrity of the actuator. 0.0
0 100
0.0
0 100
0.0
0 100
0.0
0 100

0.20 B

Joint angle
Joint angle (rad)
F. Data processing 0.00

Experimental results were segmented automatically using −0.15


0 20 40 60 80 100
a peak detector on the knee joint angle. Each segment was

Muscle force
Gait (%)

re-sampled as percentage of the gait cycle. The root means 2 5.0


10 C

Muscle Force

Muscle Force

Muscle Force

Muscle Force
5

Gas. Med.

Gas. Lat.

Tib. Ant.
(N/Kg)

(N/Kg)

(N/Kg)

(N/Kg)
Soleus
2.5 5
squared value of the data of interest (EMG, biological torque, 0
0
0 100 0 100 0 100 0 100
exoskeleton torque, joint angle) was identified for each seg-
mented cycle, values that were larger than three times the 0.2 D

Joint torque
Torque (N.m/Kg)
0.0
interquartile values were removed. Moreover, percentages of
change between assisted and non assisted condition were
calculated using the mean of all steps for EMG and joint −0.6
0 20 40 60 80 100
Gait (%)
torques (biological and exoskeleton). Statistical significance
Non Assisted
was computed for the percentage of change between ex- Assisted
Exoskeleton Torque for Non Assisted Condition

oskeleton conditions. First, normality of the distribution was Exoskeleton Torque for Assisted Condition

verified using the Shapiro–Wilk test. Then, the equality in


Fig. 3. Averaged EMG for the Gastrocnemius Medialis, Gastrocnemius
variance was verified using the Levene’s test. If both tests were Lateralis, Soleus and Tibialis Anterior (A - red), ankle joint angle (B - green),
passed a two-sided t-test was used to compute significance. muscle force for the Gastrocnemius Medialis, Gastrocnemius Lateralis, Soleus
If inequality of variance was found the Welch’s t-test was and Tibialis Anterior (C - blue), plantar dorsiflexion biological joint torque
(D - purple) and exoskeleton torque (D - purple) over the gait cycle for the
used. This was the case for most of the locomotion conditions 1.8km/h, -5% elevation walking condition. The represented data is the mean
but for some of the locomotion conditions, neither of the of all subjects.
assumptions were true and the Wilcoxon signed-rank test was
used. For the locomotion condition transitions, significance
was computed using linear mixed modelling with the torque capture’s 3D markers data (Oqus, Qualisys, Sweden), three-
or individual muscle’s EMG as a fixed effect, the transition dimensional ground reaction forces (M-Gait, MotekForce
as an independent variable, and exoskeleton conditions as a Link, The Netherlands) and EMGs (AxonMaster 13E500,
random effect. For this test, a Bonferroni correction was used Ottobock, Germany) were recorded from each subject. EMG
to reduce the effect of multi-testing (locomotion conditions signals from eight muscles were recorded including: left
as well as transitions) for the torque reductions and each and right Soleus, Tibialis Anterior, Gastrocnemius Medialis
muscle’s EMG (P <0.007). For the equivalence of the Human- and Lateralis. Marker data and ground reaction forces were
exoskeleton torque between the two tested conditions (assisted used to compute joint angles and joint torques using inverse
and non-assisted), the two-one-sided t-tests (TOST) was used. kinematics and inverse dynamics [29]. These data were used
A strict bond of ± 2 N/m was selected to take into account to personalize the NMBC using the methods described in
the possible noise in EMG, joint position and joint torque section II-B. The NMBC’s model used during this experiment
recording from sensors. Finally, for this test a Bonferroni was based on [35] and contained the following joints: left
correction for multiple testing (each walking condition) was and right plantar dorsiflexion and knee flexion-extension and
applied for a significance level of P <0.0083. the following 14 muscles tendon units: left and right Soleus,
Tibialis Anterior, Gastrocnemius Medialis and Lateralis and
Peroneus Longus, Brevis and Tertius. The following tasks were
III. E XPERIMENTS
used for the calibration of the model: static pose for 10 sec,
Experiments were conducted on 5 healthy subjects (28±5 60 seconds of treadmill walking at 1.8 km/h and 2.8 km/h, 10
years, 178±6 cm, 77±11 Kg, all male). Participants had no in- calf rises and 10 front foot rises.
stance of musculoskeletal injury or motor-control impairment, The second phase of the experiment consisted of defining
had a shoe size between 43 (9.5 US) and 46 (12 US) and the locomotion experimental parameters and acclimation of
a tibial vertical length greater than 28 cm. All experimental the subject to walking with the exoskeleton. Two experimental
procedures were carried out in accordance with the Declaration parameters were set during this phase, the support ratio (see
of Helsinki on research involving human subjects. All subjects Table I) and the step frequency for the two tested speeds. Step
provided their explicit written informed consent to participate. frequency (the time between two hell strike from the same
Experiments were approved by the Natural Sciences and leg) was controlled during the experiment to make sure that
Engineering Sciences Ethics committee of the University of the assistance was integrated by the subjects and reduced their
Twente (reference number 2020.21). own torque without altering their speed or step length.
The experiment was conducted following three phases each The support ratio (see section II-E) was selected by the
one done on a different day. subjects as a tradeoff between comfort and assistance. Since
The experiment first phase was carried out for the pur- most of our subjects were naı̈ve users of the exoskeleton,
pose of personalizing the NMBC to each individual. Motion the comfort level of assistance between users was different.
6

RMS Torque (N.m) Assisted Non Assisted

Steps (-) Steps (-)

Fig. 4. Estimated biological ankle torque for a representative subject for the two tested locomotion conditions, i.e. assisted and non-assisted. Each grey dot
represents the torque root mean squared sum (RMS) for each gait cycle. The red dotted line represents torque RMS trend within each locomotion condition.
The green dotted line represents torque RMS trend during transitions across locomotion conditions.

We privileged the comfort of the subjects over an aggressive a moonwalk task. The task was realized at the end of the
support ratio or identical support ratio. Our findings over experiment and was repeated 3 times for each condition on a
multiple subjects were that the level of a comfortable support 5 m track (see video in supplementary material.)
ratio was variable between subjects and thus an identical
support ratio was not advisable. IV. R ESULTS
Subjects walked on a treadmill (Thera-Treadpro, Sportplus) Fig. 3 presents the different transformation realized in the
with the exoskeleton with and without assistance until they NMBC from EMG (Fig. 3-A) and joint position (Fig. 3-B) to
presented a natural-looking gait and felt confident (10 to 20 muscle forces (Fig. 3-C) and joint torques (Fig. 3-D) for the
minutes on average). To measure the knee joint angle, an IMU walking tasks of 1.8 km/h and -5% elevation. In this figure,
suit was used (Link, Xsens, the Netherlands), the ankle joint the results are presented as an average over the gait cycle. In
angle was directly available from the joint encoder of the Fig. 3-D, the biological joint torque for the two conditions
exoskeleton. The knee angles are required for the simulated as well as the exoskeleton torque are presented over the gait
Gastrocnemius muscles that span the ankle and knee joints. A cycle. It can be observed that a reduction of biological joint
fall prevention system was used every time the subjects were torque is always achieved for the full gait cycle when assisted
walking with the exoskeleton (ZeroG, Aretech LLC, USA), for the 1.8km/h, -5% elevation walking task. Similar results
which provided bodyweight support of 5 Kg. can be observed for the rest of the tested walking tasks (see
The last phase of the experiment evaluated the NMBC’s supplementary material Fig. S2). In Fig. 3-A, the EMGs over
ability in supporting locomotion and exoskeleton voluntary the gait cycle for all the recorded muscle during the 1.8km/h,
control (see Video in supplementary material). Two exoskele- -5% elevation walking task are presented. The calf muscles
ton conditions were tested, non assisted (minimal impedance) present the most reduction during the push-off phase, for the
and assisted (NMBC). Each exoskeleton condition was tested Tibialis Anterior most of the reduction happens during the start
across six different locomotion conditions that were randomly of the swing phase. The following sub-sections are presenting
presented to the subject. The data were collected in a single averaged results and reduction percentages.
uninterrupted session including the six randomly combined
locomotion conditions and the transitions within. The tested A. Biological torque reduction
locomotion conditions were 1.8 km/h (speed), 0% (0 degrees) Fig. 4 shows the biological ankle torque averaged across
(slope); 1.8km/h, -5% (-2.8 degrees); 1.8 km/h, 12% (6.84 each gait cycle (for all tested walking conditions) for the
degrees); 2.8 km/h 0% (0 degrees), 2.8 km/h, -5% (-2.8 two tested exoskeleton conditions (i.e. minimal impedance
degrees); 2.8 km/h 12% (6.84 degrees). and assistance from the NMBC) as well as the trends (first-
Each locomotion condition had a duration of 3 min, the order polynomial fitting curve) (dashed line) for the tested
transition between walking conditions was of variable length walking conditions (red) and during the transition (green). Fig.
due to the time needed by the treadmill to change between 5 presents the estimated biological ankle torque for all tested
speed and/or inclination. These varied approximately between walking conditions as well as for all transitions and for the
10 seconds and 60 seconds. complete experiment between the two exoskeleton conditions.
For the last subject, a single subject study was done on Reductions between exoskeleton conditions were achieved for
7

TABLE I
S UBJECT SPECIFIC SUPPORT RATIO , EMG AND TORQUE REDUCTION AS WELL AS AVERAGED RECEIVED PEAK ASSISTANCE TORQUE FOR ALL TASKS ,
TRANSITION AND COMPLETE EXPERIMENTS . R ED CELL REPRESENTS INCREASE AND BLUE CELL REPRESENTS REDUCTION .

Subject (-) Tasks 2.8 km/h 2.8 km/h 2.8 km/h 1.8 km/h 1.8 km/h 1.8 km/h During Complete
Support Ratio (%) Muscles -5% 0% 12% -5% 0% 12% Transition Experiment

Gas. Med. (%) -14.6* -9.8* -8.6* -17.1* -3.6 -11.1* -10.2* -10.0

Gas. Lat. (%) -20.6* -15.2* 9.2* -10.3 -0.8 -6.7 -2.9 -8.5

Soleus (%) -40.6* -27.4* -22.6* -37.0* -17.2* -9.5* -22.1* -27.7
Subject 1 (60%)
Tib. Ant. (%) 13.5* 12.2* 35.8* 9.3 43.6* 32.4* 16.8 18.8
Biological
-36.2* -30.8* -26.7 -34.3* -25.9* -23.6* -28.0* -28.6
Torque (%)
Averaged
33.8 36.5 37.5 12.8 32.3 34.0 34.3 35.1
Peak Assistance (N.m)
Gas. Med. (%) 0.2 -4.2 7.5* 5.5 3.4 -5.2 5.1 -0.5

Gas. Lat. (%) 4.5 -6.8 26.4* 2.0 2.3* 1.5 -16.6 2.0

Soleus (%) -35.0* -23.6* -27.0* -27.6* -13.0* -23.6* -26.5* -26.7
Subject 2 (40%)
Tib. Ant. (%) -0.1 6.6* -2.7 3.2 -5.0 -4.6 -6.2 -2.9
Biological
-16.7* -15.4* -14.0* -9.9* -8.6* -14.6* -29.6* -13.4
Torque (%)
Averaged
22.1 22.3 25.5 18.8 19.6 19.6 21.2 21.3
Peak Assistance (N.m)
Gas. Med. (%) -8.8* -1.9 -8.0* -6.8* -10.4* -11.5* -21.2 -10.4

Gas. Lat. (%) 20.8* -18.7* -28.1* -20.0* -5.9 -13.2* -35.2* -20.9

Soleus (%) -21.3* -10.0* -16.1* -20.3* -16.9* -18.0* -27.7* -18.9
Subject 3 (30%)
Tib. Ant. (%) 7.3* 2.2 -5.1* -9.0* 4.6 0.4 -18.7 -4.5
Biological
-17.6* -15.8* -20.8* -20.7* -17.1* -15.0* -12.6* -19.8
Torque (%)
Averaged
15.2 16.1 16.3 3.3 13.2 14.6 14.5 14.8
Peak Assistance (N.m)
Gas. Med. (%) 0.3 -2.6 -1.9 -8.7* 6.6* 5.4* -3.2 -1.1

Gas. Lat. (%) -12.1* 3.5 -2.1 -7.3 12.7 -0.8 11.4 -1.6

Soleus (%) -2.8 -7.1* -12.2* -5.6* -7.0* -9.2* -7.5 -8.7
Subject 4 (40%)
Tib. Ant. (%) -0.1 8.2* -2.5 -5.5* 1.1 5.4 3.6 2.4
Biological
-2.7* -5.1* -7.0* -6.0* -3.4* -3.9* -4.7* -4.8
Torque (%)
Averaged
22.9 23.3 19.7 17.2 17.4 19.1 19.6 20.1
Peak Assistance (N.m)
Gas. Med. (%) -7.2* -2.5 -4.5 -7.9 -0.9 -14.6* 7.5 -45.7

Gas. Lat. (%) -17.0* -19.1* -13.4* -10.2 22.2* -27.2* -17.0 -5.1

Soleus (%) -23.7* -23.9* -32.2* -21.7* -20.3* -34.7* -17.9* -23.1
Subject 5 (70%)
Tib. Ant. (%) -35.5* -36.6* -31.9* -23.9* -14.4* -13.2* -34.8* -26.0
Biological
-33.7 -36.4* -38.1* -36.3* -36.9* -35.3* -33.0 -35.8
Torque (%)
Averaged
34.7 34.2 38.7 29.6 31.0 30.1 34.5 33.8
Peak Assistance (N.m)
* statistical significance (P <0.007)
8

50 Biological Torque for Assisted Condition Exoskeleton Torque for Assisted Condition
Biological Torque for Non Assisted Condition Exoskeleton Torque for Non Assisted Condition

40
Averaged RMS Torque (N.m)

*
-3% -1% * 0% *
30 * 2% 2%
2% 5% 7%
-24% -23% -23%
-22% -22%
-23% -21% -20%
20

10

0 Co
m

D
2.

2.

2.

1.

1.

1.
pl

ur
8

8
et
km

km

km

km

km

km

in
eE

g
/h

/h

/h

/h

/h

/h

Tr
xp
,-

,0

,1

,-

,0

,1

a
5%

5%

ns
er
%

2%

2%
im

iti
on
en
t

Fig. 5. Ankle joint torque root mean squared sum averaged across all subjects within each tested locomotion condition, i.e. assisted (in blue) and non-assisted
(minimal impedance, in purple). The vertical bar darker shade represents the human biological torque estimated via the neuromechanical model-based control.
The vertical bar lighter shade represents the exoskeleton assistive torque as recorded via the actuator spring deflection (which are added on top of the biological
joint torque). The number on top of each vertical bar represents the difference in total ankle torque (exoskeleton plus biological torque) between assisted and
non-assisted exoskeleton conditions. The top lower number in bold represents the reduction in biological torque between assisted and non-assisted exoskeleton
conditions. During transition represents the average of all transition happening between two locomotion conditions (i.e. change in speed, elevation or both)
and the Complete experiment represents the full recorded experiment with locomotion conditions and locomotion conditions transition. The ’*’ represents
significance in human-exoskeleton torque invariance (p<0.0083)

biological ankle torque for all tested walking conditions (rang- with an inclination of -5%). The Tibialis Anterior underwent
ing from 20% to 24%) and reduction of 22% was obtained EMG reduction primarily during walking conditions transition
also during the transition between walking conditions. The (17.2%) and walking at 1.8 km/h with -5% inclination (9%).
final reduction of all participants in the ankle for the complete Table I presents the EMG reduction obtained for each
experiment (all tested walking tasks and transition between subject independently. It can be observed that the Soleus
those tasks) was 22%. Fig. 6 shows the distribution of the muscle always presented reduction in EMG (blue cell color)
biological torques for the two tested exoskeleton conditions for for all subjects (maximum 40.6% (subject 1 for 2.8 km/h,
all walking condition and all subjects. Significant reductions -5%) and minimum 2.8% (subject 4 for 2.8 km/h, -5%)).
were found for all walking conditions as well as the walking The Tibialis Anterior had the least EMG reduction across all
condition transition, and for all subjects. muscles with an increased in amplitude for subject 1 during
Table I presents ankle torque reduction between exoskeleton assisted exoskeleton condition when compared to non-assisted
conditions obtained for each subject independently. It can be exoskeleton condition. However, EMG increase was observed
seen that for all subjects and all walking conditions, the reduc- only during the swing phase where overall muscle activation
tion in biological torque was always positive (blue cell color) and resulting torque are the lowest.
(maximum 38.1% (subject 5 for 2.8 km/h, 12%) minimum The moonwalking task showed reduction in EMG (Fig. 7)
3.4% (subject 4 for 1.8 km/h, 0%)). Table I also shows the for all muscles (from maximum 30% (Gastrocnemius Me-
averaged peak assistance in N.m. received by subjects and dialis) to 17% (Soleus)) and significance was found for all
the individual support ratio. The moonwalking task showed a muscles except the Tibialis anterior.
significant reduction in biological joint torque of 40%. (Fig.
7)
C. Human-exoskeleton torque invariance across exoskeleton
B. EMG reduction conditions
Fig. 8 shows EMG reduction for of all muscles across The total human+exoskeleton torque between exoskeleton
all walking conditions (between 14% and 4%) as well as conditions (summation of the estimated biological ankle joint
during the transition between walking conditions (13%) and torque and exoskeleton delivered torque) was preserved across
for the complete experiment (13%). Fig. 8 presents detailed walking conditions (between -3% for the 2.8 km/h at -5%
results at the muscle level. It can be observed that reduction inclination and 7% for 1.8km/h at 12% inclination) showing
was obtained for all calf muscles and all walking conditions, significance for all but 1.8 km/h, 0% and 1.8 km/h, 12%. The
during transitions as well as for the complete experiment total human-exoskeleton torque between exoskeleton condi-
(maximum reduction of 28.5% for the Soleus at 2.8 km/h tions was also preserved for the complete experiment (2%).
9

subject 5 to control an exoskeleton during moonwalking while

t1

3
t2

5
ct

ct
ec

ec

ec
je

je
bj

bj

bj
b

b
Su

Su
Su

Su

Su
* at the same time reducing the subject’s muscular effort for all
* * * *
2.

recorded muscles (Fig. 7).


8
km
/h
,-

State of the art exoskeleton control approaches are based


5%

20 25 25 30 20 40 17.5 20.0 20 40
* * on pre-defined torque profiles or state machines [4], [8]–[12].
* * *
2.
8

Although real-time mechanistic models of neuromuscular re-


km
/h
,0

flexes have been proposed to control prostheses and exoskele-


%

20 25 20 30 20 30 17.5 20.0 20 30
* * * * * tons, these are not driven by in vivo biomechanical data, but
2.
8
km

by a finite set of a priori chosen reflexive rules [13], [14]


/h
,1
2%

20 30 25 30 35 20 30 20 25 20 40
(e.g. positive force feedback and stretch reflexes). Moreover,
* *
* * *
1.

existing human-in-the-loop optimization techniques require


8
km
/h

several tens of minutes (up to 45 minutes) for the generation


,-
5%

15 20 15 20 25 20 30 17.5 20.0 20 30
* * * *
of appropriate exoskeleton torque commands [12], hampering
*
1.
8

support of large repertoire of movements. As a result, existing


km
/h
,0

15 20 20 25 20 30 15 20 20 30 approaches are limited to pre-defined movements and do not


%

*
* * * enable voluntary control of exoskeletons.
1.

*
8
km

Contrary to a proportional EMG controller, the NMBC


/h
,1
2%

15 20 20 25 20 30 17.5 20.0 20 30 realizes a non-linear bio-inspired sensor fusion between mul-


*
* tiple kinematic inputs (joint angles) and neural command
D

*
ur

*
in
g

inputs (EMGs) through a muscle model that filters out the


Tr
an
s
iti

high level frequency components of the EMG (spring and


o

20 30 20 30 20 30 15 20 20 30
n

Non Assisted Biological Torque (N.m) damper contained in the muscle model). The effective cut-
Assisted off frequency of such ”muscle-inspired filter” is dynamically
modulated as a function of joint kinematics, dictating force-
Fig. 6. Distribution of biological torque amplitude, i.e, number of occurrences length-velocities dependencies. This allows filtering EMG
of the averaged ankle biological joint torque for each gait cycle for the
two tested conditions (non assisted walking (purple) and assisted walking
artefacts, depending on the muscle operating length and veloc-
(blue)) and all tested locomotion conditions as well as locomotion conditions ity, that would result in non-physiological torque output (Fig.
transition.The symbol ’*’ represents statistical significance (P <0.007). 2). Moreover, the musculoskeletal geometry model provides
biomechanically consistent moment arms acting as non-linear
120 weighting coefficient for the projection of mechanical moment
0.5
from the muscle to the joint level, which also removes non-
100 Non Assisted
Assisted physiological torque output. Finally, the muscle-tendon model
Biological Joint Torque (N.m)

0.4 *
80 * * allows to represent the physical energy storage and release
*
0.3 -17% virtually, which are not contained in the neural command.
EMG (-)

60
-40%
-30%
-24% Overall, this allows for a more intuitive control of exoskeletons
0.2
40 as it acts like a virtual muscle.
In contrast to the state of the art, the proposed NMBC used
20 0.1
an optimization-based calibration conducted once per subject.
-28% Results showed that on average for each individual, the cali-
0
G

So

Ti
To

bration procedure required kinematic and kinetic data relative


as

as

b
ta

le

.A
.

.
l

us
M

La

nt
ed

t.

to two minutes of ground-level walking without exoskeleton.


.

Fig. 7. EMG reduction for all muscles and ankle biological joint torque After calibration, NMBC transformed EMG signals to decode
reduction for subject 5 during the moonwalk task. Data are reported for the resulting muscle and joint torques underlying any movement
assisted and non-assisted exoskeleton conditions. The symbol ’*’ represents condition with no assumption on what neuromuscular reflexes
statistical significance (P <0.05).
to be modelled. When used for exoskeleton control, NMBC
reduced torque and EMGs in unseen walking conditions and
V. D ISCUSSION moonwalking for one subject, (i.e. not used during the cali-
bration procedure) without having to change low-level control
NMBC’s ability of decoding biological ankle joint torques parameters or having to switch across pre-defined states or
from multiple wearable EMGs and joint angle sensors, en- motor torque profiles. Moreover, since no exoskeleton was
abled five different subjects to voluntarily control bi-lateral worn during the walking trials for calibration, current results
ankle exoskeletons across six walking conditions and all showed NMBC’s ability to account for the exoskeleton added
relative transitions over more than 18 minutes of continuous loading during real-time control tests. This all shows evidence
walking experiment, i.e. see supplementary movie 1. Across of NMBC’s ability of extrapolating across walking conditions
all subjects, walking conditions and transitions, the NMBC- as well as different load cases.
controlled exoskeleton systematically reduced biological joint Our results can be compared with EMG reductions realized
torques and EMGs when compared to non-assisted walking with other alternative methods, e.g. [12] using human in the
(Figs 5, 6, 3 and 8). Furthermore, the NMBC also allowed loop optimization, reported a reduction of 41% for the Soleus
10

Non Assited
Tasks 2.8 km/ h 2.8 km/ h 2.8 km/ h 1.8 km/ h 1.8 km/ h 1.8 km/ h During Complet e
Assisted Muscle -5% 0% 12% -5% 0% 12% Transit ion Experiment
Tibialis Anterior Gas. Med. (%) -7.15 -5.08 -2.75 -7.92 -0.93 -7.42 -1.71 -12.5
Gas. Lat . (%) -6.74 -14.5 -9.54 -12.5 6.61 -5.3 -14.6 -9.23
Soleus (%) -28.5 -20.4 -22.4 -25.5 -15.7 -17.3 -18.2 -20.8
Gastrocnemius Lateralis T ib. Ant . (%) -6.64 -4.91 -6.71 -9.02 -1.61 0.29 -17.2 -5.44

Gastrocnemius Medialis

-11%
EMG (-)

-14% -12%
-10% -13% -13%
-14% -4%

Co
m
2.

2.

2.

1.

1.

1.

D
pl

ur
8

8
e
km

km

km

km

km

km

in
te

g
/h

/h

/h

/h

/h

/h
Ex

Tr
,-

,0

,1

,-

,0

,1
pe

an
5%

5%
%

2%

2%
r

s
im

iti
on
en
t

Fig. 8. EMG reduction across all subjects within each walking condition as well as during transitions and the entire experiment (i.e. all locomotion conditions
and transitions altogether). Data are reported for the assisted and non-assisted exoskeleton condition. During transition represents the average of all transition
happening between two locomotion conditions (i.e. change in speed, elevation or both). Muscle-specific EMG reduction results across all locomotion conditions,
transitions and complete experiments are presented in the enclosed table.

with respect to zero torque condition (similar to our non- exoskeleton as Zhang et al [12] would have been used.
assisted condition) at a walking speed of 1.25 m/s (4.5 km/h). Results showed NMBC’s ability of dynamically adapting
In [36], using a passive exoskeleton, the Soleus was reduced to the mechanical demand of each walking condition. Fig.
by 22% and biological ankle torque by 14% at a walking 4 and supplementary Fig. S2 show that NMBC prescribed
speed of 1.25 m/s (4.5 km/h). In [9], using a pre-computed more torque to the exoskeleton during more mechanically
torque pattern, the authors obtained a reduction of Soleus of demanding walking conditions (i.e. higher speeds and ground
30%, 20% for the Gastrocnemius Medialis and an increase of elevations), with the proportion of human-contributed joint
100% for the Tibialis Anterior at a walking speed of 1.25 m/s torque proportionally decreasing. This provides evidence of
(4.5 km/h). Finally, in [15], the authors showed a reduction of NMBC’s ability of responding to different mechanical de-
Soleus EMG of 32% and an increase of Tibialis Anterior (% mands as required in real-world environments. Users’ kinemat-
not specified) at a walking speed of 1.25 m/s (4.5 km/h) using ics between conditions were similar with the main difference
the human in the loop method with EMG level reduction as the being at the level of the ankle joint angle that showed a reduced
objective function. In comparison, we obtained a reduction of plantar flexion during push off (see Figure S1 in supplementary
20.8% for the Soleus, 12.5% for the Gastrocnemius Medialis, material). This can be explained by the added joint torque
a decrease of 5.4% for the Tibialis Anterior and a decrease of given by the assistance and reduced muscle force needed to be
22% for the biological joint torque. These results were for the produced by the user (see Figure 3, supplementary Figure S2
complete experiments (all tested walking tasks and transition and S3 in supplementary material). Since the muscles do not
between those tasks) while the results from the state of the art have to produce as much force compared to the non assisted
are from a single walking task. The results from the NMBC are condition, they do not need to reach a higher force production,
on par with the current state of the art in exoskeleton mediated thus working at shorter length in the force length relationship
muscle effort reduction with the main difference being that our of the muscle (Fig. 2).
results encompass a multitude of walking conditions and the Within each condition, the total amount of joint torque
transitions between those which is currently not possible using generated by the human+exoskeleton system during walking
a passive exoskeleton system or active exoskeleton using pre- (human-generated+exoskeleton-generated torque) was always
computed torques profiles. preserved between assisted and non-assisted walking (Fig. 5).
In this study we did not consider a no-exo condition as This provided indirect validation of NMBC-estimated biolog-
the weight of the device was substantial, i.e. 10 kg for the ical torques, i.e. for each individual, walking speed and foot
backpack and 5 kg per actuator. Nevertheless, from [12] strike cadence were controlled and therefore were preserved
the difference in Soleus reduction between the no-exo and across assisted and non-assisted conditions. As a results,
zero torques condition represents only a 5% difference. Our the net human+exoskeleton ankle joint torque was expected
results showed an average of 20% reduction in the soleus’ to be similar across assisted and non-assisted walking, as
EMG (Complete experiment), which would correspond to a shown in our results. Moreover, this showed that, through
15% reduction for a possible no-exo conduction if the same NMBC, the human and the exoskeleton were always capable
11

of converging towards an equilibrium, during which human subjects gives confidence on the validity of the methods.
walking was more economical in terms of EMG and biological Different support ratios were identified to each subject based
torque generation. This is crucial to promote user’s acceptance on feedback from the subjects to offer them comfort of use.
towards wearable assistive robots. The results showed that for subjects 2 and 4, for the same level
Remarkably, since even small discrepancies in the on- of support ratio different levels of reduction were found (see
set time between the biological joint rotation and parallel Table 1). These different results may be explained by the fact
exoskeleton motor actuation could potentially increase bio- that different subjects (having different exoskeleton experience
logical EMGs and joint torques during walking [12], our levels) react to the exoskeleton assistance in a different way,
results demonstrate that NMBC could precisely synchronize yielding differences in EMG/torque reduction even if the same
the exoskeleton actuation with human muscle contraction. support ratio is used. Other aspects could also explain subject-
Timely torque delivery to biological joints has been shown specific differences in support ratios such as the quality of
to be crucial for metabolic energy reduction notably during the model calibration, the accuracy of the maximal voluntary
the push-off phase [37]. Metabolic energy comparison via contraction (MVC) tasks for EMG normalization, the EMG
a respiratory system will be conducted in future work to sensors placements across the calibration session day and the
compare net metabolic reduction. Future work will also test actual experimental session day.
NMBC to control lightweight exoskeletons in out-of-the-lab The relation between support ratio and muscle effort re-
scenarios. duction was not fully explored in this study and is one of
Results showed that that the Tibialis anterior muscle under- the current limitations. What can be extracted for the current
went the least EMG reduction and even a constant increase for results is that, to a certain limit, an increase in the support-ratio
subject 1. This increase of the EMG for the tibialis anterior could increase the reduction in joint torque as shown between
could be explained by the fact that the average joint torque subjects 1 and 3 but reduction between subjects can vary even
and assistance for all tasks (see figure S5 in supplementary for the same support ratio (see subjects 2 and 4). Imposing
material) for subject 1 presents very little or no dorsiflexion the same support ratio across all subjects would have allowed
torque and provided very little or no dorsiflexion assistance, for a more controlled comparison. However, it would have not
which was present for only subject 1. In this case, the con- been practically possible due to the above mentioned aspects.
troller was not providing assistance, potentially even counter- This is a limitation of our study. Future work will integrate
assisting (i.e. in the plantar flexion direction) due to possible subject training to control of individual subject response to
underestimation of dorsiflexion torque. exoskeleton assistance. In this context, [39] previously showed
The authors recently demonstrated that real-time model- that exoskeleton training may contribute up to 50% of the
based controllers enabled post-stroke and incomplete spinal metabolic reduction, with 4 hours of training being needed
cord injury subjects to control a uni-lateral robotic exoskeleton to observe full benefits. With this in consideration, a more
to perform knee and ankle joint rotations executed from systematic studies on the effect of support gains could be
seated positions [21]. This provided evidence that data-driven conducted.
model-based control strategies have potentials to be translated Future work will also devise automatic selection of support
and personalized to individuals with neuro-musculo-skeletal ratios based on individual neuromuscular function. Moreover,
injuries. Authors also employed model-based controllers to support ratios were kept constant throughout the experiment.
enable a transradial amputee to control a uni-lateral wrist- This led to small unwanted ankle joint rotations being occa-
hand prosthesis [20] as well as healthy individuals to control sionally induced by the exoskeleton during the swing phase,
a uni-lateral elbow joint soft exosuit [38]. With respect to i.e. when ankle joint stiffness was lowest. Future work, will
our previous work, the current paper shows for the first address this point by dynamically modulating the exoskeleton
time that the combination of calibrated person-specific data- support ratio based on joint stiffness estimates, to provide
driven neuromechanical modelling and disturbance observers more assistance when the joint is stiffer (i.e. push-off) and
can enable stable yet voluntary control of a complex bi-lateral less assistance when the joint is lax (i.e. swing) [40], [41].
exoskeleton. This, was observed during complex movement Further limitation of our controller is that the muscle model
scenarios, i.e. a broad range of walking conditions and transi- does not take into account fatigue and the tests realised were
tions underlying the coordination of a large number of muscles done on healthy subjects that should not get fatigue during our
as well as during the exchange of large interaction forces relatively short experiment (<20 min). Estimation of muscle
between the ground, the exoskeleton and the human body, fatigue and the change of muscle parameters over time (due
something not achieved previously. In this context, combi- to training for example) are research questions that we hope
nation of calibration, modelling and a passive disturbance to explore in the future as they could have a direct effect on
observer was crucial to assure stable exoskeleton operation the efficiency of assistance delivered by exoskeletons over a
in response to large human-exoskeleton-ground interaction long period.
forces. This all is crucial for enabling robotic exoskeleton Another limitation is the practicality of the method. The
applications outside of the lab in unseen and unstructured two main issues for the broad adoption of this method are
terrains. the use of single surface EMG sensors and the calibration
This study was affected by a number of limitations. The procedure. Surface EMGs are sensitive to placements and
low number of subjects (5) is a limitation of this experiment. maximal voluntary contraction for its normalization. Those can
Nevertheless, the systematic reduction in muscle effort for all easily vary depending on the expertise of the person placing
12

these sensors. For this, the use of sensorised stretchable [3] G. S. Sawicki, O. N. Beck, I. Kang, and A. J. Young,
textile-based garments for recording high-density EMGs non- “The exoskeleton expansion: Improving walking and
obstructively [42]. In combination with blindsource separation running economy,” Journal of NeuroEngineering and
techniques this will enable establishing a direct connection Rehabilitation, vol. 17, no. 1, pp. 1–9, 2020, ISSN:
between the robotic exoskeleton and human spinal motor 17430003. DOI: 10.1186/s12984-020-00663-9.
neurons [43], [44]. This has the potential to lead to an NMBC [4] J. Kim, G. Lee, R. Heimgartner, D. A. Revi, N. Karavas,
that is more intuitive and less sensitive to electrode placement D. Nathanson, I. Galiana, A. Eckert-erdheim, P. Mur-
and signal normalization as previously discussed [45]. For the phy, D. Perry, N. Menard, D. K. Choe, P. Malcolm, and
calibration, the tasks needed for the calibration dataset can C. J. Walsh, “Reducing the metabolic rate of walking
sometimes be challenging for patients. For example, spinal and running with a versatile, portable exosuit,” Science,
cord injury patients that are wheelchair-bound cannot walk on vol. 672, no. August, pp. 668–672, 2019.
a force plate (ground reaction forces are needed for inverse [5] S. B. Diller, S. H. Collins, and C. Majidi, “The
dynamics). A workaround would be to get informed directly effects of electroadhesive clutch design parameters
by muscle parameters using imaging techniques (ultrasound on performance characteristics,” Journal of Intelligent
and MRI) to better constrain the muscle model parameters Material Systems and Structures, vol. 29, no. 19,
using, for example, experimental recorded tendon length, fiber pp. 3804–3828, 2018, ISSN: 15308138. DOI: 10.1177/
length, pennation angle and physiological cross-section area. 1045389X18799474.
For healthy users, removing the calibration session (day one [6] K. Staman, A. J. Veale, and H. Van Der Kooij,
of our experimental protocol) would increase the usability of “The PREHydrA: A passive return, high force den-
the system. This could be done by calibrating the model online sity, Electro-Hydrostatic actuator concept for wear-
using exoskeleton sensor data while the user is walking with able robotics,” IEEE Robotics and Automation Letters,
the exoskeleton in transparent mode. This model calibration vol. 3, no. 4, pp. 3569–3574, 2018, ISSN: 23773766.
needs to be done only once or when a structural change in the DOI : 10.1109/LRA.2018.2854367.
musculoskeletal system (increase or decrease of muscle mass) [7] E. J. Park, T. Akbas, A. Eckert-erdheim, L. H. Sloot,
happens. R. W. Nuckols, D. Orzel, L. Schumm, T. D. Ellis,
L. N. Awad, and C. J. Walsh, “A Hinge-Free, Non-
VI. C ONCLUSION Restrictive, Lightweight Tethered Exosuit for Knee Ex-
We presented a new HMI that combined subject-specific tension Assistance During Walking,” pp. 1–11, 2020.
data-driven neuromechanical modelling with low-level distur- [8] A. T. Asbeck, S. M. M. De Rossi, K. G. Holt, and C. J.
bance observers within a real-time control framework termed Walsh, “A biologically inspired soft exosuit for walk-
NMBC. The study confirmed the two research questions ing assistance,” The International Journal of Robotics
presented in the introduction. First, significant biological joint Research, vol. 34, no. 6, pp. 744–762, 2015.
torque was obtained across all walking conditions and subjects. [9] S. Galle, P. Malcolm, S. H. Collins, and D. De Clercq,
Second, EMG reduction was obtained for the Soleus muscles “Reducing the metabolic cost of walking with an ankle
on all conditions and all subjects. These results showed that exoskeleton: interaction between actuation timing and
the NMBC enabled individuals to control a robotic bi-lateral power,” Journal of NeuroEngineering and Rehabilita-
exoskeleton voluntarily during a broad range of locomotion tion, vol. 14, no. 1, pp. 1–16, 2017, ISSN: 17430003.
DOI : 10.1186/s12984-017-0235-0.
conditions and transitions as well as dexterous and challenging
task (moonwalk, for one subject). Moreover, the proposed [10] Y. Ding, M. Kim, S. Kuindersma, and C. J. Walsh,
approach enabled exoskeleton dynamic adaptation to motor “Human-in-the-loop optimization of hip assistance with
tasks mechanical demands over unseen locomotion conditions a soft exosuit during walking,” Science Robotics, vol. 3,
that were not considered for the NMBC calibration stage and no. 15, eaar5438, Feb. 2018, ISSN: 2470-9476. DOI:
with no need to use pre-defined locomotion mode classification 10.1126/scirobotics.aar5438.
or state machines. This represents an important step to enable [11] C. Khazoom, C. Veronneau, J. P. L. Bigue, J. Grenier,
the use of wearable robots outside of the lab to support A. Girard, and J. S. Plante, “Design and control of a
complex movements during real-life situations. multifunctional ankle exoskeleton powered by magne-
torheological actuators to assist walking, jumping, and
landing,” IEEE Robotics and Automation Letters, vol. 4,
R EFERENCES
no. 3, pp. 3083–3090, 2019, ISSN: 23773766. DOI: 10.
[1] J. Mehrholz, S. Thomas, C. Werner, J. Kugler, M. Pohl, 1109/LRA.2019.2924852.
and B. Elsner, “Electromechanical-assisted training for [12] J. Zhang, P. Fiers, K. A. Witte, and S. H. Collins,
walking after stroke,” Cochrane Database of Systematic “Human-in-the-loop optimization of exoskeleton assis-
Reviews, no. 5, 2017. tance during walking,” Science, vol. 356, no. 6344,
[2] A. Ajoudani, P. Albrecht, M. Bianchi, A. Cherubini, pp. 1280–1283, 2017, ISSN: 10959203. DOI: 10.1126/
S. Ferraro, P. Fraisse, L. Fritzsche, M. Garabini, A. science . aal5054. [Online]. Available: http : / / www .
Ranavolo, P. Rosen, et al., “Smart Collaborative Sys- ncbi . nlm . nih . gov / pubmed / 4077693 % 5Cnhttp : / /
tems for Enabling Flexible and Ergonomic Work Prac- www.pubmedcentral.nih.gov/articlerender.fcgi?artid=
tices,” 2020. PMC1165169.
13

[13] H. Geyer and H. Herr, “A Muscle-Reflex Model That [22] E. E. Cavallaro, J. Rosen, J. C. Perry, and S. Burns,
Encodes Principles of Legged Mechanics Produces Hu- “Real-time myoprocessors for a neural controlled pow-
man Walking Dynamics and Muscle Activities,” vol. 18, ered exoskeleton arm.,” IEEE transactions on bio-
no. 3, pp. 263–273, 2010. medical engineering, vol. 53, no. 11, pp. 2387–2396,
[14] F. Tamburella, N. L. Tagliamonte, I. Pisotta, M. Mas- 2006, ISSN: 0018-9294. DOI: 10 . 1109 / TBME . 2006 .
ciullo, M. Arquilla, E. H. Van Asseldonk, H. Van 880883. [Online]. Available: http://www.ncbi.nlm.nih.
Der Kooij, A. R. Wu, F. Dzeladini, A. J. Ijspeert, and gov/pubmed/17073345.
M. Molinari, “Neuromuscular Controller Embedded in [23] C. Fleischer and G. Hommel, “A human-exoskeleton in-
a Powered Ankle Exoskeleton: Effects on Gait, Clini- terface utilizing electromyography,” IEEE Transactions
cal Features and Subjective Perspective of Incomplete on Robotics, vol. 24, no. 4, pp. 872–882, 2008, ISSN:
Spinal Cord Injured Subjects,” IEEE Transactions on 15523098. DOI: 10.1109/TRO.2008.926860.
Neural Systems and Rehabilitation Engineering, vol. 28, [24] B. N. Lotti, M. Xiloyannis, G. Durandau, E. Galofaro,
no. 5, pp. 1157–1167, 2020, ISSN: 15580210. DOI: 10. V. Sanguineti, and L. Masia, “A New Generation of
1109/TNSRE.2020.2984790. Wearable Robot Control ©,” no. January, 2020.
[15] R. W. Jackson and S. H. Collins, “Heuristic-Based [25] S. Yao, Y. Zhuang, Z. Li, and R. Song, “Adaptive
Ankle Exoskeleton Control for Co-Adaptive Assistance admittance control for an ankle exoskeleton using an
of Human locomotion,” IEEE Transactions on Neural EMG-driven musculoskeletal model,” Frontiers in Neu-
Systems and Rehabilitation Engineering, vol. PP, no. c, rorobotics, vol. 12, no. APR, 2018, ISSN: 16625218.
pp. 1–10, 2019. DOI: 10.1109/TNSRE.2019.2936383. DOI : 10.3389/fnbot.2018.00016.
[16] E. M. McCain, T. J. M. Dick, T. N. Giest, R. W. [26] D. Ao and J. Gao, “Movement Performance of Human-
Nuckols, M. D. Lewek, K. R. Saul, and G. S. Sawicki, Robot Cooperation Control Based on EMG-driven Hill-
“Mechanics and energetics of post-stroke walking aided type and Proportional Models for an Ankle Power-assist
by a powered ankle exoskeleton with speed-adaptive Exoskeleton Robot,” vol. 4320, no. c, 2016. DOI: 10.
myoelectric control,” Journal of NeuroEngineering and 1109/TNSRE.2016.2583464.
Rehabilitation, vol. 16, no. 1, pp. 1–12, 2019. DOI: 10. [27] H. v. d. K. W.F. Rampeltshammer A.Q.L. Keemink, “An
1186/s12984-019-0523-y. improved force controller with low and passive apparent
[17] B. Lim, J. Jang, J. Lee, B. Choi, Y. Lee, and Y. Shim, impedance for series elastic actuators,” IEEE/ASME
“Delayed Output Feedback Control for Gait Assis- Trans. on Mechatronics, 0.
tance and Resistance Using a Robotic Exoskeleton,” [28] M. Sartori, M. Reggiani, A. J. van den Bogert, and
IEEE Robotics and Automation Letters, vol. 4, no. 4, D. G. Lloyd, “Estimation of musculotendon kinematics
pp. 3521–3528, 2019, ISSN: 23773766. DOI: 10.1109/ in large musculoskeletal models using multidimensional
LRA.2019.2927937. B-splines,” Journal of biomechanics, vol. 45, no. 3,
[18] J. R. Koller, C. D. Remy, and D. P. Ferris, “Biome- pp. 595–601, 2012.
chanics and energetics of walking in powered ankle [29] S. L. Delp, F. C. Anderson, A. S. Arnold, P. Loan,
exoskeletons using myoelectric control versus mechan- A. Habib, C. T. John, E. Guendelman, and D. G.
ically intrinsic control,” Journal of NeuroEngineering Thelen, “OpenSim: open-source software to create and
and Rehabilitation, vol. 15, no. 1, pp. 1–14, 2018, ISSN: analyze dynamic simulations of movement,” Biomedical
17430003. DOI: 10.1186/s12984-018-0379-6. Engineering, IEEE Transactions on, vol. 54, no. 11,
[19] G. Durandau, W. F. Rampeltshammer, H. van der pp. 1940–1950, 2007.
Kooij, and M. Sartori, “Myoelectric model-based con- [30] M. Sartori, M. Reggiani, D. Farina, and D. G. Lloyd,
trol of a bi-lateral robotic ankle exoskeleton during “EMG-driven forward-dynamic estimation of muscle
even ground locomotion,” in 2020 8th IEEE RAS/EMBS force and joint moment about multiple degrees of free-
International Conference for Biomedical Robotics and dom in the human lower extremity.,” PloS one, vol. 7,
Biomechatronics (BioRob), IEEE, 2020, pp. 822–826, no. 12, 2011. DOI: 10.1371/journal.pone.0052618.
ISBN : 9781728159072. DOI : 10 . 1109 / biorob49111 . [31] R. P. Brent, “Some efficient algorithms for solving
2020.9224365. systems of nonlinear equations,” SIAM Journal on Nu-
[20] M. Sartori, G. Durandau, S. Došen, and D. Farina, merical Analysis, vol. 10, no. 2, pp. 327–344, 1973.
“Robust simultaneous myoelectric control of multiple [32] C. R. Winby, D. G. Lloyd, and T. B. Kirk, “Evaluation
degrees of freedom in wrist-hand prostheses by real- of different analytical methods for subject-specific scal-
time neuromusculoskeletal modeling,” Journal of neural ing of musculotendon parameters,” Journal of biome-
engineering, vol. 15, no. 6, p. 66 026, 2018. chanics, vol. 41, no. 8, pp. 1682–1688, 2008, ISSN:
[21] G. Durandau, D. Farina, G. Asin-Prieto, I. Dimbwadyo- 00219290. DOI: 10.1016/j.jbiomech.2008.03.008.
Terrer, S. Lerma-Lara, J. L. Pons, J. C. Moreno, and [33] W. L. Goffe, G. D. Ferrier, and J. Rogers, “Global
M. Sartori, “Voluntary control of wearable robotic ex- optimization of statistical functions with simulated an-
oskeletons by patients with paresis via neuromechanical nealing,” Journal of econometrics, vol. 60, no. 1-2,
modeling,” Journal of neuroengineering and rehabilita- pp. 65–99, 1994.
tion, vol. 16, no. 1, p. 91, 2019. [34] C. Meijneke, G. van Oort, V. Sluiter, E. van Assel-
donk, N. L. Tagliamonte, F. Tamburella, I. Pisotta,
14

M. Masciullo, M. Arquilla, M. Molinari, A. R. Wu, charge Timings of Spinal Motor Neurons After Targeted
F. Dzeladini, A. J. Ijspeert, and H. van der Kooij, “Sym- Muscle Reinnervation,” Nature Biomedical Engineer-
bitron Exoskeleton: Design, control, and evaluation of ing, 2016.
a modular exoskeleton for incomplete and complete [44] C. Chen, S. Ma, X. Sheng, D. Farina, and X. Zhu,
spinal cord injured individuals,” IEEE Transactions on “Adaptive real-time identification of motor unit dis-
Neural Systems and Rehabilitation Engineering, vol. 29, charges from non-stationary high-density surface elec-
pp. 330–339, 2021, ISSN: 15580210. DOI: 10 . 1109 / tromyographic signals,” IEEE Transactions on Biomed-
TNSRE.2021.3049960. ical Engineering, 2020.
[35] S. L. Delp, J. P. Loan, M. G. Hoy, F. E. Zajac, E. L. [45] M. Sartori, U. S. Yavuz, and D. Farina, “In Vivo Neu-
Topp, and J. M. Rosen, “An interactive graphics-based romechanics: Decoding Causal Motor Neuron Behavior
model of the lower extremity to study orthopaedic with Resulting Musculoskeletal Function,” Scientific
surgical procedures,” IEEE Transactions on Biomedical Reports, vol. 7, p. 13 465, 2017. DOI: 10.1038/s41598-
engineering, vol. 37, no. 8, pp. 757–767, 1990. 017-13766-6.
[36] S. H. Collins, M. B. Wiggin, and G. S. Sawicki,
“Reducing the energy cost of human walking using an
unpowered exoskeleton,” Nature, vol. 522, no. 7555,
pp. 212–215, 2015, ISSN: 0028-0836. DOI: 10 . 1038 /
nature14288. [Online]. Available: http : / / www. nature .
com/doifinder/10.1038/nature14288.
[37] J. M. Caputo and S. H. Collins, “A universal ankle–
foot prosthesis emulator for human locomotion experi-
ments,” Journal of biomechanical engineering, vol. 136,
no. 3, 2014.
[38] N. Lotti, M. Xiloyannis, G. Durandau, E. Galofaro,
V. Sanguineti, L. Masia, M. Sartori, l. masia, and
M. Sartori, “Adaptive model-based myoelectric control
for a soft wearable arm exosuit: A new generation
of wearable robot control,” IEEE Robotics Automation
Magazine, vol. 27, no. 1, p. 0, Mar. 2020, ISSN: 1558-
223X. DOI: 10.1109/MRA.2019.2955669.
[39] K. L. Poggensee and S. H. Collins, “How adaptation,
training, and customization contribute to benefits from
exoskeleton assistance,” bioRxiv, p. 2021.04.25.440289,
2021. [Online]. Available: http : / / biorxiv. org / content /
early/2021/04/26/2021.04.25.440289.abstract.
[40] M. Sartori, M. Maculan, C. Pizzolato, M. Reggiani, D.
Farina, P. Claudio, M. Reggiani, D. Farina, C. Pizzolato,
M. Reggiani, and D. Farina, “Modeling and simulating
the neuromuscular mechanisms regulating ankle and
knee joint stiffness during human locomotion,” Journal
of Neurophysiology, vol. 114, no. 4, pp. 2509–2527,
2015, ISSN: 15221598. DOI: 10.1152/jn.00989.2014.
[41] C. P. Cop, G. Durandau, A. M. Esteban, R. C. van’t
Veld, A. C. Schouten, and M. Sartori, “Model-based
estimation of ankle joint stiffness during dynamic tasks:
a validation-based approach,” in 2019 41st Annual
International Conference of the IEEE Engineering in
Medicine and Biology Society (EMBC), IEEE, 2019,
pp. 4104–4107.
[42] D. Farina, T. Lorrain, F. Negro, and N. Jiang, “High-
density EMG E-textile systems for the control of active
prostheses,” 2010 Annual International Conference of
the IEEE Engineering in Medicine and Biology Society,
EMBC’10, pp. 3591–3593, 2010. DOI: 10.1109/IEMBS.
2010.5627455.
[43] D. Farina, I. Vujaklija, M. Sartori, T. Kapelner, F. Ne-
gro, N. Jiang, K. Bergmeister, A. Andalib, J. Principe,
and O. Aszmann, “Man-Machine Interfacing With Dis-

You might also like