You are on page 1of 21

Int J Intell Robot Appl (2017) 1:306–326

DOI 10.1007/s41315-017-0025-7

REGULAR PAPER

Structural control using a deployable autonomous control system


Kevin Goorts1 • Stephen Phillips1 • Ali Ashasi-Sorkhabi1 • Sriram Narasimhan1

Received: 23 December 2016 / Accepted: 13 June 2017 / Published online: 3 July 2017
Ó Springer Nature Singapore Pte Ltd. 2017

Abstract Structural control devices facilitate the con- appropriate locations for multi-modal control. The concept
struction of lightweight structures by suppressing excessive of the overall system presents promising results for appli-
vibrations that arise from the reduced self-weight. Most of cations where temporary control is desired.
the current structural control systems are permanent
installations designed to control particular structural prop- Keywords Autonomous robotics  EKF-SLAM  Active
erties and are hence specific to a particular application. structural control  Mobile control system
This paper presents a novel concept of a deployable,
autonomous control system (DACS) targeting specific
applications where short-term vibration mitigation is 1 Introduction
desired. These applications may include control of existing
structures during predictable extreme loading events or In recent years, the use of lightweight building materials
temporary structures where the need for vibration mitiga- such as aluminum has gained considerable traction in civil
tion depends on usage characteristics. This control system engineering, driven by cost savings and the capacity to
consists of an electromechanical mass damper (EMD) create modern, aesthetically pleasing structures. The
mounted on an unmanned ground vehicle (UGV) equipped unique design process associated with these structures
with vision sensors. The mobility of the UGV combined emphasizes constructability and minimizing material use.
with on-board vision sensors facilitates autonomous posi- Although this approach yields efficient designs from a
tioning of the device at any desired location of the struc- strength perspective, well-known consequences of reduced
ture. This allows the device to update its position on the self-weight include a reduction in the structure’s inherent
structure as required, through a simultaneous localization system level damping and lower natural frequencies. This
and mapping (SLAM) solution, to effectively control dif- increase in dynamic sensitivity leads to structures that are
ferent structural modes. The performance of the SLAM prone to excessive vibrations and often require vibration
solution is evaluated using a full-scale pedestrian bridge mitigation strategies to satisfy serviceability requirements.
while the ability of the proposed system to re-position itself In some cases, lightweight structures are capable of with-
to control various modes of vibration is studied through standing day-to-day loads but require short-term vibration
real-time hybrid simulation (RTHS). The experimental mitigation during predictable, peak-loading events such as
results confirm the ability of the proposed system to large crowds or wind-storms. On the other hand, advances
effectively control large amplitude motion in slender in lightweight building materials and construction methods
bridges, while being able to position itself at the has given rise to temporary structures such as pedestrian
bridges which are designed specifically for short-term use
(access to large events or marathons). In this case, the need
& Sriram Narasimhan for vibration mitigation depends on the end-use of the
sriram.narasimhan@uwaterloo.ca
structure and as such, permanent vibration mitigation
1
Department of Civil and Environmental Engineering, measures may be considered impractical. These examples
University of Waterloo, Waterloo, ON, Canada motivate the development of a control system which can

123
Structural control using a deployable... 307

provide a relatively large control bandwidth and is suit- the suitability of the system for immediate, but temporary
able for temporary use on a range of structures (in the vibration mitigation of lightweight bridges. It is important
operating control bandwidth of the robot) as needed. to emphasize that this paper presents the concept of such a
Most control systems for bridge applications are per- robotic system; the exact implementation would require
manent installations, often tuned to one design level event. modifications to the hardware to suitably locate the device,
This means that the control design must be informed using for example on side walks if present, or using hangers
a high-fidelity model (finite-element) of the bridge. In this underneath a bridge. Such details are considered outside
paper, the concept of a deployable autonomous control the scope of this study.
system (DACS) that can achieve similar control perfor- To the authors’ knowledge, this is the first application of
mance, especially for lightweight temporary applications, a robot for structural control. However, there have been
without an a priori model of the structure is presented. To numerous applications of structural control during the last
be considered deployable, the system shall provide a suf- three decades. Passive control systems have been widely
ficiently large control bandwidth to effectively control a used for vibration suppression in bridges due to their
range of structures and be easily integrated with minimal simple design and ease of implementation (Housner et al.
modification to the structure by eliminating the need for a 1997; Soong and Spencer Jr 2002; Spencer Jr and
rigid (fixed) connection to transfer forces. The autonomy Nagarajaiah 2003); However, passive devices lack adapt-
aspect requires the ability to determine the desired control ability and only provide reliable vibration suppression of a
force and corresponding point of application based on the desired frequency. As a result, several devices are required
measured response and a global control objective. A fully to suppress different structural modes (Ming et al. 2001;
autonomous control system will have the capacity to Ubertini 2010). Active and semi-active systems feature the
position itself at the desired location on the structure and ability to adapt to varying structural properties or loading
update its position as required. The proposed DACS con- conditions and have demonstrated superior control effect
sists of an electromagnetic mass damper (EMD) mounted compared to passive devices (Soong and Spencer Jr 2000;
on an unmanned ground vehicle (UGV) which is equipped Spencer Jr and Nagarajaiah 2003). Although these systems
with forward and rear-facing vision sensors. With some can be designed to suppress different modes of vibration,
modifications to the hardware, this device can be mounted the location of the control force remains constant due to the
either underneath a bridge on a railing system or driven permanent nature of the device and dependence on a rigid
directly on a sidewalk if there is minimal traffic. The connection to transfer forces. As such, a trade-off exists
DACS may also be advantageous during the construction between the position of the device and control performance
phase or for temporary military applications. A prototypi- for each mode. In cases where the dominant mode is known
cal DACS has demonstrated effective control on a full- a priori, the trade-off is well defined and control devices
scale 16.7 m, 1800 kg pedestrian bridge. Hence, one of can be positioned appropriately. However, in some cases,
these units may be required for approximately every two the nature of the loading dictates the dominant mode of
metric tons of structure mass. The novel aspect of this vibration and several devices are required in order to
concept is that only the approximate weight of the bridge control varying modes. This is particularly the case in
(to determine the number of units) and an estimate of the slender pedestrian bridges where small groups or large
modal frequencies of interest are needed for its imple- groups of pedestrians could excite entirely different modes
mentation. The main objectives of this paper are to intro- (Dey et al. 2016). In applications where the need for
duce this idea, present the background theory and dynamics vibration mitigation is temporary, the use of several per-
of such a system, and address the associated implementa- manent devices is largely redundant and could be alleviated
tion challenges. by positioning one or two control devices to the appropriate
The deployability aspect of the proposed DACS was locations as needed. This inspires the development of a
recently studied (Goorts et al. 2016). This work involved mobile control system that is capable of autonomously
experimental determination of transfer function models to positioning itself at the desired location on a structure.
characterize and compensate for the interaction of UGV Achieving autonomy requires two of the most central
dynamics and EMD control and culminated in a prelimi- tasks in autonomous robotics: localization, the process of
nary controller design. The proposed system was shown to estimating the UGV’s position as it navigates through a
provide effective control for a SDOF system without the known environment, and mapping, the construction of a
need for a rigid connection to transfer forces. In fact, the map of the environment based on estimated locations of
presence of the UGV body dynamics was shown to mag- landmarks (Thrun et al. 2005). When navigating an
nify inertial forces generated by the EMD. The current unknown environment such as an existing bridge, the UGV
paper builds upon this previous work by developing the must build a map of the environment while concurrently
autonomy aspect of the proposed DACS and demonstrating using the same map to localize itself (Durrant-Whyte and

123
308 K. Goorts et al.

Bailey 2006). This is a fundamental problem in mobile issues in the map. The main issues addressed in this paper
robotics addressed using SLAM, an acronym for simulta- are the implementation of a general SLAM algorithm
neous localization and mapping (Durrant-Whyte et al. suitable for mapping a range of structures with sparse or
1996). repeated features and autonomous positioning of the pro-
Widely regarded as one of the most notable successes in posed DACS at the desired location on the structure. To the
robotics over the past two decades, the SLAM problem has authors’ knowledge this paper presents the first application
been formulated and solved in many different forms. One of an autonomous robot for structural control.
of the most common solution methods based on the work A schematic of the proposed DACS including front and
by Smith et al. (1990) utilizes an extended Kalman filter side profiles is shown in Fig. 1. Instead of using a rigid
(EKF) and is known as EKF-SLAM. In EKF-SLAM, the connection, the active control force generated by the EMD
standard two-step prediction-correction update procedure is transferred through the wheels of the UGV to the
associated with the EKF is used to provide estimates of the structure. For mapping existing structures and autonomous
UGV’s position and location of all landmarks in the map. positioning, an EKF-SLAM algorithm and EKF-based
All SLAM solutions require the use of sensors to observe localization method are employed using an open-source
the surrounding environment. Although the most com- robotic platform, described in later sections. To aid in data
monly used sensors are laser-based or sonar-based (Aulinas association, two Kinect sensors are mounted on the UGV.
et al. 2008), the release of the Microsoft Kinect sparked These inexpensive sensors are well suited for this appli-
significant interest in vision-based sensors which are rela- cation where vision is beneficial for accurate landmark
tively inexpensive, readily available, and offer additional identification.
visual information (Chi et al. 2014; Kamarudin et al. In the next section, the prototypical DACS is introduced
2014). along with detailed descriptions of each component. A
Over the past two decades, robotic technologies have summary of the system dynamics and design of an active
experienced significant advancements in civil engineering controller is provided followed by the framework of EKF-
applications including construction automation and struc- SLAM and details on implementing the mapping and
tural health monitoring, but are yet to be shown promising localization methods. Experimental validation of the EKF-
for structural control. For the specific case of UGV tech- SLAM implementation and autonomous positioning is
nologies applied to civil applications, most of the research presented for a full-scale pedestrian bridge. Lastly, the
is related to bridge inspection and structural health moni- main conclusions from this work and topics for future
toring. For example, Valls Miro et al. (2011) developed a studies are summarized.
multi-tracked UGV system to aid in the inspection of
concrete box girders. The UGV was equipped with a
camera to collect high-resolution images of the concrete 2 Description of DACS components
structure that could be used to visually assess the structural
integrity without entering the confined space. In this study, The DACS presented herein has four main components: an
navigation was based solely on dead-reckoning and an off- UGV for mounting the control device and enabling
line solution to the SLAM problem was used to correct the mobility, vision sensors to aid in autonomous navigation,
estimated states. An autonomous robotic system has also an EMD with auxiliary mass unit for generating control
been developed for non-destructive bridge deck inspection forces, and compact computational hardware with real-time
and evaluation (La et al. 2013). In this work, a UGV was processing capabilities. Figure 2 shows the main compo-
utilized as a platform to transport sensing equipment and nents of the DACS, each of which is explained in detail
featured the ability to autonomously traverse a rectangular next.
bridge area. SLAM was not applied in this study but rather Unmanned ground vehicle (UGV) A modified Husky
GPS and other sensors were fused using an EKF-based A200 built by Clearpath Robotics is utilized as the UGV
localization algorithm to track a desired trajectory. The (Clearpath Robotics 2014). This is a rugged, yet compact
application of SLAM to specifically map existing struc- skid-steered vehicle capable of achieving a peak linear
tures (bridges, buildings) is novel and is associated with velocity of 1.0 m/s. The UGV has a self-weight of 50 kg
unique challenges not yet studied by the robotics commu- and features an additional payload capacity of 75 kg which
nity. For example, many lightweight bridges are modular in is sufficient for the EMD, sensors, and computational
nature which from a SLAM perspective means identical equipment. In addition to providing traction and minimiz-
features may be repeated throughout the environment. ing slip, the large 300 mm lug tread tires provide sufficient
Furthermore, exploration of the bridge will be confined to a static friction in the lateral direction to prevent sliding and
straight line which limits the ability to observe features generate control action. As a skid-steered vehicle, there are
from different viewpoints and may lead to convergence no axles to connect the left and right wheels. Instead, the

123
Structural control using a deployable... 309

Fig. 1 Schematic of DACS


prototype

(a) (b)

(a) (b)
Fig. 2 Components of DACS prototype

front and back wheels on each side are connected and launched the Kinect in 2010 as a vision-based controller for
driven independently of the other side. Driving the wheels the Microsoft Xbox 360 video game console. The device
on each side at different rates causes the vehicle to skid and consists of several sensors including a RGB sensor to
turn in the direction of the slower wheels. Skid-steered provide colour images of the environment and 3D depth
systems are known for providing greater traction and do sensor with infrared transmitter to detect the depths of the
not require a steering mechanism which is beneficial for corresponding objects in the RGB images. Since the RGB
transferring control forces. The vehicle features an internal and depth sensors are not located at the same position,
storage compartment, ideal for housing computational calibration is required to remove distortions and align the
equipment and a large flat surface for mounting an EMD. images (Chi et al. 2014). OpenNI, an open-source frame-
The vehicle also features front and rear bumper bars which work in ROS to interact with digital devices, includes an
are suitable for mounting the vision sensors. The UGV is automated calibration procedure. This method, based on
equipped with high resolution quadrature encoders viewing a checker-board pattern in various orientations,
(200,000 pulse/m) and can be controlled using multiple was used to calibrate both of the Kinect sensors. Although
options including direct voltage, wheel speed, or kinematic Microsoft has not released official hardware specifications
velocity. The platform also provides ready integration with for the sensor, the PrimeSense micro-controller used to
the open source robot operating system (ROS) which process the image reports a operating range of 0.8–3.5 m
enables the use of several sensor types and position control with a field of view of 58° horizontal, 45° vertical, and 70°
algorithms. diagonal. The spatial resolution and depth resolution at a
Vision sensors The SLAM solution is meant to be distance of 2 m from the sensor are 3 and 10 mm,
simple, low-cost, and suitable for a range of structures. respectively. Although the Kinect sensor is well suited for
Hence, forward and rear facing Kinect sensors were indoor experimental development (which is the case in this
selected to extract landmarks and provide the associated study), it does not perform well in outdoor lighting con-
measurements (i.e., range and bearing). Microsoft initially ditions. However, the modifications in an outdoor

123
310 K. Goorts et al.

application should be simply to replace Kinect with a more communicate with the EMD servo drive (NI-9403 digital
suitable vision sensor. IO). An on-board ROS-enabled laptop controls the position
Electromechanical mass driver (EMD) The relatively of the UGV and processes sensor information. The EKF-
small footprint and the desire to eliminate mechanical SLAM algorithm and localization method can also be
moving parts such as gears in an active mass damper unit executed on the on-board laptop. A TCP data link was
necessitated the use of an EMD. A Parker Automation T3D created to establish communication between the cRIO and
I-force ironless linear motor positioner powered by a ROS-enabled laptop. This link ensures control is not being
Gemini Gv6K servo drive serves as the EMD in this paper. applied while the UGV is in motion.
The linear motor, shown in Fig. 3, consists of a carriage
attached to a current carrying coil which moves through a
magnetic field created by a series of permanent magnets. 3 Control strategy and system dynamics
The carriage is fitted with a mounting plate for adding
auxiliary mass up to a max payload of 54 kg. Control Consider the following equation of motion for an actively
forces up to 410 N are generated through inertia of the controlled multi-degree-of-freedom (MDOF) system
moving mass which can reach speeds up to 7 m/s. The xðtÞ þ CxðtÞ
M€ _ þ KxðtÞ þ EðtÞfa ðtÞ ¼ wðtÞ ð1Þ
position of the carriage along the 180 mm stroke is mea-
sured using a linear magnetic encoder with 0.005 mm where x represents the system displacement vector, fa is the
resolution. Contrary to most EMD control applications active control force, w models the external disturbance, and
which rely on electro-mechanical models to predict the M, C, and K are the system mass, damping, and stiffness
force-voltage relationship (Zhang and Ou 2015; Moon matrices respectively. The mobility aspect of the DACS
et al. 2004), the T3D linear motor positioner operates allows the position of the control force to change over time.
under position-feedback control and is commanded using This is accounted for in Eq. 1 by adopting a piece-wise
digital quadrature encoder signals. This control method constant location matrix EðtÞ that changes depending on the
offers improved motion profile tracking and control over position of the device. In many active control systems, the
end-of-stroke limits, but lacks a direct mathematical rela- desired control force is computed as a linear combination of
tionship between the controller input and desired force. the states (state-feedback control) and used directly as the
Earlier work on the proposed DACS led to a controller command signal to the actuator. However, for the proposed
design based on system dynamics and transfer function DACS, the control force generated by the EMD is filtered
models of the interaction between the EMD and UGV through the UGV dynamics prior to being applied to the
(Goorts et al. 2016). This controller design will be utilized structure. As such, determination of the desired EMD force
in this study to control the EMD. requires consideration of the UGV dynamics. By assuming
Computational hardware All required monitoring and no slippage of the wheels and linear behaviour over the
processing tasks as well as the execution of control loops relatively narrow frequency range of (0–5 Hz), the UGV can
for the EMD are performed on a National Instruments (NI) be approximated as a linear system with mass, damping, and
cRIO 9063 that resides on-board the UGV. The cRIO has a stiffness components. To include compensation for UGV
667 MHz dual-core processor and field programmable gate dynamics, consider the equation of motion given in Eq. 1
array (FPGA) for high-speed, deterministic, and secure expressed in the Laplace domain:
data transfer. Individual NI modules are incorporated to
ðMs2 þ Cs þ KÞxðsÞ þ EFa ðsÞ ¼ WðsÞ ð2Þ
acquire acceleration data (NI-9234 analog input), force
measurements (NI-9237 analog bridge input), and Here, the applied control force can be expressed as the
product of the EMD force FEMD and transfer function
model of the UGV dynamics HUGV :
Fa ðsÞ ¼ HUGV ðsÞFEMD ðsÞ ð3Þ

Using the inverse of the UGV model, the desired EMD


force F^EMD can be computed from the desired control force
F^a :
F^EMD ðsÞ ¼ fHUGV ðsÞg1 F^a ðsÞ ð4Þ

There are two modes of operation for the EMD: force


feedback and position feedback. Implementing force
Fig. 3 Components of electromechanical mass driver feedback requires direct force measurements which are

123
Structural control using a deployable... 311

prone to errors in inertial force applications. Position PEMD ðsÞ ¼ fHUGV ðsÞg1 fHEMD ðsÞg1 F^a ðsÞ ð10Þ
feedback is far simpler due to the readily available encoder
outputs and features more robustness to noise (can be As shown in Eq. 10, inverse transfer function models of the
commanded using digital signals) and drift prevention UGV dynamics and EMD behaviour are required for
capabilities. Nevertheless, in position feedback, achieving position feedback control of the DACS. In previous work
the desired force is significantly more complex and on the proposed system, the inverse transfer function
requires a relationship between the desired force and models were identified experimentally and are included
command position. A mathematical model relating the two here for the sake of completeness Goorts et al. (2016):
quantities can be derived based on DC motor theory. For an
s3 þ 129:4s2 þ 2876s þ 216900
applied voltage ea , the model for a DC linear motor relating fHUGV ðsÞg1 ¼
0:0128s3 þ 8:495s2 þ 2514s þ 278700
the developed force fm and position xm is given by
ð11aÞ
Ki Ki Kb La
fm ðtÞ ¼ ea ðtÞ  x_m ðtÞ  f_m ðtÞ ð5Þ 0:007907s  0:2605
Ra Ra Ra fHEMD ðsÞg1 ¼
0:0142s3 þ 4:470s2 þ 2:984s þ 0:5107
where Ra is the resistance, La is the inductance, and Ki and ð11bÞ
Kb are the force and back electromagnetic force (EMF)
constants respectively. Since there are no external damping It should be noted that consideration of control-structure
or stiffness elements present in the EMD, the generated interaction (CSI) is required for complete system modeling.
motor force is transferred to the inertial force and internal CSI describes the dynamic coupling between the deploy-
frictional losses. Hence, the relationship between the gen- able control system and supporting structure. Studies on
erated force and acceleration of inertial mass is given by active control systems such as hydraulic actuators (Dyke
et al. 1995) and EMDs (Zhang and Ou 2008) have indi-
ma x€m ðtÞ ¼ fm ðtÞ  Bm x_m ðtÞ ð6Þ cated the negative implications related to performance and
control robustness as a result of un-modeled CSI effects.
where ma and Bm represent the actuated mass and coeffi-
However, the effect of CSI on the proposed control system
cient of viscous friction respectively. The relationships in
is rather unique due to the presence of additional UGV
Eqs. 5 and 6 can be expressed in state-space with current,
dynamics and the lack of a rigid connection to the struc-
velocity, and displacement states as:
2 3 ture. This uniqueness warrants a separate investigation into
2 3 Ra Kb 2 3 213 the effects of CSI on the DACS and is reserved for a
0
i_a ðtÞ 6 La La 7 i a ðtÞ separate study.
6 7 6 K B 76
74 x_m ðtÞ 7
6 La 7
4 x€m ðtÞ 5 ¼ 6
6 i m 7 5þ6 7
4 0 5ea ðtÞ
4 m 0 5
x_m ðtÞ a ma xm ðtÞ 3.1 General control strategy
0
0 1 0
ð7Þ The overall control strategy for the DACS consists of three
main components: sensing, positioning, and control. The
The state space model can be used directly to compute sensing component involves continuous monitoring of the
system transfer functions; However, these models do not applied loading and/or dynamic response to make decisions on
include the effect of closed-loop dynamics (i.e., feedback the ideal position for the device. Changes in the desired posi-
control) which in most cases requires experimental deter- tion triggers the positioning component which relies on a
mination. Alternatively, by modeling the relationship as a localization method to autonomously navigate to the new
rational transfer function, the desired EMD force can be control position. Lastly, upon reaching the desired location, the
related to the motor position using: control component takes over to actively suppress vibrations.
FEMD ðsÞ ¼ HEMD ðsÞPEMD ðsÞ ð8Þ A schematic of the active control component developed
for the DACS prototype is shown in Fig. 4. The controller
where HEMD is a transfer function model that includes the consists of a feedback control algorithm connected in series
effects of both motor dynamics and feedback control and PEMD with the inverse UGV transfer function and inverse EMD
is the EMD motor position. Rearranging Eq. 8 for control model. The objective of the controller is to compute the
purposes yields an expression for the command position PEMD : appropriate EMD position commands to minimize the
PEMD ðsÞ ¼ fHEMD ðsÞg1 F^EMD ðsÞ ð9Þ dynamic response. The feedback control algorithm first
determines the desired control force based on the measured
Combining Eqs. 4 and 9 yields the overall relationship response. Then, the effect of UGV dynamics is compensated
between the desired control force and EMD position for by passing the desired control force through the inverse
command: transfer function model of the UGV. This yields the desired

123
312 K. Goorts et al.

   
0 I 0
A¼ ; B¼
M1 K M1 C M1 E
Since the states (i.e., position and velocity) of the system
are generally unknown and difficult to measure, LQG
control relies on the separation principle to combine a
Kalman filter for state estimation with a linear quadratic
regulator (LQR) (Anderson and Moore 2007). Accord-
ingly, the desired control force f^a is a linear function of the
estimated states Z~ defined by a controller gain matrix Gc :
f^a ðtÞ ¼ Gc Z~ ð13Þ

The performance index J is employed to optimize the level


of regulation with control effect
Z 1
J¼ ½Z~T ðtÞQZðtÞ
~ þ faT ðtÞRfa ðtÞdt ð14Þ
0

where matrices Q and R are designed to penalize errors in


the states and control effect respectively. Minimization of J
leads to the following expression for the controller gain
Fig. 4 Schematic of active controller for DACS matrix

EMD force which is then passed through the inverse EMD 1


Gc ¼  R1 BT H ð15Þ
model to compute the corresponding position command. 2
The controller is capped by a saturation block, limiting the where H satisfies the matrix algebraic Riccati equation:
position commands applied to the servo drive, in order to
avoid actuator stroke overload and force saturation. The AT H þ HA  HBR1 BT H þ Q ¼ 0 ð16Þ
servo drive contains the motor position feedback control As shown in the above formulation, the LQG controller can
loop. Here, the motor position measured by the magnetic easily be tuned via the matrices Q and R to achieve a
encoders is compared with the desired motor position and desired control objective. The inclusion of the piece-wise
the error is used to control the current supply to the motor. constant location matrix E in the input matrix allows new
control gains to be calculated corresponding to the current
3.2 Feedback control algorithm position of the device on the structure.

In structural control applications a well-known trade-off


exists between control performance and robust stability. In 4 SLAM and autonomous positioning using DACS
general, higher control authority tends to improve control
performance but uncertainties in the system model have This section presents the probabilistic framework for the
potential to severely degrade performance and even cause SLAM problem and details of the EKF-SLAM solution
instabilities if the authority is too high (Spencer Jr et al. method. Implementation details pertaining to the use of the
1994). The linear quadratic Gaussian (LQG) controller is proposed DACS to map a full-scale pedestrian bridge are
widely-used to address this trade-off and has been covered provided including an overview of the localization
in great detail, even in the structural control literature. For scheme for autonomously positioning the device for
the sake of completeness, a brief overview of the algorithm control.
is summarized below.
To start, consider the state-space representation of the 4.1 Probabilistic framework for SLAM
MDOF system presented in Eq. 1
_ ¼ AZðtÞ þ Bfa ðtÞ þ wðtÞ
ZðtÞ  ð12Þ Several unique mathematical frameworks have been used
to model the SLAM problem. Of these frameworks, the
_ T is the state vector and w
where Z ¼ ½x x  represents the probabilistic representation is the most widely used and has
process noise including external disturbances. The corre- since become standard (Durrant-Whyte and Bailey 2006).
sponding state and input matrices are given by: Although other representations have resulted in alternative

123
Structural control using a deployable... 313

solutions to the SLAM problem than those that arise from map states denoted xM are used in the estimation of robot
the probabilistic representation, there is no evidence that states and the goal becomes finding the probability distri-
these alternatives outperform the probabilistic approach in bution pðxRk jz0:k ; u0:k ; xM Þ. On the other hand, if the robot
practical SLAM scenarios (Skrzypczynski 2009). In the state is assumed to be known, the problem becomes one of
probabilistic framework, the system state xk is composed of constructing a map based on the robot’s position denoted
the robot pose state xRk and the feature map state xM k . The xR and measurement data. Here, the problem is re-formu-
underlying assumption of the probabilistic framework is lated such that the goal is to find the probability distribution
that the system state can be represented by a probability pðxM R Þ (Durrant-Whyte and Bailey 2006).
k jz0:k ; u0:k ; x
density function (PDF) at every time step k. This proba-
bility distribution of the system state is the joint posterior 4.2 EKF-SLAM
PDF of the system state given all observations z0:k , and
control inputs u0:k up to time k (Skrzypczynski 2009). One implementation (among many others) of the generic
Mathematically, this posterior probability distribution is Bayes filter algorithm for solving the probabilistic SLAM
expressed as: pðxk jz0:k ; u0:k ; x0 Þ. problem is EKF-SLAM. In EKF-SLAM, the believed state
When posed in this manner, the solution to the SLAM (i.e., the posterior PDF) is assumed to be a multivariate
problem becomes one of finding this posterior distribution, normal distribution (Gaussian), which is characterized by a
or belief of xk . The most general algorithm for calculating mean x^kjk , and a covariance Pkjk . The generic probability
this belief is given by the Bayes filter (Thrun et al. 2005). distributions for the motion model and observation model
The Bayes filter is a recursive filter, where the believed in Eqs. 17 and 18 respectively can be described by non-
state xk is first predicted based on the history of control linear state space equations with added Gaussian noise,
inputs u0:k1 and observations z0:k1 , and then corrected by such that they are of the form:
current observations zk . Mathematically, this sequential
‘prediction-correction’ recursive estimation is given as pðxk jxk1 ; uk Þ () xk ¼ gðxk1 ; uk Þ þ wk ð19Þ
(Durrant-Whyte and Bailey 2006): pðzk jxk ; mÞ () zk ¼ hðxk Þ þ vk ð20Þ
Prediction update:
where wk and vk represent process noise and measurement
pðxk jz0:k1 ; u0:k ; x0 Þ
Z noise with covariances Rk and Qk , respectively (Durrant-
¼ pðxk jxk1 ; uk Þ  pðxk1 ; mjz0:k1 ; u0:k1 ; x0 Þdxk1 Whyte and Bailey 2006). However, with this representation,
the assumption that the belief is Gaussian is violated, as the
ð17Þ nonlinear functions g and h invalidate the Gaussian prop-
erties of the posterior probability distribution. To circumvent
Measurement update:
this problem, linear approximations to the non-linear func-
pðzk jxk ; mÞpðxk ; mjz0:k1 ; u0:k ; x0 Þ tions are constructed using a first-order Taylor expansion.
pðxk ; mjz0:k ; u0:k ; x0 Þ ¼
pðzk jz0:k1 ; u0:k Þ As a result, the non-linear motion model and observation
ð18Þ model are approximated by Eqs. 21 and 22 respectively:

In these equations, the term pðxk jxk1 ; uk Þ is often referred gðxk1 ; uk Þ  gð^
xk1jk1 ; uk Þ þ Gk ðxk1  x^k1jk1 Þ
to as the ‘motion model’ or ‘state transition probability’, as ð21Þ
it describes the probability distribution on state transitions.
hðxk Þ  hð^
xkjk1 Þ þ Hk ðxk  x^kjk1 Þ ð22Þ
Additionally, the term pðzk jxk ; mÞ is referred to as the
‘observation model’, as it describes the probability of where x^k1jk1 and x^kjk1 denote the mean of the belief
making an observation zk given a believed state xk . It is distribution at k  1 and mean of the prior belief distribu-
assumed that the robot follows a Markov process, where tion at k respectively. The term Gk ¼ g0 ð^ xk1jk1 ; uk Þ is the
the state xk depends only on the preceding state xk1 , and Jacobian of g evaluated at the estimate x^k1jk1 . Similarly,
the applied control force, uk (i.e., state transition is inde- Hk ¼ h0 ð^xkjk1 Þ is the Jacobian of h evaluated at the esti-
pendent of the landmark observations) (Durrant-Whyte and
mate x^kjk1 (Thrun et al. 2005). The approximated motion
Bailey 2006).
and observation models implies the EKF-SLAM algorithm
Solving the full SLAM problem is only required when
only approximates the Gaussian belief distribution. Since a
the robot states and map states are unknown. If a map of
Gaussian distribution can be characterized by a mean and
the environment is known, the problem reduces to one of
covariance, the goal of the EKF is to efficiently estimate
localizing the robot within the map. Such a scenario exists
the mean x^k and covariance Pk , as opposed to computing
after a map has been created with SLAM and the robot
the exact posterior (i.e., pðxk jz0:k ; u0:k ; x0 Þ).
needs to navigate to a desired position. In this case, known

123
314 K. Goorts et al.

The two-step prediction-correction scheme of a generic UGV. When landmarks are not simple points it is possible
EKF is presented below in the context of SLAM. In the for them to appear different from different view-points,
prediction update, the belief distribution for the robot states presenting a fundamental problem in data association.
xRk is updated given known control input. Since the belief is The sparsity and repetitive nature of modular structures
assumed to be Gaussian, this is accomplished by updating compounds the existing challenges in landmark extraction
the mean x^Rk and covariance Pk of the distribution. In and data association. If the SLAM solution relies solely on
general, the map states are assumed to be static and as such the structure itself for mapping and ignores the surrounding
are not included in the prediction update. Thus, only the environment which may not remain constant, landmarks
robot states xRk and corresponding entries in the covariance may only be derived from structural elements or permanent
matrix, denoted PRR attachments. Using a landmark extraction method designed
k are updated. The EKF-filter equations
for updating the mean and covariance of the robot states are to map individual structural elements, will be highly sus-
given by: ceptible to false correspondences in data association. On
the other hand, if all of the elements on one side of the
x^Rkjk1 ¼ gð^
xRk1jk1 ; uk Þ ð23Þ bridge are grouped as a single line landmark, the algorithm
T
will lack measurement data to correct the longitudinal
PRR RR
kjk1 ¼ Gk Pk1jk1 Gk þ Rk ð24Þ position of the UGV. To overcome these limitations and
In the correction update, measurements to features are used develop a landmark extraction scheme that is suitable for a
to improve estimates of both the robot states and map range of structures, individual tags containing unique
states. The degree to which the measurements are incor- augmented reality (AR) codes are placed on the structure.
porated in the new state estimate is defined by the Kalman This standardizes the landmarks, facilitates efficient data
gain Kk : association, and significantly reduces the likelihood of false
correspondences. The Kinect sensors mounted on the
Kk ¼ Pkjk1 HTk ðHk Pkjk1 HTk þ Qk Þ1 ð25Þ DACS can detect the AR codes using the RGB image and
provide measurements to the tag by incorporating the depth
The observation model is used to compute the difference image. Figure 5 illustrates the placement of AR codes on a
between the actual and expected measurements (i.e., full-scale aluminum pedestrian bridge. In EKF-SLAM, the
innovation). This error, calculated as zk  hð^
xkjk1 Þ, is number of states to be estimated is proportional to the
multiplied by the Kalman gain to correct the state esti- number of landmarks in the estimated map plus the states
mates. The EKF equations for the correction update are of the UGV. As such, a trade-off exists between the
given by: number of tags added to the bridge and computational
complexity. In particular, too few tags may not provide
x^kjk ¼ x^kjk1 þ Kk ðzk  hð^
xkjk1 ÞÞ ð26Þ
sufficient measurement information for convergence where
Pkjk ¼ ðI  Kk Hk ÞPkjk1 ð27Þ as too many tags may lead to time delays in the algorithm.
Exploration scheme In any SLAM application, an
exploration scheme is required to navigate the robot
4.3 Implementation of EKF-SLAM using the DACS through the unknown environment and ensure the entire
area is explored. For this study, a straight-forward explo-
EKF-SLAM was implemented on the proposed DACS with ration scheme that tracks the center-line of the bridge is
the intended purpose of creating a map of an unknown
structure than can later be used for localization. The
implementation was tailored for a pedestrian bridge but can
be applied to other structures with only minor modifica-
tions. The main challenges and key aspects of the algo-
rithm are described below.
Landmark extraction and data association Landmark
extraction is the process of identifying distinguishable
features in the environment that can be used to develop the
overall map. The type of landmarks that are extracted and
corresponding map that is produced depends on both the
type of sensors being used and the nature of the sur-
rounding environment. Data association involves finding
correspondences between the landmarks that already exist
in the global map and those that are currently visible to the Fig. 5 Use of AR codes to standardize landmarks

123
Structural control using a deployable... 315

proposed. However, this will vary depending on the where xICR is the projection of the instantaneous center of
application, for example, this could also be the center-line rotation (ICR) on the local x-axis. Figure 6 illustrates the
of a side walk. The UGV is commanded with a constant local and global frames of reference and projection of the
forward velocity and a proportional-derivative (PD) con- ICR. As the name implies, the ICR is the point about which
troller is used to command angular velocity to correct the the vehicle rotates at any given instant. The projection of
heading of the vehicle. With AR tags on both sides of the the ICR on the x-axis forms the relationship between
bridge, the desired trajectory is marked by the midpoint commanded angular velocity and the y-component of local-
between two tags directly across from each other. The frame velocity vy :
exploration continues until no more new features are
vy ¼ xg xICR ð29Þ
identified at which point the UGV is stopped. This explo-
ration method lets the placement of tags dictate the desired For the skid-steered UGV, the location of the ICR and
trajectory and as such can be applied to a wide range of corresponding x-projection changes with varying ratios of
structures including curved bridges. forward and angular velocity inputs. However, to reduce
Loop-closure Loop closure is central to the convergence modeling complexities, the x-projection is assumed to be
of the SLAM problem and is achieved when a landmark is constant. This assumption implies the ratio between for-
re-observed after significant travel. In EKF-SLAM, state ward and angular velocity commands is constant. With the
uncertainty continues to grow until loop closure is achieved UGV traveling predominantly in a straight line with min-
(Thrun et al. 2005; Durrant-Whyte and Bailey 2006). Upon imal steering, this assumption was shown to have negligi-
achieving loop closure, the estimates of all states improve ble impact on the state estimates.
based on the correlation information that is stored in the Using the kinematic model in Eq. 28, the motion model
covariance matrix. Achieving full loop-closure on a pedes- and Jacobian can be expressed as follows:
trian bridge with a forward facing sensor requires travel to
xRk1jk1 ; uk Þ
gð^
the far end of the bridge and a return trip back to the starting 2 3
point. Not only does this process require a large amount of Xg;k1 þ ðvx;k cos wg;k1 þ xg;k xICR sin wg;k1 Þdt
6 7
time, it also results in a significant travel distance before ¼ 4 Yg;k1 þ ðvx;k sin wg;k1  xg;k xICR cos wg;k1 Þdt 5
achieving loop closure during which large amounts of wg;t1 þ xg;t dt
uncertainty may accumulate. The loop-closure problem
ð30Þ
motivates the use the second, rear-facing Kinect sensor.
0
When traveling forward, landmarks are first extracted and Gk ¼ g xRk1jk1 ; uk Þ
ð^
initialized based on measurements from the forward-facing 2 3
1 0 ðvx;k sin wg;k1 þ xg;k xICR cos wg;k1 Þdt
Kinect sensor. After continuing in the same direction, the 6 7
¼ 40 1 ðvx;k cos wg;k1 þ xg;k xICR sin wg;k1 Þdt 5
same landmark is re-observed, this time from the rear-facing
sensor. As a result, a partial loop-closure is achieved for the 0 0 1
landmarks that have been seen up to that point. Continuing ð31Þ
in this fashion results in a series of incremental partial loop-
Measurement models Dead reckoning methods based on
closures that progressively improve the state estimates.
wheel encoders and IMU’s suffer from integration and
Motion model The motion model for the proposed
DACS is derived from the kinematic model of the skid-
steered UGV. Let the robot state vector xRk ¼ ½Xg ; Yg ; wg Tk
contain the global position coordinates ðXg ; Yg Þ of the
vehicle’s center of mass (COM) and yaw angle wg . By
commanding kinematic velocities, the control input vector
uk ¼ ½vx ; xg Tk contains the linear and angular velocities.
Kinematic modeling of skid-steer vehicles has been studied
to various degrees (Pazderski et al. 2004; Wang et al.
2009; Kozlowski and Pazderski 2004). Based primarily on
the work by Pazderski et al. (2004), the kinematic model
for the UGV is given by:
2 3 2 3
X_ g cos wg xICR sin wg  
6 Y_ 7 6 7 vx
4 g 5 ¼ 4 sin wg xICR cos wg 5 ð28Þ
xg
w_ g 0 1
Fig. 6 Coordinate systems for UGV motion model

123
316 K. Goorts et al.

accumulation of erroneous signals (i.e., drift). In EKF-


SLAM, absolute position measurements to landmarks can
be used to correct this drift. The main challenge associated
with incorporating position measurements involves syn-
chronization of the measurements with the corresponding
UGV states. In some cases, measurements from vision
sensors experience time delay associated with processing
the image and associating it to a landmark in the map. The
delayed measurements then get used to correct the current
state of the UGV which may have been updated since the
instant the images were recorded.
For the proposed DACS, encoder data from the UGV
and measurements to the AR tags from the Kinect sensors
are used in the correction update. For skid-steered UGVs,
encoder information is rarely used due to large errors
caused by wheel slippage. However, since the vehicle
Fig. 7 Schematic of measurement model for Kinect sensor
travel is predominantly in a straight line, the encoder
measurements in the longitudinal (local-x) direction are
where the global distance components are computed using:
only marginally biased by wheel slippage. The same does
not apply to the lateral (local-y) or UGV heading and as dxik ¼ XG;k
i
 XG;k ð34aÞ
such, only the longitudinal data is used in the update.
Furthermore, to prevent the accumulation of error over dyik ¼ YG;k
i
 YG;k ð34bÞ
large travel distances, incremental encoder measurements Since each measurement depends on a single landmark,
opposed to absolute data are used. In this way, instances of independent updates can be performed one feature at a
wheel slippage only affect the current update and are time. Linearizing the above measurement model with
removed from memory for future updates. The measure- respect to the UGV states and ith landmark states leads to
ment model for the incremental change in the local-x Jacobian used for computing the Kalman gain:
position is given by:
Hiknct;k ¼ hiknct ð^
xkjk1 Þ
Xg;k  Xg;k1 2 3
henc ð^
xk1jk1 ; x^kjk1 Þ ¼ ð32Þ dxk dyik
i
dxik dyik
cos Wg;k1 6 ri 0 0 ... 0 0 ::: 07
6 k rki rki rki 7
¼6 7
The forward and rear-facing Kinect sensors detect the AR 4 dyik dxik dyik dxik 5
1 0 ... 0 0 ::: 0
codes and provide range and bearing measurements relative ðrki Þ2 ðrki Þ2 ðrki Þ2 ðrki Þ2
to the sensor’s local frame. The raw measurements from ð35Þ
each sensor are first transformed to the global coordinate
frame as shown in Fig. 7. The Kinect sensor can accurately
detect AR codes up to a maximum distance of 4 m; how- 4.4 Position updating using EKF-based localization
ever, experimental testing determined measurement error
increases beyond a range of 3 m. Similarly, tags can be After a sufficient map of the bridge has been obtained using
detected across the full field of view of the sensor but image SLAM, the UGV can localize to any commanded location
distortion near the edges of the field of view cause increases on the structure. As shown in the probabilistic formulation,
in measurement error. In an effort to reduce measurement the localization problem involves using a known map xM to
error, raw range measurements greater than 3 m or less than estimate the robot state xRk . Mathematically this equates to
0.5 m were rejected from the update. Figure 7 depicts a finding the posterior probability distribution
R M
sketch of the measurement model for the Kinect sensor. pðxk jz0:k ; u0:k ; x Þ. For simplicity, and to maintain the
Mathematically, the model contains range and bearing aspects of landmark extraction and data association
measurements to a unique point landmark i with believed implemented in SLAM, an EKF-based localization algo-
global coordinates ðXgi ; Ygi Þ and is expressed as: rithm is used. The EKF-SLAM equations for the prediction
2 qffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffi 3 and correction updates can be adopted for localization
6 ðdxik Þ2 þ ðdyik Þ2 7  i  simply by reducing the state vector and replacing the
  r
xkjk1 Þ ¼ 6
hiknct ð^ 4 1 dyik
7¼ k
5 ð33Þ believed map states with the known landmark locations.
tan  wg;k bik Subsequently, the same two-step prediction-correction
dxk i
scheme is used to first predict the robot state and then

123
Structural control using a deployable... 317

correct based on encoder and AR tag measurements.


Autonomous positioning of the proposed DACS is
achieved by sending desired positions to the UGV and
applying a simple proportional-derivative (PD) controller
to compute appropriate forward and angular velocity
commands. The PD controller is designed to track the
center line of the bridge, and provides reasonable accel-
erations based on the required travel distance.

5 Experimental testing and results

This section covers the experimental program that was


carried out to verify the functionality of the EKF-SLAM
solution for mapping existing structures. Additionally, the
introduced localization method for autonomous positioning
of the DACS on a structure and its efficiency in controlling
different modes of vibration will be validated experimen-
tally through hybrid simulations of a simply supported
beam. The beam is idealized as an MDOF system repre-
sentative of the lateral component of a full-scale pedestrian
bridge. The experimental program is separated into two
stages. In the first stage, the EKF-SLAM algorithm is Fig. 8 Experimental test setup
implemented to develop a map of the pedestrian bridge. In
the second stage, the DACS is localized at different loca- The EKF loop-rate was set to 5 Hz and synchronization of
tions on the bridge to suppress different modes of vibration. the measurements was achieved by predicting the future
position and timing the collection of measurements to align
5.1 Experimental setup with that particular instance. The relatively slow loop rate
provided sufficient time to process the measurements and
The physical setup consists of a modular aluminum correct the predicted location for the given iteration. For
pedestrian bridge with a span of 16.76 m (55 ft). The width SLAM, the DACS was placed at one end of the bridge and
of the bridge is 1.22 m (4 ft) and is constructed in 1.52 m (5 programmed to travel with a constant forward velocity of
ft) modules. Double-sided landmarks (i.e., AR codes) are 0.1 m/s (this was set to a very low speed primarily to avoid
placed on both sides of the bridge deck and evenly spaced unwanted accelerations in the bridge structure) until the
at 1.52 m along the length to align with the panel points. To last feature was detected. A PD steering controller cor-
facilitate hybrid simulation, two shear-type load cells with rected the UGV heading to align with the center-line of the
a maximum lateral load capacity of ±17 kN (±4000 lbf) map as it was being created. The response from the steering
are installed at mid-span and quarter-span of the bridge. At controller was intentionally slow to minimize wheel slip-
these locations, the original bridge decking is replaced with page and associated errors in the prediction model. Noise
an independent panel to accurately measure the applied models for the prediction update and measurement updates
control force. An overview of the test setup used in this were quantified experimentally prior to SLAM by physi-
study is shown in Fig. 8. When idealized as a multi-degree cally tracking the UGV position and recording exact
of freedom (MDOF) system, the mid-span and quarter-span measurements to features.
of the bridge correspond to the modeled DOFs. As such, Figure 9 compares the constructed map of the bridge
the DACS must be positioned at one of these two locations with the actual AR tag locations and includes samples from
for control purposes. the estimated DACS trajectory. Overall, the estimated
landmark states correspond well to the actual tag locations.
5.2 Map generation using EKF-SLAM However, as shown in Fig. 9, the accuracy of the map tends
to degrade towards the end of the bridge. This error is due
A map of the pedestrian bridge was developed using the to the fact the exploration stopped at the 15 m mark and the
previously described EKF-SLAM solution. The algorithm incremental loop closure scheme has not corrected the final
was programmed in MATLAB and communication with landmark estimates. Table 1 summarizes the root-mean
ROS was established using the Robotic Systems Toolbox. squared error (RMSE) between the actual map and the

123
318 K. Goorts et al.

-1

-2

-2 0 2 4 6 8 10 12 14 16

Fig. 9 Map of pedestrian bridge using EKF-SLAM

completion, a checker-board type pattern is produced as


Table 1 Summary of RMSE for landmark coordinates
shown in Fig. 10c. Upon further investigation, it can be
Direction RMSE (m) observed that the variances for the global X-coordinate
Overall map First 20 landmarks of feature estimates are considerably lower than the
variances for the global Y-coordinate. This difference is
X-coordinate 0.024 0.0063
attributed to measurement error in the sensor and the
Y-coordinate 0.043 0.0081 fact the exploration followed a nearly straight line down
the center of the bridge. In this trajectory, slight errors in
estimated landmark states in terms of the global X and the heading estimate have a considerably larger impact
Y coordinates. The RMSE for the entire map is compared on the y-measurement than the x-measurement given
with the RMSE for the first 20 features (i.e., excluding the most measurements are taken at relatively small angles.
last two rows of features). Although there is increased uncertainty associated with
The covariance matrix can be viewed in a colour-map the global y-coordinates of the landmarks, the resulting
to graphically illustrate the variances of the UGV and map is sufficient for use in localization. It is worth
map estimates. Figure 10 shows the covariance matrix noting the DACS can tolerate small errors in the lateral
containing 52 states at three different stages during direction for this application provided good position
SLAM. In the gray-scale colour map, darker shades tracking is achieved in the longitudinal direction.
represent lower covariances and lighter shades indicate
higher covariances. To reflect the uncertainty in the 5.3 Control of MDOF system using DACS
initial estimate, the variance of the feature states was
initialized to be very large. This is represented by the In stage two of the experiment, the ability of the DACS to
white diagonal line in Fig 10a. As landmarks are position itself on a structure and control different modes of
observed, the variance is revised and the off-diagonal vibration is assessed. A description of the methodology and
terms are updated to reflect the correlations between system modeling is presented followed by the test proce-
individual features. Finally, as the full map is nearing dure and key results.

1 52 1 52 1 52
1 1 1

52 52 52
(a) (b) (c)

Fig. 10 Covariance matrices at the a beginning, b middle, and c end of EKF-SLAM

123
Structural control using a deployable... 319

5.3.1 Methodology: real-time hybrid simulation (RTHS) measured directly from the experimental substructure and
taken as external input into the analytical substructure. As
Hybrid simulation is a dynamic testing method where the such, Re is transferred to the right hand side of the equation
reality of physical testing is integrated with the power of of motion. Rewriting the equation of motion in state space
the numerical simulation techniques. In this method the test form yields:
structure is divided into two parts, namely experimental _ ¼ AZðtÞ þ B1 FðtÞ þ B2 Re
ZðtÞ ð37Þ
(physical) and analytical (numerical) substructures. The
experimental substructure contains components of the test YðtÞ ¼ CZðtÞ þ D1 FðtÞ þ D2 Re ð38Þ
structure for which a reliable analytical model does not
exist. These components are isolated and tested physically _ T is the state vector and the state
where ZðtÞ ¼ ½xðtÞ xðtÞ
while the remainder of the structure is modeled analytically space matrices are defined as:
in a computer (Dermitzakis and Mahin 1985). If there are    
0 I 0
load rate dependencies associated with the experimental A¼ ; B1 ¼ B2 ¼ ;
M1 K M1 C M1
substructure, the hybrid simulations must be carried out in
real-time to capture the realistic performance of the
experimental parts (Nakashima et al. 1992; Horiuchi et al. C ¼ ½I 0  ; D1 ¼ D2 ¼ 0
1999; Mercan and Ricles 2009). Assuring the robustness
For RTHS implementation purposes, the above continuous
and reliability of the computational platform along with
state space formulation is discretized using the zero-order-
maintaining fast and well synchronized data communica-
hold discretization method. By denoting the integration
tion amongst the substructures are the key steps in imple-
time step as T and setting t0 ¼ kT and t ¼ ðk þ 1ÞT, the
mentation of the real-time hybrid simulation (Mercan and
following discrete state space formulation (DSSF) is
Ricles 2009). RTHS offers many benefits including the
obtained (Liu et al. 2016):
ability to consider a wide range of influential parameters,
loading cases, and structural configurations in a cost Z½ðk þ 1ÞT ¼ Ad ZðkTÞ þ B1d FðkTÞ þ B2d Re ðkTÞ ð39Þ
effective and timely manner. This unique advantage is due
Y½ðk þ 1ÞT ¼ Cd Z½ðk þ 1ÞT ð40Þ
to the fact that in this method only one or a few parts (i.e.,
critical components) of the test structure are built and The subscript d denotes a discrete-time system matrix that
tested physically while the rest is numerically modeled was computed assuming a discretization time step size of 1
(Ashasi-Sorkhabi et al. 2013). As such, RTHS is a con- ms. The purpose of the FPGA is to establish high-speed,
venient method to evaluate the dynamic behavior of deterministic, and secure data communication with the
complex structures including passive, active, and semi- DACS and the measurement devices. This includes issuing
active control devices such as base-isolators, tuned liquid commands to the DACS and collecting force and acceler-
and mass dampers (i.e., TLDs/TMDs), and MR dampers ation data from the shear type load cells and accelerometer.
(Christenson et al. 2008; Ashasi-Sorkhabi et al. 2017).
5.3.3 Experimental and analytical substructures
5.3.2 Real-time hybrid simulator
A numerical model of the simply-supported, linear Ber-
A dual-core real-time controller and a field programmable noulli beam, herein referred to as the main structure, makes
gate array (FPGA) are the key hardware components of the up the analytical substructure. Physical properties of the
hybrid simulator used for running the experiments in this continuous beam used in this study are listed in Table 2.
study. The main role of the real-time controller is to solve For numerical modeling, the main structure is discretized
the equation of the motion of the MDOF structure online. into four beam elements with a total of 10 translational and
Consider the following equation of motion for a MDOF rotational degrees of freedom at the element end nodes.
system: The system equivalent reduction expansion procedure
xðtÞ þ CxðtÞ
M€ _ þ Ra ðtÞ þ Re ðtÞ ¼ FðtÞ ð36Þ (SEREP) is employed to reduce the degrees of freedom in
the discretized model to three translational degrees of the
where, M is the system mass matrix, C is the inherent freedom (O’Callahan 1989). SEREP ensures the natural
damping matrix, Ra is the restoring force vector computed frequencies of the discretized system are consistent with
from the analytical substructure, Re is the restoring force the analytical solution for the continuous beam model.
vector measured from the experimental substructure and F Figure 11 presents a schematic of the discretized beam
is the applied external force vector. When the analytical model and corresponding translational DOFs. Structural
substructure is assumed to remain elastic, Ra is equal to Kx properties of the condensed discretized system are defined
where K is the stiffness matrix of the system. Re is

123
320 K. Goorts et al.

Table 2 Properties of continuous beam model The DACS, representing the experimental substructure,
Property Value
is isolated and tested physically on the full-scale pedestrian
bridge. Having the DACS on the bridge provides the
Length 16.76 m opportunity to simultaneously assess the performance of
Mass 1800 kg the EKF-based localization method for positioning the
Elastic modulus 69.00 GPa UGV and ability to control different modes of vibration.
Moment of inertia 5000 cm4 The proposed LQG controller is used to determine the
Damping ratio 1.0 % 1st mode desired control force for controlling a particular mode of
2.0 % 2nd mode vibration. The actual restoring force applied by the DACS
is measured by the shear-type load cells and transferred
back into the analytical model. In most RTHS applications,
the numerically calculated structural displacements are
applied to the physical substructure. In this experiment,
physical displacements are not required to generate control
forces but rather only influence CSI which is to be studied
separately. Figure 12 displays a schematic of the experi-
Fig. 11 DOFs in discretized beam model mental and analytical substructures.

by the discretized mass, damping, and stiffness matrices 5.3.4 Test procedure and results
denoted Md , Cd , and Kd , respectively:
2 3 2 3
437:7 12:0 5:2 755:5 711:8 307:8 To demonstrate the ability of the DACS to autonomously
6 7 6 7
Md ¼ 4 12:0 432:6 12:0 5 ; Cd ¼ 4 711:8 1063:3 711:8 5 ; position itself and control different modes of vibration,
5:2 12:0 437:7 307:8 711:8 755:5 harmonic excitation was designed to resonate the structure
2 3
4:914 4:824 2:086 in the each of the first two modes independently. The
6 7
Kd ¼ 4 4:824 6:999 4:824 5  105 excitation consists of three 60-s segments exciting the first
2:086 4:824 4:914 mode, second mode, and first mode, respectively. Each
segment is separated by a 10 s transition phase resulting in
The resulting natural frequencies for the first and second an overall duration of 200 s. The active controller was
mode of vibration are 1.0 Hz and 4.0 Hz respectively. designed to be consistent with the excitation such that the

Fig. 12 Schematic of
experimental and analytical
substructures

123
Structural control using a deployable... 321

0.1 0.1 0.1

0 0 0

-0.1 -0.1 -0.1


35 36 37 38 39 40 95 96 97 98 99 100 175 176 177 178 179 180
0.1
Displacement (m)

0.05

-0.05
Uncontrolled Controlled
-0.1
0 20 40 60 80 100 120 140 160 180 200
Time (s)
(a)

0.1 0.1 0.1

0 0 0

-0.1 -0.1 -0.1


35 36 37 38 39 40 95 96 97 98 99 100 175 176 177 178 179 180
0.1
Displacement (m)

0.05

-0.05
Uncontrolled Controlled
-0.1
0 20 40 60 80 100 120 140 160 180 200
Time (s)
(b)

0.1 0.1 0.1

0 0 0

-0.1 -0.1 -0.1


35 36 37 38 39 40 95 96 97 98 99 100 175 176 177 178 179 180
0.1
Displacement (m)

0.05

-0.05
Uncontrolled Controlled
-0.1
0 20 40 60 80 100 120 140 160 180 200
Time (s)
(c)
Fig. 13 Uncontrolled and controlled displacement response at each DOF

123
322 K. Goorts et al.

Table 3 Effectiveness of
Segment Window (s) Quarter-span Response (m) Mid-span Response (m)
DACS under forced harmonic
excitation Uncontrolled Controlled Reduction Uncontrolled Controlled Reduction
RMS RMS % RMS RMS %

1 30–60 0.0465 0.0148 68 0.0658 0.0209 68


2 100–130 0.0115 0.0069 40 0.0036 0.0011 69
3 170–200 0.0473 0.0162 66 0.0670 0.0229 66

control objective was to suppress the particular mode that where a 40 % reduction in displacement (from 18 to 10
was being excited. A set of control gains was predeter- mm) is observed. Finally, the transition back to the first
mined for each mode of control. For controlling the first mode triggered the positioning of the device back to DOF
mode of vibration, the UGV was commanded to position 2. Control for the first mode resumed at the 160 s mark and
itself at DOF 2 (mid-span). On the other hand, to control resulted in similar control effect to that demonstrated
the second mode, the UGV was instructed to position itself during the first segment. The root-mean-squared (RMS)
at DOF 1 (quarter-span). value of the uncontrolled and controlled responses at mid-
The controlled displacements are compared with the span and quarter-span are compared for a 30 s window in
uncontrolled response for each DOF in Fig. 13. For all each segment. The results, presented in Table 3, validate
DOFs, a portion of each segment is enlarged for clarity. the effectiveness of the proposed DACS to control different
Since the UGV started at an arbitrary location on the modes of vibration by positioning and updating the control
bridge, initial positioning of the device at mid-span was algorithm.
required. This positioning required approximately 20 s as
illustrated by the consistency between the controlled and Figure 14 provides a comparison between the desired
uncontrolled responses. After reaching the desired position, control force computed by the control algorithm and the
active control was applied and the displacements were measured restoring force captured by the load cells. In this
effectively suppressed by over 70 % (from 97 to 27 mm at plot, the time spent positioning the DACS is represented by
mid-span). At the onset of the transition to the second a desired control force of zero. When controlling the first
mode of vibration, the DACS suspended control operations mode, the DACS is able to accurately provide the desired
and began navigating to the quarter-span; reaching the force. However, it should be noted that when controlling
desired position at the 90 s mark. As the excitation tran- the second mode there is approximately 20 N or 8 %
sitioned to excite the second mode, DOF 2 experienced a overshoot in the measured force and increased control
free vibration response, while the displacements at DOFs 1 delay of up to 30 ms compared to the first mode. The
and 3 were reduced in amplitude but increased in fre- overshoot and additional delay could be attributed to the
quency. The control performance for the second mode is fact the control frequency is reaching the limits of the
illustrated during the middle segment for DOFs 1 and 3 previously developed transfer function models or the

400 400 400

200 200 200

0 0 0

-200 -200 -200

-400 -400 -400


35 36 37 38 39 40 95 96 97 98 99 100 175 176 177 178 179 180
400
Control Force (N)

200

-200
Desired Measured
-400
0 20 40 60 80 100 120 140 160 180 200
Time (s)

Fig. 14 Active control force

123
Structural control using a deployable... 323

4 4 4

2 2 2

0 0 0

-2 -2 -2

-4 -4 -4
35 36 37 38 39 40 95 96 97 98 99 100 175 176 177 178 179 180
4
Modal Displacement

-2
Uncontrolled Controlled
-4
0 20 40 60 80 100 120 140 160 180 200
Time (s)
(a)

0.2 0.2 0.2

0 0 0

-0.2 -0.2 -0.2

-0.4 -0.4 -0.4


35 36 37 38 39 40 95 96 97 98 99 100 175 176 177 178 179 180
0.4
Modal Displacement

0.2

-0.2
Uncontrolled Controlled
-0.4
0 20 40 60 80 100 120 140 160 180 200
Time (s)
(b)
Fig. 15 Uncontrolled and controlled modal response for a the first mode and b the second mode

tuning of the servo-drive. To further improve control per- from the previous test. Figure 15 compares the uncon-
formance the transfer function models can be extended to trolled and controlled modal responses for the first and
cover a larger frequency bandwidth and the servo drive second mode. As shown in Fig. 15a, the first mode is
could be reprogrammed to provide the desired response at suppressed during the first and third segments. Similarly,
higher frequencies. Overall, the DACS demonstrated the Fig. 15b, shows the effect of second mode control during
ability to autonomously position itself on the bridge and the second segment. Table 4 compares the RMS value of
control two separate structural modes of vibration. the uncontrolled and controlled responses for each mode
The performance of the DACS was further assessed over three different windows. The 30 s windows corre-
using broadband excitation. Similar to the harmonic exci- spond to the time in each segment after the system has
tation, the generated broadband signal was divided into reached the desired position and began applying control
three segments and filtered around the first and second forces. As shown in the table, the RMS value of the first
mode frequencies in an attempt to excite individual modes mode response is reduced by 34 % and 52 % in the first and
of the structure. Although this loading will result in first third segments respectively. Similarly, a 12 % reduction in
mode contributions during the second segment, the control the RMS value of the second mode response is achieved
objective and corresponding control gains were maintained after positioning at quarter-span and suppressing second

123
324 K. Goorts et al.

Table 4 Effectiveness of
Segment Window (s) Mode 1 Response Mode 2 Response
DACS under broadband
excitation Uncontrolled Controlled Reduction Uncontrolled Controlled Reduction
RMS RMS % RMS RMS %

1 30–60 0.3069 0.2029 34 0.0224 0.0224 –


2 100–130 0.9923 0.9975 – 0.0614 0.0540 12
3 170–200 0.6267 0.3018 52 0.0194 0.0194 –

mode vibrations. The controlled modal responses for the mode, the system positioned itself accordingly at the
first and second mode when subjected to broadband exci- quarter-span. The DACS effectively suppressed both
tation validate the features of the DACS. modes of vibration; however, further tuning of the control
algorithm and servo-drive could lead to improved control
of the second mode. The results of the forced harmonic
6 Conclusions simulation were validated by subjecting the system to
broadband excitation. In summary, the results from the
This paper presented a deployable, autonomous control simulation show the proposed system can accurately nav-
system suitable for short-term vibration mitigation in igate to the desired position and has sufficient bandwidth to
lightweight bridges. To the authors’ knowledge, this is the control different modes of vibration.
first application of its kind in structural control. The DACS The combination of deployability and autonomy for
features a relatively large control bandwidth and transfers structural control shows great promise and is particularly
control forces without the use of a rigid connection. The attractive in temporary applications. Further studies are
use of EKF-SLAM to create a map of an unknown envi- needed and are being conducted to better understand and
ronment allows the system to position itself at any location further improve the proposed system. In particular, the role
on the structure and hence control different modes of of CSI on control performance and UGV positioning for
vibration. optimal control are currently being investigated. The
The accuracy of the EKF-SLAM algorithm was assessed authors hope that this paper spurs interest amongst the
using a full-scale pedestrian bridge. The estimated land- structural engineering community in studying robotics for
mark locations corresponded well to the actual map, par- structural control.
ticularly in the longitudinal direction. The covariance in the
lateral coordinates was considerably higher due to uncer- Acknowledgements The authors gratefully acknowledge the funding
support provided by the Natural Sciences Engineering Research
tainty in the vehicles lateral position which was attributed Council (NSERC) of Canada through their Canada Research Chairs
to the nearly straight-line exploration trajectory. Despite (CRC), Collaborative Research and Development (CRD), and Post-
the estimate uncertainty, the mean values produced a map Graduate Scholarship (PGS) programs.
sufficient for autonomously positioning the UGV. Further
improvements to the SLAM implementation could include
the use of additional sensors such as an IMU for improving References
vehicle odometry or laser scanners for more accurate range
Anderson, B.D., Moore, J.B.: Optimal control: linear quadratic
measurements. Also, in addition to AR tags, adding a methods. Courier Corporation (2007)
coloured line to denote the center-line to the bridge could Ashasi-Sorkhabi, A., Malekghasemi, H., Mercan, O.: Implementation
significantly improve the lateral position estimate of the and verification of real-time hybrid simulation (RTHS) using a
vehicle and in turn reduce uncertainty associated with the shake table for research and education. J. Vib. Control 21(8),
1459–1472 (2013)
landmark estimates. Lastly, for outdoor applications, a GPS Ashasi-Sorkhabi, A., Malekghasemi, H., Ghaemmaghami, A., Mer-
can be incorporated; however, the Kinect sensors should be can, O.: Experimental investigations of tuned liquid damper-
replaced with other sensors suitable for the lighting structure interactions in resonance considering multiple param-
conditions. eters. J. Sound Vib. 388, 141–153 (2017)
Aulinas, J., Petillot, Y., Salvi, J., Llado, X.: The SLAM problem: a
The ability of the DACS to autonomously position itself survey. In: Proceedings of the 2008 conference on Artificial
and control different modes of vibration was demonstrated Intelligence Research and Development, pp. 363–371 (2008)
through RTHS of a MDOF system. Harmonic excitation Chi, C., Wang, Y., Cheng, S., Shen, C.: Robot simultaneous
was applied to resonate the structure in each of the first two localization and mapping using a calibrated kinect sensor. Sens.
Mater. 26(5), 353–364 (2014)
modes. When resonating in the first mode, the system Christenson, R., Lin, Y.Z., Emmons, A., Bass, B.: Large-scale
navigated to mid-span and applied the desired control experimental verification of semiactive control through real-time
force. As the mode of vibration transitioned to the second hybrid simulation. J. Struct. Eng. 134(4), 522–534 (2008)

123
Structural control using a deployable... 325

Clearpath Robotics.: Husky: unmanned ground vehicle (2014) Pazderski, D., Kozlowski, K., Dixon, W.E.: Tracking and regulation
Dermitzakis, S.N., Mahin, S.A.: Development of substructuring control of a skid steering vehicle. American Nuclear Society
techniques for on-line computer controlled seismic performance Tenth International Topical Meeting on Robotis and Remote
testing. Report UBC/EERC-85/04, Earthquake Engineering Systems, pp. 369–376. Gainesville, Florida (2004)
Research Center, University of California, Berkeley, CA (1985) Skrzypczynski, P.: Simultaneous localization and mapping: a feature-
Dey, P., Narasimhan, S., Walbridge, S.: Evaluation of design based probabilistic approach. Int. J. Appl. Math. Comput. Sci.
guidelines for the serviceability assessment of aluminum pedes- 19(4), 575–588 (2009)
trian bridges. Journal of Bridge Engineering p 04016109 (2016) Smith, R., Self, M., Cheeseman, P.: Estimating uncertain spatial
Durrant-Whyte, H., Bailey, T.: Simultaneous localization and map- relationships in robotics. In: Cox, I.J., Wilfon, G.T. (eds.)
ping: part I. IEEE Robot. Autom. Mag. 13(2), 99–110 (2006) Autonomous robot vehicles, pp. 167–193. Springer, New York
Durrant-Whyte, H., Rye, D., Nebot, E.: Localization of autonomous (1990)
guided vehicles. In: Giralt, G., Hirzinger, G. (eds.) Robotics Soong, T.T., Spencer Jr., B.F.: Active, semi-active and hybrid control
research: the 7th International Symposium, pp. 613–625. of structures. Bull. N. Z. Soc. Earthq. Eng. 33(3), 387–402
Springer, New York (1996) (2000)
Dyke, S.J., Spencer Jr., B.F., Quast, P., Sain, M.K.: Role of control- Soong, T.T., Spencer Jr., B.F.: Supplemental energy dissipation:
structure interaction in protective system design. J Eng Mech state-of-the-art and state-of-the- practice. Eng. Struct. 24,
121(2), 322–338 (1995) 243–259 (2002)
Goorts, K., Ashasi-Sorkhabi, A., Narasimhan, S.: Deployable active Spencer Jr., B.F., Nagarajaiah, S.: State of the art of structural control.
mass dampers for vibration mitigation in lightweight bridges. J. Struct. Eng. 129(7), 845–856 (2003)
Submitted to Journal of Structural Engineering (2016) Spencer Jr., B.F., Sain, M.K., Won, C., Kaspari, D.C., Sain, P.M.:
Horiuchi, T., Inoue, M., Konno, T., Namita, Y.: Real-time hybrid Reliability-based measures of structural control robustness.
experimental system with actuator delay compensation and its Struct. Saf. 15(1), 111–129 (1994)
application to a piping system with energy absorber. Earthq. Thrun, S., Burgard, W., Fox D.: Probabilistic robotics. MIT press
Eng. Struct. Dyn. 28(10), 1121–1141 (1999) (2005)
Housner, G.W., Bergman, L.A., Caughey, T.K., Chassiakos, A.G., Ubertini, F.: Prevention of suspension bridge flutter using multiple
Claus, R.O., Masri, S.F., Skelton, R.E., Soong, T.T., Spencer Jr., tuned mass dampers. Wind Struct. 13(3), 235–256 (2010)
B.F., Yao, J.T.P.: Structural control: past, present, and future. Valls Miro, J., De Bruijn, F., Dissanayake, G., Boisard, O., Ton, P.:
J. Eng. Mech. 123(September), 897–971 (1997) Robot-assisted inspection of concrete box girders in bridges. In:
Kamarudin, K., Mamduh, S.M., Shakaff, A.Y., Zakaria, A.: Perfor- Austroads Bridge Conference, 8th, Sydney, New South Wales,
mance analysis of the Microsoft Kinect sensor for 2D simulta- Australia, October, (No. AP-G90/11) (2011)
neous localization and mapping (SLAM) techniques. Sensors Wang, H., Zhang, J., Yi, J., Song, D., Jayasuriya, S., Liu, J. Modeling
14(12):23,365–23,387 (2014) and motion stability analysis of skid-steered mobile robots. In:
Kozlowski, K., Pazderski, D.: Modeling and control of a 4-wheel IEEE International Conference on Robotics and Automation,
skid-steering mobile robot. Int. J. Appl. Math. Comput. Sci. pp 4112–4117 (2009)
14(4), 477–496 (2004) Zhang, C., Ou, J.: Control structure interaction of electromagnetic
La, H.M., Lim, R.S., Basily, B.B., Gucunski, N., Yi, J.G., Maher, A., mass damper system for structural vibration control. J. Eng.
Romero, F.A., Parvardeh, H.: Autonomous robotic system for Mech. 134(5), 428–437 (2008)
high-efficiency non-destructive bridge deck inspection and Zhang, C., Ou, J.: Modeling and dynamical performance of the
evaluation. IEEE-ASME Trans. Mechatron. 18(6), 1655–1664 electromagnetic mass driver system for structural vibration
(2013) control. Eng. Struct. 82, 93–103 (2015)
Liu, Y., Goorts, K., Ashasi-Sorkhabi, A., Mercan, O., Narasimhan, S.:
A state space-based explicit integration method for real-time
hybrid simulation. Struct. Control Health Monit. 23(4), 641–658 Kevin Goorts received his
(2016) BASc. degree in Civil Engi-
Mercan, O., Ricles, J.M.: Experimental studies on real-time testing of neering from the University of
structures with elastomeric dampers. J. Struct. Eng. 135(9), Waterloo (UW) in 2013 and is
1124–1133 (2009) currently a Ph.D. Candidate in
Ming, G., Chen, S.R., Chang, C.C.: Parametric study on multiple the Department of Civil and
tuned mass dampers for buffeting control of Yangpu bridge. Environmental Engineering at
J. Wind Eng. Ind. Aerodyn. 89(11), 987–1000 (2001) UW. His research interests are
Moon, S.J., Chung, T.Y., Lim, C.W., Kim, D.H.: A linear motor in the area of active structural
damper for vibration control of steel structures. Mechatronics control for lightweight struc-
14(10), 1157–1181 (2004) tures with particular emphasis
Nakashima, M., Kato, M., Takaoka, E.: Development of real-time on robotic applications.
pseudo-dynamic testing. Earthq. Eng. Struct. Dyn. 21(1), 14
(1992)
O’Callahan, J.: System equivalent reduction expansion process
(SEREP). In: Proceedings of the 7th International Modal
Analysis Conference, Schnectady, NY: Union College,
pp 29–37 (vol. 1) (1989)

123
326 K. Goorts et al.

Stephen Phillips received his monitoring. In addition, Ali has co-authored 8 journal publications
BASc. degree in Civil Engi- and 9 conference papers in his research fields.
neering from the University of
Waterloo (UW) in 2016 and is Sriram Narasimhan is an
currently an MASc Candidate in Associate Professor in the
the Department of Civil and Department of Civil & Envi-
Environmental Engineering at ronmental Engineering at the
UW. His research interests are University of Waterloo, where
in the area of active structural he also holds a cross-appoint-
control and robotics applica- ment with the Department of
tions in Civil Engineering. Mechanical and Mechatronics
Engineering and the title of
Canada Research Chair in Smart
Infrastructure. He obtained his
PhD degree from Rice Univer-
sity in Houston, Texas, in 2005.
Ali Ashasi-Sorkhabi is a He has authored or co-authored
postdoctoral fellow at the over 75 journal and conference
department of civil and envi- papers and serves on the editorial board of prestigious international
ronmental engineering, Univer- journals. His research spans across structural dynamics, system
sity of Waterloo, Waterloo, ON, identification and robotic applications to infrastructure assessment
Canada. He obtained his PhD and control.
degree in Civil engineering
from University of Toronto,
Toronto, ON, Canada. His
research experience and inter-
ests span the areas of structural
dynamics, dynamic testing
methods particularly real-time
hybrid simulation, structural
control, supplemental damping
devices, vibration monitoring, and structural/non-structural health

123

You might also like