You are on page 1of 11

Robotics and Autonomous Systems 57 (2009) 712–722

Contents lists available at ScienceDirect

Robotics and Autonomous Systems


journal homepage: www.elsevier.com/locate/robot

Sensor-based guidance control of a continuum robot for a semi-autonomous


colonoscopy
G. Chen a,∗ , M.T. Pham b , T. Redarce b
a
Unilever R&D, Port Sunlight, UK
b
Laboratoire Ampere, UMR CNRS 5005, INSA Lyon, F-69621, France

article info a b s t r a c t

Article history: Due to their compliance and high dexterity, biologically-inspired continuum robots have attracted much
Received 27 September 2007 interest for applications such as medical surgery, urban search and rescue, de-mining etc. In this paper,
Received in revised form we will present an application to medical surgery-colonoscopy by designing a pneumatic-driven flexible
29 October 2008
robotic manipulator, called ColoBot. The focus of this paper lies in the sensor-based position control of
Accepted 4 November 2008
Available online 18 November 2008
the ColoBot for guiding the advancement in a tubular, compliant and slippery environment. The kinematic
model related the position of the distal end of the ColoBot to the actuator inputs which is firstly developed
Keywords:
and formulated to control the shape of the ColoBot through position control of the distal tip. To achieve
Sensor-based position control safe guidance, the ideal position of the tip should be in the central axis of the colon. A method based on
Continuum robot a circumscribed circle is proposed to approximate the central position in real-time based on three sensor
Soft actuator readings. This position will be used as reference position for the tip to adjust its shape in real time to avoid
Colonoscopy the contact with tube wall. This proposed approach can be extended to the control of continuum robots
Kinematics in the conditions of a dynamically confined space. The simulation results and experimental results with
a curved tube will be presented in order to validate the proposed control strategy.
© 2008 Elsevier B.V. All rights reserved.

1. Introduction quite rigid and require the doctor to perform difficult manoeuvres
for long insertion with minimal damage of the colon wall [4,5].
Since the human colon is a tortuous ‘‘tube’’ with several sharp
Robotics has increasingly become accepted in the past 20 years
bends, the insertion of the colonoscope requires the doctor to exert
as a viable solution to many applications in surgery, particularly in forces and rotations at shaft outside of the patient, thus causing
the field of computer assisted surgery (CAS), Minimally Invasive discomfort to the patient. The complexity of the procedure for
Surgery and Therapy (MIS and MIT) [1]. Among them, surgical doctors and the discomfort experienced by the patient of current
robotic instruments for MIS are assumed to be the most promising colonoscopies lead many researchers to choose the automated
and technically challenging, needing integrated design, real-time colonoscopy method. In [6], the authors proposed the concept
sensing, actuation and control, power supply and some degree of automated colonoscopy (also called robotic colonoscopy) from
of autonomy [2]. Colonoscopy is a typical MIT procedure for two aspects: locomotion and steering of the distal end, which
observation, diagnostics and therapy of the lower gastrointestinal are the two main actions during a colonoscopy. In order to
tract including the colon, where the second frequent malignant facilitate the operation of colonoscopy, some studies on the robotic
tumor is found in industrialized countries [3]. This procedure is colonoscopy have been carried out from these two aspects. Most
accomplished through the insertion of an endoscope (also called current research on autonomous colonoscopies have been focused
on the self-propelled robots which utilize various locomotion
the colonoscope) into the human colon. At present, however, the
mechanisms [7–12]. Among them, inchworm-like locomotion
existing colonoscopy procedure is very technically demanding for
attracted much more attention [8,9]. However, most of the current
doctors and tends to be unpopular with patients [2]. The main
inchworm-based robotic systems [8–11] showed low efficiency of
reason lies in the characteristics of current colonoscopes, which are locomotion for exploring the colon because of the structure of the
colon wall: slippery and different diameters at each section.
Another aspect work that could improve the performance of
∗ Corresponding address: Unilever R&D, Port sunlight, Quarry Road East, CH63 current colonoscopies is to design an autonomous steering robot
3JW Bebington, Wirral, UK. Tel.: +44 0 1516411446; fax: +44 0 1516411812. for guidance inside the colon during the colonoscopy. Several
E-mail addresses: gchenchine@yahoo.fr (G. Chen), minh-tu.pham@insa-lyon.fr robotic colonoscopy systems are also comprised of a flexible
(M.T. Pham). steering tip, but they did not focus on how to control this special
0921-8890/$ – see front matter © 2008 Elsevier B.V. All rights reserved.
doi:10.1016/j.robot.2008.11.001
G. Chen et al. / Robotics and Autonomous Systems 57 (2009) 712–722 713

robot to endow it with a capability for autonomous guidance


[10,13,11,14].
Our previous work [15] has been focused on a semi-autonomous
robotic colonoscopy based on a biologically-inspired robotic
manipulator-ColoBot. The ColoBot will replace the distal-end of
an actual colonoscope and provide for the ability of autonomous
steering inside the colon during the colonoscopy. This paper will
present our work on the steering control of the ColoBot for a semi-
autonomous robotic colonoscopy.

2. Related work on the control of continuum robot

Biologically-inspired continuum robots have attracted much


interest from robotics researchers during the last decades. These
(a) Colobot. (b) Cross section of Colobot.
kinds of systems are characterized by the fact that their mechanical
components do not have rigid links and discrete joints in contrast Fig. 1. Colobot and its cross section.
with traditional industry robots [16]. The design of these robots
was inspired by the movements of natural animals such as plane. A method based on a circumscribed circle is utilized to
tongues, elephant trunks [17,18] and squid tentacles [19] etc. calculate a real-time reference position of the ColoBot inside the
The unusual compliance and redundant degrees of freedom of colon. A kinematic-based position control strategy will use the
these robots provide a strong potential to achieve delicate tasks reference position to adjust the shape of the ColoBot in order to
successfully even in cluttered and/or unstructured environments, achieve guidance. The paper will touch upon the following topics:
such as medical surgery [20], undersea operations [21], urban the structure of ColoBot will be described in Section 3 along with
search and rescue [22], de-mining and so on. Some robot its sensor system. Section 4 will deal with the kinematics and
prototypes/products have been designed and fabricated for characterization of pneumatic actuators. The implementation of
different applications [23,24,21,25]. Although continuum robots the sensor-based planning algorithm and kinematic control will be
presented potential advantages for many applications, continuum detailed in Sections 5 and 6 respectively. Experimental results will
robots also present a novel problem on kinematics: how to be presented in Section 7, followed by the conclusions.
model the motion of continuum robots with respect to the
acutator inputs. Due to its lack of joints and rigid links, the
3. Design of silicone rubber based robotic tip
standard Denavit–Hartenberg (D–H) method can not be applied
to continuum robots directly. Hirose [26] developed kinematics
in 2-D for snake-like robots by introducing the serpenoid 3.1. ColoBot
curve which closely matches the shape of a snake. In contrast,
Chirikjian [27–29] developed kinematics of hyber-redundant The design of ColoBot is inspired by pioneer work [35] on a
robots by using a continuous backbone curve. However, few flexible micro-actuator (FMA) based on silicone rubber. Fig. 1(a)
continuum robots match the proposed curve which limits the shows our design of the ColoBot. The robotic manipulator is a
application of this approach. Recently, researchers [30,31,20] have kind of continuum robot [16] that is a unique unit with 3 active
developed a kinematic model and have even achieved real-time pneumatic chambers regularly disposed at 120◦ apart. These three
implementatioin [32,33] for the kinematic control of continuum chambers are used for actuation; three other chambers shown
robots. However, the desired motions for controlling continuum in Fig. 1(b) are designed to optimize the mechanical structure in
robots are obtained through either predefined trajectory or tele- order to reduce the radial expansion of active chambers under
operation by using a joystick in these control strategies. pressure. The outer diameter of the tip is 17 mm that is lesser
The main contribution of this paper lies in automatic trajectory than the average diameter of the colon. The diameter of the inner
generation for steering control of the ColoBot inside the colon. In hole is 8 mm, which is used in order to place the camera or other
order for the ColoBot to achieve automatic guidance, contact-free lighting tools. The weight of the prototype is 20 g. The internal
(minimal contact) trajectory for the distal end of ColoBot should pressure of each chamber (1.5 mm in diameter) is independently
be planned in order to guide the colonoscope deep into the colon. controlled by using pneumatic jet-pipe servovalves. The promising
However, the tubular, compliant and slippery environment of the result obtained from the preliminary experiment showed that this
human colon brings out two main constraints in generating a tip could bend up to 120◦ .
trajectory. They are:
3.2. Distance sensors
• The colon is a three-dimensional confined space and there is
very little knowledge and very little work on the model of the
In order for the ColoBot to guide its own progression
colon for the purpose of motion planning
automatically, special non-contact position sensors are used to
• the colonoscopy procedure is performed in a dynamic envi-
measure the relative position between the top-end of the ColoBot
ronment due to the breathing activities of the patient and the
and the colon wall. Because of the flexibility of the optical fibers,
movement induced by the insertion of the colonoscope body.
of their small size and of non-contact property, three optical fibers
Our proposed approach to these problems is the sensor- position sensors fabricated by ROBERVAL laboratory of Université
based real-time generation of position reference for the tip in Technologique de Compiègne France [34] are integrated into the
2-dimensional plane and its shape control in 3-D space for the ColoBot. Each sensor is placed in front of each active pneumatic
semi-autonomous colonoscopy. Three optical distance sensors [34] chamber. As for the principle of the sensor, the light of the optical
disposing at 120◦ are used to measure the position of the distal fiber sensor is emitted from a cold source of light, and is transferred
end of the Colobot inside the colon (Fig. 2(a)). For more simplicity by fiber. The light reflected by a mirror is then injected in the
but without loss of generality, it is assumed that a colon is a reception fibers placed around the emission fiber. The amount
cylindrical tube and its cross section is an ellipse at the sensor of reflected light detected is a function of the distance between
714 G. Chen et al. / Robotics and Autonomous Systems 57 (2009) 712–722

(a) Optical sensors. (b) Characterisation of optical fibre sensors.

Fig. 2. Optical fibre position sensors.

the sensor and the surface of an object, Fig. 2(b) shows the
experimental results relating the measurement of output voltage
to the distance between the sensor and the porcine intestine. It is
divided into several working areas but it is always possible to use
the sensor in the different areas to measure a linear displacement
on a long range but the resolution will be more or less high.

4. Kinematics analysis of the robotic tip

The formulation of the kinematic model which relates the


position and of the distal end of Colobot in a cartesian frame to
the actuator inputs, is composed of three steps. Firstly, the silicone-
based actuator model—the relationship between the stretch length
of each chamber and the applied pressure in each chamber is
determined experimentally. Secondly, the robot bending shape
relating to the actuator inputs (length of each chamber or applied
pressure in each chamber) is determined through geometric
relationships. Finally, a kinematic model relates the task space
frame (distal end position inside the environment) to the robot
deformation shape with the assumption that the robot bending
shape is an arc of a circle.

Fig. 3. Kinematic parameters of Colobot.


4.1. Kinematic nomenclature

Fig. 3 shows the robot shape parameters and the corresponding 4.2. Characterization of pneumatic actuators
frames. The deformation shape of ColoBot is characterized by three
parameters as done in our previous prototype EDORA [30]. Bellows-based flexible robots presented in [36,24] suppose that
the length variation of each bellows is proportional to the applied
• L is the length of the virtual center line of the robotic tip
pressure. In our case, the silicone-based actuator shows strong
• α is the bending angle in the bending plane
• φ is the orientation of the bending plane nonlinearity relating the stretch length of the chamber to the
pressure variation in preliminary experiments. This relationship is
The frame Ru (O–xyz ) is fixed at the base of the actuator. The described as:
x-axis is the one that passed by the center of the bottom end
and the center of the chamber 1. The xy-plane defines the plane 1Li = fi (Pi ) (1)
of the bottom of the actuator and the z-axis is orthogonal to
where 1Li (i = 1, 2, 3) is the stretch length of each chamber with
this plane. The frame Rs (O0 –uvw) is attached to the top end of
corresponding pressure and fi (i = 1, 2, 3) is a nonlinear function
the manipulator. So the bending angle α is defined as the angle
of Pi . The stretch length of a single chamber is measured when the
between the O–z axis and O0 –w axis in the bending plane. The
pressure is applied from 0 bar to the pressure maximum which
orientation angle φ is defined as the angle between the O–x axis
can make the actuator bend 90◦ , while the pressures of the other
and O–t axis, where O–t axis is the project of O0 –w axis on the plane
two chambers are kept at zero bar. For precise measurements, the
x–O–y. The notation is explained as the following:
pressure in the chamber is kept constant by using a closed-loop
1. i: chamber index, i = 1, 2, 3 controller. Since the deformation of the each chamber is an arc
2. R: radius of curvature of the centerline of the robotic tip of a circle, it is difficult to find a suitable sensor to measure the
3. Li : arc length of the ith chamber arc length. A simple method is then used to measure the length
4. L0 : initial length of the chamber of the chamber. When the chamber is stretching under pressure,
5. Pi : pressure in the chamber i
a fine string is placed right outside the stretched chamber, so the
6. S: effective surface of the chamber
length of the string can be considered approximately as the length
7. Ri : radius of curvature of the ith chamber
of the chamber. Results obtained from experiments proved that
8. ε : stretch length of the centerline
9. 1Li : the stretch length of the ith chamber there is a non-linear behavior (hysteresis) between the pressure
and the stretch length of each chamber (Fig. 4(a)). A polynomial
G. Chen et al. / Robotics and Autonomous Systems 57 (2009) 712–722 715

(a) Characterics of pneumtic chambers. (b) Norm variation vs polynomial order.

Fig. 4. Static characterics of pneumtic chambers and criterion of model order.

model is thus used to approximate the measurements. A criterion


based on the norm of the mean error is used to select the order
of each polynomial function fitting the data. This analysis shows
that a third order polynomial approximation (see Fig. 4(b)) allows
curve fitting significantly the actual data in the working zone of
each chamber i.e. above the threshold pressure of each chamber
(Fig. 4). The corresponding results can be written as:

if P1min < P1 < P1max




1 L = 37(P1 − P1min )3 − 54(P1 − P1min )2 − 9.5(P1 − P1min )


 1

if P2min < P2 < P2max

(2)
1L2 = −9(P2 − P2min )3 − 18(P2 − P2min )2 − 11(P2 − P2min )
if P3min < P3 < P3max



1L3 = 0.8(P3 − P3min )3 − 8.9(P3 − P3min )2 − 34(P3 − P3min )

where Pimin (i = 1, 2, 3) is the threshold of the working point of


each chamber and their values equal: P1min = 0.7 bar, P2min =
0.8 bar, P3min = 0.8 bar and Pimax (i = 1, 2, 3) is the maximum
pressure that can be applied into each chamber.
Fig. 5. Top view of the base coordinate (line l is the intersection line between the
4.3. Kinematics analysis base plane and the top-end plane o0 –uvw).

When the load effects are ignored and the deflected angle α is where h is the perpendicular height of the equilateral triangle
such as 0 < α < π , the deflected shape of the ColoBot at the obtained by the layout of the three chambers.
i=1 cos φi = 0, the length of virtual central line L is
P3
bending moment is assumed to be an arc of a circle. Given this Since
assumption, it is clear that: deduced as:
3
Li = α R i (3) 1X
L= Li . (8)
or 3 i=1

Li (L0 + ) And the orientation angle is deduced by combining Eqs. (6) and (7):
α= = . (4) √
Ri R 3(L2 − L3 )
φ = atan2 (9)
Angle φi is defined as the angle of the bending plans relative to the L3 + L2 − 2L1
chamber i, shown in Fig. 5 where atan2(x, y) is the four quadrant arctangent of the real parts
(
φ1 = −φ of the elements of x and y.
φ2 = 120 − φ In the same time, the radius of curvature of the center line and
(5)
the bending angle α are expressed as:
φ3 = −120 − φ.
 3
By using these angles, the radius of curvature of the chamber i can 
 h
P
be described as:

Li


R= √
2 3 λL (10)
Ri = R − h cos(φi ) (6)  √
λL

3

α=


and: h
2 where λL = L1 2 + L2 2 + L3 2 − L1 L2 − L2 L3 − L3 L1 . So the geometry-
Li = L − h cos(φi ) (7) based kinematic model relating the robot shape parameters to
3
716 G. Chen et al. / Robotics and Autonomous Systems 57 (2009) 712–722

actuator inputs (chamber length) is expressed as the following (by


combining Eqs. (8)–(10)):
3

1X
L = Li




 3 I =1

 √
3(L2 − L3 ) (11)
φ = atan2
L + L2 − 2L1


 √ 3
λL


α= .


h
By using the actuator models determined in Section 4.2,
the corresponding length of each chamber under the pressure
variation can be expressed as the following:

L1 = L0 + 1L1 = L0 + f (P1 )
(
L2 = L0 + 1L2 = L0 + f (P2 ) (12)
L3 = L0 + 1L3 = L0 + f (P3 ).
Thus the direct kinematic equations relating the robot shape
parameters to the input pressures are then represented by: Fig. 6. Position of ColoBot inside the colon.
 3
1X
L = L + fi (Pi )

0



 3 I =1
 √
3(f2 (P2 ) − f3 (P3 ))

φ = atan2 (13)
f3 3 ) + f2 (P2 ) − 2f1 (P1 )
( P



λ

 p
α =
 p

h
where λp = f1 (P1 )2 + f2 (P2 )2 + f3 (P3 )2 − f1 (P1 )f2 (P2 )
− f2 (P2 )f3 (P3 ) − f3 (P3 )f1 (P1 ).

4.4. Task space representation of kinematic model

With the assumption that the bending shape of ColoBot is an


arc of a circle, The cartesian coordinates (x, y, z) of the distal end
of Colobot in task space related to the robot bending parameters is
achieved through a cylindrical coordinate transformation.
Fig. 7. Computation of the safe position.
 L
 x= (1 − cos α) cos φ
α



L

1. Step 1: Three sensor measurements (s1, s2, s3) are collected.
y= (1 − cos α) sin φ (14)
 α 2. Step 2: Position Pn in the frame Rs (Fig. 7) is evaluated with these
L


sin α. three measurements.

z =
α
3. Step 3: If Pn is a safe position, then it’s necessary to go back to
And the state-space form of this model is given by step 1 for the next period (10 ms); otherwise, next safe position
X = f (Qp ) (15) Pn+1 described in the Frame Ru (Fig. 7) is calculated through the
circumscribed method and is fed to the kinematic control for
where X = (α, φ, L) , Qp = (P1 , P2 , P3 ) .
T T
execution.

5. Sensor-based motion planning algorithm for autonomous Fig. 8 shows the algorithm of the planning and guidance control
guidance of the distal end of the ColoBot inside the colon.

The objective of sensor-based motion planning is to calculate


the safe position of the distal-end of Colobot compared to the colon 5.1. Positioning of the distal end of Colobot inside the colon
wall in real-time based on the measurements of three distance
sensors for guidance inside the colon. For more simplicity but
Let A be the center of the ColoBot, Ci (i = 1, 2, 3) be three sensor
without loss of generality, it is assumed that a colon is a cylindrical
points and Di (i = 1, 2, 3) be the measurement point of each sensor
tube and its cross section is an ellipse at the sensor plane. Fig. 6
on the colon wall. Fig. 7 shows the setting of these measurements.
illustrates the sensor plane, the distal end of ColoBot and the colon
axis. The coordinates of points D1 , D2 and D3 can be obtained related
With these assumptions, the safe position will be the central to the local coordinate frame Rs (u, v, w) whose origin Pn as
axis of the colon. To approximate the colon axis, a method based on following (Fig. 3):
a circumscribed circle is proposed. Since three points D1 , D2 and D3
D1 : (s1 + R; 0; 0)Rs
(
(Fig. 7) of sensor measurements form a triangle, the center of the
circumscribed circle of this triangle is chosen as the safe position. D2 : (−(R + s2) sin(π /6); −(R + s2) cos(π /6); 0)Rs (16)
This approach iterates as following: D2 : (−(R + s3) sin(π /6); (R + s3) cos(π /6); 0)Rs .
G. Chen et al. / Robotics and Autonomous Systems 57 (2009) 712–722 717

Fig. 9. Schema of the principle of the method.

Similarly for (D2 D3 ) and p2 , their equations are


Fig. 8. Sensor-based planning and guidance control procedure: d is the distance y = a3 x + b 3 and y = a4 x + b4 .
tolerance.
Then it leads to:
And the coordinates of Pn and points D1 , D2 and D3 in the  
YD3 − YD2 XD3 + XD2 YD3 + YD2
coordinate frame Ru (x, y, z) are expressed as: a3 = ; M2 ,
XD3 − XD2 2 2
L cos φ sin α
( )
1
Pn = −L sin φ sin α b4 = YM2 − a2 XM2 ; a4 = − .
a3
L cos α Ru
cos φ[(s1 + R) cos α + L sin α] So Pn+1 is the solution of these equation:
( )
OD1 = sin φ[(s1 + R) cos α − L sin α]
y = a2 x + b 2
(s1 + R) sin α + L cos α Ru (18)

−(s2 + R) sin(π /6) cos φ cos α+
 y = a4 + b 4 .
 
(s2 + R) cos(π /6) sin φ + L cos φ sin α 
 
Thus Pn+1 = ( a4 −a2 ; a2 a4 −a2 + b2 ) (Fig. 9).
b −b b −b

(17)

OD2 = −(s2 + R) sin(π /6) sin φ cos α− 2 4 2 4

(s2 + R) cos(π /6) cos φ − L sin φ sin α 



 


−(s2 + R) sin(π /6) sin φ + L cos α 6. Formulation of task space control of ColoBot

 Ru
s3 + R) sin(π /6) cos φ cos α−

 −( 
(s3 + R) cos(π /6) sin φ + L cos φ sin α  After determining the desired trajectory from sensor-based

 

OD3 = −(s3 + R) sin(π /6) sin φ cos α + . planning, the kinematic control of Colobot will be described in this
(s3 + R) cos(π /6) cos φ − L sin φ sin α  sectioin. It should be noted that two variables are used to represent

 

−(s3 + R) sin(π /6) sin α + L cos α the position of Colobot inside the colon. However, the Colobot has
 
R u
3 degrees of freedom. So this manipulator becomes redundant for
the chosen task. The velocity kinematic equations are rewritten as
5.2. Method based on a circumscribed circle for calculating the safe following:
position
X = f (Qp )
The center of the circumscribed circle formed by the triangle ∂X ∂(α, φ, L) ∂ QL ˙
(D1 , D2 , D3 ) has the same distance to the three points. Thus, this Ẋ = Qp or (19)
∂(α, φ, L) ∂ QL ∂ QP
center will be the intersection of the medians p1 and p2 of the line
segment [D1 D2 ] and [D2 D3 ]. In the coordinate frame Ru (x, y, z ), the Ẋ = Js Jl Jp Q˙p = J Q˙p
equations of different straight lines are represented by: where X = (x, y)T , QL = (L1 , L2 , L3 )T , Qp = (P1 , P2 , P3 )T and
YD2 − YD1 J = Js Jl Jp is the Jacobian matrix with relation to the three levels
(D1 D2 ) : y = a1 x + b1 ; a1 = of pressure in the chambers.
XD2 − XD1
(p1 ) : y = a2 x + b 2
6.1. Resolution of the inverse kinematics with redundancy
is the perpendicular at (D1 D2 ) and pass by
In the case of a redundant manipulator with respect to a given
 
XD1 + XD2 YD1 + YD2
M1 , task, the inverse kinematic problem admits infinite solutions.
2 2
This suggests that redundancy can be conveniently exploited to
thus, meet additional constraints on the kinematic control problem in
1 order to obtain greater manipulability in terms of the manipulator
a2 = − and b2 = YM1 − a2 XM1 . configurations and interaction with the environment. A viable
a1
718 G. Chen et al. / Robotics and Autonomous Systems 57 (2009) 712–722

7.1. Simulation results of sensor-based planning

During the simulation in Matlab, the size of ColoBot is simulated


as 18 mm and the height as 90 mm. The cross section of the colon
is assumed to be an ellipse with the long axis 34 mm and the
short axis 24 mm. The initial position of the ColoBot is chosen
randomly and then the position algorithm will make the Colobot
near to the center of the ellipse. During the experiment, the colon
is fixed and the sensor measurements are simulated with Gaussian
measurement noise. Fig. 10 shows the results of positioning inside
the ellipse. The final position of the ColoBot is 3.33 mm far from the
median line of the ellipse after four simulation cycles (10 ms/cycle).
Furthermore, it showed that the algorithm has some oscillations in
order to find the median line of the ellipse. This can be explained
that there is no absolute position that makes three measurements
equal due to the colon shape and the noise of the measurements.
Fig. 10. Simulation results of the circumscribed method. Since the purpose of guidance control is to minimize the contact
between the robot and the colon wall, Colobot can achieve real-
solution method is to formulate the problem as a constrained time safe guidance control by choosing a suitable tolerance.
linear optimization problem. Work on resolved-rate control [37]
proposed to use the Moore–Penrose pseudo inversion of the 7.2. Implementation
Jacobian matrix as:

Q˙p = J + Ẋ = (J T (JJ T )−1 )Ẋ . (20) Fig. 11 shows the low-level control system of ColoBot. The
pressurized air comes through the compressor (1) and the general
In our case, however, there is a mechanical limit range for pressure is adjusted thanks to the device (2). The pressure in the
the elongation of each chamber and the corresponding pressure chambers are controlled by three Jet-pipe servovalves (3a, 3b and
applied into the chamber of the ColoBot. The objective function is 3c). Three pressure sensors (4a, 4b and 4c) are connected between
constructed to be included in the inverse Jacobian algorithms as
the servovalves and the ColoBot (5) for the pressure feedback
the second criteria also called the null-space method [38,39].
control. Suitable drivers and amplifiers in the rack (6) were
Q˙p = J + Ẋ + µ[I − J + J ]ġ (21) designed to amplify control signals applied to the actuator. A real-
time controller is implemented through a Dspace card Real-Time
where µ is constant and g is the second criteria for optimization
Workshop with Simulink. The Simulink block diagram designed
of the solution. This objective function evaluates the pressure
for path planning and kinematics algorithms are expressed with
difference between the applied pressure in the chamber and the
Simulink block diagram which will be compiled as real-time
average pressure applied in the chamber. So the cost function w(P )
executable under the DSP Processor of Dspace card. The system
is expressed as following:
runs at 500 Hz for a real-time control loop.
3  2
1X Pi − Piav e
w(P ) = . (22)
7.2.1. Kinematic control
3 i=1 Pimax − Pimin
To validate the position control for ColoBot, the real experiment
We can then minimize w(p) by choosing: on the Colobot as well as simulation have been carried out. The
∂w ∂w ∂w desired trajectory is a circle with a diameter of 50 mm. The
 
ġ = grad w(P ) = . (23) kinematic control algorithm is implemented under the assumption
∂ P1 ∂ P2 ∂ P3
that the displacement of distal-end of ColoBot are sufficiently small
in a cycle. Thus the velocity kinematics relating state velocities and
7. Simulations and experimental results Cartesian velocities can be approximated by 1X /1T and 1Qp /1T .
The figure on the left of Fig. 13 shows the simulation control
This section will present the simulation and experimental pressure of three chambers, while the one on the right shows the
results of sensor-based planning and an autonomous guidance real control pressure to the three chambers. Fig. 12(b) shows the
control algorithm on an emulation platform and a colon-like tube. comparison of experimental results and simulation results of a

Fig. 11. Kinematic parameters of the Colobot.


G. Chen et al. / Robotics and Autonomous Systems 57 (2009) 712–722 719

(a) miniBIRD and Colobot. (b) Simulation and real trajectory.

Fig. 12. Kinematic control results.

Fig. 13. Applied pressure control to chambers of ColoBot: Simulation (left) and real experiment (right).

and built to emulate the insertion process of a colonoscope in


the colon. The base of this platform can manually move in two
directions (X , Y ) which simulates the movements of a colonoscope
inside the colon. The bottom of ColoBot is fixed on that platform,
ColoBot can thus move in the same way as does the platform. A
tube with the diameter of 35 mm is placed in a circle emulating
the colon.
With this experimental setup, the test is to validate the sensor-
based planning and guidance capability. The base of the platform
moves stochastically in X and Y directions in order to emulate the
movement of a colonoscope in the colon. Thus the best trajectory
of distal end of ColoBot is the central axis of the tube. By calculating
the trajectory as near as possilbe, ColoBot can avoid contacting
with the tube wall. Fig. 15(a) plots the position of distal-end of
ColoBot inside the tube with respect to the time. The dashed line is
Fig. 14. Emulator for the operation of Colonoscopy. the desired trajectory and the solid line is the calculated trajectory
by the method based on a circumscribed circle. It can be seen that
trajectory tracking. The position of the distal-end in the XOY plane safe position is always around the desired position. Furthermore,
for the simulation is calculated using Eq. (14), while the position the movements of the base and three sensor measurements are
in the XOY plane for real-time experiments is acquired through shown in Fig. 15(b).
using a 6 DOF magnetic tracker (miniBIRD) positioned at the top
of the ColoBot. The small difference between two trajectories is 7.2.3. Experimental results in a colon-like tube
explained by the fact that three chambers have different working A more realistic experiment to test the performance of this
zones (Fig. 4(a)). semi-autonomous colonoscopy system is to to use a colon-like
transparent tube to see if ColoBot can cross the tube with minimal
7.2.2. Experimental results on an emulation platform contact with the tube wall. The diameter of the tube is 26 mm and
For the purpose of testing the performance of sensor-based its length is 50 cm (Fig. 16). For this experiment, the calibration
planning and guidance, an emulation platform (Fig. 14) is designed of the optical fibres was adapted to the transparent tube. It’s
720 G. Chen et al. / Robotics and Autonomous Systems 57 (2009) 712–722

(a) Guidance control results. (b) Sensor measurement evolution.

Fig. 15. Guidance control with an emulation platform.

Fig. 16. Steering control test in a colon-like tube.

Fig. 17. Evolution of bending angle of ColoBot.

highly probable that results for the distance sensors in a porcine that ColoBot has the capability to guide the exploration of the tube
intestine will be similar to those obtained in the human bowel. with a sensor-based steering control method.
The colonoscope tip is manually inserted and Fig. 17 showed
that ColoBot crossed the different positions of the tube with a 8. Conclusions and future works
different bending angle. The evolution of the measurements of
three optical fibres are represented in the left Fig. 18(a). During the This paper presented a sensor-based safe path generation
entire movement, the distances are never less than 0.8 mm. This and guidance control of a biologically-inspired continuum robot-
ColoBot for a semi-autonomous colonoscopy. The pneumatic
demonstrates that the colonoscope tip is moving through the tube
driven Colobot is a silicone-based robotic manipulator which
without touching it. For a better representation and visualization,
is driven through pneumatic actuators. Three optical fiber
Fig. 18(b) shows the extreme positions of the top-end of ColoBot distance sensors are utilized for sensor-based safe real-time path
as it progresses (with a velocity of 4 cm/s). The position of the generation for guidance control under compliant and slippery
ColoBot at the center of the tube is represented by the smallest environments of the colon.
circle. The larger circle represents the tube wall and the line shows With the assumption that the measure plane is an ellipse, a
the extreme positions of ColoBot. This experiment demonstrates method based on a circumscribed circle is utilized to calculate the
G. Chen et al. / Robotics and Autonomous Systems 57 (2009) 712–722 721

(a) Evolution of three measurements. (b) Extreme position projected into the tube plane.

Fig. 18. Guidance control result analysis.

reference position of the ColoBot. While position control in task [15] G. Chen, M.T. Pham, T. Redarce, Development and kinematic analysis of a
space used these reference positions to adjust the shape of ColoBot silicone-rubber bending tip for colonoscopy, in: Proc. of the IEEE-RSJ Int. Conf.
on Intelligent Robots and Systems, Beijing,China, 2006, pp. 168–173.
inside the colon to achieve guidance. The simulation results of [16] G. Robinson, J. Davies, Continuum robots—a state of the art, in: Proceedings of
sensor-based planning and experimental results with an emulation the International Conference on Robotics and Automation, Detroit Michigan,
platform and with a transparent tube verified the effectivity of USA, 1999, pp. 2849–2853.
[17] R. Cieslak, A. Morecki, Elephant trunk type elastic manipulator—a tool for bulk
kinematic control and guidance strategy. In the near future, the and liquid type materials transportation, Robotica 17 (1999) 11–16.
proposed method will be tested in a vivo environment. [18] M.W. Hannan, I.D. Walker, Kinematics and the implementation of an
elephant’s trunk manipulator and other continuum style robots, Journal of
Robotic Systems 20 (2) (2003) 45–63.
References [19] J.F. Wilson, D. Li, Z. Chen, R.T. George Jr, Flexible robot manipulators and
grippers: Relatives of elephant trunks and squid tentacles, in: Proc. Robots Biol.
[1] R.H. Taylor, D. Stoianovici, Medical robotics in computer-integrated surgery, Syst.: Toward a New Bionics?, 1993, pp. 474–479.
IEEE Transaction on Robotics and Automation 19 (5) (2003) 765–781. [20] N. Simaan, R. Taylor, P. Flint, A dexterous system for laryngeal surgery—multi-
[2] P. Dario, B. Hannaford, A. Menciassi, Smart surgical tools and augmenting backbone bending snake-like slaves for teleoperated dexterous surgical tool
devices, IEEE Transaction on Robotics and Automation 19 (5) (2003) 782–792. manipulation, in: IEEE International Conference on Robotics and Automation,
New Orleans, USA, 2004, pp. 351–357.
[3] P. Dario, M.C. Carrozza, A. Pietrabissa, Development and in vitro tests of
a miniature robotic system for computer-assisted colonoscopy, Jounal of [21] D.M. Lane, J.B.C. David, G. Robinson, D.J. O’Brien, J. Sneddon, E. Seaton,
Computer Aided Surgery, 4 (1999) 4–14. Elfstrom A., The amadeus dextrous subsea hand: Design, modeling, and sensor
[4] R.H. Sturges, A flexible, tendon-controlled device for endoscopy, The processing, IEEE Journal of Oceanic engineering 24 (1) (1999) 96–111.
International Journal of Robotics Research 12 (2) (1993) 121–131. [22] H. Tsukagoshi, A. Kitagawa, M. Segawa, Active hose: An artificial elephant’s
[5] T. Fukuda, S. Guo, K. Kosuge, F. Arai, M. Negoro, K. Nakabayashi, Micro nose with maneuverability for rescue operation, in: Proc. IEEE Int. Conf. Robot.
active catheter system with multi degrees of freedom, in: Proceedings of the Autom., Seoul, Korea, 2001, pp. 2454–2459.
International Conference on Robotics and Automation, San Diego, USA, 1994, [23] N. Simaan, Snake-like units using flexible backbones and actuation redun-
pp. 2290–2295. dancy for enhanced miniaturization, in: Proc. IEEE Int. Conf. Robot. Autom.,
[6] S.J. Phee, W.S. Ng, I.-M. Chen, F. Seow-choen, B.L. Davies, Automation of Barcelona, Spain, 2005, pp. 3023–3028.
colonoscopy, part one: Locomotion and steering aspects in automation of [24] Y. Bailly, Y. Amirat, Modeling and control of a hybrid continuum active catheter
colonoscopy, IEEE Engineering in Medecine and Biology Magazine 17 (3) for aortic aneurysm treatment, in: Proceedings of the International Conference
(1998) 81–89. on Robotics and Automation, Barcelona, Spain, 2005, pp. 924–929.
[7] K. Ikuta, M. Tsukamoto, S. Hirose, Shape memory alloy servo actuator system [25] G. Immega, K. Antonelli, The ksi tentacle manipulator, in: IEEE Conf. Robot.
with electric resistance feedback and application for active endoscope, in: Autom., Nagoya, Japan, 1995, pp. 3149 –3154.
Proceedings of the International Conference on Robotics and Automation, [26] S. Hirose, Biologically Inspired Robots, Oxford University Press, Oxford, 1993.
Hitachi City, Japan, 1988, pp. 427–430. [27] G.S. Chirikjian, J.W. Burdick, A modal approach to hyper-redundant manipu-
[8] A.B. Slatkin, J. Burdick, The development of a robot endoscope, in: Proc. of lator kinematics, IEEE Transactions on Robotics and Automation 10 (3) (1994)
the IEEE-RSJ Int. Conf. on Intelligent Robots and Systems, Pittsburgh, PA, USA, 343–354.
1995, pp. 3315–3320. [28] G.S. Chirikjian, J.W. Burdick, Hyper-redundant manipulator dynamics:a
[9] P. Dario, C. Paggetti, N. Troisfontaine, E. Papa, T. Ciucci, M.C. Carrozza, M. continuum approximation, Advanced Robotics 9 (3) (1995) 217–243.
Marcacci, A miniature steerable end-effector for application in an integrated [29] G.S. Chirikjian, Design and analysis of some nonanthropomorphic biologically
system for computer-assisted arthroscopy, in: IEEE International Conference inspired robots: An overview, Jornal of Robotic Systems 18 (12) (2001)
on Robotics and Automation, 1997, pp. 1573–1579. 701–713.
[10] A. Menciassi, Park J.H., S. Lee, S. Gorini, P. Dario, J.O. Park, Robotic solutions [30] G. Chen, M.T. Pham, T. Redarce, C. Prelle, F. Lamarque, Design and control of an
and mechanisms for a semi-autonomous endoscope, in: Proc. of the IEEE- actuator for colonoscopy, in: 6th Int. workshop on Research and Education in
RSJ Int. Conf. on Intelligent Robots and Systems, Lausane, Switzerland, 2002, Mechatronic, Annecy, France, 2005, pp. 109–114.
pp. 1379–1384. [31] B.A. Jones, I.D. Walker, Kinematics for multi-section continuum robots, IEEE
[11] S. Kumar, I.M. Kassim, V.K. Asari, Design of a vision- guided microrobotic Transactions on Robotics 22 (1) (2006) 43–55.
colonoscopy system, Advanced robotics 14 (2) (2000) 87–114. [32] B.A. Jones, I.D. Walker, Practical kinematics for real-time implementation of
[12] I. Kassim, W.S. Ng, G. Feng, S.J. Phee, Review of locomotion techniques continuum robots, IEEE Transactions on Robotics 22 (6) (2006) 1087–1099.
for robotic colonoscopy, in: Proceedings of the International Conference on [33] A. Kapoor, N. Simaan, R. Taylor, Constrained control for surgical assistant
Robotics and Automation, Taipei, Taiwan, 2003, pp. 1086–1091. robots, in: IEEE International Conference on Robotics and Automation, 2006,
[13] J. Piers, D. Reynaerts, H. Van Brussel, G. De Gersem, H.T. Tang, Design of pp. 231–236.
an advanced tool guiding system for robotic surgery, in: Proceedings of the [34] C. Prelle, F. Lamarque, P.E. Mazeran, Miniture high resolution position sensor
International Conference on Robotics and Automation, Taipei, Taiwan, 2003, for long stroke measurements, in: Proceedings of the 5th France–Japanese
pp. 2651–2656. Congress and the 3rd European–Asian Congress on Mechatronics, Besan_con,
[14] B. Kim, H.Y. Lim, J.H. Par, J.O. Park, Inchworm-like colonoscopic robot with France, 2001, pp. 443–446.
hollow body and steering device, JSME International Journal Series C 49 (1) [35] K. Suzumori, S. Iikura, H. Tannaka, applying a flexible-micro-actuator robotic
(2006) 205–212. mechanisms, IEEE Control Systems 12 (1) (1992) 21–27.
722 G. Chen et al. / Robotics and Autonomous Systems 57 (2009) 712–722

M.T. Pham received the M.E. in electrical engineering in


[36] G. Thomann, M. Betemps, T. Redarce, The development of a bendable
1998, the M.S. and Ph.D. degrees in control engineering
colonoscopic tip, in: Proceedings of the International Conference on Robotics
from the University of Nantes, France in 1998 and 2001,
and Automation, Taipei, Taiwan, 2003, pp. 658–663.
respectively. He joined the Laboratoire d’Automatique
[37] D.E. Whitney, Resolved motion rate control of manipulators and human
Industrielle (LAI), Lyon, France, in 2003 and is currently
prostheses, IEEE Transaction on Man-Machine systems 10 (2) (1969) 47–53.
Assistant Professor at the Mechanical Engineering Design
[38] J.M. Hollerbach, K.C. Suh, Redundancy resolution of manipulator through
Department of INSA, Lyon, France. His research interests
torque optimization, A.I. Memo 882, Massachusetts Institute of Technology,
include robot identification, control, and the applications
1986.
to medical robotics.
[39] Y. Nakamura, Advanced Robotics, Redundancy and Optimization, Addison-
Wesley, 1991.

T. Redarce received his Ph.D. in electrical engineering


from the Institut National Polytechnique de Grenoble
(INPG) in 1984. He received his Habilitate Doctor level
G. Chen received his B.Sc. degree in mechatronics from from the Institut National des Sciences Appliquées de
Jilin University, China, the M.S. degree in control theory & Lyon (INSA) in 1995. He was assistant professor for
engineering from Chinese Academy of Sciences, China and 15 years in the Mechanical Engineering Department (INSA
the Ph.D. degree in Robotics from INSA de Lyon, France, de Lyon) and then professor in the Electrical Engineering
in 1999, 2002 and 2005, respectively. From 2006 to 2007, Department. He taught automatic control and Industrial
He was a Postdoctoral Fellow in Emotion group of INRIA Informatic. In 1999, H. T. Redarce was a visiting researcher
Rhone-alpes, France. at the laboratoire d’Imagerie, de Vision et d’Intelligence
Currently, he is a Marie Curie Research Fellow at artficielle (LIVIA) de l’Ecole de technologie Supérieure de
Unilever R&D, Port Sunlight, UK. His research interests l’Université du Québec in montréal (Canada). Since 2000 he is at the head of the
includes medical robotics, especially on modeling and laboratory’s robotics research team.
control of flexible robots, mechatronics, also planning and His interests include medical robotics, mechatronics systems, and robotic
navigation of autonomous mobile vehicles. vision. He has published more than 100 papers in various journals and conferences.

You might also like