Professional Documents
Culture Documents
article info a b s t r a c t
Article history: Due to their compliance and high dexterity, biologically-inspired continuum robots have attracted much
Received 27 September 2007 interest for applications such as medical surgery, urban search and rescue, de-mining etc. In this paper,
Received in revised form we will present an application to medical surgery-colonoscopy by designing a pneumatic-driven flexible
29 October 2008
robotic manipulator, called ColoBot. The focus of this paper lies in the sensor-based position control of
Accepted 4 November 2008
Available online 18 November 2008
the ColoBot for guiding the advancement in a tubular, compliant and slippery environment. The kinematic
model related the position of the distal end of the ColoBot to the actuator inputs which is firstly developed
Keywords:
and formulated to control the shape of the ColoBot through position control of the distal tip. To achieve
Sensor-based position control safe guidance, the ideal position of the tip should be in the central axis of the colon. A method based on
Continuum robot a circumscribed circle is proposed to approximate the central position in real-time based on three sensor
Soft actuator readings. This position will be used as reference position for the tip to adjust its shape in real time to avoid
Colonoscopy the contact with tube wall. This proposed approach can be extended to the control of continuum robots
Kinematics in the conditions of a dynamically confined space. The simulation results and experimental results with
a curved tube will be presented in order to validate the proposed control strategy.
© 2008 Elsevier B.V. All rights reserved.
1. Introduction quite rigid and require the doctor to perform difficult manoeuvres
for long insertion with minimal damage of the colon wall [4,5].
Since the human colon is a tortuous ‘‘tube’’ with several sharp
Robotics has increasingly become accepted in the past 20 years
bends, the insertion of the colonoscope requires the doctor to exert
as a viable solution to many applications in surgery, particularly in forces and rotations at shaft outside of the patient, thus causing
the field of computer assisted surgery (CAS), Minimally Invasive discomfort to the patient. The complexity of the procedure for
Surgery and Therapy (MIS and MIT) [1]. Among them, surgical doctors and the discomfort experienced by the patient of current
robotic instruments for MIS are assumed to be the most promising colonoscopies lead many researchers to choose the automated
and technically challenging, needing integrated design, real-time colonoscopy method. In [6], the authors proposed the concept
sensing, actuation and control, power supply and some degree of automated colonoscopy (also called robotic colonoscopy) from
of autonomy [2]. Colonoscopy is a typical MIT procedure for two aspects: locomotion and steering of the distal end, which
observation, diagnostics and therapy of the lower gastrointestinal are the two main actions during a colonoscopy. In order to
tract including the colon, where the second frequent malignant facilitate the operation of colonoscopy, some studies on the robotic
tumor is found in industrialized countries [3]. This procedure is colonoscopy have been carried out from these two aspects. Most
accomplished through the insertion of an endoscope (also called current research on autonomous colonoscopies have been focused
on the self-propelled robots which utilize various locomotion
the colonoscope) into the human colon. At present, however, the
mechanisms [7–12]. Among them, inchworm-like locomotion
existing colonoscopy procedure is very technically demanding for
attracted much more attention [8,9]. However, most of the current
doctors and tends to be unpopular with patients [2]. The main
inchworm-based robotic systems [8–11] showed low efficiency of
reason lies in the characteristics of current colonoscopes, which are locomotion for exploring the colon because of the structure of the
colon wall: slippery and different diameters at each section.
Another aspect work that could improve the performance of
∗ Corresponding address: Unilever R&D, Port sunlight, Quarry Road East, CH63 current colonoscopies is to design an autonomous steering robot
3JW Bebington, Wirral, UK. Tel.: +44 0 1516411446; fax: +44 0 1516411812. for guidance inside the colon during the colonoscopy. Several
E-mail addresses: gchenchine@yahoo.fr (G. Chen), minh-tu.pham@insa-lyon.fr robotic colonoscopy systems are also comprised of a flexible
(M.T. Pham). steering tip, but they did not focus on how to control this special
0921-8890/$ – see front matter © 2008 Elsevier B.V. All rights reserved.
doi:10.1016/j.robot.2008.11.001
G. Chen et al. / Robotics and Autonomous Systems 57 (2009) 712–722 713
the sensor and the surface of an object, Fig. 2(b) shows the
experimental results relating the measurement of output voltage
to the distance between the sensor and the porcine intestine. It is
divided into several working areas but it is always possible to use
the sensor in the different areas to measure a linear displacement
on a long range but the resolution will be more or less high.
Fig. 3 shows the robot shape parameters and the corresponding 4.2. Characterization of pneumatic actuators
frames. The deformation shape of ColoBot is characterized by three
parameters as done in our previous prototype EDORA [30]. Bellows-based flexible robots presented in [36,24] suppose that
the length variation of each bellows is proportional to the applied
• L is the length of the virtual center line of the robotic tip
pressure. In our case, the silicone-based actuator shows strong
• α is the bending angle in the bending plane
• φ is the orientation of the bending plane nonlinearity relating the stretch length of the chamber to the
pressure variation in preliminary experiments. This relationship is
The frame Ru (O–xyz ) is fixed at the base of the actuator. The described as:
x-axis is the one that passed by the center of the bottom end
and the center of the chamber 1. The xy-plane defines the plane 1Li = fi (Pi ) (1)
of the bottom of the actuator and the z-axis is orthogonal to
where 1Li (i = 1, 2, 3) is the stretch length of each chamber with
this plane. The frame Rs (O0 –uvw) is attached to the top end of
corresponding pressure and fi (i = 1, 2, 3) is a nonlinear function
the manipulator. So the bending angle α is defined as the angle
of Pi . The stretch length of a single chamber is measured when the
between the O–z axis and O0 –w axis in the bending plane. The
pressure is applied from 0 bar to the pressure maximum which
orientation angle φ is defined as the angle between the O–x axis
can make the actuator bend 90◦ , while the pressures of the other
and O–t axis, where O–t axis is the project of O0 –w axis on the plane
two chambers are kept at zero bar. For precise measurements, the
x–O–y. The notation is explained as the following:
pressure in the chamber is kept constant by using a closed-loop
1. i: chamber index, i = 1, 2, 3 controller. Since the deformation of the each chamber is an arc
2. R: radius of curvature of the centerline of the robotic tip of a circle, it is difficult to find a suitable sensor to measure the
3. Li : arc length of the ith chamber arc length. A simple method is then used to measure the length
4. L0 : initial length of the chamber of the chamber. When the chamber is stretching under pressure,
5. Pi : pressure in the chamber i
a fine string is placed right outside the stretched chamber, so the
6. S: effective surface of the chamber
length of the string can be considered approximately as the length
7. Ri : radius of curvature of the ith chamber
of the chamber. Results obtained from experiments proved that
8. ε : stretch length of the centerline
9. 1Li : the stretch length of the ith chamber there is a non-linear behavior (hysteresis) between the pressure
and the stretch length of each chamber (Fig. 4(a)). A polynomial
G. Chen et al. / Robotics and Autonomous Systems 57 (2009) 712–722 715
When the load effects are ignored and the deflected angle α is where h is the perpendicular height of the equilateral triangle
such as 0 < α < π , the deflected shape of the ColoBot at the obtained by the layout of the three chambers.
i=1 cos φi = 0, the length of virtual central line L is
P3
bending moment is assumed to be an arc of a circle. Given this Since
assumption, it is clear that: deduced as:
3
Li = α R i (3) 1X
L= Li . (8)
or 3 i=1
Li (L0 + ) And the orientation angle is deduced by combining Eqs. (6) and (7):
α= = . (4) √
Ri R 3(L2 − L3 )
φ = atan2 (9)
Angle φi is defined as the angle of the bending plans relative to the L3 + L2 − 2L1
chamber i, shown in Fig. 5 where atan2(x, y) is the four quadrant arctangent of the real parts
(
φ1 = −φ of the elements of x and y.
φ2 = 120 − φ In the same time, the radius of curvature of the center line and
(5)
the bending angle α are expressed as:
φ3 = −120 − φ.
3
By using these angles, the radius of curvature of the chamber i can
h
P
be described as:
Li
R= √
2 3 λL (10)
Ri = R − h cos(φi ) (6) √
λL
3
α=
and: h
2 where λL = L1 2 + L2 2 + L3 2 − L1 L2 − L2 L3 − L3 L1 . So the geometry-
Li = L − h cos(φi ) (7) based kinematic model relating the robot shape parameters to
3
716 G. Chen et al. / Robotics and Autonomous Systems 57 (2009) 712–722
L1 = L0 + 1L1 = L0 + f (P1 )
(
L2 = L0 + 1L2 = L0 + f (P2 ) (12)
L3 = L0 + 1L3 = L0 + f (P3 ).
Thus the direct kinematic equations relating the robot shape
parameters to the input pressures are then represented by: Fig. 6. Position of ColoBot inside the colon.
3
1X
L = L + fi (Pi )
0
3 I =1
√
3(f2 (P2 ) − f3 (P3 ))
φ = atan2 (13)
f3 3 ) + f2 (P2 ) − 2f1 (P1 )
( P
λ
p
α =
p
h
where λp = f1 (P1 )2 + f2 (P2 )2 + f3 (P3 )2 − f1 (P1 )f2 (P2 )
− f2 (P2 )f3 (P3 ) − f3 (P3 )f1 (P1 ).
5. Sensor-based motion planning algorithm for autonomous Fig. 8 shows the algorithm of the planning and guidance control
guidance of the distal end of the ColoBot inside the colon.
Q˙p = J + Ẋ = (J T (JJ T )−1 )Ẋ . (20) Fig. 11 shows the low-level control system of ColoBot. The
pressurized air comes through the compressor (1) and the general
In our case, however, there is a mechanical limit range for pressure is adjusted thanks to the device (2). The pressure in the
the elongation of each chamber and the corresponding pressure chambers are controlled by three Jet-pipe servovalves (3a, 3b and
applied into the chamber of the ColoBot. The objective function is 3c). Three pressure sensors (4a, 4b and 4c) are connected between
constructed to be included in the inverse Jacobian algorithms as
the servovalves and the ColoBot (5) for the pressure feedback
the second criteria also called the null-space method [38,39].
control. Suitable drivers and amplifiers in the rack (6) were
Q˙p = J + Ẋ + µ[I − J + J ]ġ (21) designed to amplify control signals applied to the actuator. A real-
time controller is implemented through a Dspace card Real-Time
where µ is constant and g is the second criteria for optimization
Workshop with Simulink. The Simulink block diagram designed
of the solution. This objective function evaluates the pressure
for path planning and kinematics algorithms are expressed with
difference between the applied pressure in the chamber and the
Simulink block diagram which will be compiled as real-time
average pressure applied in the chamber. So the cost function w(P )
executable under the DSP Processor of Dspace card. The system
is expressed as following:
runs at 500 Hz for a real-time control loop.
3 2
1X Pi − Piav e
w(P ) = . (22)
7.2.1. Kinematic control
3 i=1 Pimax − Pimin
To validate the position control for ColoBot, the real experiment
We can then minimize w(p) by choosing: on the Colobot as well as simulation have been carried out. The
∂w ∂w ∂w desired trajectory is a circle with a diameter of 50 mm. The
ġ = grad w(P ) = . (23) kinematic control algorithm is implemented under the assumption
∂ P1 ∂ P2 ∂ P3
that the displacement of distal-end of ColoBot are sufficiently small
in a cycle. Thus the velocity kinematics relating state velocities and
7. Simulations and experimental results Cartesian velocities can be approximated by 1X /1T and 1Qp /1T .
The figure on the left of Fig. 13 shows the simulation control
This section will present the simulation and experimental pressure of three chambers, while the one on the right shows the
results of sensor-based planning and an autonomous guidance real control pressure to the three chambers. Fig. 12(b) shows the
control algorithm on an emulation platform and a colon-like tube. comparison of experimental results and simulation results of a
Fig. 13. Applied pressure control to chambers of ColoBot: Simulation (left) and real experiment (right).
highly probable that results for the distance sensors in a porcine that ColoBot has the capability to guide the exploration of the tube
intestine will be similar to those obtained in the human bowel. with a sensor-based steering control method.
The colonoscope tip is manually inserted and Fig. 17 showed
that ColoBot crossed the different positions of the tube with a 8. Conclusions and future works
different bending angle. The evolution of the measurements of
three optical fibres are represented in the left Fig. 18(a). During the This paper presented a sensor-based safe path generation
entire movement, the distances are never less than 0.8 mm. This and guidance control of a biologically-inspired continuum robot-
ColoBot for a semi-autonomous colonoscopy. The pneumatic
demonstrates that the colonoscope tip is moving through the tube
driven Colobot is a silicone-based robotic manipulator which
without touching it. For a better representation and visualization,
is driven through pneumatic actuators. Three optical fiber
Fig. 18(b) shows the extreme positions of the top-end of ColoBot distance sensors are utilized for sensor-based safe real-time path
as it progresses (with a velocity of 4 cm/s). The position of the generation for guidance control under compliant and slippery
ColoBot at the center of the tube is represented by the smallest environments of the colon.
circle. The larger circle represents the tube wall and the line shows With the assumption that the measure plane is an ellipse, a
the extreme positions of ColoBot. This experiment demonstrates method based on a circumscribed circle is utilized to calculate the
G. Chen et al. / Robotics and Autonomous Systems 57 (2009) 712–722 721
(a) Evolution of three measurements. (b) Extreme position projected into the tube plane.
reference position of the ColoBot. While position control in task [15] G. Chen, M.T. Pham, T. Redarce, Development and kinematic analysis of a
space used these reference positions to adjust the shape of ColoBot silicone-rubber bending tip for colonoscopy, in: Proc. of the IEEE-RSJ Int. Conf.
on Intelligent Robots and Systems, Beijing,China, 2006, pp. 168–173.
inside the colon to achieve guidance. The simulation results of [16] G. Robinson, J. Davies, Continuum robots—a state of the art, in: Proceedings of
sensor-based planning and experimental results with an emulation the International Conference on Robotics and Automation, Detroit Michigan,
platform and with a transparent tube verified the effectivity of USA, 1999, pp. 2849–2853.
[17] R. Cieslak, A. Morecki, Elephant trunk type elastic manipulator—a tool for bulk
kinematic control and guidance strategy. In the near future, the and liquid type materials transportation, Robotica 17 (1999) 11–16.
proposed method will be tested in a vivo environment. [18] M.W. Hannan, I.D. Walker, Kinematics and the implementation of an
elephant’s trunk manipulator and other continuum style robots, Journal of
Robotic Systems 20 (2) (2003) 45–63.
References [19] J.F. Wilson, D. Li, Z. Chen, R.T. George Jr, Flexible robot manipulators and
grippers: Relatives of elephant trunks and squid tentacles, in: Proc. Robots Biol.
[1] R.H. Taylor, D. Stoianovici, Medical robotics in computer-integrated surgery, Syst.: Toward a New Bionics?, 1993, pp. 474–479.
IEEE Transaction on Robotics and Automation 19 (5) (2003) 765–781. [20] N. Simaan, R. Taylor, P. Flint, A dexterous system for laryngeal surgery—multi-
[2] P. Dario, B. Hannaford, A. Menciassi, Smart surgical tools and augmenting backbone bending snake-like slaves for teleoperated dexterous surgical tool
devices, IEEE Transaction on Robotics and Automation 19 (5) (2003) 782–792. manipulation, in: IEEE International Conference on Robotics and Automation,
New Orleans, USA, 2004, pp. 351–357.
[3] P. Dario, M.C. Carrozza, A. Pietrabissa, Development and in vitro tests of
a miniature robotic system for computer-assisted colonoscopy, Jounal of [21] D.M. Lane, J.B.C. David, G. Robinson, D.J. O’Brien, J. Sneddon, E. Seaton,
Computer Aided Surgery, 4 (1999) 4–14. Elfstrom A., The amadeus dextrous subsea hand: Design, modeling, and sensor
[4] R.H. Sturges, A flexible, tendon-controlled device for endoscopy, The processing, IEEE Journal of Oceanic engineering 24 (1) (1999) 96–111.
International Journal of Robotics Research 12 (2) (1993) 121–131. [22] H. Tsukagoshi, A. Kitagawa, M. Segawa, Active hose: An artificial elephant’s
[5] T. Fukuda, S. Guo, K. Kosuge, F. Arai, M. Negoro, K. Nakabayashi, Micro nose with maneuverability for rescue operation, in: Proc. IEEE Int. Conf. Robot.
active catheter system with multi degrees of freedom, in: Proceedings of the Autom., Seoul, Korea, 2001, pp. 2454–2459.
International Conference on Robotics and Automation, San Diego, USA, 1994, [23] N. Simaan, Snake-like units using flexible backbones and actuation redun-
pp. 2290–2295. dancy for enhanced miniaturization, in: Proc. IEEE Int. Conf. Robot. Autom.,
[6] S.J. Phee, W.S. Ng, I.-M. Chen, F. Seow-choen, B.L. Davies, Automation of Barcelona, Spain, 2005, pp. 3023–3028.
colonoscopy, part one: Locomotion and steering aspects in automation of [24] Y. Bailly, Y. Amirat, Modeling and control of a hybrid continuum active catheter
colonoscopy, IEEE Engineering in Medecine and Biology Magazine 17 (3) for aortic aneurysm treatment, in: Proceedings of the International Conference
(1998) 81–89. on Robotics and Automation, Barcelona, Spain, 2005, pp. 924–929.
[7] K. Ikuta, M. Tsukamoto, S. Hirose, Shape memory alloy servo actuator system [25] G. Immega, K. Antonelli, The ksi tentacle manipulator, in: IEEE Conf. Robot.
with electric resistance feedback and application for active endoscope, in: Autom., Nagoya, Japan, 1995, pp. 3149 –3154.
Proceedings of the International Conference on Robotics and Automation, [26] S. Hirose, Biologically Inspired Robots, Oxford University Press, Oxford, 1993.
Hitachi City, Japan, 1988, pp. 427–430. [27] G.S. Chirikjian, J.W. Burdick, A modal approach to hyper-redundant manipu-
[8] A.B. Slatkin, J. Burdick, The development of a robot endoscope, in: Proc. of lator kinematics, IEEE Transactions on Robotics and Automation 10 (3) (1994)
the IEEE-RSJ Int. Conf. on Intelligent Robots and Systems, Pittsburgh, PA, USA, 343–354.
1995, pp. 3315–3320. [28] G.S. Chirikjian, J.W. Burdick, Hyper-redundant manipulator dynamics:a
[9] P. Dario, C. Paggetti, N. Troisfontaine, E. Papa, T. Ciucci, M.C. Carrozza, M. continuum approximation, Advanced Robotics 9 (3) (1995) 217–243.
Marcacci, A miniature steerable end-effector for application in an integrated [29] G.S. Chirikjian, Design and analysis of some nonanthropomorphic biologically
system for computer-assisted arthroscopy, in: IEEE International Conference inspired robots: An overview, Jornal of Robotic Systems 18 (12) (2001)
on Robotics and Automation, 1997, pp. 1573–1579. 701–713.
[10] A. Menciassi, Park J.H., S. Lee, S. Gorini, P. Dario, J.O. Park, Robotic solutions [30] G. Chen, M.T. Pham, T. Redarce, C. Prelle, F. Lamarque, Design and control of an
and mechanisms for a semi-autonomous endoscope, in: Proc. of the IEEE- actuator for colonoscopy, in: 6th Int. workshop on Research and Education in
RSJ Int. Conf. on Intelligent Robots and Systems, Lausane, Switzerland, 2002, Mechatronic, Annecy, France, 2005, pp. 109–114.
pp. 1379–1384. [31] B.A. Jones, I.D. Walker, Kinematics for multi-section continuum robots, IEEE
[11] S. Kumar, I.M. Kassim, V.K. Asari, Design of a vision- guided microrobotic Transactions on Robotics 22 (1) (2006) 43–55.
colonoscopy system, Advanced robotics 14 (2) (2000) 87–114. [32] B.A. Jones, I.D. Walker, Practical kinematics for real-time implementation of
[12] I. Kassim, W.S. Ng, G. Feng, S.J. Phee, Review of locomotion techniques continuum robots, IEEE Transactions on Robotics 22 (6) (2006) 1087–1099.
for robotic colonoscopy, in: Proceedings of the International Conference on [33] A. Kapoor, N. Simaan, R. Taylor, Constrained control for surgical assistant
Robotics and Automation, Taipei, Taiwan, 2003, pp. 1086–1091. robots, in: IEEE International Conference on Robotics and Automation, 2006,
[13] J. Piers, D. Reynaerts, H. Van Brussel, G. De Gersem, H.T. Tang, Design of pp. 231–236.
an advanced tool guiding system for robotic surgery, in: Proceedings of the [34] C. Prelle, F. Lamarque, P.E. Mazeran, Miniture high resolution position sensor
International Conference on Robotics and Automation, Taipei, Taiwan, 2003, for long stroke measurements, in: Proceedings of the 5th France–Japanese
pp. 2651–2656. Congress and the 3rd European–Asian Congress on Mechatronics, Besan_con,
[14] B. Kim, H.Y. Lim, J.H. Par, J.O. Park, Inchworm-like colonoscopic robot with France, 2001, pp. 443–446.
hollow body and steering device, JSME International Journal Series C 49 (1) [35] K. Suzumori, S. Iikura, H. Tannaka, applying a flexible-micro-actuator robotic
(2006) 205–212. mechanisms, IEEE Control Systems 12 (1) (1992) 21–27.
722 G. Chen et al. / Robotics and Autonomous Systems 57 (2009) 712–722