Professional Documents
Culture Documents
Abstract—In this paper, a master–slave integrated surgi- and an additional 2-DOF wrist joint. Therefore, the robot allows
cal robot system for the laparoscopic surgery is proposed. the tool tip to approach the target from an arbitrary position and
Instead of commanding the manipulator from the remote posture in the abdomen. It is generally a master–slave-type robot
master console, the proposed system integrates the master
controller into the proximal end of the slave manipulator. and a surgeon operates the remote slave arms with the wrist joint
The slave has a flexible wrist joint, whose bending angle is via the master console. Since the slave arms in the abdomen re-
operated by a joystick on the master. Focusing on suturing produces the surgeon’s 6-DOF hand motion in the console, the
of a curved needle, which is a common task in laparoscopic master–slave type enables an intuitive operation. In addition,
surgery, we developed an active motion transformation master–slave robots enable telesurgery over computer networks
method that allows the surgeon to insert the needle
easily. When inserting the needle, the proposed system and microsurgery using motion scaling between the master and
transforms the surgeon’s wrist rotation into the rotation the slave. Several robots have been developed [3], [4], [18],
about the bent forceps gripper. Positioning performance and da Vinci [5] surgical system is a commercially successful
of the proposed system is evaluated by an experiment. one, already introduced in thousands of hospitals in the world.
Furthermore, we compared the suturing task performance However, the robot is not the best choice for all surgical pro-
between the proposed system and conventional forceps.
The experimental results show that the proposed system cedures of all hospitals since it requires a space for the master
reduces the contact force against an organ model. console, a operating skill different from the conventional lara-
poscopic procedure, a time-consuming setup procedures, and
Index Terms—Medical robotics, pneumatic systems.
high introduction and running costs [6], [7].
I. INTRODUCTION On the other hand, hand-held forceps with the wrist joint
have been developed [8]. The wrist joint is manipulated from
APAROSCOPIC surgery is one of the minimally invasive
L surgery procedures. An endoscope and several long tools
are inserted into the patient’s abdominal cavity through small
the interface mounted on the forceps itself while supporting
the weight of the forceps. The translation operation of it is
the same as the conventional forceps. Its setup time is shorter
incisions made in his/her skin. Though the postoperative recov- than the master–slave type. The system is small because there
ery is earlier than the conventional open surgery, superior skills is no master console. Several hand-held robotic forceps driven
are required for surgeons, as it is impossible to approach the by actuators have been developed. Matsuhira et al. proposed
target from arbitrary angles since the motion of the surgical tool the robotic forceps driven by an electric motor [10]. Focacci
is constrained at the insertion hole of the abdomen. In other et al. and Hassan et al. developed more lightweight forceps
words, only 4-degree of freedom (DOF) motions are allowed by separating actuators from the main body [13], [15]. Zahraee
for surgical tools in the abdomen [1], [2]. In this paper, we call et al. and Okken et al. designed an interface of the forceps based
the nonarticulating tool as a conventional forceps. on ergonomics [14], [23]. Bensignor et al. developed the thin-
A typical surgical robot for the laparoscopic surgery has 6- diameter robotized forceps without pitch axis and evaluated
DOF motion, with a 4-DOF arm outside the abdominal cavity it [12]. Other mechanically driven tools have been developed
[9]. Unlike the master–slave robot, such hand-held robots are
Manuscript received July 10, 2017; revised September 21, 2017 and operated using buttons and dials, and it is difficult for surgeons
January 3, 2018; accepted January 31, 2018. Date of publication March to input complex 3-D trajectory. However, since the interface
22, 2018; date of current version June 12, 2018. Recommended by
Technical Editor Prof. D. Stoianovici. (Corresponding author: Ryoken such as a dial for each motion axis is independent, the surgeon
Miyazaki.) is not able to operate the 6-DOF and the grasper at the same
R. Miyazaki, T. Kanno, and K. Kawashima are with the Department time like the master–slave type. Moreover, hand-held robots
of Biomechanics, Institute of Biomaterials and Bioengineering, Tokyo
Medical and Dental University, Tokyo 101-0062, Japan (e-mail: ryoken. are heavier than conventional forceps due to the weight of the
miyazaki@gmail.com; kanno.bmc@tmd.ac.jp; kkawa.bmc@tmd.ac.jp). actuators. Wearable type robot forceps, which are mounted on
K. Hirose is with the Faculty of Medicine, Tokyo Medical and Dental the operator’s arm, is one of good solutions, though they have
University, Tokyo 113-8510, Japan (e-mail: 130721ms@tmd.ac.jp).
Y. Ishikawa is with the Department of Hepatobiliary and Pancreatic more weight for attachment parts and require time-consuming
Surgery, Medical Hospital, Tokyo Medical and Dental University Tokyo equipment procedure [11], [16], [17].
113-8510, Japan (e-mail: ishimsrg@tmd.ac.jp). From the aforementioned, our challenge is the development
Color versions of one or more of the figures in this paper are available
online at http://ieeexplore.ieee.org. of a robot that has operability like a master–slave type with a
Digital Object Identifier 10.1109/TMECH.2018.2817212 handheld robot size. Thus, we developed a master–slave inte-
1083-4435 © 2018 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission.
See http://www.ieee.org/publications standards/publications/rights/index.html for more information.
1216 IEEE/ASME TRANSACTIONS ON MECHATRONICS, VOL. 23, NO. 3, JUNE 2018
Fig. 1. Developed robotic system. It consists of a 2-DOF robotic forceps and a 4-DOF passive holder. The forceps is composed of a pneumatically
driven manipulator and a master controller. Variables φ 1, 2 and q1, 2, 3, 4 represent the motion axes of a wrist joint of the forceps and passive joints of
the holder. The origin O is a forceps insertion point to the abdominal cavity.
grated surgical robot and an active motion transformation. It driven manipulator and a master controller. Variables φi and qi
consists of a 2-DOF pneumatically driven robotic forceps and a represent the joint displacements of a wrist joint of the forceps
4-DOF passive holders to support of its weight. The wrist joint of and the 4-DOF passive joints of the holder. O indicates the
the forceps is operated by a built-in master controller, integrated fixed point, which is the insertion point of the forceps to the ab-
in the end of forceps. A surgeon operates the wrist joint and domen. An operator manipulates the wrist joint (φ1 , φ2 ) of the
the grasper, like those in a master–slave robot, while operating forceps tip by the master controller and operates the translational
the translational motion manually like the conventional forceps. (q1 , q2 , q3 ) and rotational (q4 ) motion of the forceps directly. The
It achieved smaller footprint than master–slave surgical robots, robot allows the operator to manipulate the bending motion of
omitting a master console. Moreover, to reduce the weight, we the forceps tip, like a master–slave type, while operating the
used pneumatic actuators that have high power-to-weight ratio translational motion manually like a conventional surgical tool.
for driving the forceps. We describe the components of the system in Section II-A. In
For the intuitive operation of a curved needle, the active mo- addition, we developed the motion transformation control that
tion transformation was proposed. It actively transforms the assists the insertion of a curved needle using the precise control
rotation axis using the precise control of the joint and the op- of the wrist joint (φ1 , φ2 ) and the rotational motion (q4 ). We
erator’s motion. The details are described in Section II-B. The describe its algorithm in Section II-B.
proposed transformation and the developed robot allowed the
surgeon to operate the tip positions, postures, and grasper at the A. Mechanical Design
same time.
In [19], we reported a prototype of the master–slave integrated In this section, we describe the components of the developed
surgical robot. In this paper, in addition to [19], we discuss kine- system: the passive holder, the robotic forceps, and the IMU.
matics analysis, position control performances, and evaluation The holder has four passive joints, which constructs the re-
using suturing tasks by experts and novices. mote center of motion (RCM) mechanism allowing the 4-DOF
The rest of this paper is organized as follows. Section II forceps motion around the fixed insertion point as fixed point.
presents the developed surgical robot system. Section III dis- The RCM and O are identical. Note that, the holder has ac-
cusses kinematic and dynamic model. Section IV presents a tuators, which we use the passive holder by deactivating the
controller and positioning performances. Section V shows the actuators. For further details of the holder, please refer to [27].
evaluation of the robot by small target suturing and measure- The robotic forceps consist of 2-DOF wrist joint and a grasper,
ment of the force in suturing. Section V concludes and discuss and the master controller. They are shown in right side of Fig. 1.
this paper. Desired motion of the joint and the grasper, in the abdominal
cavity, are realized by the control of the manipulator in re-
sponse to the input by the master controller. In the manipulator,
II. DEVELOPED ROBOTIC SYSTEM
we adopt the pneumatically driven manipulator same as in [20].
The developed robot shown in Fig. 1 consists of the 2- The forceps tip consists of the 2-DOF push–pull-driven wrist
DOF robotic forceps, the 4-DOF passive holder, and an iner- joint and the grasper. The diameter of the insertion portion into
tial measurement unit (IMU) [19]. The forceps and the holder the abdominal is 8 mm. The driving unit of the wrist joint con-
are separable. The robotic forceps consists of a pneumatically sists of four pneumatic cylinders (SMC, Corp., CJ2QB10-15),
MIYAZAKI et al.: MASTER–SLAVE INTEGRATED SURGICAL ROBOT WITH ACTIVE MOTION TRANSFORMATION USING WRIST AXIS 1217
are set as the initial position and the initial rotation. The posi- 1) Viscous friction Cj Ẋj : The force due to the pneumatic
tion and rotation matrix are written as follows: cylinder, where Cj denotes the viscosity coefficient.
pinit = R2 a + R2 E k δ 0 e + E j θ 0 g (11) 2) Coulomb friction Dj sgn(Ẋj )eμ j θ : The main component
of the Coulomb friction is the friction between the supere-
and lastic wires and the wire guide on the flexible joint, where
Rinit = R2 E k δ 0 E j θ 0 E k (−δ 0 ) . (12) the friction coefficient is denoted by Dj . The friction be-
comes larger according to the bending angle, which is
Next, as shown in Fig. 3(b), we consider the position and pos- modeled in this paper as eμ j θ .
ture when the operator’s wrist is rotated by angle q4 rot without 3) Elastic force ±Kj φk : Elastic forces are caused by the
the transformation control. We call this rotation an overall rota- bended joints and wires, which are proportional to the
tion. Then, q4 = q4 rot , δ = δ0 , and θ = θ0 are set as the rotate angle parameter φ.
position prot and the rotate posture Rrot , which are written as 4) Elastic force K : Elastic forces are caused by the elon-
follows: gated and contracted joints, which are proportional to the
prot = R2 a + R2 E k q 4 r o t E k δ 0 e + E j θ 0 g (13) stretch of the joint from the natural length .
and
IV. POSITION CONTROL LAW
k δ0 j θ0 k (−δ 0 ) k q4r o t k q4r o t
Rrot = R2 E E E E = Rinit E . (14)
A. Design of the Controller
The aforementioned equation shows that the forceps tip was ro- In this subsection, we discuss the control law of the robotic
tating from R0 by angle q4 rot and (13) represents the tip position forceps shown in Fig. 4. The wrist joint is driven by pneumatic
prot is changed by the rotation angle q4 rot as compared with p0 . cylinders in response to the reference position qref (δref , θref ),
Therefore, (13) and (14) show that when the bent forceps are which is operated by the master controller and the transforma-
rotated, the tip position changes. tion controller, which is a wrist rotation angle estimator. The
Finally, we discuss the motion transformation control. In the bending direction δ and the bending angle θ represent the pos-
robotic system, q4 and δ are coaxial rotations around the Z-axis. ture of the joint obtained by converting θ1,2 using (1). The
Therefore, as shown in Fig. 3(c), this control changes only the reference position of the joint are written as follows:
posture without changing the tip position by controlling δ =
δ0 − q4 rot to cancel the wrist rotation angle q4 = q4 rot . Then, δref δ0 − q4 rot
q4 = q4 rot , δ = δ0 − q4 rot , and θ = θ0 are set as the tip rotate qref = = (18)
θref αθ0
position pcntl and the tip rotate posture Rcntl , which are written
as follows: where δ0 and θ0 denote a bending direction and an angle that
are inputted by the operator from the master controller. α is a
pcntl = R2 a + R2 E k δ 0 e + E j θ 0 g = pinit (15) scaling constant of the angle between the operation and the joint.
and q4 rot denotes an estimate of operator’s wrist rotation angle from
the IMU. From (18), to control the tip rotation in response to
Rcntl = R2 E k δ 0 E j θ 0 E k (−δ 0 ) E k q 4 r o t = Rinit E k q 4 r o t . (16)
wrist rotation, δref is modified by adding δ0 to the wrist-rotation
The aforementioned equation shows that the forceps tip was angle q4 rot to cancel the rotation about the sheath axis.
rotating from R0 by angle q4 rot . Equation (15) shows that the δ0 and θ0 are given by following equation:
tip rotate position pcntl is not affected by wrist rotate angle q4 rot atan2 (φ , φ )
and is equal to the initial position p0 . Therefore, we clarified that δ0 s2 s1
= (19)
the tip rotation can be performed by controlling the tip position θ0 φm 1 + φm 2 2
2
of the forceps.
where φm 1, 2 [deg] denote the bending angle of the controller.
Since the controller is a 2-DOF variable resistor, we experi-
C. Dynamic Model
mentally approximated the angle φm 1, 2 and voltage v, when the
In this subsection, dynamic model of the robotic forceps is supply voltage to the sensor is 5 V, by the following polynomial:
discussed in order to compensate for its mechanical impedance
φm 1, 2 = 2.47v 3 − 18.86v 2 + 19.88v + 28.62. (20)
for precise control.
The resisting forces Z = [Z1 , Z2 , Z3 , Z4 ]T that act on the To estimate the wrist rotation angle x, we applied a Kalman
cylinders are given as follows: filter [26] to the signals of a gyroscope and an accelerometer in
⎡ ⎤ the IMU for robust measurement against the sensor noise and
C1 Ẋ1 + D1 sgn(Ẋ1 )eμ 1 θ − K1 φ1 + K
⎢ ⎥ the gyroscopic drift. The filter can be described as follows:
⎢ C2 Ẋ2 + D2 sgn(Ẋ2 )eμ 2 θ − K2 φ2 + K ⎥
Z=⎢ ⎢ ⎥ (17) xk = Axk −1 + B ẋk + wk
μ θ ⎥ (21)
⎣ C3 Ẋ3 + D3 sgn(Ẋ3 )e 3 + K3 φ1 + K ⎦
C4 Ẋ4 + D4 sgn(Ẋ4 )eμ 4 θ + K4 φ2 + K zk = Hxk + vk . (22)
T
where φ is the angle parameter defined as the same as (1). Each The system state is defined as xk = x ẋb k . x and ẋb de-
term of the aforementioned force has the following meaning. note the filtered angle and the bias, which is the amount of the
1220 IEEE/ASME TRANSACTIONS ON MECHATRONICS, VOL. 23, NO. 3, JUNE 2018
Fig. 4. Block diagram of the controller. It consists of three part: the operator input using the master controller, the transformation controller that
estimate the wrist rotation angle and modify the input, and the wrist joint position controller. The joint position controller is a cascade controller that
includes a minor loop of the pneumatic force controller.
Fig. 5. Joint position control with the step input reference of 1°/s. Upper,
middle, and lower figures represent the bending angle of the joint, the
cylinder positions, and the cylinder forces.
that are a step wise input, a sinusoidal input, and the developed
transformation control.
First, we evaluated the performance when the reference bend-
ing angle θref stepwisely changes from 0° to 60° with a step
input of 1°/s and the reference bending direction δref = 0°.
Fig. 5 shows the bending angle θ (upper), the cylinder positions
X1,3 (middle), and the cylinder forces F1,3 (lower). The dotted
and solid lines show the reference and measured signals. We
confirmed a tracking error of 1° or less in a steady state.
Next, a sine wave with an amplitude 50°and a frequency 0.5
or 2.0 Hz was input to the reference bending angle θref . In
Fig. 6, the dotted and solid lines show the reference and mea-
sured signals. Tracking error is 2.0° or less at the frequency of
2.0 Hz, showing that the control bandwidth is sufficient for
surgical operations [27]. Fig. 7. Joint position control with the developed transformation control.
Finally, we evaluate the developed transformation control per- The initial input of δ0 = 0°, θ0 = 50°. The figures showed the bending
formance when the operator rotates the wrist while inputting the direction (upper), the wrist rotation angle (middle), and the bending angle
(lower).
constant bending angle θref = 50°. We compared the estimation
of the rotation angle using the IMU with the measurement of
that using a rotary encoder (MTL Inc., MEH-12-2000PTS16).
Fig. 7 shows the performance of the transformation control, We computed the mean absolute error and mean absolute
where the upper, middle, and lower figures represent the bend- deviation between the reference and the measured position in
ing direction, the wrist rotation angle, and the bending angle. In each experiment and summarized the results in Table III.
the upper and lower figures, the dotted and solid lines show the
reference and measured signals. In the middle figure, the dotted V. SUTURING TASK
and solid lines represent the measured rotation angle using the
A. φ 1-mm Target Suturing
rotary encoder and the estimation of the rotation angle using the
IMU. The estimation showed good performance and the amount In this subsection, we tried to a φ 1-mm target for evaluating
of the drift and the noise from the IMU were negligibly small. the interface of the robot and the position control performance.
1222 IEEE/ASME TRANSACTIONS ON MECHATRONICS, VOL. 23, NO. 3, JUNE 2018
∗
Mean absolute error. † Mean absolute deviation.
TABLE VI
FORCE AND TIME RESULTS OF SUTURE TASKS FOR ROBOT VERSUS CONVENTIONAL, p-VALUE
Experts
Time [s] 46.08 ± 15.70 38.10 ± 6.30 NS 39.00 ± 12.68 32.43 ± 8.63 NS
Maximum force [N] 1.50 ± 0.32 2.90 ± 0.77 <0.001 1.89 ± 0.66 2.84 ± 0.62 <0.001
Novices
Time [s] 45.82 ± 13.79 43.13 ± 24.39 NS 33.61 ± 9.46 29.51 ± 10.81 NS
Maximum force [N] 2.05 ± 0.70 3.87 ± 0.88 <0.001 1.97 ± 0.48 3.19 ± 0.60 <0.001
These score shows the mean ± standard deviation. † Wilcoxon signed-rank test. NS: Not significant.
From [29] and [30], there is no significant difference in the TABLE VII
EXPERTS VERSUS NOVICES ABOUT THE FORCE IN TABLE VI, p-VALUE∗
completion time between a surgical robot and the conventional
forceps in a simple suture task. From the aforementioned, the
results of this experiment are consistent with the trends of these Longitudinal Transverse
Experts Experts
previous studies. In order to more clarify the characteristics of
the developed robot, we have to evaluate it using other evaluation Method Rob. Con. Rob. Con.
index.
Novices Rob. 0.01 <0.01 NS 0.01
Con. <0.01 <0.01 <0.01 NS
[29] G. F. Dakin and M. Gagner, “Comparison of laparoscopic skills perfor- Yoshiya Ishikawa received the medical degree
mance between standard instruments and two surgical robotic systems,” from the Tokyo Medical and Dental University,
Surgical Endoscopy, vol. 17, no. 4, pp. 574–579, 2003. Tokyo, Japan, in 2010, where from May 2015 to
[30] R. Berguer and Warren Smith, “An ergonomic comparison of robotic March 2018, he was working toward the doc-
and laparoscopic technique: The influence of surgeon experience and task toral degree with Medical and Dental Science
complexity,” J. Surgical Res., vol. 134, no. 1, pp. 87–92, 2006. Track, Graduate School of Medical and Dental
[31] M. Hollander, D. A. Wolfe, and E. Chicken, Nonparametric Statistical Sciences.
Methods. New York, NY, USA: Wiley, 2013. After the medical residency program, he
[32] T. P. Cundy et al., “Force-sensing enhanced simulation environment worked as a Digestive Surgeon. Since 2014, he
(ForSense) for laparoscopic surgery training and assessment,’ Surgery, has been a Clinical Fellow with the Department
vol. 157, no. 4, pp. 723–731, 2015. of Hepatobiliary and Pancreatic Surgery, Medi-
[33] T. Horeman et al., “Force measurement platform for training and as- cal Hospitals, Tokyo Medical and Dental University. He currently works
sessment of laparoscopic skills,” Surgical Endoscopy, vol. 24, no. 12, with Saitama Cancer Center, Ina, Japan. He is a specialist of Endoscopic
pp. 3102–3108, 2010. Surgery and Hepatobiliary and Pancreatic Surgery.
[34] T. Horeman et al., “Assessment of laparoscopic skills based on force and
motion parameters,” IEEE Trans. Biomed. Eng., vol. 61, no. 3, 805–813,
Mar. 2014.
[35] O. M. Schb et al., “Laparoscopic Roux-en-Y choledochojejunostomy,”
Amer. J. Surg., vol. 173, no. 4, pp. 312–319, 1997.
[36] C. Rossitto et al., Learning a new robotic surgical device: Telelap Alf X Takahiro Kanno received the B.S., M.S., and Dr.
in gynaecological surgery,” Int. J. Med. Robot. Comput.-Assisted Surg., Eng. degrees in mechanical engineering from
vol. 12, no. 3, pp. 490–495, 2016. Kyoto University, Kyoto, Japan, in 2007, 2009,
and 2013, respectively.
He worked as a Postdoctoral Researcher with
Ryoken Miyazaki is currently working toward the Tokyo Institute of Technology, Tokyo, Japan.
the doctoral degree with the Institute of Bioma- He is currently an Assistant Professor with the
terials and Bioengineering, Tokyo Medical and Tokyo Medical and Dental University, Tokyo. His
Dental University, Tokyo, Japan. research interests include robotics, teleopera-
His recent work is on pneumatically driven tion, and haptics.
surgical robots.