Professional Documents
Culture Documents
com/12555
DOI 10.1007/s12555-009-0114-y
Abstract: In this paper, the development of an unmanned autonomous forklift is discussed. A system
configuration using vision, laser ranger finder, sonar, etc. for autonomous navigation is presented. The
kinematics of a spin-turn mechanism is analyzed first, and then the obtained kinematics equations are
transformed to the equations represented by path variables. These equations are nonlinear state
equations to be used for control purposes. A time varying feedback control law via the chained form of
Murray and Sastry [12] is derived. The effectiveness of the proposed control law is examined through
simulations and experiments.
Keywords: Chained form, feedback control, kinematics, path variables, unmanned forklift.
proposed feedback control algorithm is to force the limited up to 10 km/h both for empty and loaded
forklift to follow a reference path provided by a path operations. To achieve autonomy, the forklift is modified
planner. To build such a controller, a representation of so that all the necessary sensors and a PC for steering
the forklift kinematics in terms of the reference path and driving motors are attached. The main requirement
variables is derived. The proposed algorithm can be in automating the forklift is to provide the ability for dual
applied in various environments, since the path following operations, that is, the forklift can be operated in the
controller does not rely on the environment luminance unmanned mode as well as in the (original) manual mode.
condition. The used sensors are the following. For the purpose of
The contributions of this paper are the following. A 3-D map building, one LRF NAV 200 (SICK) with 360˚
system configuration of the unmanned forklift equipped scanning ability is attached at the top of the forklift.
with sensors and a control PC is described. The Three LMS 200-30106 LRFs (SICK) with 180˚ scanning
kinematics of the forklift with a spin-turn mechanism is ability are also attached: two at the front left/right sides
then presented. Typical things on this model that makes and one at the rear side. To detect obstacles in the near
it different from the general mobile robot or car-like left/right sides of the forklift, ten STMA-506MD
vehicle kinematics [22,23] are the offset a and three ultrasonic sensors are attached around the forklift. For
caster wheels (see Fig. 5). A feedback control law for detecting moving objects and measuring the pallet
path following of the forklift in terms of path variables is position, three HVR-200 cameras are also attached: two
also derived. The proposed control law is derived based cameras at the forklift body (left and right) and one
on the original structure of the chained form introduced camera at the right fork. The industrial PC is used as a
in [12], and the objective in [21] is extended to include main control unit that collects data from the sensors and
the lateral and orientation errors between the actual and performs unmanned autonomous navigations.
desired positions of the unmanned forklift. As shown in Fig. 2, the motion command for the
This paper is structured as follows. In Section 2, a unmanned forklift is generated based on the information
system configuration for the development of an un- of its pose provided by several sensors. The absolute
manned autonomous industrial forklift is presented. The pose of the forklift in the global reference coordinate is
kinematics of the forklift in the inertia frame and its determined on a given map based on the data from
representation in path variables are analyzed in Section 3. ultrasonic satellite and gyro sensor. The present pose and
In Section 4, a feedback control law that makes the radial speed of the forklift from its initial point is calculated
and orientation errors of the forklift with respect to the using the data from wheel encoder and gyro sensor. The
reference path equal to zero is derived. In Section 5, information about the forklift environment (obstacles,
simulation and experimental results are presented. Con-
clusions are given in Section 6.
2. SYSTEM CONFIGURATION
workspace structure, etc.) is obtained by using vision, where vd is the velocity of the driving wheel
laser range finder, and sonar sensors. Based on the characterized by the following relationship
current pose, speed, and the information about the
change on its working environment, the position of the vd = rd ωd , (3)
forklift with respect to its goal point on the reference
frame can be calculated. The control command to actuate where rd is the radius of the driving wheel, and ω d is
the motion of the forklift is then generated by the angular velocity of the driving wheel, respectively.
considering the trajectory to the goal pose and the safety Therefore, the linear velocity of the forklift becomes
of its motions.
The control inputs for the forklift consist of linear and ⎛ a sin δ ⎞
v = rd ωd ⎜ cos δ + ⎟. (4)
angular velocities. Fig. 3 show the navigation schematic ⎝ l ⎠
of the forklift. The appropriate control signal is
determined by an action selection algorithm based on the Finally, the kinematics relationship between two input
tasks (following a path, tracking a trajectory, avoiding variables {vd , δ&}, where δ& is the rate of change of
obstacles, etc.) that needs to be accomplished by the the steering angle, and four generalized variables
autonomous forklift. Fig. 4 shows the signal configura-
{ X , Y , θ , δ } (or two output variables {v, θ&} ) is given as
tion for the implementation of the steering and traction
control on the forklift. follows.
⎛ a sin δ ⎞
3. FORKLIFT KINEMATICS X& = v cos θ = rd ωd ⎜ cos δ + ⎟ cos θ ,
⎝ l ⎠
3.1. Kinematics in the inertial frame ⎛ a sin δ ⎞
Y& = v sin θ = rd ωd ⎜ cos δ + ⎟ sin θ ,
In Fig. 5, let O − X − Y and o − x − y be the inertia ⎝ l ⎠
frame and the body coordinate frame attached to the
forklift, respectively. Let v and θ be the velocity of
the forklift in the x -direction and the rotational angle of OICR
the x -axis with respect to the X -axis. Let δ be the
steering angle of the driving wheel. Under the δ
h2
assumption that the wheels do not slip, let OICR be the
h1
instantaneous center of rotation of the forklift. Finally, b
let l and a be the length of the forklift and the offset l v
of the center of the driving wheel from the centerline of y x
the body, respectively. 2rd
θ
Using the geometry in Fig. 5, the distance between Y o
OICR to the center of the driving wheel becomes δ
vd
a 2r1
l
h1 = . (1)
sin δ
2r2
Then the following relationship can be derived. θ
O X
vd v
θ& = = , (2)
h1 h1 cos δ + a Fig. 5. Schematic of the forklift with a spin-turn
steering mechanism.
116 Tua Agustinus Tamba, Bonghee Hong, and Keum-Shik Hong
rd ωd sin δ Ccurv
θ& = ,
l (5) θe
δ& = ωs .
nθ e θt
3.2. Kinematics in the path coordinates v si v sθ e
This section describes a different mathematical model v co θ
of the forklift kinematics. This new model relates the o
desired path coordinates with the input variables. Fig. 6
shows the position and orientation errors between the Δθt
actual position and the desired path to be followed by the Y
forklift. d
Let ϕ ( xt (t ), yt (t ) ) be a curve of the desired path to Δs θt
s&
be followed by the forklift, and the distance along the o proj
path is parameterized with s (t ). The following relation- ϕ ( xt , yt )
ship can be obtained for s (t ).
t
s (t ) = ∫ vt (τ )dτ + s (0), (6) θt θt + Δθt
0
X
where s (0) is the initial distance along the path, and
Fig. 6. Kinematic model of the forklift in the path
variables.
vt (t ) = x&t2 (t ) + y&t2 (t ) (7)
4.1. Coordinate transformation in chained form κ ( s) with respect to s. The inputs transformation are
The chained form is one of the canonical structures for defined as
the kinematic modeling of a nonholonomic system. This
form is very useful because it provides a very ⎛ a sin δ ⎞
cos θ e ⎜ cos δ + ⎟
controllable structure of a system in the systematic u1 = ⎝ l ⎠v ,
d (16)
development of a control strategy. 1 − d (t )κ ( s )
A system with 2 inputs and n state variables can be u2 = α 2 (q )ωs + α1 (q )u1 ,
written as a (2, n) chained form as follows [12].
where
x1 = u1 ,
x&2 = u2 , ∂x2 ∂x2
α1 (q) = + (1 − d (t )κ ( s) ) tan θe
x&3 = x2u1 , (13) ∂s ∂d
M ∂x ⎡ sin δ (1 − d (t )κ ( s ) ) ⎤
+ 2⎢ − κ (s)⎥ , (17)
x&n = xn −1u1. ∂θ e ⎢⎣ cos θ e ( l cos δ + a sin δ ) ⎥⎦
l (1 − d (t )κ ( s ) )
2
Based on the path coordinate model derived in the α 2 (q) = .
previous section, the forklift studied in this paper has cos3 θ e ( l cos δ + a sin δ )
2
four state variables. Therefore, the forklift path
coordinate (12) can be described in the following (2,4) 4.2. A time varying feedback control law
chained form. The control design via a smooth time varying
x&1 = u1 , feedback presented in this paper is based on the work
presented in [11,13]. This paper presents a modification
x&2 = u2 , of their work for the development of a path following
(14)
x&3 = x2 u1 , control by using the chained form of the path coordinate
x&4 = x3u1. model (12). Since the objective of the control design is to
make the lateral error d and orientation error θ e in
The coordinate transformation for the state variables is (12) equal to zero, the purpose of the designed path
defined as following control is to make x2 and x4 in (14) equal
x1 = s , to zero.
x2 = −κ ′( s )d (t ) tan θ e −
(
κ ( s) (1 − d (t )κ ( s) ) 1 + sin 2 θ e ) For a system given in the chained form, its variables
can be rearranged as
2
cos θ e η = (η1 ,η2 ,K ,η n −1 ,η n ) = ( x1 , xn ,K , x3 , x2 ) . (18)
sin δ (1 − d (t )κ ( s ) )
2
+ , Rearranging (14) in the structure of (18), the following
cos3 θ e ( l cos δ + a sin δ ) new chained form can be obtained.
x3 = tan θ e (1 − d (t )κ ( s ) ) , η& = h1 (η )u1 + h2 (η )u2 , (19)
x4 = d , where
(15)
h1 (η ) = [1 η3 L ηn 0] ,
T
where κ ′( s ) is the derivative of the path curvature
118 Tua Agustinus Tamba, Bonghee Hong, and Keum-Shik Hong
h2 (η ) = [ 0 0 L 0 1] .
T u2′ (η2 ,η3 ,η4 ) = − sign(u1 ) ( k1η2 + k2 sign(u1 )η3
(25)
+ k3η4 ) ,
For the forklift kinematics, the above reordering is an
exchange between the second and fourth coordinates. Let
and the path following feedback control law becomes
η = (η1 ,η *), where η * = (η 2 ,η3 ,K ,η n ), the chained
form (19) can be rewritten as follows. u2 (η2 ,η3 ,η4 , t ) = − k1 u1 (t ) η2 − k2u1 (t )η3
(26)
η&%1 = 0 , − k3 u1 (t ) η4 .
40
6
0
0
-2 -10
-4 -20
0 5 10 15
reference Time [sec]
-6 simulated Fig. 11. Orientation error between the forklift and the
-6 -4 -2 0 2 4 6 desired path.
X [m]
Fig. 8. Simulation for a circular desired trajectory. 2
2 1.9
1.7
-1
1.6
-2
-3 1.5
-4 u1 1.4
0 5 10 15
u2
-5 Time [sec]
0 5 10 15
Time [sec] Fig. 12. Linear velocity vd of the steering wheel.
Fig. 9. Control inputs, u1 and u2 , of (26).
1
0.4
0
Steering rate [rad/sec]
0.2
-1
0
Lateral error [m]
-0.2 -2
-0.4 -3
-0.6
-4
-0.8
-5
-1 0 5 10 15
0 5 10 15 Time [sec]
Time [sec]
Fig. 13. Angular velocity ω s of the steering wheel.
Fig. 10. Lateral error between the forklift and the
desired path.
whereas the radius of each arc segment is 1 meter. The
and 16 show the linear and angular velocities in initial and goal points are the same, that is, (5500, 5500).
obtaining Fig. 14, respectively. It is seen that the The experimental result shows that there exist some
proposed path following control algorithm can make the errors between the actual and the reference paths,
unmanned forklift follow the given reference path. particularly when going around four corner points. But,
The reference trajectory for a second experiment is the overall performance is acceptable. Figs. 18 and 19
shown in Fig. 17, which consists of four straight lines show the corresponding linear and angular velocities,
and four arcs. The length of each straight line is 2 meters, respectively.
120 Tua Agustinus Tamba, Bonghee Hong, and Keum-Shik Hong
6.5 6
Start experiment
6 5.5 Start
VP 1 reference
5.5
5
VP 2
4.5
5
4
Goal
4.5
X [m]
3.5
Y [m]
4
3
3.5
2.5
3 2
Goal
2.5 1.5
VP 3 1
2 experiment
reference
1.5
0.5
0 1 2 3 4 5 6 7 8 2 3 4 5 6 7
X [m] Y [m]
Fig. 14. Experimental result when the reference path Fig. 17. Experimental result when the reference path
involves only straight lines. includes both straight lines and arcs.
0.16 0.18
0.14 0.16
0.14
0.12
0.12
0.1
0.1
0.08
0.08
0.06
0.06
0.04 0.04
0.02 0.02
0 0
0 50 100 150 200 250 0 50 100 150 200 250
Time [sec] X [sec]
Fig. 15. Linear velocity vd for Fig. 14. Fig. 18. Linear velocity vd for Fig. 17.
1.5 0.2
0
1
Angular velocity [rad/sec]
Angular velocity [rad/sec]
-0.2
0.5
-0.4
0 -0.6
-0.8
-0.5
-1
-1
-1.2
-1.5 -1.4
0 50 100 150 200 250 0 50 100 150 200 250
Time [sec] Time [sec]
Fig. 16. Angular velocity ω s for Fig. 14. Fig. 19. Angular velocity ω s for Fig. 17.
rithm of the reference path curvature is left as a future and Autonomous Systems, vol. 54, no. 12, pp. 1026-
work. 1038, August 2006.
[15] D. O. Lecking, O. Wulf, and B. Wagner, “Variable
REFERENCES pallet pick-up for automatic guided vehicles in
[1] A. Stenz, J. Bares, S. Singh, and P. Rowe, “A industrial environments,” Proc. of IEEE Int. Conf.
robotic excavator for autonomous truck loading,” on Emerging Technologies and Factory Automation,
Proc. of the IEEE/RSJ Int. Conf. on Intelligent pp.1169-1174, September 2006.
Robots and Systems, vol. 3, pp. 1885-1893, October [16] J. Roberts, A. Tews, C. Pradalier, and K. Usher,
1998. “Autonomous hot metal carrier-navigation and
[2] J. Gutiérrez, J. L. Gordillo, and I. López, manipulation with a 20 ton industrial vehicle,” Proc.
“Configuration and construction of an autonomous of IEEE Int. Conf. on Robotics and Automation, pp.
vehicle for a mining task,” Proc. of IEEE Int. Conf. 2770-2771, April 2007.
on Robotics and Automation, pp. 2010-2016, April [17] H. Fang, R. Lenain, B. Thuilot, and P. Martinet,
2004. “Robust adaptive control of automatic guidance of
[3] H. Frohn and W. V. von Seelen, “VISOCAR: An farm vehicles in the presence of skidding,” Proc. of
autonomous industrial transport vehicle guided by IEEE Int. Conf. on Robotics and Automation, pp.
visual navigation,” Proc. of IEEE Int. Conf. on 3113-3118, April 2005.
Robotics and Automation, vol. 2, pp. 1155-1159, [18] B. Thuilot, C. Cariou, and P. Martinet, “Automatic
May 1989. guidance of a farm tractor along curved paths,
[4] R. K. Miller, D. G. Stewart, W. H. Brockman, and S. using a unique CD-DGPS,” Proc. of IEEE Int. Conf.
B. Skaar, “A camera space control system for an on Intelligent Robots and Systems, pp. 674-679,
automated forklift,” IEEE Trans. on Robotics and November 2001.
Automation, vol. 10, no. 5, pp. 710-716, October [19] C. B. Low and D. Wang, “GPS-based path
1994. following control for a car-like wheeled mobile
[5] G. Garibotto, S. Masciangelo, M. Ilic, and P. robot with skidding and slipping,” IEEE Trans. on
Bassino, “ROBOLIFT: A vision guided autono- Control Systems Technology, vol. 16, no. 2, pp.
mous fork-lift for pallet handling,” Proc. of IEEE/ 340-347, March 2008.
RSJ Int. Conf. on Robots and Systems, pp. 656-663, [20] P. Coelho and U. Nunes, “Path-following control of
November 1996. mobile robots in presence of uncertainties,” IEEE
[6] J. P. Laumond, Robot Motion Planning and Control, Trans. on Robotics, vol. 21, no. 2, pp. 252-261,
Springer-Verlag, Toulouse, 1998. April 2005.
[7] D. John and R. D. Nelson, “Dictionary of Math- [21] C. Samson, “Control of chained systems:
ematics,” pp. 81-82, Penguin Books, England, 1989. Application to path following and time-varying
[8] F. J. Rodríguez, M. Mazo, and M. A. Sotelo, point stabilization,” IEEE Trans. on Automatic
“Automation of an industrial forklift truck, guided Control, vol. 40, no. 1, pp. 64-77, January 1995.
by artificial vision in open environment,” Auto- [22] G. Kaloutsakis, N. Tsourveloudis, and P.
nomous Robot, vol. 5, no. 2, pp. 215-231, May Spanoudakis, “Design and development of an
1998. Automated Guided Vehicle,” Proc. of IEEE Int.
[9] J. Pagès, X. Armangué, J. Salvi, J. Freixenet, and J. Conf. on Industrial Technology, vol. 2, pp. 990-993,
Martí, “A computer vision system for autonomous December 2003.
forklift vehicles in industrial environments,” Proc. [23] N. M. Dung, V. H. Duy, N. T. Phuong, S. B. Kim,
of the 9th Mediterranean Conf. on Control and and M. S. Oh, “Two-wheeled welding mobile robot
Automation, June 2001. for tracking a smooth curved welding path using
[10] K. Petrinec, Z. Kovačić, and A. Marozin, “Sim- adaptive sliding-mode control technique,” Interna-
ulator of multi-AGV robotic industrial environ- tional Journal of Control, Automation, and Systems,
ments,” Proc. of IEEE Int. Conf. on Industrial vol. 5, no. 3, pp. 283-294, June 2007.
Technology, vol. 2, pp. 979-983, December 2003.
[11] C. A. Samson, A. De Luca, and G. Oriolo,
Feedback Control of a Nonholonomic Car-like
Robot, Dipartimento di Informatica e Sistemistica,
Università di Roma “La Sapienza,” 2004.
[12] R. M. Murray and S. S. Sastry, “Nonholonomic Tua Agustinus Tamba received the B.S.
motion planning: Steering using sinusoids,” IEEE degree in Engineering Physics from
Trans. on Automatic Control, vol. 38, no. 5, pp. Institute of Technology Bandung, Indo-
700-716, May 1993. nesia, in 2006. He is currently a graduate
student at the School of Mechanical
[13] I. Schworer, Navigation and Control of Auto- Engineering, Pusan National University,
nomous Vehicle, M.S. Thesis, Virginia Polytechniq Busan, Korea. His research interests in-
Institute and State University, 2005. clude control of unmanned vehicles and
[14] M. Seelinger and J. D. Yoder, “Automatic visual path planning technologies for auton-
guidance of a forklift engaging a pallet,” Robotics omous robots.
122 Tua Agustinus Tamba, Bonghee Hong, and Keum-Shik Hong