Professional Documents
Culture Documents
The reliability of a behaviour is calculated automatically. A special type of behaviour, so-called fusion behaviours,
The latter calculates the influence of a set of behaviours on are used to combine the outputs of p other behaviours
the fusion by calculating the minimum combined deviation Bc . A fusion behaviour has a normal behaviour interface.
from human-defined goals. A drawback of this approach is Its input vector e is composed of the activities ac , target
that goals as well as the configuration parameter have to ratings rc , and output vectors uc . Two fusion types are
be chosen by a human operator. available, which determine how the fusion behaviour’s
activity, target rating and control vector are calculated.
In Eck et al. (2007), two different types of support for
In the case of a weighted fusion, the following formulas
a tele-operator are identified, called passive and active
are used:
support, respectively. Passive support is a combining term
for all methods with which a system consults or advises the
operator, e. g. by displaying status messages at the opera- p−1 p−1 p−1
a2j
P P P
tor’s console. Mechanisms for active support, by contrast, aj · rj aj · uj
j=0 j=0 j=0
are realised on the robot with the purpose to adapt the a= · ι; r= ; u= (1)
p−1 p−1 p−1
operator’s commands to the robot’s current environment. P
ak
P
ak
P
ak
For example, a safety component could provide active k=0 k=0 k=0
support by stopping the robot if it gets too close to an
obstacle. The robot control system presented there fea- 4. SUPPORTING DIFFERENT TYPES OF CONTROL
tures different operation modes, among them two in which
the user can drive the robot manually, being supported by This section starts by giving a brief overview of the control
several assistance systems if desired. An autonomous mode system of the mobile robot ravon. The focus lies on
is also available. The separation into active and passive the elements used for tele-operating the robot and the
support is taken up in Section 4.2 of this paper. corresponding control flows. The different types of control
that the system offers to an operator are then introduced,
followed by a detailed explanation of how they are realised.
3. BEHAVIOUR-BASED APPROACH
4.1 System Overview
In the work at hand, behaviour-based concepts are used
to combine different modes of control in one robot control Figure 4 depicts the main components of the control sys-
system. The authors make use of iB2C 1 , a behaviour- tem as well as the control flow between these components
based architecture that has been implemented using the that is relevant for the work at hand. As can be seen, the
robot control software framework mca2 2 . In the following, human operator can input commands into the global nav-
basic information about iB2C is provided. For details, the igation system or into the behaviour-based drive system.
reader is referred to Proetzsch et al. (2010). Combined drive commands from the latter are then sent to
a safety system realising collision avoidance. The output
All of the behaviours in iB2C have a common interface
of this system is then used as input for the hardware
for transferring so-called behaviour signals between be-
abstraction layer (hal). Alternatively, the pure operator
haviours (see Figure 2). The stimulation s is used to grad-
commands can be used.
ually enable a behaviour, whereas the vector ı of inhibitory
inputs is used to gradually disable it. The combined value Human Operator
192
TA 2010
Timisoara, Romania, Oct 5-8, 2010
TM
Cordless Rumblepad 2 is employed.) Combination
Inhibition
By simply pressing a button, the user can initiate a
Direct Control Devices
switching between the outputs of the safety system and
the direct operator commands at any time. The reason for GUI
(WLAN)
GUI (Long-
Distance Link)
Joystick
using a switch at this low level is that the user shall be able
to very fast gain full control over the vehicle in case manual
steering is necessary. This can happen in situations in Control
which the collision avoidance might interfere with the user Combination Combination
commands (e. g. when driving the robot through a narrow Fusioned Drive Pure Operator
door into the lab) or in which the autonomous part of the Commands Drive Commands
control system fails. 3 It shall be mentioned here that the To Lower Navigation Layers
193
TA 2010
Timisoara, Romania, Oct 5-8, 2010
Operator
4.5 Full Autonomy Command (OC)
ponents in a sophisticated way that allows for a seamless, The outputs of BFB0 can then be calculated as follows:
gradual transition from using only the autonomous com-
ponents over using a combination of autonomous compo-
nents and operator commands to using only the operator’s a2FB1 + a2OC
commands as input for the safety system. In the following, aFB0 = · ιFB0 (4)
aFB1 + aOC
this transition mechanism is explained in detail. p−1 2
P 2
aj
Each of the six behaviours introduced in Section 4.4 is j=0
not only connected to the lower layer, but also to the p−1 · (1 − aOC ) + a2
P OC
navigation layers higher up in the hierarchy. The basic ak
idea behind this double connection is to let the operator’s = k=0
· ιFB0 (5)
p−1
inputs overwrite the commands of higher layers and send P
a2j
its own commands to lower layers. In order to allow for j=0
a gradual transition between commands of the operator p−1
P · (1 − aOC ) + aOC
and the higher layers, behaviour-based techniques are ak
k=0
employed.
194
TA 2010
Timisoara, Romania, Oct 5-8, 2010
p−1 p−1
P
a2j
P
aj ·rj
0 if cdev = −1 → 0 (I)
cOCFW = (9)
j=0 j=0 0→1 if cdev = 0 → 1 (II)
p−1
P · (1 − aOC ) · p−1
P + aOC · rOC
ak ak 0 if (I)
aOCFW = (10)
rFB0 = k=0
p−1
k=0
(6) 0→1 if (II)
P
a2j
j=0 Thus the fusion of the higher navigation behaviours and
p−1
P · (1 − aOC ) + aOC the operator’s input yields for the forward subnet:
ak
k=0
p−1 p−1 0.5 if (I)
P
a2j
P
aj ·cj cFB0FW =
j=0 j=0
(1 − aOCFW ) · 0.5 + aOCFW · cOCFW if (II)
· (1 − aOC ) · p−1 + aOC · cOC
p−1
P P (11)
ak ak (
cFB0 = k=0 k=0
(7) (1 − aOC ) · ιFB0FW if (I)
p−1 aOCFW = 2
(1 − aOCFW ) + a2OCFW · ιFB0FW if (II)
P
a2j
j=0
p−1
P · (1 − aOC ) + aOC (12)
ak
k=0 The corresponding formulas for the subnet dealing with
backward motion are:
Assuming that the tele-operator inputs a control value of
0, then cOC = 0 and aOC = 0. In this case, BFB1 is not
inhibited and BOC does not have any influence at BFB0 , cFB1BW = 0 aFB1BW = 0 (13)
so only the outputs of the higher navigation layers are sent
to the lower layers. In case the operator issues a command Again, two cases are to be distinguished for the tele-
with the maximum value of 1, the activity of BOC will operator’s influence:
go up to 1, fully inhibiting BFB1 and gaining maximum
influence in the weighted fusion at BFB0 . Figure 8 provides
a diagram showing the gradual change from no operator 1→0 if (I) 1→0 if (I)
cOCBW = ; aOCBW =
control to maximum operator control. 0 if (II) 0 if (II)
(14)
If none of the high-level behaviours is active (i. e aFB1 = 0),
only the operator’s commands have an influence at BFB0 , And the fusion of the two inputs yields:
setting the system into the assisted tele-operation mode.
cOCBW if (I)
5. EXAMPLE cFB0BW = (15)
0 if (II)
An example shall demonstrate how the influence of the aOCBW · ιFB0BW if (I)
operator in the assisted tele-operation or fully autonomous aOCBW = (16)
0 if (II)
mode works. The control flow in the behaviour network
depicted in Figure 7 shall be examined in detail for the In order to control the robot, the outputs of the subnets
two behaviour subnets dealing with forward and backward for the two directions have to be coordinated. For this
motion. purpose, the control value cFB0 of the backward subnet is
Assuming that the combined desired velocity of the higher negated. Again, a weighted fusion is employed, yielding:
navigation behaviours is 0.5, i. e the behaviours want to
drive the robot in forward direction with half speed and a ccombined =
desired activity of 1.0. The operator intervenes by moving
(1 − aOC ) · ιFB0FW · 0.5 + aOCBW · ιFB0BW · (−cOCBW )
the joystick from “full speed backward” (−1.0) to “full
speed forward” (1.0). In order to properly inhibit the
(1 − aOC ) · ιFB0FW + aOCBW · ιFB0BW
higher layers, the activity outputs of BOCFW and BOCBW if (I)
are both connected to the inhibitory inputs of BFB1FW and
(1 − aOC FW
) · 0.5 + aOCFW
· cOCFW
BFB1BW , thus their inhibition is max {aOCFW , aOCBW } =:
if (II)
aOC .
(17)
For the subnet dealing with forward motion, the following
formulas result: acombined =
2 2
((1 − aOC ) · ιFB0FW ) + (aOCBW · ιFB0BW )
· ιcombined
((1 − aOC ) · ιFB0FW ) + (aOCBW · ιFB0BW )
aFB1FW = (1 − aOC )
cFB1FW = 0.5 (8) if (I)
2 2
(1 − aOCFW ) + aOCFW · ιFB0FW · ιcombined
Two cases have to be distinguished for the influence of the
tele-operator:
if (II)
(18)
195
TA 2010
Timisoara, Romania, Oct 5-8, 2010
Figure 8 shows the values of some of the different velocities puter, Hübner Giessen, John Deere, Optima, ITT Cannon,
calculated in the behaviour-based network against the MOBOTIX, and Unitek Industrie Elektronik.
operator’s control input cdev .
Velocities against Operator Input REFERENCES
1
0.9 C. Armbrust, T. Braun, T. Föhst, M. Proetzsch, A. Ren-
0.8
0.7 ner, H. Schäfer, and K. Berns. Using robots in haz-
0.6
0.5
ardous environments: Landmine detection, de-mining
0.4 and other applications, chapter RAVON – The Robust
0.3
0.2 Autonomous Vehicle for Off-road Navigation. Wood-
0.1
0
head Publishing Limited, 2010. to be published.
-0.1 -1
-0.2
-0.9 -0.8 -0.7 -0.6 -0.5 -0.4 -0.3 -0.2 -0.1 0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1
Antal K. Bejczy. Toward advanced teleoperation in space.
-0.3 In Steven B. Skaar and Carl F. Ruoff, editors, Teleop-
-0.4
-0.5 c_combined
eration and Robotics in Space, Progress in Astronautics
-0.6
-0.7
c_OC_FW
c_FB0_FW
and Aeronautics Series. AIAA, 1994.
-0.8
c_FB0_BW
David J. Bruemmer, Donald D. Dudenhoeffer, and Julie L.
-0.9
-1 Marble. Dynamic-autonomy for urban search and res-
c_dev cue. In AAAI Mobile Robot Competition 2002, AAAI
Technical Report, pages 33–37, Edmonton, Alberta,
Fig. 8. Different velocities calculated within the behaviour- Canada, 28 July - 1 August 2002. AAAI Press.
based network printed against the tele-operator’s in- Daniela Doroftei, Geert De Cubber, Eric Colon, and Yvan
put Baudoin. Behavior based control for an outdoor cri-
sis management robot. In Proceedings of the IARP
Looking at the curve of ccombined , it can be seen that the
International Workshop on Robotics for Risky Inter-
operator is able to increase the robot’s velocity continu-
ventions and Environmental Surveillance 2009 (RISE
ously from the lowest to the highest value against the de-
2009), Brussels, Belgium, January 12–14 2009. IARP.
sire of the higher navigation behaviours to move the robot
Daniel Eck, Manuel Stahl, and Klaus Schilling. The
forward with a constant velocity. For −1 ≤ cdev < −0.5,
small outdoor rover merlin and its assistance system
the operator’s input lets the robot move backwards. At
for tele-operations. In 6th International Conference on
cdev = −0.5, the combination of operator and higher
Field and Service Robotics (FSR 2007), pages 277–286,
behaviour inputs results in the robot not moving at all.
Chamonix, France, July 9-12 2007.
If the operator inputs a control value cdev = 0 then the
J. Koch, M. Reichardt, and K. Berns. Universal web
higher navigation behaviours have full control over the
interfaces for robot control frameworks. In IEEE/RSJ
robot. For cdev ≥ 0, the activity of the backward subnet
International Conference on Intelligent Robots and Sys-
is 0. Hence it does not have any influence, resulting in
tems (IROS), Nice, France, September 22-26 2008.
ccombined = cFB0F W .
Qingping Lin and Chengi Kuo. On applying virtual reality
to underwater robot tele-operation and pilot training.
6. CONCLUSION AND FUTURE WORK The International Journal of Virtual Reality, 5(1), 2001.
Kai Lingemann, Andreas Nüchter, Joachim Hertzberg,
The paper at hand presented the integration of different and Hartmut Surmann. About the control of high speed
control modes with different levels of operator influence mobile indoor robots. In Proceedings of the Second
within one robot control system. It described how an European Conference on Mobile Robotics (ECMR ’05),
operator can easily choose the control mode fitting best to pages 218–223, Ancona, Italy, September 7-10 2005.
the current situation. Using behaviour fusion, the control M. Proetzsch, T. Luksch, and K. Berns. Development
system allows an operator to continuously increase or of complex robotic systems using the behavior-based
decrease his influence on the robot’s motion. control architecture iB2C. Robotics and Autonomous
In the future, the currently used gui shall be replaced Systems, 58(1):46–67, 2010.
by a Java-based application (see Koch et al. (2008)). A James P. Trevelyan, Sung-Chul Kang, and William R.
widget in the Java-gui shall display imagery provided by Hamel. Robotics in hazardous applications. In Bruno
GoogleEarth
R
. The operator will then be be able to use Siciliano and Oussama Khatib, editors, Springer Hand-
that widget to provide the robot with paths and targets, book of Robotics, chapter 48, pages 1101–1126. Springer
which will significantly improve the high-level control of Berlin Heidelberg, 2008.
the robot. Louis L. Whitcomb. Underwater robotics: Out of the
research laboratory and into the field. In Proceedings
ACKNOWLEDGEMENTS of the 2000 IEEE International Conference on Robotics
& Automation (ICRA 2000), pages 709–716, San Fran-
cisco, CA, USA, April 24-28 2000.
The authors gratefully acknowledge the funding of Christo-
pher Armbrust and Bernd-Helge Schäfer by the PhD Pro-
gramme of the University of Kaiserslautern’s Department
of Computer Sciences.
Furthermore, Team ravon thanks the following compa-
nies for their technical and financial support: IK elek-
tronik, Mayser, Hankook, MiniTec, SICK, DSM Com-
196