Professional Documents
Culture Documents
Peter Charbachi
pci13001@student.mdh.se
Filippo Ferrario
ffo16001@student.mdh.se
2018-05-16
Mälardalen University Master Thesis
Abstract
In this thesis we investigate the problem of automatic calibration and control of hydraulic compo-
nents in the domain of construction equipment. Methods that are able to remove a costly manual
approach in favour of an automatic one are investigated and evaluated. The thesis aims to inves-
tigate what methods are available in achieving this goal as well as evaluate the performance and
applicability of such methods in the domain of construction equipment.
The literature indicates that a great focus is put on learning a model of the plant at run time
in order to provide accurate control. Common approaches to the problem are the Recursive Least
Square method and PID controllers for non-linear systems, but other methods are also present,
such as the Nodal Link Perceptron Network (NLPN).
The methods chosen to be compared are the existing method of manually calibrating two set
points for start and end current and interpolating between them; the use of a PI controller with a
static line inverse model; a PI controller with a static curve inverse model; a PI controller with an
NLPN adaptive inverse model and lastly, a completely NLPN based control strategy.
The methods were implemented in Matlab Simulink and evaluated in simulations based on
data collected from real wheel loaders in the construction equipment domain, produced by Volvo
CE. The simulations are performed on data from three machines and were evaluated twice for
the adaptive methods in order to evaluate how well the methods improved. The results were then
evaluated in terms of average absolute error, as well as a discussion of the behaviour shown in the
plots.
The evaluations indicates that the most effective method for control is the PI controller using a
static line inverse model. The method produces the smallest average error of both actions evaluated,
lifting and lowering of the boom, while the complete NLPN solution provide the worst results.
1
Mälardalen University Master Thesis
Table of Contents
1 Introduction 5
1.1 Thesis Goals . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6
1.2 Thesis Outline . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6
2 Background 7
2.1 Wheel Loader Machines . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7
2.2 Hydraulics . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 9
2.2.1 Spool Valves . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 9
2.3 Calibration . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 10
2.4 Artificial Neural Network . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 11
2.5 Proportional Integral Derivative . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 13
2.6 Regression Analysis . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 14
2.6.1 Least Squares Estimation Method . . . . . . . . . . . . . . . . . . . . . . . 14
3 Problem Formulation 15
3.1 Calibration Principles . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 15
3.2 Existing Method of Calibration . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 15
3.3 Problem Statement . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 17
3.4 Research Questions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 18
4 Related Work 19
4.1 Nodal Link Perceptron Network . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 19
4.2 Proportional Integral Derivative Control . . . . . . . . . . . . . . . . . . . . . . . . 19
4.3 Recursive Least Square . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 20
4.4 Hydraulic Control . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 21
5 Methodology 22
5.1 Data Anonymisation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 23
8 Evaluation 31
9 Threats to Validity 41
10 Discussion 42
10.1 PI + Line Inverse Model . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 42
10.2 PI + Curve Inverse Model . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 42
10.3 PI + Adaptive Inverse Model . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 42
10.4 NLPN . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 43
10.5 Final Considerations . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 43
11 Conclusion 45
2
Mälardalen University Master Thesis
12 Future Work 46
References 50
Appendix 51
A Actual Data . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 51
3
Mälardalen University Master Thesis
List of Figures
1 Wheel loader . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5
2 Wheel loader top and side view . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7
3 Wheel loader sub system . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8
4 Lifting and tilting of GET . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8
5 Simplified diagram of the hydraulic system. . . . . . . . . . . . . . . . . . . . . . . 10
6 Intersection of a 5-way spool valve. . . . . . . . . . . . . . . . . . . . . . . . . . . . 11
7 Structure of a general neuron for an artificial neural network. . . . . . . . . . . . . 12
8 Structure of a generic artificial neural network. . . . . . . . . . . . . . . . . . . . . 12
9 PID using error feedback. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 13
10 Polynomial Regression Analysis. . . . . . . . . . . . . . . . . . . . . . . . . . . . . 14
11 Existing calibration method. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 16
12 Behaviour of the machine speed with regards to current. . . . . . . . . . . . . . . . 17
13 Research methodology. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 22
14 NLPN Structure . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 24
15 Simulink representation. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 25
16 Simulation design of the plant. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 27
17 PID + Static Inverse . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 28
18 PID + Adaptive Inverse . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 30
19 Adaptive NLPN Control . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 30
20 Evaluation command used to test all solutions. . . . . . . . . . . . . . . . . . . . . 31
21 Evaluation of Existing method on each machine. . . . . . . . . . . . . . . . . . . . 32
22 Evaluation of PI + Line Inverse on each machine. . . . . . . . . . . . . . . . . . . . 33
23 Evaluation of PI + Curve Inverse on each machine. . . . . . . . . . . . . . . . . . . 34
24 Evaluation of PI + Adaptive Inverse first run on each machine. . . . . . . . . . . . 35
25 Evaluation of PI + Adaptive Inverse second run on each machine. . . . . . . . . . 36
26 Evaluation of NLPN method first run on each machine. . . . . . . . . . . . . . . . 37
27 Evaluation of NLPN method second run on each machine. . . . . . . . . . . . . . . 38
28 Lifting results of the evaluated methods compared to the baseline. . . . . . . . . . 39
29 Lowering results of the evaluated methods compared to the baseline. . . . . . . . . 40
30 Lowering results of the evaluated methods compared to the baseline. . . . . . . . . 40
4
Mälardalen University Master Thesis
1 Introduction
The domain of construction equipment contains a large variety of unique machines and vehicles.
All of these machines are tailored to excel at their specific tasks, being excavators for digging,
articulated haulers for transporting materials, compactors to flatten the ground or wheel loaders,
see Figure 1, for moving and loading materials. Every machine has its own purpose and thus a place
in the operators toolbox. Even though the machines are tremendously specialised towards their
specific task, they are still highly customisable, with a range of different attachments to further
tailor them to the current workload. Operating these machines is no easy task [1], an action that
seems as trivial as filling the wheel loader bucket with gravel is actually a rather challenging task
for a novice. It takes professional operators a lot of time and practise to become familiar enough
with the machines to manoeuvre them effectively and smoothly. If the machine becomes unsuitable
for the work task at hand and is required to be changed; or if its behaviour changes during its
lifetime, the operator might be introduced to a machine with an unfamiliar behaviour. In this
case, the operators experience and familiarity loses its relevance, which motivates the need for all
machines to display the same behaviour.
Hydraulics systems, which are a main part of construction equipment, consist of components
that posses individual characteristics. This individuality does not only manifest by the manufac-
turing of the component, but also by its usage and wear which is known as hysteresis. This in
turn results in a range of different machine behaviour which diverges from the behaviour that the
operator is familiar to. The described phenomenon does not only reduces operator productivity,
but can also negatively impact safety.
The current way to deal with this changing behaviour is done by the use of individual calibra-
tion of the hydraulic system, where the aim is to conform machine behaviour as well as improve
manoeuvrability. Calibration is a manual process and for this reason it represents a costly pro-
cedure for companies. Automatic calibration of the hydraulics is an approach to therefore reduce
cost and also improve machine quality.
This thesis focus on the investigation, development and evaluation of automatic calibration
methods for construction equipment hydraulics. The study is performed in collaboration with
Volvo CE, and is aimed at their wheel loaders machines. The focus will be on the wheel loaders
ground engaging tool (GET), also known as boom arm. However, the results of the study are not
limited to the wheel loaders’ GET, but could potentially be applied to other parts of the machines
hydraulic system such as steering as well as other construction equipment machines.
5
Mälardalen University Master Thesis
6
Mälardalen University Master Thesis
2 Background
This background section introduces the key elements necessary to better understand the work
presented in this thesis. First, a general knowledge of the machines and how they are operated
is provided. Following this, an explanation on their working hydraulics, spool valves and the
calibration process needed is given. The section is concluded with an introduction of the techniques
used in the thesis.
Figure 2: Volvo L260H wheel loader design in side and top view.
A typical wheel loader is powered by a diesel engine which is responsible for not only driving
the wheels but also powering the hydraulic pump. Power to the wheels is transferred through a
torque converter and mechanical transmission, similar to the design found in cars and trucks. The
hydraulic pump, which is also powered by the diesel engine, handles task such as steering, braking
and controlling of the GET. Figure 3 shows how the diesel engine is the sole power source and
how the power travels to the tires as well as get transferred to the hydraulic pump. The hydraulic
pump then utilise that power to operate brakes, steering and GET, while both brakes and steering
are also used in the control of the tires.
Compared to a normal car, a wheel loader does not steer by turning the front wheels or even
the front axis. The front and rear axis are fixed, with the rear axis only able to flex a bit vertically
to keep as many wheels on the ground as possible in order to increase stability. Wheel loaders have
hydraulically controlled articulated steering, where the vehicle’s whole front section is connected to
the rear by an articulation joint. The rear axis supporting the engine is connected to the front axis
through this articulation joint and allows for power to be transferred in order to provide power to
all four wheels. The articulated steering allows the front axis of the vehicle to turn independently of
the rear, causing the front and rear tires to follow in each others tracks, see the top view in Figure
2. This is achieved with the use of two single acting hydraulic cylinders mounted on each side of
the articulation joint. To turn the vehicle, one of the hydraulic cylinders is pressurised to push the
vehicles front section around the joint. The single acting design of the hydraulic cylinder permits
only one of the cylinders two actions to be used, where only the extension action is allowed. This
requires the other cylinder to be left unpressurised permitting the oil to flow out of the cylinder in
7
Mälardalen University Master Thesis
Powertrain
Brake
Hydraulic Pump
Hydraulic
Steering
Hydraulic
Implements
Tool Force &
Hydraulic
Speed
Ground Engaging Tool (GET)
Figure 3: Wheel loader sub system, based on the work of Cobo et al. [2].
Figure 4: Lifting and lowering of the GET is shown on the left while tilting in and out is shown
on the right.
8
Mälardalen University Master Thesis
The first and second levers are responsible for the lifting and tilting actions of the GET respec-
tively, where the actions can be seen in Figure 4. These commands are essential to the functionality
of the machine, and for many attachments, the only actions applicable. They work by controlling
typically three hydraulic cylinders for larger wheel loaders or possibly two for smaller ones. One or
two hydraulic cylinders are used to perform the lifting action with the remaining hydraulic cylinder
being used for tilting. In order to provide both directions of actions, lifting and lowering, tilting in
and out, the hydraulic cylinders are required to be double acting. This means that they are able to
fill both chambers separated by the piston with hydraulic fluid, thus allowing them to be operated
in both directions. This design is different from the one regarding steering, where the hydraulic
cylinder’s retraction is dependant on the other cylinders extraction. The third and fourth levers
are different, they provide general purpose hydraulic actions which are dictated by the attachment.
Example of such actions can be road cleaning brush attachments which requires hydraulic fluid in
order to spin and operate. Other examples can be special fork attachments which have one height
modifiable fork arm, or bucket attachments that have the additional functionality to tip sideways.
All attachments and their actions are dependant on the GET which in turn makes them dependant
on the hydraulic system operating it.
2.2 Hydraulics
The increased digitalisation which has affected a magnitude of fields, has not advanced without
making an impact on the construction equipment domain [2]. Advances in autonomous machines
has even made its way into the construction equipment domain [3], with Volvo CE even introducing
prototype autonomous machines [4]. Other advances such as electric or hybrid machines has also
been making an appearance in order to reduce noise, fuel consumption and emissions. An example
of this is the EX2 fully electric excavator introduced by Volvo CE as part of their electromobility
product line [5]. This product line consist of vehicles and machines that are able to utilise an
electric motor to perform either the machines propulsion or main function [6].
The hydraulic system has also gotten changes, however more discrete. One such change affects
the control of the hydraulic actuators, which involve the introduction of electronic control by the
use of pulse-width modulation (PWM) signals and solenoids. The process and connections can be
seen in the simplified diagram shown in Figure 5. The operator commands the machine by the
use of the levers located in the cabin. These are then processed by an electronic control module
which converts the actions into PWM signals. The signals are then sent to operate the solenoid
valves inside the pilot valves controlling the hydraulic fluid, which in turn controls the main valve
that then controls the hydraulic cylinder. The solenoid valves operating the hydraulics are of the
proportional design, which allows the operator to gradually specify the size of the orifice of which
the hydraulic fluid exits. This design affects the rate of which the hydraulic fluid travels through
the valve to the hydraulic cylinder which translates into its operating speed. The use of pilot valves
allows for weaker valves and is able to better utilise power already trapped in the system, it does
however allow for more steps in between, which depending on their individual characteristics can
affect the overall behaviour.
9
Mälardalen University Master Thesis
Hydraulic
Cylinder
Lift
Hydraulic
Cylinder O O O O
Main Valve Main Valve
Tilt T P T T P T
O O O O
Pilot Valve Pilot Valve Pilot Valve Pilot Valve
T P T P T P T P
Electronic
Control PWM
Module
(ECM) Pump 1 Tank Pump 2
Lever
Operator
the mentioned valves by allowing an increased precision of the spool’s location inside the housing.
These valves are able to produce finer control of flow rate, which in a wheel loader hydraulic system
would be translated into the actions operating speed.
Due to the design of the spool valve, it is able to perform two actions at once, which intuitively
makes it a good choice for a hydraulic cylinder. It allows pressurised oil to travel to the direction
of choice, while allowing a path for the oil in the other cylinder to escape. Without a way to
release the oil in the other cylinder, vacuum and compressed oil would prevent the system from
performing as intended. Such a two action design, while keeping control of the system simple,
also makes adjustment to the control coarse, causing fine control of the system difficult. Methods
that handle control of the in-take and out-take separately do exist and are able to improve control
precision. This “independent metering” design, does not only increase control difficulty, but also
price, as it imposes the need for separate valves for every port, practically doubling the amount of
valves.
2.3 Calibration
Calibration is the process done in order to conform machine behaviour towards a desired uniform
behaviour. For the electronically controlled hydraulic systems, this process is manually done by
setting lower and upper ranges for the PWM signal of which the lever operates within. This
is achieved by a technician that is required to travel to the machine in person. The process of
calibration then requires the use of specialised equipment in order to analyse various hydraulic
machine actions and set the ranges for the PWM signals. These actions include lifting and tilt-
ing of the GET, which are operated and evaluated until deemed satisfying. The hydraulics can
10
Mälardalen University Master Thesis
A B
P→B P→A
T→A T→B
Tank Pressure
be considered satisfying when the control is consistent and smooth, i.e. no sudden uncontrolled
movements or jerking actions, and in line with the uniform behaviour. Such a calibration method
does not take into consideration any behaviour occurring whilst within the specified range, but
only aims to encapsulate it. To constantly achieve the desired behaviour of the control, repeatedly
calibrating the hydraulics is a necessary task. This becomes more apparent when major adjust-
ments to machine configuration are made, such as machine repairs. The changes in attachments
can also affect this, which due to the varying weight of the attachments are able to make existing
calibration inadequate. In order to avoid the need of manually calibrating the system to respond
to such changes, an automatic approach is investigated as a way to allow the machine to respond
and adapt itself. The calibration process can be seen as an optimisation problem, where the aim is
to minimise the difference between desired and actual machine behaviour. Optimisation strategies
work by constantly aiming to improve the current solution to a problem by maximising or min-
imising a property. This is done by modifying a set of parameters and evaluating whether the new
configuration provides a solution closer to the optimal result. This process is then repeated until
an acceptable solution is provided. The acceptable solution in these outcomes are often within a
predefined tolerance range of the optimal result. It is not impossible for optimisation problems
to be excessively large and unmanageable, which makes finding a perfect solution impractical. In
these cases a tolerance value is used to make the problem feasible.
11
Mälardalen University Master Thesis
X0 = 1
X1 W1
W0
X2 W2
X3 W3 ∑ Activation
Function
Output
Xn Wn
neurons in the previous layer. The network ends with an output layer where the amount of neurons
is chosen depending on the task. For classification problems, the output layer usually contains one
neuron per category, whilst approximation problems often only use one neuron. The data sent to
such a network can be visualised as passing through a pipeline where every step is a network layer.
The training of a neural network is done with a technique called backpropagation. In this phase
the aim is to minimise a target scalar cost function (e.g., the average quadratic error) using a set
of training data samples. This is achieved by computing the gradient of the error with respect to
the network’s weights and using a minimisation technique.
Neural networks have been able to provide robust approaches for approximating real, discrete
and vector target functions. Additionally, ANNs were also deemed the most effective methods
for certain types of problems, such as the ability to interpret complex real world sensor data [9].
Their design makes them well suited for problems involving different kind of sensors, where the
training data is complex, noisy and derived from devices producing information about a specific
environment. After training, the ANN will eventually have constructed a set of weights unique to
its architecture that model a solution to solve the problem. These weights are not always simple
to be interpreted by a human but represents the key for an ANN to achieve its goal.
Output
Layer
Input
Layer
Hidden Hidden
Layer 1 Layer 2
12
Mälardalen University Master Thesis
Ki e(τ)dτ
∫
0
r e u y
∑ Kp e ∑ System
de
Kd
dt
Controller
1
Figure 9 illustrate the structure of a PID which compute an error value e as difference between
the setpoint r and the measured process variable y. Corrections to this method are applied ac-
cording to the three components, where P represent the proportional part of the error, can be seen
as the “present” error. I is the integral part of it and represents the accumulation of the “past”
error. And finally the last part, D can be considered as the prediction of the “future” error. In
fact, as stated by Araki [11], the PID controller can be understood as a controller that takes the
present the past and the future of the error into consideration. Thus, the control action is the sum
of all the three terms. The system tries to minimise the error e by adjusting over time the control
variable u.
The input/output relation of the constants in a PID controller with error feedback, as the one
illustrated in Figure 9, can be described according to Araki [11] as follow:
Z t
de
u = Kp e + Ki e(τ )dτ + Kd (1)
0 dt
where all the controller parameters are visible: the proportional gain Kp , the integral gain Ki and
the derivative gain Kd .
The PID is the most widely used controller in process control until today, according to Araki [11].
Investigations performed in Japan, showed that 90% of the controllers used by the industries are
PID controllers or modified version of this technique.
13
Mälardalen University Master Thesis
y = β0 + β1 x + (2)
Other models also exist that consist of multiple regressors, known as multiple linear regression
models, or designs that does not produce a line, but a polynomial known as polynomial regression
models. Polynomial regression models aim to estimate a curve through the data set and can do
this with a curve of a predetermined arbitrary order. They are thus able to provide a better
representation for non-linear system, as compared to their linear counterparts. A general rule
for polynomial regression models is the use of as low order as possible for the regression model,
as transformations are preferred before increasing the model complexity. Model estimation for
polynomial regression models outside the range of the data set, known as extrapolation, as well
as inside the data set known as interpolation, can also be very hazardous, where polynomial roots
can appear at unexpected places.
A way to handle such methods is the piecewise regression models, such as the Spline method
or Piecewise Cubic Hermite Interpolating Polynomial. By splitting the variable space at different
locations, known as knots, it is possible to assign each section with their own function. This can be
useful to model real system, such as hydraulic valves. A polynomial will have difficulties capturing
the flat behaviour seen in Figure 12, whilst a piecewise method would be more appropriate.
14
Mälardalen University Master Thesis
3 Problem Formulation
In order to describe the problem addressed in this thesis, a first introduction of the working prin-
ciples and the existing method is presented. The problem formulation is described right after the
initial introduction. Concluding this section are the research questions, representing the funda-
mental core of this thesis.
15
Mälardalen University Master Thesis
A)
A)
A) No
No Current
Current 0%
0% set
set point
point 100%
100% set
set point
point Max
Max Current
Current
No Current 0%6,7%
set point
13,3% 20,0% 26,7% 33,3% 40,0% 46,7% 53,3% 60,0% 66,7% 73,3% 80,0% 86,7% 100% set100,0%
93,3% point Max Current
6,7% 13,3% 20,0% 26,7% 33,3% 40,0% 46,7% 53,3% 60,0% 66,7% 73,3% 80,0% 86,7% 93,3% 100,0%
Deadpan
6,7% 13,3%
Deadpan 20,0% 26,7% 33,3% Actual 46,7%
40,0% machine respone
53,3% 60,0%
Actual machine respone 66,7% 73,3% 80,0% 86,7%Deadpan
93,3% 100,0%
Deadpan
0%
0%
5%
5%
10%
10% Deadpan
15%
15%
20%
20%
25%
25%
30%
30%
35%
35% Actual
40% machine
40%
45%
45% respone55%
50%
50% 55%
60%
60%
65%
65%
70%
70%
75%Deadpan
75%
80%
80%
85%
85%
90%
90%
95%
95%
100%
100%
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
C)
(b) Existing calibration with under estimated set points.
C)
C) No
No Current
Current 0%
0% set
set point
point 100%
100% set
set point
point Max
Max Current
Current
No Current 0%10,0%
set point
20,0% 30,0% 40,0% 50,0% 60,0% 70,0% 80,0% 100% set100,0%
90,0% point Max Current
10,0% 20,0% 30,0% 40,0% 50,0% 60,0% 70,0% 80,0% 90,0% 100,0%
10,0% 20,0% 30,0% Actual 50,0%
40,0% machine respone
60,0% 70,0%
Actual machine respone 80,0% 90,0% 100,0%
0%
0%
5%
5%
10%
10%
15%
15%
20%
20%
25%
25%
30%
30%
35%
35% Actual
40% machine
40% 45%
45% respone55%
50%
50%
55% 60%
60%
65%
65%
70%
70%
75%
75%
80%
80%
85%
85%
90%
90%
95%
95%
100%
100%
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
In order to perform calibration, the use of a weight on the boom is required, which is of importance
in calibrating some actions. This requirement is met by just equipping a bucket attachment on to
the machine. For the start current (0%) set point for the booms lifting action, the process is done
by setting a start current low enough to not cause any response from the machine. This while
still being within the range of acceptable currents which the calibrated set point is required to be
located within for the valve to be deemed fully operational. The current is then tested and the
hydraulic pressure after the main valve is measured to determine if there is any actual response.
If there is no response, the machine is left to settle for a few seconds before the current is raised
and tested again. This whole process is then repeated until the desired pressure is met. For the
end current (100%), the process differs, but still also depend on the approach of manual testing.
Two currents are first measured, one high enough to be certain that the valve is fully open, and
one lower than the first one but still higher than the previously set start current. A line between
the points is then calculated and used to estimate the actual end current. If this current does
not fall within the requirements, parts of this process will also be repeated. For setting the start
current for lowering the boom, the process is similar to lifting, where it is gradually increased until
a satisfying result is found. However, for the end current, the process is quite different, mainly due
to two reasons. The first one is due to gravity, where a fully open valve could lead to speeds too
high for the machine to operate ideally, thus requiring restrictions. The second reason is due to
something called the float function and the design of the valves in the machine. The float function
is a way that allows the operator of the machine to cause the boom and bucket to fall to the
ground and lay there. This can then be used by the operator to scrape or even out the ground
while operating the machine in reverse. To achieve this, the machine de-pressurises the cylinder
by fully opening both cylinder ports to the tank while also connecting the pressure intake directly
to the tank. This is a special state of the machine and is achieved with the special design of the
main valves. By applying extra pressure to the valve, which is done by increasing the current
above the end current thus trying to open the valve more than maximum, this state is activated.
It is only possible to achieve for the lowering action of the boom, and therefore impose problems
on the actions calibration process. The process that aims to find the end current uses a current
that is high enough to ensure that the valve is fully open. This action can accidentally activate
the float function of the machine, causing irregular and faulty data, while negatively impacting
safety. Another method is therefore constructed in order to calibrate the end current for the boom
lowering action. This action greatly depends on the need for a bucket or equally heavy attachment
to be connected to the boom and focuses on measuring the speed of the action. The boom is fully
raised with its attachment locked, before being lowered at a constant current. The speed of the
16
Mälardalen University Master Thesis
boom is measured and compared to an ideal speed. Depending on the result, the process might be
repeated multiple times after increasing or decreasing the current. The tilting in and out set point
calibration of the boom however follows the exact same process as the lifting calibration, where
the start current is gradually increased and the end current is calculated and tested.
Current
Figure 12: Behaviour of the machine speed with regards to current.
A way to automate or remove the need of this process is therefore of interest as an approach to
reduce cost and increase manoeuvrability. The current solution, while able to produce an adequate
controllability of the complete machine behaviour, fails to further improve the control within the
actual machine response range. The machine behaviour is non-linear which in turn can cause
unwanted behaviour during operation. This non-linear nature of a machine’s speed in regards to
the current can bee seen in Figure 12, where the data is collected from the lifting action of one
wheel loader. Some interesting details can be recognised from this picture, the first one is the
non-linearity of the system, where the increased of current does not increase the speed in a linear
fashion. Another interesting aspect is related to the physical limitation of the system where after
a certain current, any further increase would not translate into an additional rise in speed. This is
an important section of the curve since it represents the ideal location to set the end current. It is
worth noting that the behaviour in Figure 12 does not start at zero current.
Having the automatic calibration performed and located on target hardware will introduce
additional problems, mainly regarding the embedded system nature. The calibration method will
need to exist on hardware alongside multiple software applications which all requires to collabo-
rate and share computing resources. Another limitation is presented in the solutions that require
designated hardware. Lastly the automatic calibration method will need to be effective. Auto-
matic calibration should ideally perform both better and faster than existing manual methods for
calibration in order to potentially replace current methods and increase their availability.
17
Mälardalen University Master Thesis
RQ1: What methods for automatic calibration of hydraulics are available and applicable to con-
struction equipment vehicles?
RQ2: How do methods for automatic hydraulic calibration perform at controlling hydraulics in con-
struction equipment vehicles?
18
Mälardalen University Master Thesis
4 Related Work
The thesis highly values the research written in areas closely related to the control and identification
of hydraulic systems. The following subsections will present the current techniques in use for the
control of a hydraulic system, where Section 4.1 describes an ANN based solution and Section
4.2 describes PID based techniques. Both approaches represent a great interest for this thesis,
since the proposed methods are inspired from the solutions derived from such papers. Section 4.3
explores approaches based on the Recursive Least Square method for identification of hydraulic
systems, while Section 4.4 describe other work in the field of hydraulic control.
19
Mälardalen University Master Thesis
investigates the optimisation process behind the search of improved PID parameters which was
realised by the application of a Genetic Algorithm approach. The entire procedure is tested with
the use of Simulink and the results of these tests demonstrate that the optimised PID is able to
improve the performance of the hydraulic-servo system.
Liu and Daley [24] adopt an optimal tuning strategy to improve the performance of a non-
linear PID. By the use of the inverse model of the control dead-zone and a non-linear compensator,
they were able to remove the occurrence of unexpected overshoot, big steady-state error and long
settling times for closed-loop hydraulic systems. This solution was able to successfully improve the
hydraulic control system in their experiments.
Liu investigated a self tuning approach for improving PI controllers used to operate induction
motors [25]. By using a gradient descent optimization approach to the parameter space, the PI
controller’s constant were able to be tuned online. This approach allows the system to better adapt
to the highly non-linear behaviour of such system. Several other automated tuning procedures have
been investigated in the literature [26–31].
Zheng et al. [32] demonstrated the performances and higher control precision obtained in the
position servo control, compared to a conventional PID controller. This online adaptive tuning
PID controller is realised by the use of fuzzy logic and its ability to solve the contradiction between
response, frequency and overshoot for improving the control accuracy is investigate in this research.
Another research in the field of self-tuning PID has been presented by Çetin and Akkaya [33]. In
this article the authors analysed a Hybrid Fuzzy PID Controller with Coupled Rules (HFPIDCR)
for position control of the hydraulic system. The evaluation, performed by simulations, is compared
with the performance of a classic PID and a Fuzzy Logic Controller (FLC). The results of this
study demonstrate that HFPIDCR is more effective than the other controllers compared, where
its rise and settling time are shorter.
20
Mälardalen University Master Thesis
Kadissi et al. [38] investigate a control strategy based on a robust non-linear strategy called
backstepping for identification and real time control of an electrohydraulic servo system. Electro-
hydraulic systems are known to be highly non-linear and for this reason the authors based their
identification on the recursive least square technique. The experimental results are evaluated by
comparison with a real-time classic PID controller.
21
Mälardalen University Master Thesis
5 Methodology
One of the most important qualities of science, according to Dodig-Crnkovic [42], is the continuous
re-examination and self-correction process it is subject to. This highlights the recursive nature
of the logic of science and the scientific method, which is based on a set of rules defining the
way to pose questions and formulating successful hypotheses. This entire procedure is achieved
through logical reasoning, observations and experiments, creating a very impartial process based
on replicability, where everyone is able to replicate a test under the same conditions and determine
if certain results are valid or not.
Considering that computer science has roots in multiple scientific fields, allows this process’
applicability. The mathematical roots gives it a more logical imprint, while other roots could give
it a more empirical one. Embedded systems is one branch of computer science where this dualism
between logical and empirical approach is applied.
For these reasons, this thesis will be based on an iterative process which will perform according
to the schema depicted in Figure 13, where the first step is represented by a study of the current
and existing system solutions. This step intends to provide an understanding of the calibration
process and allows for the extraction of metrics and methods for evaluation. The following four
steps are part of an iterative process, where solutions will be constantly explored, discovered and
evaluated. Exploration of existing methods, models and tools on the market is conducted to get
an extensive view of possible problem solutions. Solutions that are unsuited for the task will be
excluded and the exploration step will repeat.
A selection is done based on the results reported on the researched literature analysed during the
exploration phase. If a method seem promising the selected method is implemented as a Matlab
Simulink model in order to be evaluated. The evaluation step will give a direction to follow
according to its results, where the implemented method could be discarded and the procedure will
fall back into the “Select methods for further testing” step. On the other hand if it turn out to be
suitable for a possible implementation in a real machine, it will move forward in progress. Before
reaching the final comparison, all the implemented methods suited for a real machine application
must be evaluated in order to provide metrics for the final step.
The objective of this iterative process is the ability of changing direction during each step of the
research. Basing the progression on the results from the previous steps, allowing a more flexible
approach capable of giving a good direction from the early stages. Another important benefit of
this continuous approach is represented by the ease of fixing possible unsuitable approaches.
Explore existing
Implementation of
Study existing methods, models Select methods for
methods for
calibration solution and tools on the further testing
simulation
market
Evaluate simulation
Implementation of
Comparison of Evaluate real world methods for real Comparison of
methods implementation hardware simulated methods
(Proof of concept)
22
Mälardalen University Master Thesis
The methods will be evaluated in simulation and real world tests performed on real machines.
The methods will be evaluated on their ability to confirm to a predetermined set of actions with
regards to the error between the desired and actual response. The methods are then to be compared
to each other as well as a baseline which will be the existing method explained in Section 3. An
identical evaluation will be performed for the real machine testing, where a similar control signal
will be used instead of lever movement in order to provide more accurate results.
The method will be evaluated looking at the absolute average error they produce for the pre-
determined control sequence and by studying the machines behaviour.
23
Mälardalen University Master Thesis
is the vector with our set of basis functions. We can express the function approximated by our
NLPN as
XN
fW (x) = WT Φ(x) =
T
W i φi (x)
i=1
n m
where x ∈ R is our input vector and fW (x) ∈ R is the output.
Ф1
X1 [W1]
f1(x)
Ф2
X2
X
fm(x)
[Wm]
Xn
ФN
For more details regarding the described theory consult Opdenbosch dissertation [14].
24
Mälardalen University Master Thesis
to a 1-dimensional output is illustrated in Figure 15. This implementation allows the user to select
three different types of basis functions used for the approximation, a Triangular, Gaussian and a
Hyperbolic function.
Approximation x1
f(x)
Constant sigma
PHI_V
W
NLPN 1D to 1D
uT
phi(k)
W(k)
e(k)
RLS
Desired
The NLPN block of this design takes three inputs: an input vector, a constant sigma and a
matrix of weights. Sigma is used only in the case the Gaussian or the Hyperbolic basis functions are
chosen. This parameter is not applied in the case a Triangular basis function is used. The output
of this NLPN block consists of a scalar, representing the approximation of the desired function
and a vector of basis function, which are then used to compute the weights. Weights are computed
with a Recursive Least Square (RLS) block according to the error, computed as the difference
between the desired output and the approximation generated by the output from the NLPN. Once
adjusted, these weights are then passed back to the NLPN to improve the approximation. This
follows the iterative process that characterise a NN, where the predicted output is continuously
adjusted according to the learning process, represented by the RLS in this specific design.
6.3 Motivation
This particular method has been chosen for its flexibility. In fact the main advantage of using
basis functions, which are the main component of an NLPN, is the ability to arbitrarily select
a precision for the approximation. In addition to this, a good selection of basis functions are
capable of approximating even non-linear functions, which is a advantage for the scope of this
thesis. In addition to the aforementioned advantage, this design is simple to be extended to higher
dimensions, where multiple factors, such as pressure and load of the system, can be taken in
consideration. The NLPN is not consider a deep network, and for this reason the computation
required for the training is less than other NN based approaches.
25
Mälardalen University Master Thesis
26
Mälardalen University Master Thesis
method was evaluated alongside the spline function, but produced similar results in the area with
extensive data points. The PCHIP method was thus chosen due to its increased linear behaviour
and reduced overshoot [45].
The dynamics of the plant appear as the time it takes for the system to respond to the command,
not to be confused with the delay of the system which represents the time for the system to receive
an action. The dynamics of the plant were realised with the use of a transfer function constructed
from real data as well as expert knowledge where the settling time is a given number. The delay
was included as a transport delay block based on expertise knowledge. The real data was acquired
from a Volvo machine by raising the GET from fully down position to high position with the engine
being in an idle state. In the end, the complete structure of the plant is realised in Figure 16.
27
Mälardalen University Master Thesis
enforced and left for the PI controller. The tuning of the PI is sub-optimal and done following a
trial and error approach. The same PI design is used for all the implementations that makes use of
a PI controller. The lifting PI is saturated at the maximum current the valve can handle. for the
lowering PI is saturated at a current that is low enough to avoid activating the machines floating
function. The anti-windup method ”clamping” is also activated and the complete implementation
is done in discrete time in the Simulink PID block.
yend − ystart
y =m·x+k (3) m= (4)
xend − xstart
y−k
k = ystart − m · xstart (5) x= (6)
m
Figure 17: PID with a static inverse model for controlling one action.
28
Mälardalen University Master Thesis
Algorithm 1 Pseudo code of function for finding a current capable of producing the desired speed.
1: procedure Find Roots(Polynomial, Speed)
Polynomial - List of coefficients for the polynomial
Speed - Reference speed of which to find a current to achieve
2: let f = Polynomial − Speed
3: let r be a vector containing the roots of f
4: Remove any imaginary roots ri from r
5: Remove any roots rk from r where
rk > M axCurrent OR rk < M inCurrent
6: if |r| > 0 then
7: let Current be the smallest root in r
8: else
9: let Current be 0
10: end if
11: return Current
12: end procedure
29
Mälardalen University Master Thesis
Speed
Weights Learning NLPN
Current
Weights
NLPN responsible for learning
Controlling NLPN Current
the inverse model
Speed
Figure 18: PID with a learning inverse model for controlling one action.
which allows the nodal grid to be fully utilised. This is different from the method explained in
Section 7.6, where the NLPN uses the speed as an input. This design enables the removal of
one unknown, namely the size of the neural network input space. Previous design requires the
input space for the lifting neural network to be large enough to encompass the behaviour of all
machines, thus resulting in possible overestimation. This overestimation causes a trade off between
performance and accuracy in the form of the amount of nodal points. By bounding the input space,
it is possible to accurately place the input space in an area that is exercised, thus removing the
need for a trade off.
The NLPN design has another change that differs it from other methods, which is the saturation
error block shown in Figure 19. In the case of the user applying maximum command, the controller
should supply the minimum current necessary to fully open the valve. However, due to ambiguity
in the machine behaviour, where every current over the end current will produce the same speed,
the network can end up learning a model well outside the allowed saturation range. The error
calculation over this saturation block is there to prevent this and enforce a more accurate model.
Command
NLPN Current
Error
Lever Signal Command
Speed Control Speed Saturation
Learning NLPN Current Plant Speed
MaxSpeed Control Strategy
Lever to operate the system
Speed Control responsible for Calculate Error Wheel loader system
converting signal to reference speed
Saturation Error
MaxSpeed Max Speed Speed
Figure 19: NLPN responsible for learning and controlling one hydraulic action.
30
Mälardalen University Master Thesis
8 Evaluation
In order to evaluate the methods, simulations and real target tests were initially considered to be
used. However, real target evaluation was deemed unable to be completed in time and therefore cut
out of the scope of this thesis and is instead moved to future work. The evaluation was supposed
to be conducted on a real-time target computer called Speedgoat, a rapid prototyping hardware
connected to the ECU of the machine to be tested. Signals are then received from the lever of the
machine, calculated on the Speedgoat and transferred back to the ECU in order to send the proper
current to the valves. Communication between these components suffered from major delays and
the source of this issue was not discovered, leading this type of evaluation as a future work. For
this reason the focus is shifted on a simulated approach.
The evaluation of the methods in simulation was done in the Matlab Simulink environment
and used a predetermined command signal which is shown in Figure 20. A real command signal was
not available during the evaluation phase, creating the necessity of constructing a signal instead.
This constructed command signal is exclusively used for the methods evaluation. This analysis was
performed on data sets from three different machines of the same model, which will be known as
machine A, B and C, and is done in order to evaluate how well the solutions perform on different
machines. In order to simulate a different machine, the simulation is changed by replacing the
current to speed function inside the plant to the one unique to the machine. The plant still uses
the same transfer function and delay block, but only changes the function of which the pchip block
process, see Figure 16.
This section focuses on the different solutions and their evaluations. Tables compiling and
displaying the actual data are available in Appendix A.
Evaluation Command
100
90
80
70
Command %
60
50
40
30
20
10
0
0 100 200 300 400 500 600 700 800 900 1000
Time (seconds)
In order to set a baseline, the existing method is firstly evaluated and the results are shown
in Figure 21. This method makes use of a manually calibrated set of start and end points for
each machine. The existing method is able to produce good response in the higher commands
for Machine A and C, and does not produce any spikes in response for either action, excluding
the error caused by the dynamics of the system being unable to provide an instant transition in
speed. The method is however unable to produce the desired speeds in the middle to low command
ranges, and continues this trend through both lifting and lowering actions.
Evaluation of the second method, namely the method using a PI + Line Inverse model, is able
to produce promising results as shown in Figure 22. The method is able to produce better results
in regard to error as compared to the baseline. It is able to produce good responsiveness for the
higher commands and extends that responsiveness to the middle ranges as well with an additional
31
Mälardalen University Master Thesis
A; Lift - Existing Method - AVG Error: 33.1983 A; Lower - Existing Method - AVG Error: 64.5314
Speed mrad/s
Speed mrad/s
Machine Behaviour Machine Behaviour
Reference Speed Reference Speed
Error Error
Moving Average Moving Average
0 100 200 300 400 500 600 700 800 900 1000 0 100 200 300 400 500 600 700 800 900 1000
Time (seconds) Time (seconds)
B; Lift - Existing Method - AVG Error: 32.6962 B; Lower - Existing Method - AVG Error: 95.366
Speed mrad/s
Speed mrad/s
C; Lift - Existing Method - AVG Error: 25.8646 C; Lower - Existing Method - AVG Error: 66.3285
Speed mrad/s
Speed mrad/s
32
Mälardalen University Master Thesis
decent response for the lower ranges. The method is able to produce similar results for both actions
and produced few spikes. Lifting does produce an interesting response at 600 seconds where the
command signal has some aggressive discrepancies.
Looking at the plot for lifting it is also possible to see how the machine is able to increase its
maximum speed close to 80 seconds into execution. As mentioned in Section 7.1, this response
is not available in the lowering command, and due to manually setting the input range is neither
present in the existing method.
A; Lift - PI + Reference Line - AVG Error: 9.1187 A; Lower - PI + Reference Line - AVG Error: 9.6724
Speed mrad/s
Speed mrad/s
Machine Behaviour Machine Behaviour
Reference Speed Reference Speed
Error Error
Moving Average Moving Average
0 100 200 300 400 500 600 700 800 900 1000 0 100 200 300 400 500 600 700 800 900 1000
Time (seconds) Time (seconds)
B; Lift - PI + Reference Line - AVG Error: 8.4257 B; Lower - PI + Reference Line - AVG Error: 10.7261
Speed mrad/s
Speed mrad/s
C; Lift - PI + Reference Line - AVG Error: 9.3145 C; Lower - PI + Reference Line - AVG Error: 10.406
Speed mrad/s
Speed mrad/s
Proceeding to the other method using a static inverse model, i.e. the method using a PI + Curve
Inverse model with results shown in Figure 23. The plots again show results of better control as
compared to the baseline. The method produces almost similar results to the PI + Line Inverse
model method for the lowering action, but does however seem to perform worse when considering
lifting. Spikes are also few, but still more present than previous methods. The discrepancy at 600
33
Mälardalen University Master Thesis
seconds is also more apparent in this method compared to the previous one.
A; Lift - PI + Reference Curve - AVG Error: 15.3165 A; Lower - PI + Reference Curve - AVG Error: 9.5631
Speed mrad/s
Speed mrad/s
Machine Behaviour Machine Behaviour
Reference Speed Reference Speed
Error Error
Moving Average Moving Average
0 100 200 300 400 500 600 700 800 900 1000 0 100 200 300 400 500 600 700 800 900 1000
Time (seconds) Time (seconds)
B; Lift - PI + Reference Curve - AVG Error: 12.9822 B; Lower - PI + Reference Curve - AVG Error: 10.7321
Speed mrad/s
Speed mrad/s
C; Lift - PI + Reference Curve - AVG Error: 15.3585 C; Lower - PI + Reference Curve - AVG Error: 10.7508
Speed mrad/s
Speed mrad/s
The fourth method is the first adaptive one, the PI + Adaptive Inverse method and displays
the plots in Figure 24 for the first iteration and Figure 25 for the second. This method is able to
produce the overall best result across all machines for lifting, with few spikes and a low average
error. The lowering action however does not perform as well, where major spikes are present in
the results. The method was able to produce good results even on the first run of the evaluation
command, but was still able to improve these results for its second attempt. The second attempt
resets everything except the inverse model, resulting in the same rise in maximum speed for both
executions. The lowering action was still more prone to error with the presence of spikes that
diminished the results.
Lastly, the results from the approach exclusively based on the NLPN method were quite inter-
esting, seen in Figures 26 and 27 for run one and two respectively. In the initial phase of lifting, the
34
Mälardalen University Master Thesis
A-RUN1; Lift - PI + Adaptive Inverse - AVG Error: 6.9091 A-RUN1; Lower - PI + Adaptive Inverse - AVG Error: 22.4813
Speed mrad/s
Speed mrad/s
Machine Behaviour Machine Behaviour
Reference Speed Reference Speed
Error Error
Moving Average Moving Average
0 100 200 300 400 500 600 700 800 900 1000 0 100 200 300 400 500 600 700 800 900 1000
Time (seconds) Time (seconds)
B-RUN1; Lift - PI + Adaptive Inverse - AVG Error: 7.9112 B-RUN1; Lower - PI + Adaptive Inverse - AVG Error: 20.3108
Speed mrad/s
Speed mrad/s
C-RUN1; Lift - PI + Adaptive Inverse - AVG Error: 7.344 C-RUN1; Lower - PI + Adaptive Inverse - AVG Error: 22.7646
Speed mrad/s
Speed mrad/s
35
Mälardalen University Master Thesis
A-RUN2; Lift - PI + Adaptive Inverse - AVG Error: 6.8233 A-RUN2; Lower - PI + Adaptive Inverse - AVG Error: 22.5498
Speed mrad/s
Speed mrad/s
Machine Behaviour Machine Behaviour
Reference Speed Reference Speed
Error Error
Moving Average Moving Average
0 100 200 300 400 500 600 700 800 900 1000 0 100 200 300 400 500 600 700 800 900 1000
Time (seconds) Time (seconds)
B-RUN2; Lift - PI + Adaptive Inverse - AVG Error: 7.8158 B-RUN2; Lower - PI + Adaptive Inverse - AVG Error: 19.4521
Speed mrad/s
Speed mrad/s
C-RUN2; Lift - PI + Adaptive Inverse - AVG Error: 7.3017 C-RUN2; Lower - PI + Adaptive Inverse - AVG Error: 22.8229
Speed mrad/s
Speed mrad/s
36
Mälardalen University Master Thesis
method produced an oscillatory behaviour while also having difficulties increasing the maximum
speed as fast as previous methods. The NLPN also produced various aggressive spikes and ended
up unable to fully utilise the speed of the machine towards the second half of the execution for
both runs. For the lowering action, the NLPN method was able to produce much better results
with less noticeable spikes compared to the results for the lifting actions.
A-RUN1; Lift - NLPN - AVG Error: 37.5043 A-RUN1; Lower - NLPN - AVG Error: 17.3899
Speed mrad/s
Speed mrad/s
Machine Behaviour Machine Behaviour
Reference Speed Reference Speed
Error Error
Moving Average Moving Average
0 100 200 300 400 500 600 700 800 900 1000 0 100 200 300 400 500 600 700 800 900 1000
Time (seconds) Time (seconds)
B-RUN1; Lift - NLPN - AVG Error: 29.9326 B-RUN1; Lower - NLPN - AVG Error: 18.559
Speed mrad/s
Speed mrad/s
C-RUN1; Lift - NLPN - AVG Error: 44.6342 C-RUN1; Lower - NLPN - AVG Error: 17.5383
Speed mrad/s
Speed mrad/s
Figures 28 and 29 display bar plots of the average error for every method and every machine
exercising each action compared to the baseline or “Existing Method”. The figures display each
machines response to that action where the line at 1 represents the baseline and the values above
the bars is their value rounded to 1 decimal. It is seen that for lifting, all methods except the NLPN
one were able to produce a lower average error than the baseline. The most effective method for
lifting was evaluated to be the PI controller with the adaptive inverse function, resulting in an
average error of roughly five times less than the baseline during its second execution. The PI
37
Mälardalen University Master Thesis
A-RUN2; Lift - NLPN - AVG Error: 37.8551 A-RUN2; Lower - NLPN - AVG Error: 18.1794
Speed mrad/s
Speed mrad/s
Machine Behaviour Machine Behaviour
Reference Speed Reference Speed
Error Error
Moving Average Moving Average
0 100 200 300 400 500 600 700 800 900 1000 0 100 200 300 400 500 600 700 800 900 1000
Time (seconds) Time (seconds)
B-RUN2; Lift - NLPN - AVG Error: 31.4031 B-RUN2; Lower - NLPN - AVG Error: 19.383
Speed mrad/s
Speed mrad/s
C-RUN2; Lift - NLPN - AVG Error: 38.9687 C-RUN2; Lower - NLPN - AVG Error: 18.3111
Speed mrad/s
Speed mrad/s
38
Mälardalen University Master Thesis
controller and reference line inverse was a second, with 0.3 times the error of the baseline, followed
by the PI and Curve Inverse model and lastly the NLPN.
1.7
Lifting Action Error
1.5
1.5
Machine A
Machine B
Machine C 1.3
Method Average 1.2
1.1 1.1
Error relative to baseline
1.0
1
0.9
0.8
0.6
0.6 0.6
0.5 0.5
0.5
0.5
0.4
0.3
0.3 0.3 0.3 0.3 0.3
0.2 0.2 0.2 0.2
0.2 0.2
0.0
Methods
Figure 28: Lifting results of the evaluated methods compared to the baseline.
The lowering action, seen in Figure 29, shows that all methods were able to produce a lower
average error than the baseline, where all methods produced at least about one third of that error.
The PI + Line Inverse method and Curve Inverse method resulted in about half the error compared
to the PI + Adaptive Inverse method, which was the most effective method for the lifting action.
The NLPN was able to produce far better results for lowering than lifting and was no longer the
worst method for the action. The worst method for lowering is instead the otherwise best method
for lifting, the PI + Adaptive Inverse with an average error of 0.3 times less than the baseline
during its second execution. The method which achieved the best results for lowering was the PI
+ Line Inverse model method, however the difference between this method and the one utilising a
Curve Inverse model is minuscule.
The final results are displayed in the bar plot shown in Figure 30, and shows the average error
compared to the baseline for every method per action as well as an average of both actions. Looking
at this, it is apparent that the baseline is outperformed by most methods. The method utilising a
PI + Line Inverse model was able to provide the best results, with a combined average error of 0.2
times the baseline. The PI + Curve Inverse model and the method utilising an Adaptive Inverse
model are not far away, both with a rounded error of 0.3 times less than the baseline.
39
Mälardalen University Master Thesis
Machine A
Machine B
Machine C
Method Average
Error relative to baseline
1.0
0.5
Methods
Figure 29: Lowering results of the evaluated methods compared to the baseline.
Lifting
Lowring
Average 1.3
1.2
Error relative to baseline
1.0
0.7 0.7
0.6
0.5
0.5
0.4
Methods
Figure 30: Lowering results of the evaluated methods compared to the baseline.
40
Mälardalen University Master Thesis
9 Threats to Validity
The thesis made use of a data set to represent the machines which did not contain a complete
mapping of the machine’s current to speed behaviour. Due to the incomplete data set, a regression
analysis was used in order to estimate this data. The estimated version of the behaviour was used
as there still would be discrepancies between all the machines individual behaviour.
The dynamics of the plant were also not perfectly modelled in simulation and were instead
simplified for ease of use. The model was constructed from data retrieved from the lowering and
lifting actions of a similar machine used in the evaluations and the transfer function representing
the dynamics was then constructed by the use of expertise knowledge. The dynamics does not take
into account gravity, current angle or weight of the boom nor the current pressure in the hydraulic
system. The dynamics are neither unique to every machine.
The real target machine testing considered in this thesis was not completed in the end which
makes any concrete statements or conclusions inappropriate as they would be based on simplified
simulations. Additionally, the evaluation methods used, being the average of the error and eval-
uation of the resulting plots, are not able to provide a complete answer. The metrics should be
expanded upon with examples such as rise time and settling time.
The evaluation was only conducted on three machines of the same model. Further investigations
should be performed in order to produce more conclusive results.
Due to the lack of expertise knowledge and MATLAB being unable to automatically tune the
PI-controller, a sub-optimal method was used. The tuning of the PI controller could greatly affect
the affiliated methods, and should therefore be mentioned. Currently the same settings for the PI
controller are used in all evaluations in order to provide a fair comparison between the methods.
41
Mälardalen University Master Thesis
10 Discussion
This section presents a discussion of the results retrieved during the evaluation. The discussion
will focus on the results achieved by evaluating the methods simulations. Methods that are able to
control electro-hydraulic systems without the need of any individual calibration were investigated
and compared to each other as well as the baseline of using the existing individual calibration and
interpolation method. The methods were able to provide interesting results, some less stable than
others, but overall were able to construct a footing to base any future work upon.
42
Mälardalen University Master Thesis
The lowering action was however not able to produce as promising results. The plots of the
method as seen in Figure 24 and the second run of the method in Figures 25 show that the method
was producing some spikes during the lowering action. This behaviour was present in the tests
performed on all three machines, and a reason for this is still not confirmed. It is believed that the
initial learning was done on a machine with behaviour too drastic or perhaps stopped in the middle
of adapting to the plants dynamics which ended up biasing the initial inverse model. Letting the
method continue executing for longer might improve these results, however for this thesis, only two
runs were considered and longer and more thorough testing is left as future work. Additionally,
looking into extending the inverse model to better learn any plant dynamics might also improve
these results.
10.4 NLPN
The NLPN solutions makes use only of a Neural Network approach for controlling the plant. The
initial control model is again pre-trained, similarly to the PI + Adaptive Inverse model, using a
machine outside the evaluated machines. The plots of the first run, presented in Figure 26, show
an initial learning phase of the machine between 0 and 200 seconds where jagged results are present
in the behaviour.
The lifting action of the NLPN did produce some troublesome results, where looking at the
behaviour for Machine C’s first run, the method managed to produce quite a large spike of error
as compared to other machines and actions. The lifting action was also unable to fully utilise the
maximum speed of the plant by the end of the evaluation where it kept producing results lower
than demanded. Additionally the method was unable to produce a lower average error than the
baseline, which was the only method unable to do so of the ones evaluated, as seen in Figure 30.
The second run of the lifting action, seen in Figure 27, did not drastically improve the results and
was still unable to outperform the baseline. It did however remove the extensive spike of error
previously experienced by Machine C, while the average error managed to increase for Machine A
and B.
The lowering action’s results were much more promising. The spikes of error were fewer and
far less aggressive, and the average error was drastically better than the baseline. The difference
between the two runs were more impactful than for the lifting action. Instead of the machines
receiving a decrease in average error compared to the first run, all machines received a slight
increase.
Looking at the plots for this method regarding all machines and actions, it is also shown that
the method managed to produce some interesting results towards the end of the execution. The
error is quite high while the behaviour of the plant is at 0 speed. This indicates that the NLPN
was trying to apply a negative current and was instead receiving this error from the saturation
block shown in Figure 19. This block was used to prevent the plant from receiving illegal values,
being negative or too high currents which could damage the components. Ideally this block should
always output an error of 0, but in such cases where the output of the network produces the results
presented, it will attempt to correct this.
The reason for the lowering actions superior results compared to lifting is currently unknown.
The poor results from the lifting action can emerge from various reasons, such as an incomplete
initial control model or oversimplified simulation models.
The NLPN only method was also expected to have some difficulties in this evaluation as it
attempts to learn a “look up table” kind of interpretation of the control model. This makes it
difficult for the method to take into account any dynamics of the plant and its previous states
when trying to learn what command results in what speed. This leaves the NLPN lacking in
areas regarding dynamics as compared to the other methods, where the PI controller is able to
better handle such changes. Further extending the method to account for such dynamics should
be considered if attempting such a solution in any future work.
43
Mälardalen University Master Thesis
completely confirmed nor denied to be either good or bad and do need to be further evaluated.
Various choices made during implementation were grounded in the time needed to understand and
implement them and thus sub-optimal solutions were used. The tuning of the PI controller is such
an example, where a more optimally tuned PI controller is necessary to completely confirm or deny
anything, the same goes for the Max Speed block.
Additionally, the simulations does not take into account any online changes to the system, such
as engine RPM, system pressure and weight on the boom. It is theorised that such changes would
completely change the behaviour of the adaptive models by causing the system to learn possibly
faulty inverse models. This would require extensive investigations in order to find ways of how to
handle such behaviour. It is expected that the static models would be better suited to handle such
models, where the reference model wont be changed and the PI controller would be able to provide
improved results.
Due to the many issues encountered and the lack of time, it was not possible to perform the
real world tests. These represent a fundamental weight in the ability to make any concrete claim
about the tested methods. What can be concluded from this work is that all methods provided
interesting results which makes them interesting to pursue with further investigation, and provides
a footing for future work.
44
Mälardalen University Master Thesis
11 Conclusion
In this thesis methods for automatic calibration and control of working hydraulics were investigated
and evaluated with the aim of removing the need for costly and manual calibrations. The research
questions this thesis aim to answer are;
RQ1: What methods for automatic calibration of hydraulics are available and applicable to con-
struction equipment vehicles?
RQ2: How do methods for automatic hydraulic calibration perform at controlling hydraulics in con-
struction equipment vehicles?
In order to answer RQ1, a literature review was performed and summarised in the related work
presented in Section 4. It was presented within literature that great focus is on learning the input-
output inverse model of the plant. Another topic of interest is seen in using the Recursive Least
Square method for achieving this, but also other method such as those using neural networks could
be found. PID controllers were also often seen in literature, where different methods of tackling
the non-linearity of the system were used.
RQ2 was unable to be completely answered as the evaluation could not be extended to cover an
accurate enough representation of the machine to be tested. This was aimed to be answered with
real target machine evaluations and the simulation results as well as their discussions in Section
8 and 10. A missing real target machine evaluation and a proper evaluation of the methods
applicability for the machine’s real environment, which includes weight on the boom, pressure in
the system, current angle of the boom and engine RPM, were not performed which makes any
concrete statements unwarranted. The thesis did however indicate that the methods evaluated
had potential, but still have room to grow.
45
Mälardalen University Master Thesis
12 Future Work
The research sparked a lot of interests to expand the scope, being ways of evaluation or control
strategies. The area of hydraulic control was tested and evaluated for the GET lifting and lowering
actions, but the other hydraulic actions or systems on a wheel loader and similar machines are not
properly investigated in this thesis. A future work could be to increase the evaluation of the control
strategies to cover tilting, steering as well as other machines such as excavators and articulated
haulers. Additionally, other and improved methods of evaluation would be investigated as well
as more accurate simulations. Methods such as rise time is worth investigating as responsiveness
is an important goal for these kind of vehicles. The simulations could also be expanded upon in
order to capture the real behaviour of the machine by not limiting the simulation to speed, but
also taking into account the current GET position in order for proper simulation of retardation,
speed and weight.
One of the most important tasks that was cut due to time constraints is the testing of the
investigated methods on the real target machine. The solutions were implemented for real target
hardware and were attempted to be tested with the use of the Speedgoat, but due to problems
in signal delays, the task had to be cut out of the scope. The real target testing is an important
task that should definitely be followed up on in any future work, since the admittedly limited
simulations might not have been able to properly display the system.
It should be worth reflecting on the direction the thesis took, which instead of trying to automate
the tedious parts of the existing solution, focused entirely towards trying to replace the existing
solution all together. In the future, methods towards improving existing solutions should be
considered more thoroughly.
Additionally, further improvements to the control strategy should be considered. Current
solutions are not perfect, where even the method deemed best still suffers from some spikes in
speed when performing drastic changes in command. Further improvements to the tuning of the
PI controller should be investigated as it might provide an additional increase in performance. The
adaptive methods are also subject to further improvements, where they currently are unable to
learn the dynamics of the plant and are thus in risk of skewing the inverse or control model of
the system. The adaptive methods could also be further improved upon by allowing additional
input data to be used for learning. Currently both implementations utilising the NLPN use only
one input being command or speed. For further increase in accuracy, additional inputs, such as
pressure, engine RPM and load weight could be considered. The pressure of the system is affected
by the RPM of the engine as well as other components. A sensor measuring these inputs could
help increase controllability by reducing overfitting where the same command produce two different
speeds due to system pressure and load weight. A possible extension of such systems could also
be investigated as a way for the machine to self diagnose the hydraulic system.
The addition of retardation is also a task that needs to be considered in the future. The
retardation helps slow down the GET when reaching the mechanical limit in order to reduce a
hard hammer action. It is important to investigate methods of keeping this same functionality
intact in order to not diminish any strength or selling points of the machines.
The Max Speed block could also be investigated and further improved upon. Current method
of realising the maximum speed is far from elegant and the method of relying on oscillations and
a moving average to increase the speed are non optimal. Methods that make use of the active
response could be investigated in order to provide more reliable results.
Lastly the use of valve position sensors should be investigated as they in theory could provide a
solution to a lot of different problems. The position sensors such as the ones explained in [47, 48],
are part of the hydraulic valves and returns a value related to the position of the spool inside
valve. This would directly translate to the opening of the valve which in turn leads to its flow
rate and the speed of the GET. These sensors are not affected by either pressure in the system,
weight on the GET nor the engine RPM and does this while providing a bounded maximum value.
These valves and their sensors are able to simplify the problem of control, but does so at a greater
financial cost. The valves were confirmed to be testable during this thesis, but due to the cost of
them, focus was instead put on solutions using existing hardware.
46
Mälardalen University Master Thesis
ACKNOWLEDGEMENTS
We would like to say our thanks to everyone who helped us during this thesis. Our thesis
supervisors Dr. Alessandro V. Papadopoulos and Dr. Saad Mubeen of the IDT department at
Mälardalen University Sweden who always offered us help and guidance whenever we were unsure.
Our supervisor Lars-Erik Larsson at Volvo CE who always answered any questions we had and
always managed to find time to help us out whenever asked. We would also like to thank Per
Verner at Volvo CE, for not only allowing us to attend the training in operating the wheel
loaders, travelling and experiencing the factory in which the machines are produced, but also the
hospitality. We would like to generally thank everyone at Volvo CE for their kindness and help
during our stay at the company. It was great fun listening to all experiences and the shared
knowledge as well as driving the machines with everyone.
A special thanks is in order for Dr. Patrick Opdenbosch, who so kindly offered us finished
implementation as well as guidance which were of great help in the process of this thesis.
Finally we would like to thank our families and friends for the support.
47
Mälardalen University Master Thesis
References
[1] S. H. Park, K. Alam, Y. M. Jeong, C. D. Lee, and S. Y. Yang, “Modeling and simulation of
hydraulic system for a wheel loader using AMESim,” 2009 Iccas-Sice, pp. 2991–2996, 2009.
[2] M. Cobo, R. Ingram, and S. Cetinkunt, “Modeling, identification, and real-time control of
bucket hydraulic system for a wheel type loader earth moving equipment,” Mechatronics,
vol. 8, no. 8, pp. 863–885, 1998.
[3] S. Sarata, Y. Weeramhaeng, and T. Tsubouchi, “Approach path generation to scooping po-
sition for wheel loader,” in Proceedings - IEEE International Conference on Robotics and
Automation, 2005.
[4] Press Release, “Building the world we want to live in: Volvo Construction Equipment unveils
futuristic innovations to drive sustainability and change,” https://www.volvoce.com/global/
en/news-and-events/news-and-press-releases/2016/building-the-world-we-want-to-live-in/,
2016, [Online; Accessed 15 March - 2018].
[5] Press Information, “EX2: Prototype electric excavators,” https://www.volvoce.com/global/
en/this-is-volvo-ce/what-we-believe-in/innovation/prototype-electric-excavator/, 2017, [On-
line; Accessed 3 May - 2018].
[6] Press Information, “Volvo CE unveils 100% electric compact excavator prototype,” https:
//www.volvoce.com/-/media/volvoce/global/global-site/news-and-events/images/2017/
volvo-ce-unveils-ex2-prototype-at-volvo-group-innovation-summit.pdf?la=en&v=XRU2Pw,
2017, [Online; Accessed 3 May - 2018].
[7] J. Watton, Fundamentals of fluid power control. Cambridge University Press, 2009.
[8] P. Opdenbosch, “Digital Hydraulic Actuator Control Using an Electro-Hydraulic PoppetValve
(EHPVTM),” pp. 1–7, 2003.
[9] Tom M. Mitchell, Machine learning, 1st ed. McGraw-Hill Science/Engineering/Math, 1997.
[10] K. J. Åström and R. M. Murray, Feedback Systems: An Introduction for Scientists and Engi-
neers, 2008, vol. 36, no. 4.
[11] M. Araki, “PID control,” Control systems, robotics and automation 2, vol. II, pp. 1–23, 2002.
[12] D. C. Montgomery, E. A. Peck, and G. G. Vining, An Introduction to Linear Regression
Analysis, fifth edit ed. John Wiley & Sons, 2012.
[13] T. Hastie, R. Tibshirani, and J. Friedman, The Elements of Statistical Learning. Springer,
2009, vol. 27, no. 2.
[14] P. Opdenbosch, “Auto-Calibration and Control Applied To Electro-Hydraulic Valves,” Ph.D.
dissertation, Georgia Institute of Technology, 2007.
[15] P. Opdenbosch, N. Sadegh, W. Book, T. Murray, and R. Yang, “Modelling an electro-hydraulic
poppet valve,” International Journal of Fluid Power, vol. 10, no. 1, pp. 7–15, 2009.
[16] P. Opdenbosch, N. Sadegh, W. Book, and A. Enes, “Auto-calibration based control for inde-
pendent metering of hydraulic actuators,” in Proceedings - IEEE International Conference on
Robotics and Automation, 2011, pp. 153–158.
[17] P. Opdenbosch, N. Sadegh, and W. Book, “Intelligent controls for electro-hydraulic poppet
valves,” Control Engineering Practice, vol. 21, no. 6, pp. 789–796, 2013.
[18] N. Sadegh, “A Perceptron Network for Functional Identification and Control of Nonlinear
Systems,” IEEE Transactions on Neural Networks, vol. 4, no. 6, pp. 982–988, 11 1993.
[19] N. Sadegh, “A Nodal Link Perceptron Network with Applications to Control of a Nonholo-
nomic System,” IEEE Transactions on Neural Networks, vol. 6, no. 6, pp. 1516–1523, 1995.
48
Mälardalen University Master Thesis
[20] K. S. Narendra and K. Parthasarathy, “Identification and control of dynamical systems using
neural networks,” IEEE Transactions on Neural Networks, vol. 1, no. 1, pp. 4–27, 1990.
[21] P. Opdenbosch, N. Sadegh, and W. Book, “Learning Control Applied to Electro-Hydraulic
Poppet Valves,” pp. 1525–1532, 2008.
[22] J. L. Pfaff and K. A. Tabor, “Velocity based electronic control system for operating hydraulic
equipment,” May 11 2004, US Patent 6,732,512.
[23] A. A. Aly, “PID Parameters Optimization Using Genetic Algorithm Technique for Electrohy-
draulic Servo Control System,” Intelligent Control and Automation, vol. 02, no. 02, pp. 69–76,
2011.
[24] G. Liu and S. Daley, “Optimal-tuning nonlinear PID control of hydraulic systems,” Control
Engineering Practice, vol. 8, no. 9, pp. 1045–1053, 2000.
[25] Z. Liu, “Self-tuning control of electrical machines using gradient descent optimization,” Opti-
mal Control Applications and Methods, vol. 28, no. 2, pp. 77–93, 3 2007.
[26] A. O’Dwyer, Handbook of PI and PID Controller Tuning Rules. London, UK: Imperial
College Press, 2009.
[27] A. V. Papadopoulos and A. Leva, “Antiwindup-aware PI autotuning,” in Proceedings IFAC
Conference on Advances in PID Control, vol. 2. IFAC, 2012, pp. 554–559.
[28] J. Berner, T. Hägglund, and K. J. Åström, “Asymmetric relay autotuning practical features
for industrial use,” Control Engineering Practice, vol. 54, pp. 231–245, 2016.
[29] O. Arrieta, A. Visioli, and R. Vilanova, “PID autotuning for weighted servo/regulation control
operation,” Journal of Process Control, vol. 20, no. 4, pp. 472–480, 2010.
[30] A. Leva, S. Negro, and A. V. Papadopoulos, “PI/PID autotuning with contextual model
parametrisation,” Journal of Process Control, vol. 20, no. 4, pp. 452–463, 2010.
[31] A. Leva and A. V. Papadopoulos, “Disturbance rejection in autotuners: an assessment method
and a rule proposal,” in American Control Conference (ACC), Jul. 2015, pp. 2876–2881.
[32] J. m. Zheng, S. d. Zhao, and S. g. Wei, “Application of self-tuning fuzzy PID controller for
a SRM direct drive volume control hydraulic press,” Control Engineering Practice, vol. 17,
no. 12, pp. 1398–1404, 2009.
[33] Ş. Çetin and A. V. Akkaya, “Simulation and Hybrid Fuzzy-PID control for positioning of a
hydraulic system,” Nonlinear Dynamics, vol. 61, no. 3, pp. 465–476, 2010.
[34] R. Ghazali, Y. M. Sam, M. F. Rahmat, and Zulfatman, “On-line identification of an electro-
hydraulic system using recursive least square,” SCOReD2009 - Proceedings of 2009 IEEE
Student Conference on Research and Development, no. SCOReD, pp. 471–474, 2009.
[35] R. Ghazali, Y. M. Sam, M. F. Rahmat, and Zulfatman, “Open-loop and closed-loop recursive
identification of an electro-hydraulic actuator system,” 2010 IEEE Conference on Robotics,
Automation and Mechatronics, RAM 2010, vol. d, pp. 285–290, 2010.
[36] R. Ghazali, Y. M. Sam, M. F. Rahmat, K. Jusoff, and A. W. I. M. Hashim, “Self-Tuning Con-
trol Of An Electro-Hydraulic System,” International Journal on Smart Sensing and Intelligent
Systems, vol. 4, no. 2, pp. 189–204, 2011.
[37] A. R. Plummer and N. D. Vaughan, “Robust adaptive control for hydraulic servosystems,”
Journal of Dynamic Systems, Measurement, and Control, vol. 118, no. June 1996, pp. 237–244,
1996.
[38] C. Kaddissi, J.-P. Kenné, and M. Saad, “Identification and real-time control of an electrohy-
draulic servo system based on nonlinear backstepping,” Mechatronics, IEEE/ASME, vol. 12,
no. 1, pp. 12–22, 2007.
49
Mälardalen University Master Thesis
50
Mälardalen University Master Thesis
Appendix
A Actual Data
Result of average error for all methods exercising the Lift command.
Result of average error for all methods exercising the Lower command.
Result of the average for both Lifting and Lowering action by every method.
51