Professional Documents
Culture Documents
Saqlain Haider
Harpal Singh
2013
Author
Harpal Singh Saqlain Haider
Supervisors
Anders Hedlund Christer Åhlund
Ascom Network Testing AB Luleå University of Technology
www.ascom.com www.ltu.se
Preface
This Master thesis work has been done as a partial fulfilment of Master degree
in Computer Science, Electrical and Space Engineering with specialization in
the field of Mobile Systems at Luleå University of Technology, Luleå, Sweden.
The work was carried out at Terminal and Pocket Division of Ascom Network
Testing AB, Skellefteå, Sweden. Ascom Network Testing AB provide solutions
for drive testing, analysing, benchmarking and monitoring of mobile network
performance. Ascom Network Testing AB’s continuous R & D contributes with
a market share of 40 % in the field of drive testing for wireless communication
networks. Ascom develops technology for deploying, monitoring and assurance
of quality of service for broadband wireless networks.
Acknowledgement
We would like to thank our mentor and external advisor Anders Hedlund (Se-
nior Specialist User Equipment Measurements) at Ascom Network Testing AB,
Skellefteå, Sweden for his support, motivation, valuable comments and time
he invested in this project which allowed us to gain a deeper understanding in
the field of network performance measurements. We got an opportunity to go
beyond the academic and research work to make this a meaningful personal
and professional experience.
We would like to extend our gratitude to Adrain Jakobsson (Department Man-
ager R & D,Terminals & Pockets) at Ascom Network Testing AB, who provided
us a platform to conduct our research. He has been a dedicated manager with
instant response to queries. We would like to acknowledge him for allowing
us to be a part of ongoing research and development in Terminal and pocket
division.
Special thanks to Prof. Christer Åhlund (Program co-ordinator, Masters in
Mobile Systems) from Department of Computer Science, Electrical and Space
Engineering of Luleå University of Technology, Sweden for his supervision to
provide valuable comments and suggestions. He has guided us by the means
of courses offered by the division and provided a strong foundation in the
field of wireless communication. We are grateful for both our supervisors for
sparing valuable time for guidance and thesis report review with meaningful
comments.
We are grateful to our family members, close friends and colleagues from Luleå
University of Technology, for their encouragement and support. At last we
would be thankful to all employees of Ascom Network Testing AB for providing
a friendly and supportive environment throughout the research period.
Harpal Singh
Saqlain Haider
Abstract
Existing available bandwidth estimation tools were mainly designed for fixed
IP backbone networks and desktops with assumption of First In First Out(FIFO)
Principle. While LTE supports high data rates of 100 Mbps, challenge is to
adapt available bandwidth algorithms for quick and non-intrusive measure-
ments on an Android OS based device supporting different MIMO configu-
rations. This Master thesis presents real time, two way available bandwidth
measurement tool using Two Way Active Measurement Protocol (TWAMP)
for Android OS based devices to measure high speed LTE networks. The tool
performance is verified against FTP throughput measurement with effect of
variation in constant bit rate UDP cross traffic and load on the server on end-
to-end measurements. The results from emulation and tests in a commercial
LTE network show that we can achieve available bandwidth estimations on
both the uplink and downlink in real time. This opens up wide possibility to
include various existing available bandwidth techniques and tools in mobile
application to be used over a wireless link. Further, possible suggestions to
achieve better available bandwidth estimations with native application devel-
opment has been proposed.
Contents
Preface i
Acknowledgement ii
Abstract iii
1 Introduction 1
1.1 Bandwidth Related Metrics . . . . . . . . . . . . . . . . . . . . . 3
1.1.1 Capacity . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3
1.1.2 Available Bandwidth . . . . . . . . . . . . . . . . . . . . . 3
1.1.3 Bulk Transfer Capacity (BTC) and TCP throughput . . . . 4
1.2 Background . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5
1.3 Related Work . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7
1.4 Thesis Objective . . . . . . . . . . . . . . . . . . . . . . . . . . . 8
1.5 Research Methodology . . . . . . . . . . . . . . . . . . . . . . . . 9
1.6 Individual Contribution . . . . . . . . . . . . . . . . . . . . . . . 10
1.7 Report Outline . . . . . . . . . . . . . . . . . . . . . . . . . . . . 10
2 Study Review 11
2.1 Available bandwidth estimation tools and techniques . . . . . . . 11
2.1.1 Probe Gap Model . . . . . . . . . . . . . . . . . . . . . . . 11
2.1.2 Probe Rate Model . . . . . . . . . . . . . . . . . . . . . . . 14
2.1.3 Performance metrics . . . . . . . . . . . . . . . . . . . . . 16
2.2 LTE Overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . 17
2.2.1 LTE Radio Interface Architecture . . . . . . . . . . . . . . 19
2.2.2 QoS Control in LTE . . . . . . . . . . . . . . . . . . . . . . 20
2.3 Android OS . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 25
2.3.1 Android supported API’s . . . . . . . . . . . . . . . . . . . 26
2.4 Measurement errors for available bandwidth estimation . . . . . . 30
iv
Contents
4 Architecture Implementation 36
4.1 Test Bed . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 36
4.1.1 TWAMP Client: . . . . . . . . . . . . . . . . . . . . . . . . 36
4.1.2 TWAMP Server . . . . . . . . . . . . . . . . . . . . . . . . 37
4.1.3 Cross traffic generator: . . . . . . . . . . . . . . . . . . . . 37
4.1.4 Multiple client Emulator . . . . . . . . . . . . . . . . . . . 37
4.2 Evaluation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 38
5 Results 40
Bibliography 45
v
List of Figures & Tables
5.1 Available bandwidth and FTP results with cross traffic in Mbps . 40
5.2 Available bandwidth estimation with load on server . . . . . . . . 41
vi
List of Abbreviations
viii
List of Figures & Tables
ix
Chapter 1
Introduction
Long Term Evolution (LTE) also termed as 4G was introduced in 3GPP re-
lease 8 [2]. This release provides a significant development over existing 3G
UMTS/HSPA networks. The core development in LTE is the use of OFDM
based air interface and flat IP based network architecture for voice and data
traffic. Higher order modulation, larger bandwidth utilization and MIMO us-
age in LTE allows it to achieve asymmetric data rates of up to 100 Mbps
for downlink and 50 Mbps for uplink in user traffic. Support for both Time
Division Duplexing (TDD) and Frequency Division Duplexing (FDD) is pro-
vided and its usage is operator implementation specific. TDD has restrictions
for providing higher data rates due to scheduling pattern which gives prefer-
ence for FDD. Downlink radio link has been optimized for higher throughput
performance whereas the uplink is modified for better power management con-
sidering end-user device perspective.
There would be 5 billion mobile broadband subscriptions by end of year 2017 as
per predictions made by Ericsson [20] regarding the growth rate as illustrated
in figure 1.1. The growth of smart phones usage will increase from 700 million
(2011) to 3 billion (2017). As these devices gets under affordable price ranges,
we will see large penetration in its usage and subscription to mobile internet
usage. The driving force has been the development of dedicated hardware,
efficient mobile operating system and affordable prices for the smart phones
supporting high speed LTE networks.
Available bandwidth estimation is crucial for traffic engineering, QoS manage-
ment, multimedia streaming, server selection in application services, conges-
tion management and network capacity provisioning in wireless mobile net-
works. Available bandwidth measurement can be considered essential to en-
sure that the wireless mobile operators are living up to the standard of the
quality of service guaranteed by them while providing desired date rates to
the users. This can also be considered to compare the performance index of
various Telecom operators in a specific region. Various projects have been de-
veloped by time to measure the network performance metrics by looking into
various characteristics of the network. These studies involved in investigating
1
Figure 1.1: Ericsson: Traffic and Market Report June 2012
the traffic modelling and characterization in a network and the network topol-
ogy for the end-to-end measurements. These key studies had lead researchers
to adopt these defined characteristics to develop new protocols and simulation
parameters.
2
1.1. Bandwidth Related Metrics
1.1.1 Capacity
For N links in a certain end-to-end path, capacity of a path is the maximum
possible IP layer rate the path can transfer from source to receiver. The capac-
ity of the link depends on the underlying transmission technology and prop-
agation medium. The following definitions related to capacity are discussed
below and shown in figure 1.3.
Tight Link: The link with the minimum available bandwidth can be defined
as the tight link of the path. Available bandwidth is discussed in section 1.1.2.
Narrow Link: The link with minimum capacity which sets the upper bound
for the capacity of the whole network is called the narrow link of the path.
3
1.1. Bandwidth Related Metrics
4
1.2. Background
1.2 Background
Available bandwidth measurement techniques can be classified into two broad
categories. One being passive estimation and the other being active probing.
Passive estimation is done on the basic of congestion situation, packet loss and
delay performance to estimate the available bandwidth. Active probing on
the other hand sends probe packets over a network to estimate the available
bandwidth. Due to efficiency and the reliability of estimations, active probing
is usually considered. Active probing further consists of probe gap or probe rate
models.
The probe gap model generates the estimate of available bandwidth by estima-
tion of cross traffic rate in the link. Tools developed following this technique
require the previous knowledge of the capacity of the network path to be mea-
sured. The working behind this probing technique is where the sender sends
pair of packets to the receiver. The pair packets are transmitted close enough
together in time for packets to queue together at bottleneck link. Measuring
the change in packet spacing, the receiver can make an estimate of amount of
cross traffic during the measurement time in the link.
The probe rate techniques operate on a basis of self induced congestion where
this mechanism sends stream of packets where the input rate of each stream
is varied either iteratively or exponentially. Here, the available bandwidth
is defined as the lowest input rate which overloads the network. The avail-
able bandwidth estimation in probe rate model does not consider the previous
knowledge of tight link capacity in the network. Each technique under probe
rate model or probe gap model has different probing techniques, levels of in-
trusiveness and estimation time.
Active probing techniques for both probe gap and probe rate models can be
classified into two phases to provide estimates of available bandwidth of the
network. The first phase defines sending probe packets in a selected man-
ner. To measure end-to-end available bandwidth we need to inject probing
packets in to the network so that we could sample it for that specific time.
The motive behind sending probing packets in selective manner is to not add
massive additional traffic on the network to be measured and get close to the
measurement of tight link. Any probe rate higher than the tight link capacity
shows delays within the probing packets crossing through that tight link. This
5
1.2. Background
suffered delay within the probing packets assists us to calculate the available
bandwidth.
There are various probing schemes existing. Initial ones consider probe pack-
ets arranged in multiple packet pairs as shown in 1.5 . This probing sequence
is defined by two parameters. One of them is Intra pair interval defined as
D t
in and the inter Pair interval . Train Of Packet Pairs(TOPP) follows the
D
concept of different parameters of in. Thirdly is to send train of N pack-
ets with varying probe rates and gap within each consecutive probe train.
Fourthly is the usage of sequence of exponentially spaced packets defined as
"Chirps"(Figure 2.4) where the train of packets is sent with increasing probing
rate within two consecutive probing packets.
These inter packet pair time separation may be negative, positive or zero as
D D
shown in Figure 1.5. A negative value ( out < in) occurs when the first
packet gets cross traffic packets in the queue followed by the second packet
D D
whereas a positive value ( out > in) occurs when the cross traffic packets
D
gets inserted between the probing packets pair in the queue. ( out = in) D
occurs when cross traffic has no effect on the inter packet separation.
Further the second phase defines the analysis phase where the received probe
packets are analysed to estimate available bandwidth. The analysis is further
divided into 2 parts. It is either done by one way delay calculations of probe
packet train or packet dispersion of probing packets pairs. Various factors add
noise to the estimation which will be discussed later in chapter 2. To reduce
the factors adding some noise to the estimation, filters such as exponentially
weighted average, intersection filters or kalman filters have been used in some
of the tools.
Most of the available bandwidth measurement tools and techniques consider
available bandwidth measurement in one direction.To measure it on both up-
link and downlink, they need to be deployed on both of the end points with
an complex architecture with each end serving as client as well as server. As
the available bandwidth of uplink and downlink links are asymmetric, the
conventional way of sending packets in one way and then initiating a session
6
1.3. Related Work
on the other link without the knowledge of probe rate does not seem to be
a appropriate choice. This provides a complex architecture for the measure-
ment where the server also initiates a session towards the client for downlink
measurement providing a load on the server where it needs to handle various
clients.We further may need root access to the server to initiate a session. To
address this issue to analyse both the links on real time we propose a mech-
anism to estimate available bandwidth using Two Way Active Measurement
Protocol(TWAMP).
7
1.4. Thesis Objective
8
1.5. Research Methodology
Identify study related work, state of the art, gaps, open research and
development challenges: Previous studies on comparison of various tools
used in the wired and wireless network under various network scenarios was
carried out. This study is unique as it provides an insight of the usefulness of
the tool development in Android OS while focussing on the resource scheduling
& QoS of 4G networks.
9
1.6. Individual Contribution
10
Chapter 2
Study Review
Ā = C ∗ (1 − ) (2.1.1.1)
11
2.1. Available bandwidth estimation tools and techniques
e
Where C is the known capacity of the tight link, is strain and is defined as
follows:
∆out − ∆in
= (2.1.1.2)
∆in
Hence, in PGM it is assumed that the tight link is same as the narrow link i.e
bottleneck and follows FIFO model. Further PGM assumes that the capacity
of the link is known in advance so that it can further estimate the available
bandwidth. Tools such as Spruce [52] , Abing [41] and IGI [24] are based on
probe gap model.
Spruce considers Poisson technique by sending 1500-byte packet pairs as com-
pared to packet trains. This makes spruce a non-intrusive and effective method.
Considering the value of the initial gap this method ensures that the bottle-
neck queue does not become empty between the two probes in a pair. This
technique differentiates capacity measurement from the available bandwidth
measurement. Abing sends 40 back to back 1500 byte UDP packet pairs with
a determined separation of 50 ms. When these pass through the tight link,
probing packets can be separated by cross traffic in any place on this path.
Separation between the consecutive packets of the packet pair can happen even
if there is no congestion. Hence the time delays with those probing packet pairs
will be present due to the effect of the cross traffic along the path. The final
time delay between these packet pairs will have information of the amount of
cross traffic with different capacities. We can consider this as a load on the
path. Hence time delay is proportional to the load on the path. According to
this method, it consists of two components, Time delay initial (Tdinit) which
is same for all measurement and this is due to the narrow link . The other
to consider is Time delay variable(Tdvar) which reflects the queuing changes.
Hence final time delay between packet pairs may be defined as follows:-
T d = T dinit + T dvar (2.1.1.3)
Abing is similar to other probe gap model techniques, its uniqueness lies in the
12
2.1. Available bandwidth estimation tools and techniques
way it makes the estimate of cross traffic passing every link in the end-to-end
path to calculate the mean value for Td , available bandwidth and amount of
cross traffic in the path it measures.
IGI also uses the probe gap model. Two packet pair techniques were developed
by the authors to define available bandwidth. One was termed as IGI (Initial
Gap Increasing) and other defined as PTR (Packet Transmission Rate). Both
these algorithms send a sequence of packet trains to the destination with in-
crease in initial gap. The defined algorithms monitor the difference between
D D
average in and out gaps until the difference closes to zero. This is defined
as the turning point after which the narrow link gets overflown by the probing
packets. At this point IGI and PTR formula computes the available band-
width measurement. This is obtained by subtraction of estimated competing
traffic throughput from the capacity of the path measured by any capacity
estimation tool. IGI operates on finding initial probing gap (gB) where the
probing packet trains will interact with the cross traffic in the joint queuing
region as defined by the authors. gB is defined as a gap value of two back to
back probing packets on the bottleneck link.
Looking into tools based on probe gap models, initial probing packet selection
can reduce the accuracy of the tool as well as other factors such as probe packet
size selection and number of probe packets in a train. Small probing packets
can be sensitive to interference. Further sending too many packets can cause
queue overflow and packet loss. IGI suffers from accuracy in a multiple hop
environment with significant cross traffic following through the tight link. It
may also be unresponsive to variations in cross traffic flowing throwing through
the estimation path at high speeds of Gbps.
13
2.1. Available bandwidth estimation tools and techniques
TOPP technique sends stream of packet pairs with uniform increase in input
rates in each iteration. The input rate is defined by making changes in the
input gap of each pair. The available bandwidth is defined here as the esti-
mation of maximum input rate which is not larger than the measurement rate
at the destination end. TOPP makes an estimate to measure available band-
width within a fixed range [Rmin, Rmax]. TOPP mechanism sends the packet
pairs with the gradual increase in rates from the source to the destination.
D
Considering the initial dispersion s for the packet pair sent from source to
the destination with probe packet of size L bytes, the rate of pair would be as
follows:-
Ro = L/∆s (2.1.2.1)
14
2.1. Available bandwidth estimation tools and techniques
In the scenario as shown in figure 2.3 where Ro is more than the available
bandwidth, second probe packet will get queued behind the first probe packet
and thus the measurement rate at receiver would be Rm < Ro. For the scenario
Ro< A , the packet pair arrival would be at the same rate Rm = Ro.
BART [19] stands for Bandwidth Available in Real Time which estimates
end-to-end available bandwidth over a network path. BART estimates the
bandwidth quasi continuously in real time. It works on the principle of self in-
duced congestion where it sends sequence of probe packet pairs at randomised
rates and samples the available bandwidth of the network. It generates very
low probe traffic rates in a network. BART uses the concept of Kalman fil-
tering for real time estimation of available bandwidth. A current estimate is
maintained which is incrementally improved with each new inter packet time
separation calculation in a sequence of probe packet pairs. BART can be tuned
for agility vs stability of the available bandwidth estimates.
15
2.1. Available bandwidth estimation tools and techniques
here we define P as the packet size, δ as gap between the two closest packet of
the stream and Tk as instantaneous gap .
In this mechanism the instantaneous rate increases along the train of packets.
To estimate the available bandwidth we analyse the queuing delay. We see
an increase in queuing delay in case the instantaneous rate is higher than
the available bandwidth of the network path. Here we estimate the initial
instantaneous rate where we see the queuing delay. PathChirp with similarity
to Pathload uses information of relative one way delay of the probing packets.
There lies some benefits with the use of chirps in this mechanism as they use
(N-1) packets as compared to (2N-2) packets in TOPP. Further exponential
spacing within packets require only log(G2)-log(G1) packets for probing the
network over the range of [G1,G2] Mbps. PathChirp is able to capture delay
correlation information with the use of small number of probing packets which
packet pair mechanism cannot do.
16
2.2. LTE Overview
17
2.2. LTE Overview
Operators can have the benefit to transfer more data per MHz of spectrum
which allows them to have lower cost per bit. The distribution of functions for
radio access network between 3G RNC and NodeB is now simplified in LTE
with base station or evolved-NodeB (eNodeB). The eNodeB MAC sub layer is
responsible for scheduling transmission over both uplink and downlink. LTE
deploys OFDM and SC-FDMA for downlink and uplink transmission respec-
tively. OFDM allows support for both time and Frequency duplexing modes
(TDD & FDD). It relies on the rapid adaptation to channel conditions and
employs rate adaptation and hybrid soft combining techniques.
LTE architecture can be split into two parts, a radio access network and a core
network. Radio access networks is named as E-UTRAN and handles modula-
tion, compression and handover. The core network is named as Evolved Packet
Core(EPC) which looks into functions like charging and mobility management.
The EPC consists of Mobility Management Entity (MME), Serving Gateway,
Packet Data Network gateway (PDN) and Policy & Charging Rules Function
(PCRF). MME handles control plane functions which are related to subscriber
and session management. Serving Gateway is a routing node for other 3GPP
technologies and for packet flows towards E-UTRAN. PDN Gateway provides
the access to the external network and acts as a router. PCRF manages IP
Multimedia Subsystem(IMS) configuration of each subscriber and manages the
traffic flow.
18
2.2. LTE Overview
For data transmission LTE uses a frame of 10ms in length divided into 10
subframes in time domain of each 1 ms in length as shown in figure 2.5.
A subframe is divided into 2 slots in the time domain of 0.5 ms in length.
Each of this slot is divided into number of resource blocks in the slot. Each
resource block is 0.5 ms in length containing 12 sub-carriers from each of the
OFDM frequency domain. The channel bandwidth ranging from 1.25 MHz
till up to 20 MHz of LTE network defines the number of resource blocks in
symbol. The cyclic prefix being used defines the number of OFDM symbols
in a resource block. Group of resource blocks make a transport block having
common modulation/coding. To schedule transmission over an air interface
resource block is considered the main unit. Multiple UE’s can be addressed
in a single transport block where the MAC has the control of what to send
at particular time. Using OFDMA, users are allocated specific numbers of
physical resource blocks (PRBs) by the scheduler at eNodeB. Shared channel
transmission is utilized in LTE transmission scheme where the resources are
dynamically shared within the user terminals.
19
2.2. LTE Overview
responsible for scheduling of shared radio resource blocks for transmission over
the LTE air interface in both uplink and downlink channel and it also deter-
mines the data rate for each link. The data is transferred between the MAC
sub-layers in UE and eNodeB with the usage of constructed transport blocks.
Downlink and uplink shared transport channels (DL-SCH and UL-SCH) are
used for sending these transport blocks. In LTE, the scheduling decision is
possible at once very 1ms with the granularity in frequency domain being
180 kHz.Various scheduling algorithms are implemented for resource block al-
location such as Proportional Fair(PF), Maximum Throughput(MT), Round
Robin, Blind Equal Throughput (BET) or Even Resources (ER).
The downlink scheduler dynamically controls the terminal(s) to transmit to.
It controls the resource blocks upon which the user terminal’s DL-SCH should
be transmitted. The uplink scheduler dynamically controls the mobile ter-
minals who are ready to transmit on their UL-SCH and also defines which
uplink time/frequency resources are available. The uplink scheduling occurs
per mobile terminal and not per radio bearer. The channel-status reports indi-
cating the instantaneous channel quality both in time and frequency domains is
sent by mobile terminals for channel dependent scheduling typically for down-
link. A mobile terminal can also send buffer status information to eNodeB
using a MAC message to assist the uplink scheduler in decision making.The
channel-status report consists of Rank Indication (RI), Precoder Matrix Indi-
cation(PMI), Channel Quality Indication(CQI). The reporting can be either
periodic or a-periodic. Channel dependent scheduling allows to achieve gain
in system capacity.
Scheduling grants, if available to terminal forms the basis of scheduling decision
and provides the user terminal information about the resources available and
the associated transport format to use for the transmission on the UL-SCH.
Similar to the downlink scheduler, the uplink scheduler can retrieve informa-
tion regarding the buffer status, channel conditions and priorities of different
traffic flows. A scheduling request is defined as a flag raised by the terminal
for the request of uplink resources from uplink scheduler. On the reception of
the request the scheduler allots grant to the terminal. The scheduler utilizes
the following input for scheduling decision.
• QoS attributes
20
2.2. LTE Overview
It allows them to offer multiple services to the end users. Subscriber differenti-
ation allows service providers to differentiate subscribers for the same service.
It may be such as post or prepaid connections, corporate or private subscribers
and roaming services. LTE utilizes various techniques for radio resource man-
agement to maximize cell throughput while maintaining QoS and fairness for
users and the offered services. At a particular location, to analyse the QoS
experienced by the end user the measurements statistics are averaged over a
period of time. This may actually provide errors on the estimation. Drive
testing is the means of collection of data related to radio interface in different
locations of the cellular network coverage. A lot of information regarding the
signal strength, user throughput, delays due to traffic distribution and infor-
mation about call drops are analysed. Data collection can be categorized as
Instantaneous data collection and time averaged data collection. Instantaneous
data collection collects log information of throughputs values within the resolu-
tion of 1ms as for the Transmission Time Interval (TTI) providing information
for peak throughputs. Whereas these values are dependent on the resource al-
location and scheduling algorithm at the instant in the network. Hence Time
averaged data collection is based on time averaged sample values which are
smoothed for giving information for per TTI basis. These measurements for
various locations allow us to make information network maps.
Various radio measurements provide information on the QoS for the end user.
Main information is the Reference Signal Received Power (RSRP). It is essen-
tial for handover and cell selection procedure. RSRP which is a pilot mea-
surement, defined as a linear average over the power contributions (in W)
of the resource elements that carry cell-specific reference signals within the
considered measurement frequency band. Another radio measurement of user
throughput is Channel Quality Indicator (CQI) or the averaged CQI value for
the whole system bandwidth known as Wideband CQI. LTE defines 16 CQI
levels for different Modulation and Coding Schemes (MCS). WCQI can assist
us an indication for data rate supported by the system for the given channel
conditions. The bitrate per symbol rate obtainable in an LTE network depends
on the SINR for both the links. As discussed earlier CQI is signalled over the
radio interface which determines the coding rate based on modulation such as
QPSK, 16QAM, 64QAM and the amount of redundancy.
The bearer which is short for EPS bearer may be considered as the core element
of QoS in LTE. It identifies the packet flows between terminal and gateway that
receive a common QoS treatment as shown in figure 2.6. The packet filters in
terminal and gateway for uplink and downlink traffic respectively determines
the packet flows association with the bearer. Hence the packet flow which
is mapped to same bearer receives the same packet forwarding treatment(for
example, scheduling policy, queue management policy, rate shaping policy,
link layer configuration). Separate bearers are required for different packet
forwarding treatment. This allow differentiation of traffic in LTE with different
QoS requirements. The system reserves the resources according to the bearer
and associated signalling procedures before the transmission on packet flows
21
2.2. LTE Overview
over the network with the assistance of admission control function. There is one
bearer for each combination of QoS class and IP address of the user terminal
and different ones for a terminal with different Access Point Names (APN).
For an end-to-end IP system, a tunnel header is attached which contains the
bearer identification allowing the network nodes to associate the packet with
correct QoS parameters. Classification of bearers can be done as follows:
GBR vs Non GBR Bearers: We can differentiate bearers in two kinds:
Guaranteed bit rate(GBR) and non guaranteed bit rate(non-GBR). Services
utilizing GBR do not confer congestion related packet loss whereas for services
with non-GBR can experience congestion related packet loss and are realized by
the admission control function. A GBR bearer reserves transmission resources
for itself in an admission control system when established. Whereas non-GBR
does not block transmission resources and remain established for long period
of time. An operators can define services with GBR bearers to provide better
user experience.
Default versus Dedicated bearers: A bearer can also be defined as a de-
fault bearer or an dedicated bearer. When an terminal attaches to a network
it is connected via a default bearer being associated with per terminal IP ad-
dress till existence of the network connection. The default bearer is considered
as a non-GBR bearer and its associated QoS is based on subscription data.
Different Dedicated bearers are required for packet flows flowing from same
22
2.2. LTE Overview
QoS Parameters
The QoS concept in EPS is class based where each of the bearer is assigned
only one QoS Class Identifier (QCI) by the network.
QCI is pre-configured by operators and is defined as a scaler used with the
access network as a reference to the node specific parameters which control
packet forwarding treatment on user plane. QCI standardization is to ensure
that the application or services mapped to the QCI receive similar minimum
level of QoS in multi-vendor network deployment and roaming services.
Allocation and retention priority(ARP) provides control plane treatment re-
lated to the set up and retention of the bearers and decide which bearer to be
released during resource limitations.
Maximum Bit Rate(MBR)and Guaranteed Bit Rate(GBR) are defined for GBR
bearers only. MBR is the bit rate that the bearer may not exceed. Whereas
GBR is the bit rate the network guarantees using admission control function.
Set up of MBR higher than GBR is set for future releases of 3GPP.
Aggregate Maximum Bit Rate (AMBR) allows operators to limit the total
amount of bit rate consumption by the subscriber and offer differentiated sub-
scriptions. 3GPP specifies two different AMBR parameters:
• APN-AMBR: This is definition for per subscriber and APN and its
knowledge is only to the gateway
The AMBR definition is for the non-GBR bearers only and its different for
both the uplink and downlink with four definitions as UL APN-AMR, UL
terminal-AMBR. DL APN-AMR and DL terminal-AMBR.
QoS mechanism:
QoS mechanism in EPS can be defined as user plane functions or control-plane
signaling procedures.
Control-plane signalling Procedures: PCRF can issue policy and charging con-
trol (PCC) rules for the gateway. This can be used for new bearer estab-
lishment or modification of existing bearers which handles the packet flow.
UL/DL packet filters describe the packet flow.
23
2.2. LTE Overview
User Plane functions: User plane QoS functions are carried out by configura-
tion of network nodes on packet-flow-level functions, bearer-level functions or
DSCP-level functions.
24
2.3. Android OS
2.3 Android OS
Google’s Android OS has gained a high market presence which includes mid-
dleware, key applications and software stack for the mobile devices. Android
OS is based on the modified version of Linux Kernel version 2.6 which sup-
ports core systems as security, memory management, drivers, process man-
agement and network stack. Google and the other members of Open handset
Alliance [4] have collaborated for Android’s development and release where as
Android Open Source Project (AOSP) [5] is the one for maintenance an further
development of Android. Open handset alliance is a group of various hard-
ware, software and telecom companies looking into the advancement of open
standards for mobile devices. The android OS distribution was released on 5
November 2007 with the foundation of Open Handset Alliance. The Android
code was released under the Apache License, a free software and open source
license. Android OS platform can be subdivide into following 5 layers as shown
in figure 2.7:
1. Application: Some of the core applications are on the top of the frame-
work which includes such as e-mail client, SMS app, Maps application,
Web browser, Contacts etc.
25
2.3. Android OS
5. Linux Kernel: Android operates on Linux Kernel version 2.6 for the core
system services. They include memory management, process manage-
ment, network stack, security and driver model. It also acts as a hard-
ware abstraction layer between the application and all the hardware.
26
2.3. Android OS
27
2.3. Android OS
28
2.3. Android OS
Comparison and analysis for all the three sets of API with advantages and dis-
advantages with each programming model has been done [43]. Development
in SDK platform is quite easier whereas it has low performance as compared
to NDK and Renderscript. Hence it is not suitable for performance critical
applications. Whereas NDK provided better support for these kind of ap-
plications. An issue with NDK support is its portability to different kind of
microprocessor architecture such as ARM architecture or Intel based Android
devices. Renderscript on the other hand provides the best support over various
devices. Whereas looking into the memory allocation model, programming is
cumbersome and also it is difficult to port legacy code already existing. In
the SDK version the Java Thread API pool executer class is used whereas for
29
2.4. Measurement errors for available bandwidth estimation
the NDK version pthread API in bionic library is used. This improvement of
Android during multi threading can improve with dual core hardware support.
The Android NDK allows Android SDK to build programs in native code using
JNI. Hence Android NDK is an extension of Android SDK. There are advan-
tages an disadvantages to use native code in the application. It can enhance
the performance of the application whereas it may increase the complexity of
the application.
Benchmarking of the run time performance for various algorithms written in
Java and native code on real Android device has been done [36]. The experi-
ments performed shows that the native code runs up to 34.2 % times faster as
compared to algorithm which run on Dalvik VM . A majority of the Available
bandwidth estimation tools are written in C language for the Linux platform.
As Android OS is based on Linux platform, hence code reuse is possible on
the Android platform with the assistance of JNI function.
• CONTEXT SWITCHING:
Context switching can be defined as the procedure when an ongoing
process is abruptly suspended by the operating system to assign the
CPU to another process. This effect can lead to abrupt changes in the
gap time between the packets within the train. In the process of sending
a train of packets, each loop reads the system time as sending timestamp
30
2.4. Measurement errors for available bandwidth estimation
of that packet until the loop sends the whole train of packets. In case of
a context switch the time stamp for each packet will be unreliable.
• END-TO-END PATHOLOGIES:
The location of the destination end for the available bandwidth has an
important role. On a multi hop network the location and the link con-
nectivity to it has an dependency on the tight link capacity of the path.
We need to ensure that the location of the server does not become the
tight link capacity of the end-to-end network.
Along with these factors lies the errors associated to mobile network such as
fading, RSNR, scheduling & modulation profiles and resource sharing. Other
limitations possible with mobile networks can be wireless overheads, antenna
polarization & transmitting power limitations.
31
Chapter 3
Two Way Measurement
32
3.1. Two Way Active Measurement Protocol [TWAMP]
[RFC4656] [51] which is used to measure one way metrics between the network
devices. With OWAMP one can measure one way metrics in both directions
between two network devices by using it bi-directionally. By doing so it does
not accommodate two way measurements. TWAMP defines value added octets
[11] which specifies behaviours of the session sender and the session reflector.
The server and control client agree on value added octets to be used during
the network performance measurement.
33
3.2. TWAMP Implementation:
34
3.3. TWAMP Light
This allows a simplified architecture where the roles will be simply to act as
a test point over a network. The controller establishes a test session with
the server through the non-standard means. After the establishment of the
session, the controller part of the network transmits the probe test packets
towards the responder. In the TWAMP Light the session reflector does not
necessarily have the knowledge of the session state. This eliminates the need
for the TWAMP control protocol and it gets with the assumption that the
session reflector is configured and communicates its configuration with the
server through non-standard means.
35
Chapter 4
Architecture Implementation
36
4.1. Test Bed
time can be specified. The application receives the reflected train of packets
from the TWAMP server to compute the available bandwidth. The results are
displayed on a graph as well as stored in a log file. The graph displays the
values in Kbps for both uplink and downlink available bandwidth. Further
the log file generated shows the time stamp values of the transmission and
reception times of probe packets for both the session sender and reflector end.
37
4.2. Evaluation
4.2 Evaluation
PRM model has been utilized for available bandwidth estimation where we do
not consider the initial knowledge of the tight link capacity. We define the
available bandwidth as the lowest input rate which overloads the network. We
calculate from the values either from the graph values or the log file gener-
ated at the Android phone to find the turning point to estimate the available
bandwidth.
We divided the experimental measurements in two parts:
The location of the measurement device was kept constant during the experi-
ment at Ascom premises. A FTP throughput measurement was initially done
to know the user throughput values and thereafter we ran our application. The
experimentation was repeated 5 times to have an average value. Thereafter,
experiments were ran with addition of CBR UDP cross traffic using JPERF
on another computer. The computer was tethered to the mobile device so that
we could send the cross traffic on the wireless link we intend to measure.
Timestamp resolution and accuracy is a concern to measure available band-
width on an Android and Windows OS while using Java. Java does not pro-
vide support for microsecond precision. Overall both the underlying OS of
end points do not provide timestamp accuracy in microsecond range required
for available bandwidth measurements. The most suggestive and accurate
approach is to provide a reliable external clock. NTP implementation for An-
droid and Windows OS seems a suitable option. Whereas to measure available
bandwidth we do not necessarily need time synchronization within the two
38
4.2. Evaluation
ends as the available bandwidth measurement works on one way packet train
delay calculation. Rather an accurate and stable time stamping is the main
requirement. Time stamping achieves better performance if done close to ker-
nel level. Our current implementation uses NTP. We initially will present the
results with various cross traffic values and its effects on measurements. Sec-
ondly we will see how the load on the server can effect the results achieved on
the mobile device where we run the TWAMP Session.
TEMS ™ POCKET :
TEMS ™ POCKET, developed by Ascom Network Testing is an industry
leading Android OS based tool which provides solution for wireless network
testing, troubleshooting and optimization on an Android device. It supports
major wireless technologies displaying current wireless network characteristics
and look into the cell coverage and capacity. To investigate the accuracy of
our results obtained, we compare it with the FTP throughput measurement
results using TEMS ™ POCKET on both links.
39
Chapter 5
Results
Figure 5.1: Available bandwidth and FTP results with cross traffic in Mbps
The results achieved using our measurement tool does not provide information
regarding existing cross traffic in commercial network. While the experiments
were run during a particular time of the day, an assumption is made for an
existence of constant cross traffic in the network. We compare our measure-
ment tool results with FTP throughput values where the FTP results provides
achievable throughput of the network being less than the theoretical capacity
of the LTE network. It is possible to run experiments to estimate available
bandwidth in LTE networks with existing measurement tools on a computer
40
Figure 5.2: Available bandwidth estimation with load on server
tethered via LTE enabled phone or Dongle. However, as our thesis objective is
to consider the development and deployment of measurement tool for Android
OS based devices, existing tools for computers is not opted to measure avail-
able bandwidth on LTE networks. Existence of FTP sessions on the Android
device allows us to select it as a benchmarking option against our measure-
ment tool. Hence, consideration of variation in induced CBR UDP cross traffic
during available bandwidth measurements and FTP results is done to evaluate
the accuracy of our measurement tool.
Figure 5.1 shows the measurement tool performance comparison against FTP
throughput and effect of induced constant bit rate(CBR) UDP cross traffic
on end-to-end measurements. The findings show that the available bandwidth
estimates decrease linearly with the increase in injected CBR cross traffic. At
no cross traffic, we achieve 6 Mbps & 22 Mbps for available bandwidth esti-
mate and 10 Mbps & 35 Mbps for FTP throughput for uplink and downlink
respectively. FTP results show higher throughput values as compared to avail-
able bandwidth estimates by our measurement tool. Predominantly, usage of
Java for the measurement tool development restricts the tool to generate a
high probe traffic rate. Added errors to these measurements are system call
delays and NTP timestamping. NTP provides stable clock with high precision
and accuracy. However, Java Implementation of NTP does not permanently
change the system time in Android OS without root access and non-access
to socket layer timestamping. The results are however still prone to context
switching on the Android OS.
The available bandwidth measurement tool was tested for commercial 3G and
Wi-Fi network in Ascom premises and showed better results as compared to
LTE network. However, we did not consider the results obtained for the com-
parison purposes. An essential reason for better results was due to generation
of lower probe traffic rate to make available bandwidth estimates and less
time resolution requirements. Java and NTP timestamp was able to handle
41
measurements more accurately as compared to test done for LTE network.
A constant train of probe packets each of size 1440 Kb and specified differ-
ence between the next trains of packets was generated by the traffic emulator
on single port number 15001 as used in our measurement tool. We did not
consider TWAMP control protocol to establish an authenticated session. The
reception of the packets at the TWAMP receiver is implementation specific,
where we considered single port to accept all test sessions. As the TWAMP
server accepts probe packets from various clients on a singe port, it differen-
tiates them on the basis of sender IP address and sender discriminator. Our
traffic emulator generates probe traffic by differentiating clients on the basis
of sender discriminator and reception of reflected packets in the same order.
This feature also allows to run multiple test sessions on a single device.
Figure 5.2 depicts the results estimate by the measurement tool due to conges-
tion on the server with addition of multiple users connectivity to the TWAMP
server. Large amount of packet generation due to multiple clients showed
packet loss on reception at the Emulator. Hence we maintained smaller in-
creases in connections to the TWAMP server. The results show negative per-
centage decline in the result obtained by the measurement tool with added
number of simultaneous connections to the TWAMP server. The percent-
age change in measurements with added connections to the TWAMP server
are calculated with comparison with available bandwidth estimation obtained
with measurement tool due to single user connectivity to the TWAMP server
with no cross traffic. The negative decline in available bandwidth estimates is
predominantly due to access of all clients on a single TWAMP port. As the
probe packets get queued at the socket, it produces errors in the timestamps
values with system time delays and buffering of data at the port.
42
Chapter 6
Conclusion and Future work
We have developed a PRM based quick and non-intrusive two way available
bandwidth measurement tool using TWAMP to measure 4G networks on an
Android OS based device.
IETF IIPM aims to incorporate TWAMP as a measurement standard to mea-
sure available path capacity, tight section capacity and UDP throughput in
forward and reverse path links. Our work extends the study and applicability
of TWAMP for the deployment of available bandwidth tools and techniques.
TWAMP light utilized in this research work allows creating easy test end points
for the tool deployment. It allows possibility to generate probe traffic accord-
ingly for asymmetric uplink and downlink channel. The conclusion from the
thesis objective in section 1.4 has been addressed as follows:
• State of the art study: PRM for available bandwidth estimation in mo-
bile networks reduces estimation and reliability errors caused by bursty
traffic. Scheduling decision in LTE occurs once at every 1ms based on
existing radio conditions at UE, buffer status reports, QoS attributes
and interference situation in neighbouring cells. QoS attributes such as
MBR, ARP, AMBR with priorities for voice services utilizing GBR re-
strict the bit rate achieved by the generated probe packets. Android
NDK development using JNI allows enhanced performance over Android
SDK using Java whereas it brings increase in complexity of application
and non support for all microprocessor architecture.
43
sessions. It provides rich datasets with available bandwidth estimations
with associated geo-location values.
Due to short span of time for master thesis, native development of available
bandwidth measurement tool using Android NDK could not be considered.
Native development shall provide less system call delays with system level
timestamping and lower adjacent probe packet interval. Work needs to be ex-
tended regarding classification of parameters of competing users per transport
block, effect of SINR on varying scheduling and modulation decision happen-
ing in LTE per TTI of 1ms at eNodeB. Implementation work as defined in
3GPP User Equipment (UE) application layer data throughput performance
(TR 37.901) [1] for LTE gives an insight for test scenarios. Large Scale mea-
surement tool deployment based on TWAMP is possible on publicly available
servers such as M-LAB [18] supporting internet measurement transparency.
It shall allow publicly availability of rich user data sets for researchers being
essential for characterization of LTE traffic, creating network maps and traffic
policy.
44
Bibliography
[1] 3GPP TR 37.901. "user equipment (ue) application layer data throughput
performance". Ts, 3rd Generation Partnership Project (3GPP).
[2] 3GPP. "release 8". Technical report, 3rd Generation Partnership Project.
[4] O.H. Alliance. "industry leaders announce open platform for mobile de-
vices". Press release, 2007.
[7] M.A. Alzate, J.C. Pagan, N.M. Pena, and M.A. Labrador. "end-to-end
bandwidth and available bandwidth estimation in multi-hop ieee 802.11
b ad hoc networks". In 42nd Annual Conference on Information Sciences
and Systems, CISS, pages 659–664. IEEE, 2008.
45
Bibliography
[12] E. Bergfeldt, S. Ekelin, and J.M. Karlsson. "a performance study of band-
width measurement tools over mobile connections". In 69th Vehicular
Technology Conference, pages 1–5. IEEE, 2009.
[13] T Brethour and K Gibbs. Jperf version 1.0 the iperf front end. The Board
of Trustees of the University of Illinois, 2003.
[14] R.L. Carter and M.E. Crovella. "measuring bottleneck link speed in
packet-switched networks". In Journal of Performance evaluation, 27:297–
318, 1996.
[15] C.U. Castellanos, D.L. Villa, O.M. Teyeb, J. Elling, and J. Wigard. "com-
parison of available bandwidth estimation techniques in packet-switched
mobile networks". In 17th International Symposium on Personal, Indoor
and Mobile Radio Communications, pages 1–5. IEEE, 2006.
[17] C. Dovrolis and R. Prasad. "pathrate: A measurement tool for the capac-
ity of network paths", 2004.
[20] June) Ericsson. (2012. "ericsson: Traffic and market report [ online].
available: http://www.ericsson.com/traffic-market-report.
[22] C.D. Guerrero and M.A. Labrador. "on the applicability of available band-
width estimation techniques and tools". In Journal of Computer Commu-
nications, 33(1):11–22, 2010.
46
Bibliography
[32] R. Kapoor, L.J. Chen, A. Nandan, M. Gerla, and MY. Sanadidi. "cap-
probe: a simple and accurate capacity estimation technique for wired
and wireless environments". In SIGMETRICS Performance Evaluation
Review, volume 32, pages 390–391. ACM, 2004.
[34] K. Lai and M. Baker. "nettimer: A tool for measuring bottleneck link
bandwidth". In Proc. of the USENIX Symposium on Internet Technologies
and Systems, volume 134, 2001.
[35] M. Li, Y.L. Wu, and C.R. Chang. "available bandwidth estimation for the
network paths with multiple tight links and bursty traffic". In Journal of
Network and Computer Applications, 2012.
[36] C.M. Lin, J.H. Lin, C.R. Dow, and C.M. Wen. "benchmark dalvik and
native code for android system". In Second International Conference on
Innovations in Bio-inspired Computing and Applications (IBICA), pages
320–323. IEEE, 2011.
[37] B.A. Mah. "pchar: A tool for measuring internet path characteristics",
2001.
[38] M. Mathis and M. Allman. "a framework for defining empirical bulk
transfer capacity metrics". Technical report, RFC 3148, July, 2001.
47
Bibliography
[43] X. Qian, G. Zhu, and X.F. Li. "comparison and analysis of the three
programming models in google android".
[48] S. Saroiu, P.K. Gummadi, and S.D. Gribble. "sprobe: A fast technique
for measuring bottleneck bandwidth in uncooperative environments". In
proc. of INFOCOM, page 1. IEEE, 2002.
[49] N. Seitz. "itu-t qos standards for ip-based networks". In Journal of Com-
munications Magazine, 41(6):82–89, 2003.
48
Bibliography
[54] T. Utility. "test tcp (ttcp) benchmarking tool for measuring tcp and udp
performance", 2003.
[55] K. Yum, J.Z. Babiarz, K. Hedayat, R.M. Krzanowski, and A. Morton. "A
Two-Way Active Measurement Protocol (TWAMP)", 2008.
[56] B. Zhang, C. Zhang, B.H. He, and S. Liu. "design and implementation
of data collection and analysis based on twamp". In Journal of Applied
Mechanics and Materials, 148:254–257, 2012.
[57] M. Zhang, C. Luo, and J. Li. "estimating available bandwidth using mul-
tiple overloading streams". In IEEE International Conference on Com-
munications, volume 2, pages 495–502. IEEE, 2006.
49
Appendix A
Format of Test Packet
This document shows the different test packets transmitted by TWAMP pro-
tocol in unauthenticated mode.
50
A.2. Test packet from the Session Reflector
51