Professional Documents
Culture Documents
Troubleshooting Guide
Issue 04
Date 2013-08-30
and other Huawei trademarks are trademarks of Huawei Technologies Co., Ltd.
All other trademarks and trade names mentioned in this document are the property of their respective holders.
Notice
The purchased products, services and features are stipulated by the contract made between Huawei and the
customer. All or part of the products, services and features described in this document may not be within the
purchase scope or the usage scope. Unless otherwise specified in the contract, all statements, information,
and recommendations in this document are provided "AS IS" without warranties, guarantees or representations
of any kind, either express or implied.
The information in this document is subject to change without notice. Every effort has been made in the
preparation of this document to ensure accuracy of the contents, but all statements, information, and
recommendations in this document do not constitute a warranty of any kind, express or implied.
Website: http://www.huawei.com
Email: support@huawei.com
Purpose
This document describes how to diagnose and handle eRAN faults. Maintenance engineers can
troubleshoot the following faults by referring to this document:
Intended Audience
This document is intended for:
l System engineers
l Site maintenance engineers
Product Versions
The following table lists the product versions related to this document.
Change History
For details about the changes in this document, see 1 Changes in eRAN Troubleshooting
Guide.
Organization
1 Changes in eRAN Troubleshooting Guide
This chapter describes common maintenance functions that are used to analyze and handle faults.
It also explains or provides references on how to use the functions.
This chapter describes how to diagnose and handle intra-RAT handover faults. RAT is short for
radio access technology.
This chapter describes the method and procedure for troubleshooting service drops in the Long
Term Evolution (LTE) system. It also provides the definitions of service drops and related key
performance indicator (KPI) formulas.
This section defines inter-RAT handover faults, describes handover principles, and provides the
fault handling method and procedure.
This chapter provides definitions of faults related to traffic rates and describes how to
troubleshoot low uplink/downlink UDP/TCP rates and rate fluctuations. UDP is short for User
Datagram Protocol, and TCP is short for Transmission Control Protocol.
This chapter defines cell unavailability faults and provides a troubleshooting method.
This section defines IP transmission faults and describes how to troubleshoot IP transmission
faults.
This chapter describes the definitions of application layer faults and the troubleshooting method.
This chapter describes how to troubleshoot transmission synchronization faults. This type of
faults include the clcok reference problem, IP clock link fault, system clock unlocked fault, base
station synchronization frame number error, or time synchronization failure.
This chapter describes the method and procedure for troubleshooting radio frequency (RF) unit
faults in the Long Term Evolution (LTE) system.
When faults cannot be rectified by referring to this document, collect fault information for
Huawei technical support to quickly troubleshoot the faults. This section describes how to collect
fault information.
Conventions
Symbol Conventions
The symbols that may be found in this document are defined as follows.
Symbol Description
General Conventions
The general conventions that may be found in this document are defined as follows.
Convention Description
Command Conventions
The command conventions that may be found in this document are defined as follows.
Convention Description
GUI Conventions
The GUI conventions that may be found in this document are defined as follows.
Convention Description
Keyboard Operations
The keyboard operations that may be found in this document are defined as follows.
Format Description
Key Press the key. For example, press Enter and press Tab.
Key 1+Key 2 Press the keys concurrently. For example, pressing Ctrl+Alt
+A means the three keys should be pressed concurrently.
Key 1, Key 2 Press the keys in turn. For example, pressing Alt, A means
the two keys should be pressed in turn.
Mouse Operations
The mouse operations that may be found in this document are defined as follows.
Action Description
Click Select and release the primary mouse button without moving
the pointer.
Drag Press and hold the primary mouse button and move the
pointer to a certain position.
Contents
04 (2013-08-30)
This is the fourth official release.
Compared with issue 03 (2012-12-29), this issue includes the following new information.
Compared with issue 03 (2012-12-29), this issue includes the following changes.
03 (2012-12-29)
This is the third official release.
Compared with issue 02 (2012-07-30), this issue does not include any new information.
Compared with issue 02 (2012-07-30), this issue includes the following changes.
9.5 Troubleshooting Cell Unavailability l Deleted the possible cause: the IP path is
Faults Due to Abnormal Transport faulty or not configured.
Resources l Added a possible cause: the S1 interface is
faulty or not configured.
02 (2012-07-30)
This is the second official release.
Compared with issue 01 (2012-06-29), this issue does not include any new information.
Compared with issue 01 (2012-06-29), this issue includes the following changes.
01 (2012-06-29)
This is the first official release.
Compared with draft A (2012-05-11), this issue does not include any new information.
Compared with draft A (11.05.12), this issue includes the following changes.
14.5 Troubleshooting RTWP Faults Added the step for troubleshooting, including
the step for diagnosing and handling the cross-
connected antennas.
Draft A (2012-05-11)
This is a draft.
3 2.2.3 Determining the Determine the fault scope and type based on the
Fault Scope and Type symptoms.
4 2.2.4 Identifying Fault Identify the fault causes based on the fault information
Causes and symptom.
5 2.2.5 Rectifying the Take appropriate measures or steps to rectify the fault.
Fault
For details about data to be backed up and how to back up data, see eNodeB Routine Maintenance
Guide.
l Fault symptom
l Time, location, and frequency
l Scope and impact
l Equipment running status before the fault occurs
l Operations performed on the equipment before the fault occurs, and the results of these
operations
l Measures taken to deal with the fault, and the results
l Alarms and correlated alarms when the fault occurs
l Board indicator status when the fault occurs
l Consult the person who reports the fault about the symptom, time, location, and frequency
of the fault.
l Consult maintenance personnel about the equipment running status, fault symptom,
operations performed before the fault occurs, and measures taken after the fault occurs and
the effect of these measures.
l Observe the board indicator, operation and maintenance (OM) system, and alarm
management system to obtain the software and hardware running status.
l Estimate the scope and impact of the fault by means of service demonstration, performance
measurement, and interface or signaling tracing.
l Do not handle a fault hastily. Collect as much information as possible before rectifying the
fault.
l Keep good liaison with maintenance personnel of other sites. Resort to them for technical
support if necessary.
Reference None
Alarm Definition Alarm information is the output of the eNodeB alarm system.
information It relates to the hardware, links, trunk, and CPU load of the
eNodeB, and includes the description of faults or exceptions,
fault causes, and handling suggestions. Alarm information is
a key element for fault locating and analysis.
Reference For details about how to use the alarm system, see M2000
Online Help. For detailed information about each alarm, see
eNodeB Alarm Reference.
Service Faults
Service faults are further classified into the following types:
l Access faults
– User access fails.
– The access success rate is low.
l Handover faults
– The intra-frequency handover success rate is low.
– The inter-frequency handover success rate is low.
l Service drop faults
– Service drops occur during handovers.
– Services are unexpectedly released.
l Inter-RAT interoperability faults
Inter-RAT handovers cannot be normally performed.
l Rate faults
– Data rates are low.
– There is no data rate.
– Data rates fluctuate.
Equipment Faults
Equipment faults are further classified into the following types:
l Cell faults
– Cell setup fails.
– Cell activation fails.
l Operation and maintenance channel (OMCH) faults
– The OMCH is interrupted or fails intermittently.
– The CPRI link does not work properly.
– The S1/X2/SCTP/IPPATH links do not work properly.
– IP transport is abnormal.
l Clock faults
– The clock source is faulty.
– The IP clock link is faulty.
– The system clock is out of lock.
l Security faults
– The IPSec tunnel is abnormal.
– SSL negotiation is abnormal.
– Digital certificate processing is abnormal.
l Radio frequency faults
– The standing wave is abnormal.
l Access faults: Check the S1 interface and Uu interface. Locate transmission faults segment
by segment. Then, determine whether faults occur in the eRAN based on the interface
conditions. If so, proceed to locate specific faults.
l Rate faults: Check whether there are access faults. If there are access faults, locate specific
faults by using the previous methods. Then, check the traffic on the IP path to determine
fault points.
l Handover faults: Start signaling tracing and determine fault points according to the
signaling flow.
For instructions on fault locating and analysis, see 3 Common Maintenance Functions.
This chapter describes common maintenance functions that are used to analyze and handle faults.
It also explains or provides references on how to use the functions.
3.3 Comparison/Interchange
Comparison and interchange are used to locate faults in a piece or pieces of equipment.
3.4 Switchover/Reset
Switchover helps identify whether the originally active equipment is faulty or whether the active/
standby relationship is normal. Reset is used to identify whether software running errors exist.
l Real-time
l Able to trace the user over all standard interfaces
l Usable when traffic is heavy
l Applicable in various scenarios, for example, call procedure analysis and VIP user tracing
User tracing is usually used to diagnose call faults that can be reproduced. For details about how
to perform user tracing, see the online help for the operation and maintenance system.
l Real-time
l Complete: All messages within a period on an interface can be traced.
l Able to trace link management messages
Interface tracing applies in scenarios where user equipment (UEs) involved are uncertain. For
example, this function can be used to diagnose the cause for a low success rate of radio resource
control (RRC) connection setup at a site. For details about how to perform interface tracing, see
the online help for the operation and maintenance system.
3.3 Comparison/Interchange
Comparison and interchange are used to locate faults in a piece or pieces of equipment.
Comparison is a function used to locate a fault by comparing the faulty component or fault
symptom with a functional component or normal condition, respectively. Interchange is a
function used to locate a fault by interchanging a possibly faulty component with a functional
component and comparing the running status before and after the interchange.
Comparison usually applies in scenarios with a single fault. Interchange usually applies in
scenarios with complicated faults.
3.4 Switchover/Reset
Switchover helps identify whether the originally active equipment is faulty or whether the active/
standby relationship is normal. Reset is used to identify whether software running errors exist.
Switchover switching of the active and standby roles of equipment so that the standby equipment
takes over services. Comparing the running status before and after the switchover helps identify
whether the originally active equipment is faulty or whether the active/standby relationship is
normal. Reset is a means to manually restart part of or the entire equipment. It is used to identify
whether software running errors exist.
Switchover and reset can only be emergency resorts. Exercise caution when using them, because:
l Compared with other functions, switchover and reset can only be auxiliary means for fault
locating.
l Because software runs randomly, a fault is usually not reproduced in a short period after a
switchover or reset. This hides the fault, which causes risks in secure and stable running of
the equipment.
l Resets might interrupt services. Improper operations may even cause collapse. The
interruption and collapse have a severe impact on the operation of the system.
In Long Term Evolution (LTE) networks, access faults occur either during radio resource control
(RRC) connection setup or during E-UTRAN radio access bearer (E-RAB) setup. The access
success rate is a key performance indicator (KPI) that quantifies end user experience. An
excessively low access success rate indicates that end users have difficulty making mobile-
originated or mobile-terminated calls.
Related Counters
l RRC Connection Setup Measurement (Cell)(RRC.Setup.Cell)
l RRC Connection Setup Failure Measurement (Cell)(RRC.SetupFail.Cell)
l E-RAB Setup Measurement (Cell)(E-RAB.Est.Cell)
l E-RAB Setup Failure Measurement (Cell)(E-RAB.EstFail.Cell)
Related Alarms
l Hardware-related alarms
– ALM-26104 Board Temperature Unacceptable
– ALM-26106 Board Clock Input Unavailable
– ALM-26107 Board Input Voltage Out of Range
– ALM-26200 Board Hardware Fault
– ALM-26202 Board Overload
– ALM-26203 Board Software Program Error
– ALM-26208 Board File System Damaged
l Temperature-related alarms
– ALM-25650 Ambient Temperature Unacceptable
– ALM-25651 Ambient Humidity Unacceptable
– ALM-25652 Cabinet Temperature Unacceptable
– ALM-25653 Cabinet Humidity Unacceptable
– ALM-25655 Cabinet Air Outlet Temperature Unacceptable
– ALM-25656 Cabinet Air Inlet Temperature Unacceptable
l Link-related alarms
l Top3 cells with the largest amounts of failed RRC connection setups
(L.RRC.ConnReq.Att - L.RRC.ConnReq.Succ) and lowest RRC connection setup
success rates
l Top3 cells with the largest amounts of failed E-RAB setups and lowest E-RAB setup
success rates
In addition, after the Evolved Packet Core (EPC) obtains the international mobile subscriber
identity (IMSI) of the UE with the lowest success rate based on the UE's temporary mobile
subscriber identity (TMSI), you can start a task to trace the UE throughout the whole network.
l To check DL interference, use a spectral scanner. If both neighboring cells and external
systems may cause DL interference to the cell, locate the exact source of the DL
interference.
l To check UL interference, start a cell interference detection task and analyze the result.
Possible Causes
Scenario Fault Description Possible Causes
Troubleshooting Flowchart
Figure 4-1 show the troubleshooting flowcharts for handling low RRC connection setup rates
and low E-RAB setup rates, respectively.
Figure 4-1 Troubleshooting flowcharts for handling low RRC connection setup rates and low
E-RAB setup rates
Troubleshooting Procedure
1. Select topN cells.
2. Check whether parameters of the UE or eNodeB are incorrectly configured.
l Yes: Correct the parameter configurations. Go to 3.
l No: Go to 4.
3. Check whether the fault is rectified.
l Yes: End.
l No: Go to 4.
4. Check whether the radio environment is abnormal.
l Yes: Handle abnormalities in the radio environment. Go to 5.
l No: Go to 6.
5. Check whether the fault is rectified.
l Yes: End.
l No: Go to 6.
6. Check whether parameters of the EPC are incorrectly configured.
l Yes: Correct the parameter configurations. Go to 7.
l No: Go to 8.
7. Check whether the fault is rectified.
l Yes: End.
l No: Go to 8.
8. Contact Huawei technical support.
Fault Description
l The UE cannot receive broadcast information from the cell.
l The UE cannot receive signals from the cell.
l The UE cannot camp on the cell.
l The end user complains about an access failure, and the value of the performance counter
L.RRC.ConnReq.Att is 0.
l An RRC connection is successfully set up for the UE according to standard interface tracing
results, but then the mobility management entity (MME) releases the UE because the
authentication procedure fails.
l The end user complains that the UE can receive signals from the cell but is unable to access
the cell.
l According to the values of the performance counters on the eNodeB side, the number of
RRC connections that are successfully set up is much greater than the number of E-RABs
that are successfully set up.
l According to the KPIs, the E-RAB setup success rate is relatively low, and among all cause
values, the cause values indicated by L.E-RAB.FailEst.TNL and L.E-RAB.FailEst.RNL
contribute a large proportion.
Background Information
None
Possible Causes
l Cell parameters are incorrectly configured. For example, the E-UTRA absolute radio
frequency number (EARFCN), public land mobile network (PLMN) ID, threshold used in
the evaluation of cell camping, pilot strength, and access class.
Figure 4-2 Fault handling flowchart for access faults due to incorrect parameter configurations
Typical Cases
l Case 1: An E398 UE failed to access the network despite the fact that the authentication
and encryption functions were enabled on the EPC.
Fault Description
During a site test, an E398 UE failed to access a network where the authentication and
encryption functions were enabled on the EPC.
Fault Diagnosis
1. The S1 interface was traced. According to the tracing result shown in Figure 4-3, the
access attempt was rejected due to no-Sultable-Cells-In-tracking-area(15).
2. The signaling at the EPC side was traced. According to the tracing result shown in
Figure 4-4, the access attempt was rejected by the HSS in the diameter-authorization-
rejected(5003) message.
In conclusion, the E398 UE was unable to access the network because the UE used a
SIM card. To access an LTE network, the UE must use a USIM card.
Fault Handling
The SIM card in the E398 UE was replaced by a USIM card. Then, the authentication
procedure was successful and the UE successfully accessed the network.
l Case 2: The E-RAB setup success rate at a site deteriorated due to incorrect transport
resource configurations.
Fault Description
According to the KPIs for a site, the E-RAB setup success rate deteriorated intermittently.
Fault Diagnosis
1. The cause value contained in the S1AP_INITIAL_CONTEXT_SETUP_FAIL
message (that is, the initial context setup request message) was checked and was found
to be transport resource unavailable(0), as shown in Figure 4-6.
This cause value indicates that the E-RAB failed to be set up due to faults related to
transport resources, rather than faults related to radio resources.
2. The IP address contained in the S1AP_INITIAL_CONTEXT_SETUP_REQ message
was checked and was found to be 8A:14:05:14. However, this IP address (8A:
14:05:14) was different from the peer IP address (8A 14 05 13) specified in the
IPPATH MO. Figure 4-7 shows the details of the
S1AP_INITIAL_CONTEXT_SETUP_REQ message.
Fault Handling
New IPPATH MOs were configured on the eNodeB based on the network plan. Then, the
E-RAB setup success rate was observed for a while, during which the E-RAB setup success
rate was normal all along.
Fault Description
l During a random access procedure, the UE cannot receive any random access responses.
l During an RRC connection setup process, the eNodeB has not received any RRC
connection setup complete messages within the related timeout duration.
l During an E-RAB setup process, the response in security mode times out.
l The eNodeB has not received any RRC connection reconfiguration complete messages
within the related timeout duration.
l At the eNodeB side, both the RRC connection setup success rate and the E-RAB setup
success rate are low.
Background Information
Radio environment abnormalities include radio interference, imbalance between the uplink (UL)
and downlink (DL) quality, weak coverage, and eNodeB hardware faults (such as distinct
antenna configurations). The items to be investigated as well as the methods of investigating
these items are described as follows:
Figure 4-8 and Figure 4-9 show common causes of random access failures and E-RAB setup
failures, respectively.
Possible Causes
l The cell provides weak coverage.
l The UE does not use the maximum transmit power.
l Inter-modulation interference exists.
l The UE is located at cell edge.
Fault Diagnosis
To effectively diagnose access faults due to radio environment abnormalities, you are advised
to firstly find out whether this fault is caused by radio interference or weak coverage. The
following procedure is recommended:
Typical Cases
Fault Description
According to the KPIs for an eNodeB at a site, the RRC connection setup success rate fluctuated
significantly within a period.
Fault Diagnosis
1. The KPIs were checked. For local cell 1, the daily RRC connection success rate was only
52%.
2. The signaling over the Uu interface was traced. The result indicated that all RRC connection
setup failures occurred because UEs do not respond. The following figure shows a snapshot
of the signaling traced over the Uu interface.
3. Simulated load was added to the LTE side. The impact of the DL LTE signals on the DL
GSM signals was tested, during which the call drop rate at the GSM side raised significantly.
As a result, it was highly probable that inter-modulation interference existed.
4. Online spectral scan was applied to the LTE side. Interference with a magnitude of 10 dB
was found within the high-frequency resource blocks (RBs), which affected signaling
transmission.
5. The site was investigated and the cause of the fault was located. The LTE and GSM sides
shared the same antennas. The antennas aged and induced inter-modulation interference.
Fault Handling
The antennas were replaced. Then, the access success rate was restored.
This chapter describes how to diagnose and handle intra-RAT handover faults. RAT is short for
radio access technology.
This section provides information required to troubleshoot intra-RAT handover faults due to
poor Uu quality. The information includes fault descriptions, background information, possible
causes, fault handling method and procedure, and typical cases.
Related Counters
l Outgoing Handover Measurement (Cell)(HO.eRAN.Out.Cell)
l Incoming Handover Measurement (Cell)(HO.eRAN.In.Cell)
Related Alarms
l Board overload alarm
– ALM-26202 Board Overload
l Alarms related to RF modules
– ALM-26529 RF Unit VSWR Threshold Crossed
– ALM-26522 RF Unit RX Channel RTWP/RSSI Unbalanced
l Cell capability degraded alarm
– ALM-29243 Cell Capability Degraded
l Alarms related to CPRI links
– ALM-26235 RF Unit Maintenance Link Failure
– ALM-26234 BBU CPRI Interface Error
– ALM-26233 BBU CPRI Optical Interface Performance Degraded
– ALM-26506 RF Unit Optical Interface Performance Degraded
l Alarms related to clock sources
– ALM-26263 IP Clock Link Failure
– ALM-26264 System Clock Unlocked
– ALM-26538 RF Unit Clock Problem
– ALM-26260 System Clock Failure
– ALM-26265 Base Station Frame Number Synchronization Error
Handover Procedures
Handovers are classified as coverage-based, load-based, frequency-priority-based, service-
based, and UL-quality-based. For details, see eRAN Mobility Management in Connected Mode
Feature Parameter Description.
Possible Causes
There are various causes of handover faults, such as incorrect data configuration, hardware faults,
interference, and poor Uu quality. Therefore, to effectively diagnose a handover fault, you need
to carry out a pertinent analysis based on the actual situation.
Fault Analysis
The following measures are effective in locating a handover fault:
To locate an intra-RAT handover fault, you are advised to select TopN cells with handover faults
and then follow the troubleshooting procedure shown in Figure 5-1.
Troubleshooting Procedure
1. Check whether the hardware is faulty.
Hardware faults are the most likely cause if handovers suddenly become abnormal without
recent modifications to the configurations of the abnormal cell and its neighboring cells.
Yes: Hardware faults are often accompanied by alarms. You are advised to handle the fault
by following the instructions on how to troubleshoot handover faults due to hardware faults.
Go to 2.
No: Go to 3.
Fault Description
Typical hardware faults include faulty or overloaded boards, as well as abnormal radio frequency
(RF) module or clock sources. If a hardware fault occurs, the cell will degrade in capability or
even become out of service, in addition to the following symptoms:
Background Information
Related Alarms
Possible Causes
Possible hardware faults that will cause handover faults are listed as follows:
l A board is overloaded.
l An RF module is faulty.
l A common public radio interface (CPRI) link is faulty.
l A clock source is faulty.
Figure 5-2 Fault handling flowchart for intra-RAT handover faults due to hardware faults
Typical Cases
Fault Description
Handovers between cell 0 and cell 2 under an eNodeB were normal with a high success rate, but
the handovers from cell 1 under the eNodeB to its neighboring cells were abnormal with a
relatively low success rate (7%) during busy hours.
Fault Diagnosis
1. Alarms about the eNodeB were checked. Cell 1 had reported ALM-26529 RF Unit VSWR
Threshold Crossed.
2. As engineers of the customer confirmed, the eNodeB had been reconstructed recently.
Therefore, it was highly probable that the RF connections became abnormal during the site
reconstruction.
3. At the site, it was found that the jumper was not securely connected to the feeder, which
had caused the cell malfunction.
Fault Handling
The jumper was securely connected to the feeder. According to the KPI log, the inter-cell
handover success rate was restored.
Fault Description
l Handovers to neighboring cells are seldom initiated.
According to drive test results or signaling tracing results, the UE experiences relatively
low signal quality in its serving cell. The signal level of neighboring cells meets the
threshold for a handover, but handovers occur with a low probability This leads to a high
service drop rate.
l Handovers to neighboring cells are frequently initiated.
The signal level and quality of neighboring cells are almost the same as those of the serving
cell, but handovers to the neighboring cells are frequently initiated. This leads to poor
quality of voice services and a high probability of service drops.
Background Information
None
Possible Causes
l Configurations of neighboring cells are incorrect.
If neighboring cells are not configured or incorrectly configured, handovers cannot be
triggered even after the UE reports measurements of these neighboring cells.
l The X2 link is incorrectly configured.
If an X2 interface is incorrectly configured, handovers to some neighboring cells cannot
be successfully executed. For example, if the IP path for an X2 interface is incorrectly
configured, X2-based inter-eNodeB handovers cannot be executed; or, if the IP path from
the target eNodeB to the source serving gateway (S-GW) is not configured, X2-based inter-
S-GW handovers cannot be executed.
l Parameters such as handover thresholds, hysteresis, and time-to-trigger are inappropriately
configured.
In the preceding handover scenario, a handover is triggered only when the signal level of
a neighboring cell is higher than that of the serving cell by at least a certain amount. As a
result, if handover parameters (such as the threshold, cell individual offsets [CIOs],
hysteresis, and time-to-trigger) are inappropriately set, the probability of triggering
handovers is either significantly low or significantly high.
Figure 5-3 Fault handling flowchart for intra-RAT handover faults due to incorrect data
configurations
No: Go to 7.
7. Contact Huawei technical support.
Typical Cases
Fault Description
During a drive test, a UE did not receive any handover commands after sending A3 measurement
reports to the eNodeB. Ultimately, the service is dropped.
Fault Diagnosis
Fault Handling
The configuration of the IPPATH MO was corrected. Then, the test was conducted again and
the UE was successfully handed over to the target cell.
Fault Description
The service satisfaction rate in the target cell is lower than the admission threshold for handed-
over services, due to which the target eNodeB rejects the requests of handovers to the target cell.
The service satisfaction rate in a cell can be viewed on the M2000.
Background Information
None
Possible Causes
l UEs in the target cell surge due to assemblies or activities.
l A large number of UEs have been handed over to the target cell due to inappropriate
parameter configurations.
Figure 5-4 Fault handling flowchart for intra-RAT handover faults due to target cell congestion
Typical Cases
Fault Description
Fault Diagnosis
Fault Handling
Engineers of the customer were advised to expand the cell capacity or reduce UEs in the cell by
modifying handover parameter configurations. After the correspond measure was taken, the
success rate of handovers to the cell became normal.
Fault Description
Two symptoms may occur when the Uu quality is poor. One is that the UE cannot receive any
handover commands from the eNodeB, the other is that the UE cannot access the target cell and
cannot report the handover complete message.
Background Information
Checking interference
1. Start a cell interference detection task and check the performance counter indicating the
uplink (UL) signal quality. If high UL modulation and coding scheme (MCS) orders seldom
appear, it is highly probable that interference to the cell exists.
2. Start the UE spectral scanning function and further determine whether the interference
originates from neighboring cells or external systems.
Imbalance between UL and DL quality is classified into two situations: lower UL quality and
lower DL quality.
l Check whether the transmit power of the RRU and UE falls within link budgets.
l Check the actual UL and DL coverage by using drive tests.
Possible Causes
The following Uu problems may cause handover faults:
l Interference
l Unsatisfactory coverage
l Imbalance between UL and DL quality
l Antenna system faults
Figure 5-5 Fault Handling flowchart for intra-RAT handover faults due to poor Uu quality
Typical Cases
None
This chapter describes the method and procedure for troubleshooting service drops in the Long
Term Evolution (LTE) system. It also provides the definitions of service drops and related key
performance indicator (KPI) formulas.
This section provides information required to troubleshoot service drops due to handover faults.
The information includes fault descriptions, background information, possible causes, fault
handling method and procedure, and typical cases.
A service drop is counted each time the eNodeB sends an E-RAB RELEASE INDICATION or
UE CONTEXT RELEASE COMMAND message to the MME with a release cause other than
Normal Release, Detach, User Inactivity, cs fallback triggered, and Inter-RAT
redirection after an E-UTRAN radio access bearer (E-RAB) has been successfully set up for a
UE.
An E-UTRAN radio access bearer (E-RAB) is a bearer on the access stratum (AS) for carrying
service data of UEs. An E-RAB release is a process of releasing the bearer resources for UEs,
and it represents the capability of a cell to release bearer resources for UEs. One E-RAB release
is counted once.
Related Counters
E-RAB Release Measurement (Cell) (E-RAB.Rel.Cell)
l Release types
– Normal releases
– Abnormal releases
– Normal releases for outgoing handovers
– Abnormal releases for outgoing handovers
l QoS class identifier (QCI)
– QCIs of 1 to 9
l Abnormal release causes
– Radio faults (L.E-RAB.AbnormRel.Radio)
If the percentage of abnormal E-RAB releases due to radio faults to all abnormal E-
RAB releases is greater than 30%, you need to check whether the network planning
such as the physical cell identifier (PCI) and neighboring cell planning is proper.
– Transmission faults (L.E-RAB.AbnormRel.TNL)
If the percentage of abnormal E-RAB releases due to transmission faults to all abnormal
E-RAB releases is greater than 30%, you need to check whether the transmission links
over the S1/X2 interface experience exceptions such as intermittent disconnections.
– Congestion (L.E-RAB.AbnormRel.Cong)
If the percentage of abnormal E-RAB releases due to congestion to all abnormal E-RAB
releases is greater than 30%, you need to check whether congestion occurs in the cell.
– Handover failures (L.E-RAB.AbnormRel.HOFailure)
If the percentage of abnormal E-RAB releases due to handover failures to all abnormal
E-RAB releases is greater than 30%, you need to check whether parameters are properly
set for the neighboring cells.
– MME faults (L.E-RAB.AbnormRel.MME)
If the percentage of abnormal E-RAB releases due to mobility management entity
(MME) faults to all abnormal E-RAB releases is greater than 30%, you need to check
whether parameters are properly set for the evolved packet core (EPC).
For details, see eNodeB Performance Counter Reference.
Formula
The service drop rate is calculated based on services but not on UEs. For example, services are
set up on multiple data radio bearers (DRBs) for a UE. Then, if all these services experience
drops, multiple service drops are counted.
The formula for calculating the service drop rate is as follows:
Service drop rate = L.E-RAB.AbnormRel/(L.E-RAB.AbnormRel + L.E-RAB.NormRel)
Where,
l The L.E-RAB.AbnormRel counter measures the total number of abnormal E-RAB releases
in a cell.
l The L.E-RAB.NormRel counter measures the total number of normal E-RAB releases in
a cell.
Drive Test
To identify service drops in drive tests, you need to check logs and signaling procedures on the
UE side.
For details, see the related UE user guide.
Related Alarms
None
Possible Causes
If the service drop rate increases or greatly fluctuates, you must first locate the faults and then
handle the faults accordingly. Table 6-1 describes possible causes of service drops.
Troubleshooting Flowchart
To troubleshoot service drops, you are advised to select topN cells with service drops and then
follow the troubleshooting procedure shown in Figure 6-1.
Troubleshooting Procedure
Troubleshooting service drops of the whole network
1. Check whether the whole network has experienced operations such as cutover, replacement,
upgrade, or patch installation.
2. Check whether the eNodeB parameters, such as timers or algorithm switches, have been
modified.
3. Check whether the traffic volume sharply increases.
The traffic volume trend of the whole network can be determined based on the number of
E-RAB setup attempts and successful E-RAB setups. Check whether there are activities
such as number allocation or important holidays that may lead to a traffic volume increase.
4. Check whether the versions or parameters of the EPC network elements (NEs) have been
modified.
1. Check whether the topN cells have experienced operations such as cutover or relocation.
2. Check whether the topN cells have experienced operation and maintenance (OM)
operations such as cell deactivation or board restart.
3. Check whether the traffic volume sharply increases.
The traffic volume trend of a topN cell can be determined based on the number of E-RAB
setup attempts and successful E-RAB setups. Check whether there are activities such as
concerts or sports that may lead to a traffic volume increase.
4. Check whether the cell parameters have been modified, such as the maximum number of
acknowledged mode (AM) protocol data unit (PDU) retransmissions by the UE or eNodeB,
or the UE inactivity timer length.
5. Check whether the versions or parameters of the EPC NEs corresponding to the topN cells
have been modified.
Fault Description
According to the definitions of eNodeB performance counters, the L.E-RAB.AbnormRel.Radio
counter measures the number of abnormal E-RAB releases due to radio interface faults in non-
handover scenarios.
Related Information
None
Possible Causes
Abnormal E-RAB releases due to radio faults are caused by faults such as the number of Radio
Link Control (RLC) retransmissions reaching the maximum, UE uplink out-of-synchronization,
or signaling procedure failures that are resulted from weak coverage, uplink interference, or UE
exceptions.
Typical Cases
None
Fault Description
According to the definitions of eNodeB performance counters, the L.E-RAB.AbnormRel.TNL
counter measures the number of abnormal E-RAB releases due to faults at the transport network
layer.
Related Information
None
Possible Causes
Abnormal E-RAB releases due to transmission faults are caused by transmission exceptions
between the eNodeB and the MME. For example, the transmission link over the S1 interference
experiences intermittent disconnections.
Typical Cases
None
Fault Description
According to the definitions of eNodeB performance counters, the L.E-RAB.AbnormRel.Cong
counter measures the number of abnormal E-RAB releases due to resource congestion.
Related Information
None
Possible Causes
Abnormal E-RAB releases due to congestion are caused by congestion of radio resources on the
eNodeB side. For example, the radio sources are insufficient if the number of UEs reaches the
upper limit.
capacity expansion. After rectifying the congestion fault, check whether the corresponding
counter has a proper value.
1. Turn on the switch for the MLB algorithm, and then check whether the congestion fault is
rectified.
Yes: End.
No: Go to 2.
2. Contact Huawei technical support.
Typical Cases
None
Fault Description
According to the definitions of eNodeB performance counters, the L.E-
RAB.AbnormRel.HOFailure counter measures the number of abnormal E-RAB releases due to
outgoing handover failures.
Related Information
Counters related to outgoing handovers to a specific cell
Possible Causes
Abnormal E-RAB releases due to handover failures are caused by failures of handovers from
the local cell to another cell.
Typical Cases
None
Fault Description
According to the definitions of eNodeB performance counters, the L.E-RAB.AbnormRel.MME
counter measures the number of abnormal E-RAB releases that are initiated by the evolved
packet core (EPC). However, these abnormal releases are not included in the value of the L.E-
RAB.AbnormRel counter.
Related Information
None
Possible Causes
Abnormal E-RAB releases due to MME faults are initiated by the EPC when UEs are performing
services.
1. Obtain the S1 tracing messages related to the topN cell and analyze specific release causes.
2. Collect the analysis result and information about the signaling procedure and then contact
EPC engineers.
3. Check whether the fault is rectified.
Yes: End.
No: Go to 4.
4. Contact Huawei technical support.
Typical Cases
None
This section defines inter-RAT handover faults, describes handover principles, and provides the
fault handling method and procedure.
First office application (FOA) and commercial Long Term Evolution (LTE) networks are being
deployed in large scales. GSM/EDGE radio access network (GERAN) and Universal terrestrial
radio access network (UTRAN) will coexist with LTE networks for a long time. This requires
operators to use effective inter-RAT policies for protecting the GERAN and UTRAN resources
and providing rich services at the same time.
Related Counters
Inter-RAT Outgoing Handover Measurement (Cell) (HO.IRAT.Out.Cell)
Related Formulas
Handover Success Rate Formula
Fault Description
The following are symptoms of inter-RAT handover faults:
Related Information
l UE capability for inter-frequency handover
Monitor the network access signaling procedure on the eNodeB to check whether the UE
supports inter-frequency handovers. The information about whether the UE supports inter-
frequency handovers can be obtained from the IE Feature group indicators in the
UECapabilityInformation message.
According to 3GPP TS 36.331 B.1 Feature group indicators, the eighth and ninth indicators
indicate whether a UE supports packet switched (PS) handovers to GERAN and URTAN,
respectively. Table 7-1 lists the eighth and ninth indicators.
If the value of the eighth and ninth indicators is 0, the UE does not support PS handovers.
If the value of the eighth and ninth indicators is 1, the UE supports PS handovers.
l Neighboring cell configuration check
Inter-RAT neighboring cells must be configured before handovers can be performed from
evolved universal terrestrial radio access network (E-UTRAN) to UTRAN/GERAN. Use
the related commands provided by Huawei to configure inter-RAT neighboring cells.
– Check for missing and redundant neighboring cell configurations.
Check whether the routing area code (RAC) is configured when an external UTRAN
cell is added by running the ADD UTRANEXTERNALCELL and whether
NoHoFlag is set to Permit Ho when a neighboring relationship is added by running
the ADD UTRANNCELL or ADD GERANNCELL command.
– Check handover parameter settings.
Check whether handover threshold parameters are properly set by comparing the
settings with the default values or settings for a cell where handovers are normal.
The threshold settings can be queried by using the LST
INTERRATHOUTRANGROUP and LST INTERRATHOGERANGROUP
commands.
Possible Causes
l The UE does not support inter-RAT handover.
l Inter-RAT handover parameters or evolved packet core (EPC) parameters are incorrectly
set, or there are missing neighbor relationships.
l The signal quality is poor. For example, the coverage is poor or there is interference.
Fault Handling
Inter-RAT handover faults are complex and you need to determine whether an inter-RAT
handover fault occurs in the entire network or in a cell based on the fault scope and background.
If the fault occurs in the entire network, locate the fault by checking the signaling exchange and
parameter settings on the mobility management entity (MME) and serving GPRS support node
(SGSN). If the fault occurs in a cell, check the data configuration, frequency, and hardware of
the cell.
Figure 7-1 shows the troubleshooting flowchart for inter-RAT handover faults.
Typical Cases
l Case 1: In a PS handover from E-UTRAN to UTRAN, the eNodeB did not deliver a PS
handover command but delivered a redirection command to the UE.
Fault Description
In a test of PS handover from E-UTRAN to UTRAN in a laboratory at a site, after the UE
reported B1 measurement results to the eNodeB, the eNodeB did not deliver a PS handover
command but delivered a redirection command.
Fault Diagnosis
The result of tracing the network access procedure found that the UE did not support inter-
RAT handover. If a UE does not support inter-RAT handover, the eNodeB will redirect the
UE to UTRAN.
Fault Handling
The problem was solved after a UE that supports inter-RAT handover was used.
l Case 2: In a test of PS handover from E-UTRAN to UTRAN, the eNodeB did not deliver
a PS handover command.
Fault Description
In a test of PS handover from E-UTRAN to UTRAN in a laboratory at a site, after the UE
reported B1 measurement results to the eNodeB, the eNodeB did not deliver a PS handover
command.
Fault Diagnosis
The result of tracing the network access procedure found that the UE supported inter-RAT
handover. The PS handover switch was checked on the eNodeB. The check result indicated
that the switch was turned on. Then, the neighboring cell relationships were checked. The
check result shows that a RAC was not configured for the neighboring UTRAN cell.
Fault Handling
The problem was resolved after an RAC was added to the neighboring UTRAN cell.
l Case 3: In a test of PS handover from E-UTRAN to UTRAN, the eNodeB sent the MME
a PSHO Required message. After two seconds, the eNodeB sent the MME a PSHO Cancel
message.
Fault Description
In a test of PS handover from E-UTRAN to UTRAN in a laboratory at a site, the 4G EPC
and eNodeB were provided by vendor Y and the 3G core network and radio network
controller (RNC) were provided by vendor Z. After handover conditions were met, the
eNodeB sent the MME a PSHO Required message. After two seconds, the eNodeB sent
the MME a PSHO Cancel message.
Fault Diagnosis
Uu and S1 signaling was traced. The tracing result shows that the eNodeB sent the MME
a HO Cancel command after the UE reported B1 measurement results to the MME and the
eNodeB sent the MME a HO Required command. The reason why the eNodeB sent the
HO Cancel command was that the MME did not respond to the HO Required command.
The length of WaitInterRATSysHoRspTimer configured on the eNodeB was 2 seconds.
The eNodeB did not receive a response from the MME when the timer expired. As a result,
the eNodeB sent the Handover Cancel command to cancel the handover. The MME log
was checked. The check result shows that the MME received the HO Required command
but did not forward the command to the SGSN. The reason why the MME did not forward
the command is that the Gn interface was not configured between the MME and the SGSN,
and as a result, the MME could not find the SGSN. When the timer expired, the eNodeB
sent the UE a PSHO Cancel command.
Fault Handling
The problem was solved after the Gn interface was reconfigured between the MME and
SGSN.
This chapter provides definitions of faults related to traffic rates and describes how to
troubleshoot low uplink/downlink UDP/TCP rates and rate fluctuations. UDP is short for User
Datagram Protocol, and TCP is short for Transmission Control Protocol.
l No transmission
User equipment (UE) that has accessed a network cannot perform data services.
l Low downlink rate on a single UE
The observed rate of a downlink service, either a User Datagram Protocol (UDP) or
Transmission Control Protocol (TCP) service, on a UE is at least 10% lower than the
baseline value.
l Downlink rate fluctuation on a single UE
The observed rate of a downlink service, either a UDP or TCP service, on a UE fluctuates
by more than 50%.
l Low uplink rate on a single UE
The observed rate of an uplink service, either a UDP or TCP service, on a UE is at least
10% lower than the baseline value.
l Uplink rate fluctuation on a single UE
The observed rate of an uplink service, either a UDP or TCP service, on a UE fluctuates
by more than 50%.
l Abnormal rates on multiple UEs
A key performance indicator (KPI) indicates an abnormal rate, or a large number of users
complain about their traffic rates. This fault may be caused by a specific single-UE rate
fault or a common rate fault on multiple UEs.
l User-recognized abnormal rate
The rate of a data service on a UE is abnormal according to the user's definition. For
example, the currently observed rate is noticeably lower than the rate of the previous day
or a period; the observed rate is considerably lower than the rate achieved by equivalent
equipment.
l No transmission
l Low single-UE rate, including uplink and downlink UDP/TCP rates
l Single-UE rate fluctuation, including uplink and downlink UDP/TCP rates
l Abnormal multi-UE rates
The traffic rates of data services can be measured in the following ways:
l The Ethernet-layer rate can be measured by using DU Meter at the server and client.
l The rates at the RLC and MAC layers can be measured at the eNodeB.
l The rates at layers such as RLC and MAC for Huawei user equipment (UE) can be measured
by using the Probe.
Category 1 5160 No
Category 2 25456 No
Category 3 51024 No
Category 4 51024 No
The theoretical rate can be determined based on the number of RBs and modulation order. For
details, see 3GPP TS 36.213.
Take a 20 MHz cell as an example. The only UE in the cell can use 100 RBs and MCS index
28. Then, the TBS of 75736 can be selected at the MAC layer for the UE. If MIMO is used, two
transport blocks (150752) are transmitted per transmission time interval (TTI), which is 1 ms.
Then, the throughput is 150.752 Mbit/s.
NOTE
The theoretical rate calculated is the protocol-stipulated MAC-layer rate, not the application-layer rate for
eNodeBs.
Fault Description
The observed rate is stable but at least 10% lower than the baseline value.
Figure 8-2 Rate fault 1 - stable but lower than the baseline value
The observed rate fluctuates by more than 50%, as shown in the following figures.
Related Information
The User Datagram Protocol (UDP) is a simple datagram-oriented transport-layer protocol. UDP
provides an unreliable service. It sends datagrams from the application to the IP layer but does
not ensure that the datagrams can arrive at their destinations. However, UDP features a high
transmission speed, because a connection does not need to be set up before UDP-based
transmission between a client and a server and retransmission upon timeout is not applied.
TCP uses a more complicated control mechanism than UDP. In most cases, a link with a normal
TCP rate has a normal UDP rate, but a link with a normal UDP rate does not necessarily have
a normal TCP rate. When diagnosing rate faults, ensure normal UDP rates before handling TCP
services.
3GPP specifications impose uplink capability constraints on user equipment (UE) categories.
Only UEs of category 5 support 64 quadrature amplitude modulation (64QAM) in the uplink.
Possible Causes
A common way to find a cause is as follows: First, check whether the service involved is a UDP
service or a TCP service. If it is a TCP service, inject uplink and downlink UDP packets on a
single thread and check whether the uplink and downlink UDP rates can reach their peak values.
The purpose is to "clear the way" for TCP rate fault diagnosis. For example, eliminate rate
limiting at the network adapter and rectify radio parameter setting errors before handling TCP
rate faults. If the service involved is a UDP service, locate the fault by investigating link from
the server to the UE in an end-to-end manner. Second, if the UDP rate can reach its peak value
but the TCP rate cannot, the fault exists in the TCP transmission mechanism.
Fault Handling
None
the ping operation fails or the delay is excessively long, contact EPC or datacom technical
support.
2. Check whether the server malfunctions.
a. On the server, run the following command to set the UDP packet injection volume:
iperf –c x.x.x.x –u –i 1 –t 99999 –b yyym
NOTE
cell is unloaded. If the RSSI is 3 dBm to 5 dBm higher than the normal value, uplink
interference exists. Locate the interference source, and mitigate the interference.
5. Check whether the basic information about the data services or the parameter settings are
incorrect.
This check is twofold:
l Check whether the basic information about the data services is incorrect.
In this step, check the user's subscription information and UE's capability. Specifically,
check whether the user is subscribed to the correct QCI, whether the MBR and AMBR
of the UE are set as expected, and whether the UE is empowered with expected
capabilities.
l Check whether the basic information about the parameter settings is incorrect.
The parameter settings refer to the settings for the eNodeB. Algorithm setting changes
cause severe drops in the traffic rate. Export eNodeB parameter settings, and compare
them with the baseline values. If the values are inconsistent, confirm whether the settings
are customized for the operator or have been changed to incorrect values. If the settings
have been changed to incorrect values, inform the operator immediately.
6. Check whether the number of users in the cell is excessively large.
Check the number of users in the cell and the downlink RB usage by performing Users
Statistics Monitoring and Usage of RB Monitoring tasks, respectively, under cell
performance monitoring. If an excessively large number of users have accessed the cell
and RBs are exhausted when a UE accesses the cell, the traffic rate on each UE will not be
high, and low-priority users will experience even lower traffic rates.
7. Check whether license information is incorrect.
Run the LST LICENSE command to query license information, and observe whether:
l The license has expired, or limitation is imposed on functions related to the data services.
l The licensed throughput capability is correct.
8. Check whether the client works abnormally.
Client faults may exist in the UE or in the PC connected to the UE.
l Check for faults in the UE.
If spare UEs are available, replace the UE and check whether the rate fault disappears.
If it disappears, the fault exists in the UE.
l Check for faults in the PC connected to the UE.
Investigate the software installed and running on the PC. You are advised to remove or
close all programs except those required by the test. In addition, close the Windows
firewall and firewalls of antivirus programs.
Check the central processing unit (CPU) usage. If the CPU usage exceeds 80%, the CPU
is heavily loaded. Close unused software or service, or replace the PC with a better one.
9. Check for TCP errors.
TCP fault diagnosis varies depending on the symptom. If the throughput is maintained at
a level lower than the peak value, check parameter settings and the round trip time (RTT).
If the throughput can reach the peak value but is not stable, check for packet loss and severe
packet misordering.
l Check the TCP rate status.
Use a multi-thread download program (for example, FlashGet or FileZilla) or open
multiple Windows command line windows to download data. If the rate is higher than
the single-thread rate, perform further TCP checks. If the rate is equal to or even lower
than the single-thread rate, go back to the previous steps to recheck for possible faults.
l Check basic TCP parameter settings.
Ensure that the basic TCP parameters are correctly set. The parameters include the
receive window, send window, and maximum transmission unit (MTU).
l Check the RTT.
Ping the server by using 32-byte packets and MSS-byte packets (MSS is short for
maximum segment size), and take the average RTT value for the two types as the
calculated RTT. Typically, the RTT value is required to be less than or equal to 50 ms.
Link optimization is required if the RTT value is greater than 50 ms.
l Check for packet loss and severe packet misordering.
On the PC side, trace packet headers or use the TCP fault diagnosis module to check
for packet loss and severe packet misordering. If packet loss or severe packet
misordering occurs, contact datacom personnel for handling.
10. If the fault persists, contact Huawei technical support.
Typical Cases
l Case 1: The downlink rate was low with microwave transmission.
Fault Description
On network X in a country, the cell bandwidth was 15 MHz. In a downlink File Transfer
Protocol (FTP) throughput test using a single UE in a single cell, it was found that all
eNodeBs connected to a 100 Mbit/s microwave transport network had their downlink
throughput not exceeding 30 Mbit/s, but eNodeBs connected to a 1 Gbit/s optical transport
network had their downlink throughput as high as 80 Mbit/s.
Fault Diagnosis
A UDP test found that the UDP throughput was 100 Mbit/s at the sender but dropped to
only 80 Mbit/s at the receiver (eNodeB). Severe packet loss occurred. Due to TCP
congestion control, the throughput of 30 Mbit/s was normal, so the fault did not exist in the
eNodeB. The operator requested operation and maintenance (OM) personnel to locate the
packet loss point based on the following assumption: The throughput of 80 Mbit/s on the
optical transport network did not reach 100 Mbit/s, so congestion should not occur in the
microwave transport network.
The microwave transmission media were replaced with an Ethernet cable for the direction
connection between the eNodeB and the S-GW. The FTP transfer rate was maintained at
30 Mbit/s. The segment-by-segment check found that packet loss occurred at a position
between the input and output ports on a switch before packets entered the microwave
network. The operator traced the input and output ports and confirmed that packet loss
occurred. The operator further found that the fault was caused by a small buffer size that
was set for the port on the switch.
Fault Handling
The operator extended the buffer size and tested again. The test result indicated that the
downlink rate could reach the expected value. The extended buffer size helps enhance anti-
burst capability, reduce the tail drop probability, and increase the FTP transfer rate.
l Case 2: UDP services were functional, but FTP services were unavailable.
Fault Description
Operator T in country D stated that no FTP service was available on eNodeBs operating in
the 1800 MHz band but all cells operated properly with UEs normally accessing the cells,
being released, and performing UDP services.
Fault Diagnosis
Based on the feedback from the operator, a check for TCP errors was performed directly,
only to find that the FTP transfer rate dropped to zero and the server could not be pinged.
Because UDP services ran normally in the downlink, it was almost ascertained that the fault
was down link disconnection.
The check on a 800 MHz eNodeB connected to the same transport network found that FTP
services ran normally. Therefore, it was highly possible that the eNodeBs had faults. Due
to the severe impact of the fault, data configurations were immediately restored for the
1800 MHz eNodeBs by using the backup data configuration files. The fault was rectified.
The faulty configuration files were compared with baseline data configurations. The
comparison result indicated that a key radio parameter for downlink and uplink
transmission was set to a value different from the baseline value. The fault was caused by
the incorrect parameter setting.
Fault Handling
Parameter settings were changed to baseline values for all faulty eNodeBs.
l Case 3: The traffic rate occasionally reached the peak value using the E398 but never
reached the peak value using Samsung UEs.
Fault Description
In a single cell under an eNodeB on network Y in country P, a single Samsung UE could
reach only 80 Mbit/s unexpectedly in both single-thread and multi-thread (using FileZilla)
TCP download. Huawei E398 could occasionally reach 100 Mbit/s in both single-thread
and multi-thread TCP download. Both the Samsung UE and Huawei E398 experienced rate
drops.
Fault Diagnosis
A UDP packet injection test was performed, only to find that Huawei E398 and Samsung
UE could both reach the peak values. Therefore, the fault should exist in the TCP
transmission mechanism. In this fault case, rate drops occurred, which was an evidence of
packet loss. The fault symptoms on Huawei E398 and Samsung UE were different, so there
must be causes other than packet loss.
The analysis of TCP/IP headers using a third-party tool indicated that packet loss occurred
on the radio interface. It was found from the configuration file for the eNodeB that the QoS
class identifier (QCI) was 7 and the unacknowledged mode (UM) was used. UM is
insensitive to packet loss, so the frontline personnel tried QCI 9 upon request in a further
test. In the test, rate drops disappeared, but Samsung UE still failed to reach the peak value
in neither single-thread nor multi-thread TCP download while Huawei E398 could reach
the peak value in both single-thread and multi-thread TCP download. A further test was
performed on RTT using Samsung UE and Huawei E398. The test result indicated that the
RTT value for Samsung UE was longer and less stable than the RTT value for Huawei
E398. A comparison between the configuration file for the eNodeB on network Y and the
baseline configuration file found a difference in the radio-interface encryption setting. The
Advanced Encryption Standard (AES) encryption algorithm was enabled for the radio
interface on network Y, but this algorithm was disabled in the lab. The frontline personnel
disabled the AES encryption algorithm as requested. Then, the traffic rate on Samsung UE
could reach 100 Mbit/s. The fault could be reproduced: The rate dropped to 80 Mbit/s after
this algorithm was enabled. The reason for Samsung UE's failure to reach the peak value
was the setting of the AES encryption algorithm on the radio interface.
Fault Handling
The problem in network Y was caused by more than one fault, which was further induced
by incorrect parameter settings. The problem was resolved after the parameter settings were
corrected.
Fault Description
A key performance indicator (KPI) indicates an abnormal rate according to the routine KPI
monitoring result, or a large number of users complain about their traffic rates.
Related Information
Related Counters
Possible Causes
If a large number of users complain about their traffic rates, find the cause by following the
procedure for troubleshooting abnormal single-UE rates. Pay more attention to faults that may
cause large-scope failures, for example, eNodeB faults, transmission failures, large-size
reconfiguration, and radio frequency (RF) faults.
If a KPI indicates an abnormal rate, check whether the KPI calculation formula is correct,
investigate TopN cells, analyze the changes of the KPI with other KPIs, review recent key actions
on the network, and if necessary collect and provide KPI logs.
Fault Handling
None
Typical Cases
Fault Description
On network T in a country, the routine KPI monitoring result indicated that the average traffic
rate had been decreasing across the network since a day while the number of users remained
almost unchanged.
Fault Diagnosis
The check on the rate calculation formula, counter measurement, and statistics changes found
that network T never changed the formula or measurement method. Therefore, it was not the
formula that caused the fault. The investigation of TopN cells found that the entire network had
almost the same trend, so the fault was not caused by abnormal individual cells. The analysis of
other KPIs indicated that the number of users remained almost unchanged. In addition, network
reconfiguration should not cause a gradual decrease. Finally, the review on recent key actions
found two actions: rollback of the evolved packet core (EPC) version and provisioning of low-
rate subscription services. Further analysis was performed on the two actions.
The analysis found that the EPC version rollback did not affect the traffic rate. In an aggregate
maximum bit rate (AMBR) test in a lab, Transmission Control Protocol (TCP) services were
performed on UEs with AMBRs of 20 Mbit/s and 100 Mbit/s. The KPI monitoring result
indicated that the rate on a UE with an AMBR of 100 Mbit/s was about four times as high as
the rate on a UE with an AMBR of 20 Mbit/s. The investigation of AMBR distribution at more
than ten sites in recent days found that the number of UEs with a subscribed rate of 256 Mbit/s
had dropped by more than 70%. A majority of subscribers on the network were low-rate ones.
The confirmation with the operator proved that some UEs newly subscribed to low AMBRs,
and some with a subscribed rate of 256 Mbit/s switched to low AMBRs. That was the cause of
the rate decrease.
Fault Handling
No handling was required. The rate decrease was caused by the provisioning of low-rate
subscription services.
This chapter defines cell unavailability faults and provides a troubleshooting method.
This section provides information required to troubleshoot cell unavailability faults due to faulty
hardware. The information includes fault descriptions, background information, possible causes,
fault handling method and procedure, and typical cases.
Cell unavailability mentioned in this chapter means that all UEs in a cell cannot perform services.
If only some UEs cannot perform services, the problem is due to scenario-specific causes. These
causes can be found with the aid of signaling tracing, which is not described in this chapter.
Factors that may affect the running of a cell include transmission, hardware, configuration, and
RF. If any factor is abnormal, the cell may be unavailable. In this case, check these factors for
troubleshooting.
Related Alarms
l Cell alarms
– ALM-29240 Cell Unavailable
l Transmission alarms
– ALM-25880 Ethernet Link Fault
– ALM-25886 IP Path Fault
– ALM-25888 SCTP Link Fault
l Hardware alarms
– ALM-26101 Inter-Board CANBUS Communication Failure
– ALM-26200 Board Hardware Fault
– ALM-26201 Board Memory Soft Failure
– ALM-26205 BBU Board Maintenance Link Failure
l Optical module and CPRI alarms related to the faulty cell
– ALM-26230 BBU CPRI Optical Module Fault
– ALM-26246 BBU CPRI Line Rate Negotiation Abnormal
l RF module alarms related to the faulty cell
– ALM-26238 RRU Network Topology Type and Configuration Mismatch
l Configuration alarms related to the faulty cell
– ALM-26243 Board Configuration Data Ineffective
– ALM-26251 Board Type and Configuration Mismatch
l License alarms
– ALM-26817 License on Trial
l Other alarms
– ALM-29201 S1 Interface Fault
Possible Causes
Cell unavailability may be caused by:
Troubleshooting Flowchart
Cell unavailability faults are generally indicated by alarms, MML command outputs, and logs.
Based on the information, you can know which factor leads to a failure in the setup or running
of a cell. The fault handling method provided in this section is used before log analysis, which
is shown in Figure 9-1.
Troubleshooting Procedure
1. Check whether there are related alarms.
Yes: Handle the alarms. For details, see eNodeB Alarm Reference. Go to 2.
No: Go to 3.
2. Check whether the cell fault is rectified.
Yes: End.
No: Go to 3.
3. Check cell fault information.
Perform the following operations in different scenarios:
l If the cell fault occurs during the deployment of an eNodeB or the setup of a cell, run
the ACT CELL command.
l If the cell fault occurs in another scenario, run the DSP CELL command.
4. Rectify the fault based on cell fault information.
Possible fault causes and handling methods are provided as follows:
l If transport resources are abnormal, follow the instructions on how to troubleshoot cell
unavailability faults due to abnormal transport resources.
l If RF resources are abnormal, follow the instructions on how to troubleshoot cell
unavailability faults due to abnormal RF resources.
l If system capacity or capability is limited, follow the instructions on how to troubleshoot
cell unavailability faults due to limited capacity or capability.
l If data configurations are incorrect, follow the instructions on how to troubleshoot cell
unavailability faults due to incorrect data configurations.
5. Check whether the cell fault is rectified.
Yes: End.
No: Go to 6.
6. Check whether there are hardware faults.
Yes: Handle the fault problems. Go to 7.
No: Go to 8.
7. Check whether the cell fault is rectified.
Yes: End.
No: Go to 8.
8. Contact Huawei technical support.
Fault Description
A cell fails to be set up after data configuration.
Background Information
A cell cannot be set up successfully if the cell parameter settings do not match the actual RF/
baseband processing capability or other parameters.
Incorrect data configuration usually leads to a failure in the setup of a cell, not in the running of
a cell.
Related Alarms
Possible Causes
A resource item is set to a value inconsistent with the hardware or software configuration, leading
to cell setup failures. Possible causes are listed as follows:
l Incorrect UL/DL subframe ratio or incorrect special subframe radio in TDD mode
l Incorrect cell power configuration
l Incorrect cell frequency configuration
l Incorrect cell preamble format configuration
l Incorrect cell UL/DL cyclic prefix configuration
l Incorrect cell bandwidth configuration
l Incorrect cell beamforming algorithm switch configuration
l Incorrect cell operator information configuration
l Incorrect cell antenna mode configuration
l Incorrect CPRI line rate configuration
l Incorrect cell network-related configuration
Typical Cases
None
Fault Description
If the cell unavailability is caused by abnormal transport resources, a message will be displayed
after execution of the ACT CELL or DSP CELL command. The message is displayed as
Abnormal S1 link state for a cell.
Background Information
None
Possible Causes
The possible causes are:
l In RAN sharing scenarios, the SCTP links of all operators in a cell are faulty or not
configured, or the S1 interfaces are all faulty or not configured.
l In non-RAN sharing scenarios, the SCTP link or S1 interface is faulty or not configured.
l Other transmission faults occur.
No: Go to 3.
3. Check whether there is an SCTP link alarm.
Yes: Handle the alarm according to the help information of ALM-25888 SCTP Link Fault.
Go to 4.
No: Go to 5.
4. Check whether the cell fault is rectified.
Yes: End.
No: Go to 5.
5. Check whether there are S1 interface fault alarms.
Yes: Handle the alarms according to the help information of ALM-29201 S1 Interface Fault.
Go to 6.
No: Go to 7.
6. Check whether the cell fault is rectified.
Yes: End.
No: Go to 7.
7. Contact Huawei technical support.
Typical Cases
Fault Description
A cell failed to be activated. In the command output, the value of Reason For Latest State
Change was
CCEM_CELLBASIC_ERR_CELL_SETUP_FAIL_S1LINK_DOWN~1973485632.
Fault Diagnosis
1. OM personnel checked the active alarms and found there were not alarms related to the
faulty cell.
2. Run the DSP SCTPLNK MML command, check the SCTP link status and found that the
link was normal.
3. Run the DSP S1INTERFACE MML command, check the S1 interface status, found that
S1 interfaces were not configured.
Fault Handling
After OM personnel configured S1 interfaces, the cell fault was rectified.
Fault Description
RF-related alarms are reported.
Background Information
RF Resource Item
Possible Causes
A cell is unavailable if data configuration or hardware configuration of RF resources is incorrect.
The possible causes are abnormal CPRI links, abnormal RF units, version mismatch between
the main control board and RF units, unsuccessful negotiation of CPRI line rates, and mismatch
between RF networking and data configuration.
Typical Cases
Fault Description
After a cell activation command was executed, Figure 9-2 was displayed. In another case, after
a cell query command was executed, Figure 9-3 was displayed.
Fault Handling
After OM personnel reinstalled the fibers, the alarms were cleared and the cell was successfully
activated.
Fault Description
A cell fails to be set up if the required capacity or capability is limited on software or hardware.
Background Information
None
Possible Causes
The hardware or software specification is limited (for example, the licensed capacity or
capability is limited), leading to cell unavailability.
Typical Cases
Fault Description
After the DSP CELL command was executed, Figure 9-4 was displayed.
Figure 9-4 Command output indicating a failure to obtain the licensed number of cells
According to the command output, the cell activation failure is caused by license limitation. The
DSP LICENSE command is run, and the result indicates that the licensed number of cells is 3.
However, four cells are actually configured according to the result of the LST CELL command.
The configured number of cells exceeds the licensed number, which leads to the cell activation
failure.
Fault Handling
After a new license is applied for, downloaded, and activated, the cell is successfully activated.
Fault Description
Board fault alarms are reported. Alternatively, cell unavailability faults cannot be rectified after
resetting, powering off, or reinstalling faulty boards.
Background Information
None
Possible Causes
A cell may not be set up if a fault occurs in the main control board, LBBP, RF unit, other hardware
(for example, a subrack).
Typical Cases
None
This section defines IP transmission faults and describes how to troubleshoot IP transmission
faults.
Related Alarms
The following alarms may be reported to indicate Internet Protocol (IP) transmission faults:
Troubleshooting Flowchart
Troubleshooting Procedure
1. Check whether an alarm indicating the Ethernet link fault is reported in the active alarms
on the eNodeB. If an alarm indicating the Ethernet link fault is reported, rectify the fault.
If no alarm indicating the Ethernet link fault is reported, go to 2.
2. Ping the IP address nearest to the local end or the network segment IP address. If the IP
address nearest to the local end or the network segment IP address cannot be pinged, there
is an IP data link layer fault. Rectify the fault. If the IP address nearest to the local end or
the network segment IP address can be pinged, go to 3.
3. Ping an IP address that is in the same network segment as the local IP address and ping the
destination IP address. If the IP address in the same network segment can be pinged but
the destination IP address cannot be pinged, there is an IP layer link fault. Rectify the fault.
If both IP addresses can be pinged, go to 4.
4. If the fault persists, contact Huawei technical support.
Fault Description
An alarm indicating an Ethernet link fault can be monitored among active alarms on the eNodeB.
Related Information
None
Possible Causes
The Ethernet cable or optical module has faults.
Fault Handling
None
Both green indicators on the eNodeB and Port negotiation is successful and the ports
switch are on. are up. This indicates that the physical
layer communication is normal.
The green indicator on the eNodeB is on The port on the eNodeB is up and the port
and the green indicator on the switch is off. on the switch is down. The possible cause
is that the configuration is incorrect or the
hardware is faulty. Perform the following
steps to locate the fault.
The green indicator on the eNodeB is off The port on the eNodeB is down and the
and the green indicator on the switch is on. port on the switch is up. The possible cause
is that the configuration is incorrect or the
hardware is faulty. Perform the following
steps to locate the fault.
Both green indicators on the eNodeB and The negotiation has failed and the ports are
the switch are off. down. Perform the following steps to
locate the fault.
2. Check cables.
l Check the Ethernet cable.
Check whether the Ethernet cable is properly prepared and whether the cable is longer
than 100 m.
a. Check and record the bandwidth (100 Mbit/s or 1000 Mbit/s) supported by the
personal computer (PC) used.
b. Disconnect the Ethernet cable from the eNodeB and connect it to the PC and check
whether the ports used to connect the PC and the switch are up. If the ports are up,
check and record the bandwidth (100 Mbit/s or 1000 Mbit/s) negotiated between
the PC and the switch.
l Check the optical cable and optical modules.
a. Check whether the optical modules are securely inserted. If they are not securely
inserted, reinsert them. Check information about the optical module manufacturer,
rate, mode (single-mode or multi-mode), wavelength, and communication
distance. It is recommended that the eNodeB and peer device use optical modules
provided by the same manufacturer and with the same rate.
b. Check whether the optical cable is securely inserted. If it is not securely inserted,
reinsert it. Check whether the optical cable is broken due to excessive bending. If
it is broken, replace it.
c. Check whether the optical module is damaged by inserting two ends of one optical
cable to the optical module. Check whether an alarm indicating an optical module
fault is reported on the LMT. If no alarm indicating an optical module fault is
reported, the optical module is normal. If an alarm indicating optical module fault
is reported, replace the optical module.
3. Check configurations.
Log in to the eNodeB and run the LST ETHPORT and DSP ETHPORT commands to
check the Ethernet port configuration, especially the Port Attribute, Speed, and Duplex.
The Port Attribute indicates whether an Ethernet port is an electrical port or optical port.
The port attribute can be set to AUTO. If the Port Attribute is set to Fiber, but an electrical
port is used, the port status should be down. Other parameters can be checked in a similar
way.
The rate and duplex mode must be configured the same on the eNodeB and the switch. If
they are not configured the same on the eNodeB and the switch, the port negotiation fails
or the port negotiation succeeds but packets are lost. The Gigabit Ethernet (GE) electrical
port on the eNodeB can be set to AUTO only. If the GE electrical port on the eNodeB is
used to connect to the switch, the port attribute must be set to AUTO on both the eNodeB
and the switch.
The following parameter settings are recommended.
Port Type Rate and Duplex Mode Rate and Duplex Mode
on the eNodeB on the Switch
Change the parameter settings on the eNodeB to check the configurations on the switch.
Change both the rate and duplex mode to AUTO. If port negotiation succeeds after the
change and the DSP ETHPORT command output is the same as expected, the rate and
duplex mode are both set to AUTO on the switch. If the port negotiation fails, the rate and
duplex mode are not set to AUTO on the switch. Analyze the possible configuration on the
switch based on the DSP ETHPORT command output and change the configuration on
the eNodeB accordingly.
4. Isolate the fault.
a. Connect a PC to the Ethernet port on the eNodeB and check whether the alarm is
cleared.
b. Connect a PC to the Ethernet port on the switch and check whether the PC indicator
is on.
c. Identify and isolate the fault.
l If the alarm is cleared and the PC indicator is off, the Ethernet port on the switch
is faulty. Go to 4.4.
l If the alarm persists and the PC indicator is on, the Ethernet port on the eNodeB
is faulty. Go to 4.5.
l If the alarm is cleared and the PC indicator is on, the Ethernet ports on the peer
device and the eNodeB are not fully electrically compatible. Go to 4.6.
d. Replace the switch.
e. Run the RST ETHPORT and RST BRD commands to reset the Ethernet port and
the board, respectively.
Check whether an alarm indicating a board chip fault is reported. If an alarm indicating
a board chip fault is reported, replace the board on which the Ethernet port is located.
f. Check the parameters negotiated between the Ethernet ports on the switch and the
eNodeB.
5. If the fault persists, contact Huawei technical support.
Typical Cases
None
Fault Description
Signaling messages and service data cannot be transmitted between communication devices.
The peer device cannot be pinged.
Related Information
None
Possible Causes
l The Ethernet port negotiation mode is inconsistent between the eNodeB and the peer device.
l The virtual local area network (VLAN) is incorrectly configured.
Fault Handling
Check whether the ARP and VLAN mechanisms work properly. Before transmitting an Internet
Control Message Protocol (ICMP), Stream Control Transmission Protocol (SCTP), or User
Datagram Protocol (UDP) packet, the eNodeB queries the next-hop media access control (MAC)
address in the ARP table based on the IP route. The eNodeB transmits the packet only if an ARP
table is configured on the eNodeB. If no ARP table is configured, the eNodeB broadcasts an
ARP request for the next-hop MAC address.
Typical Cases
None
Fault Description
The peer device cannot be pinged and an IP address in the same network segment as the eNodeB
can be pinged. Alarms indicating an SCTP link fault, cell unavailability, and a path fault are
reported by the upper layer.
Related Information
None
Possible Causes
l The route configuration is incorrect or a related device is faulty.
l The transmission network is disconnected.
Fault Handling
In most cases, the cause is that routes are unavailable. If the ARP table and VLAN are normal,
troubleshoot the fault as described in the next section.
Typical Cases
None
This chapter describes the definitions of application layer faults and the troubleshooting method.
The operation and maintenance (OM) channel is used for remote maintenance of eNodeBs. An
OM channel is set up using TCP handshakes.
Figure 11-1 Troubleshooting flowchart for IP transport and application layer faults
Troubleshooting Procedure
1. Check whether an alarm indicating a Stream Control Transmission Protocol (SCTP) link
fault is reported or whether the SCTP link status is abnormal.
Yes: Troubleshoot the SCTP link fault.
No: Go to 2.
2. Check whether an alarm indicating an Internet Protocol (IP) path fault is reported or whether
the IP path status is abnormal.
Yes: Troubleshoot the IP path fault.
No: Go to 3.
3. Check whether an alarm indicating an operation and maintenance (OM) channel fault is
reported or whether the OM channel status is abnormal.
Yes: Troubleshoot the OM channel fault.
No: Go to 4.
4. Contact Huawei technical support.
Fault Description
l Either of the following alarms is reported:
– ALM-25888 SCTP Link Fault
– ALM-25889 SCTP Link Congestion
l The Stream Control Transmission Protocol (SCTP) link is unavailable or available only in
one direction.
After sending data to the peer device, the sender does not receive a response from the peer
device. In addition, the sender does not receive data from the peer device.
l The SCTP link is abnormal.
The SCTP link is faulty or intermittently disconnected.
Related Information
To rectify SCTP link faults, you need to trace SCTP messages.
SCTP message blocks include 13 types of messages such as INIT, INIT ACK, DATA, SACK,
ABORT, SHUTDOWN, ERROR, COOKIEECHO, and HEARTBEAT.
Parameters such as the first peer IP address, the second peer IP address (used in SCTP dual
homing), and peer port number configured on the eNodeB must be consistent with those
configured on the mobility management entity (MME). Run the LST SCTPLNK command. In
the command output, the parameters in red rectangles are eNodeB parameters and the parameters
in the blue rectangles are evolved packet core (EPC) parameters. Ensure that the MME
parameters configured on the eNodeB are consistent with the SCTP parameters of the MME and
that eNodeB parameters configured on the EPC are consistent with the SCTP parameters of the
eNodeB.
On the MME, check whether the peer port number configured on the MME is the same as the
local port number configured on the eNodeB and whether a correct network segment is
configured.
Possible Causes
l The transmission network is faulty.
l The SCTP parameters are incorrectly configured on the eNodeB or MME.
l The NE has internal faults.
Fault Handling
None
Typical Cases
None
Fault Description
l The S1 interface is normal and cells are successfully activated, but UEs cannot attach to
the network.
l UEs can attach to the network but cannot set up bearers of some QoS class identifiers
(QCIs). QoS is short for quality of service.
Related Information
The related alarm is as follows:
ALM-25886 IP Path Fault
Possible Causes
l The Internet Protocol (IP) route is incorrectly configured.
l The IP path parameters are incorrectly configured.
Fault Handling
None
Typical Cases
None
Fault Description
The ALM-25901 Remote Maintenance Link Failure alarm is reported.
Operation and maintenance (OM) channel faults are classified into two categories:
l OM channel unavailability: The OM channel is faulty.
l OM channel interruption: The OM channel is intermittently interrupted.
Related Information
None
Possible Causes
l The transmission network is faulty.
l The OM channel parameters are incorrectly configured on the eNodeB or mobility
management entity (MME).
l Some ports are disabled in the transport network.
Fault Handling
None
Typical Cases
None
12 Troubleshooting Transmission
Synchronization Faults
This chapter describes how to troubleshoot transmission synchronization faults. This type of
faults include the clcok reference problem, IP clock link fault, system clock unlocked fault, base
station synchronization frame number error, or time synchronization failure.
Fault Description
External reference clocks for eNodeBs include GPS, synchronous Ethernet, clock over IP, BITS,
E1/T1, and TOD clocks. Any abnormality in a reference clock will cause the eNodeB incapable
of locking the reference clock. The clock status can be checked by running the DSP
CLKSTAT command.
l The value of Current Clock Source State indicates an unknown status.
l The value of Current Clock Source State indicates that the reference clock is abnormal,
for example, the reference clock is lost.
l The value of PLL Status indicates that the PLL status is abnormal, for example, the
reference clock is in free-run mode or there is excessive frequency deviation.
l The value of Clock Synchronization Mode indicates that the clock synchronization mode
is not set to a specified mode.
Background Information
l The following describes how to perform a clock quality test:
1. Start a clock quality test by running the STR CLKTST command.
2. Several hours later, stop the clock quality check by running the STP CLKTST
command.
3. Check the clock quality test result by running the DSP CLKTST command.
Possible Causes
l The clock mode is incorrectly set.
l The clock source is incorrectly added.
l The clock working mode is incorrectly set for the eNodeB.
l The external reference clock is abnormal, for example, there is excessive frequency
deviation.
l The clock source is incorrectly selected, which leads to a clock lock failure.
Troubleshooting Flowchart
None
Troubleshooting Procedure
1. Check the clock configuration for the eNodeB.
a. Check whether the clock synchronization mode is set to a specified mode.
Check whether the mode is set to the required one, for example, frequency
synchronization or phase synchronization. If the configuration is incorrect, change the
mode to the required one.
b. Check whether the clock sources are correctly added.
Use different query commands for different clock sources. For details, see eNodeB
MML Command Reference.
c. Check whether the work mode of the clock is correctly set.
If the eNodeB needs to lock an external clock source, set the clock working mode to
AUTO or MANUAL. The difference between the two settings are:
l AUTO indicates that the eNodeB automatically selects a reference clock based on
the status, priorities, and link available status of reference clocks.
l MANUAL indicates that the eNodeB is forced to select a user-defined reference
clock.
l If the clock working mode is set to AUTO using the SET CLKMODE command, the
reference clock is the one automatically selected. The query command is DSP
CLKSTAT.
l If the link availability status of the selected clock source is Available but the link
activation status is Unactivated, the reference clock is the one manually selected after
the clock working mode is set to MANUAL using the SET CLKMODE command.
4. Check whether the eNodeB correctly locks an external clock source.
To check the lock status, run the DSP CLKSTAT command. The following describes the
parameters in this command:
l Current Clock Source: It indicates the clock source to be traced by the eNodeB.
l Current Clock Source State: The value should be Normal.
l PLL Status: The initial status should be Fast Tracking, and then Locked.
l Clock Synchronization Mode: It indicates the configured clock synchronization mode.
– Non-IP clock
For a non-IP clock source, if the link available state is available and the link active
state is activated in step 3, the states queried by running DSP CLKSTAT must be
normal.
The only risk is that the eNodeB enters free-run mode (instead of locked mode) after
a period of fast tracking. The eNodeB adjusts the local oscillator during fast tracking,
but the difference between the local oscillator and external clock sources is still
above the locking threshold. Therefore, the eNodeB cannot lock an external clock
source and enters free-run mode.
In this case, perform a clock quality test to check the frequency deviation values,
and report them to Huawei technical support.
– IP clock
For an IP clock, even if the clock link is available and activated, it cannot be
guaranteed that all check items are normal. The query command is DSP
CLKSTAT. The reason is that whether the eNodeB can lock an external clock
source depends on two packets (Sync and Delay_Resp) as well as the clock
information the packets carry.
In this situation, take two actions: (1) Collect clock packets received by the eNodeB
on the M2000 or collect headers of the packets on the nearest transmission
equipment; (2) Perform a clock quality test on the IP clock in the same way as that
for a non-IP clock. Then, send the packets (or packet headers) and quality test result
to Huawei technical support.
5. If the transmission synchronization fault persists, contact Huawei technical support.
Typical Cases
None
l Encapsulation between two eNodeBs: Data streams between two eNodeBs are encapsulated
in transport mode.
l Encapsulation between an eNodeB and an SeGW: Data streams (except those between the
SeGW and the EPC) are encapsulated in tunnel mode.
l Encapsulation between an eNodeB and the EPC: Data streams over the S1 interface are
encapsulated in transport mode.
Transmission security faults occur in most cases where security link negotiation between the
eNodeB and the security gateway fails. Parameters affecting the negotiation include IKE
parameters and IPSec parameters. IKE parameters include the ciphering algorithm, verification
algorithm, IKE version, identity authentication mode, and shared key. IPSec parameters include
the ciphering mode, ciphering algorithm, authentication algorithm, and authorization mode. For
details, see eRAN Transmission Security Feature Parameter Description.
Fault Description
When a transmission security fault occurs:
l The eNodeB is out of control, and all operation commands cannot be delivered from the
M2000 to the eNodeB.
l The eNodeB is under control, but transmission-related alarms are displayed on the Web
LMT.
l Transmission detection commands such as ping cannot be successfully executed.
Background Information
l Related Alarms
– ALM-26841 Certificate Invalid
– ALM-25891 IKE Negotiation Failure
– ALM-25880 Ethernet Link Fault
– ALM-26223 Transmission Optical Interface Performance Degraded
– ALM-26222 Transmission Optical Interface Error
– ALM-26220 Transmission Optical Module Fault
– ALM-25901 Remote Maintenance Link Failure
– ALM-25888 SCTP Link Fault
Possible Causes
Possible causes are:
l Transmission security parameters are mismatched between the local and peer ends, which
leads to IPSec tunnel negotiation failures.
l Security tunnel update fails due to certificate update failures or certificate expiry.
Troubleshooting Flowchart
Transmission security faults are generally due to data configuration. Therefore, data consistency
check between the eNodeB and the SeGW is crucial to troubleshooting.
Troubleshooting Procedure
1. Check whether an IPSec policy group is bound to the port involved.
Run the LST IPSECBIND command. The output is as follows:
If no binding relationship is found, bind an IPSec policy group to the port. Run the ADD
IPSECBIND command, and specify values for the mandatory parameters such as the slot
No., subboard type, port type, port No., and IPSec policy group name. To learn about the
IPSec policy group name, run the LST IPSECPOLICY command.
2. Check whether the IKE proposal is correctly configured.
Run the DSP IKEPROPOSAL command for query. If the values in the red frame are
inconsistent with the network plan, run the MOD IKEPROPOSAL command to change
them.
4. Check whether the IKE proposal configuration on the eNodeB is the same as that on the
SeGW.
Run the LST IKEPROPOSAL command to check whether the IKE proposal with the ID
indicated in 3 is consistent with the that used by the SeGW. Pay more attention to the
encryption algorithm, authentication algorithm, IKE version, and key. If the authentication
is based on digital certificates, go to 5. If the authentication is based on shared keys, go to
6.
5. Check whether the eNodeB's certificate chain is correct.
Run the DSP TRUSTCERT command to check the operator's root certificate. Pay more
attention to the information in the red frame. Check whether the name of the root certificate
is correct and whether the root certificate has expired. If the root certificate is incorrect,
apply for a new one. Then, run the DLD CERTFILE command to download the root
certificate, and run the ADD TRUSTCERT command to add the root certificate to the
eNodeB.
Run the DSP CERTMK command check the operator's device certificate. Pay more
attention to the information in the red frame. Check whether the issuer of the root certificate
is correct and whether the root certificate has expired. If the device certificate is incorrect,
apply for a new one. Then, run the DLD CERTFILE command to download the device
certificate, and run the ADD CERTMK command to add the device certificate to the
eNodeB.
Run the DSP APPCERT command to check whether the certificates used for IKE and SSL
are correct. Pay more attention to the information in the red frame. If a used certificate is
incorrect, run the MOD APPCERT command to change it.
Typical Cases
The following describes how to troubleshoot an IKE negotiation failure.
Fault Description
An IPSec policy group was bound to a port, but an IPSec tunnel failed to be set up between the
eNodeB and the SeGW.
Fault Diagnosis
to send six IKE_AUTH messages before staring the next round of authentication
negotiation.
3. OM personnel checked the IKE_AUTH messages sent from the SeGW to the eNodeB.
The notification payload in the messages was NO_PROPOSAL_CHOSEN. This indicated
that the SeGW failed to obtain the required IPSec proposal and therefore this round of IKE
authentication negotiation failed. The SeGW sent these messages to notify the eNodeB of
this failure.
NOTE
The eNodeB considered the encrypted notification messages invalid and therefore discarded these
messages.
Fault Handling
This fault was due to the configuration on the peer equipment. After the message transmission
rule on the peer equipment was modified, the fault was rectified.
This chapter describes the method and procedure for troubleshooting radio frequency (RF) unit
faults in the Long Term Evolution (LTE) system.
Generally, RF unit faults are indicated by alarms. Therefore, this chapter describes how to
troubleshoot RF unit faults based on reported alarms.
VSWR Test
During a VSWR test on a radio frequency (RF) unit, power of the RF unit is first coupled as
forward power and backward power by using directional couplers, and then they are measured
by using standing-wave detectors. The difference between the measured forward power and
backward power is the return loss, which can be converted to a VSWR value by using related
formulas. The VSWR value is used to determine whether a VSWR alarm is reported.
The VSWR test result indicates the connection condition between the RF unit and the antenna
system. If a large VSWR value is obtained, the antenna system is improperly connected with
the RF unit. The output power of the RF unit is not transmitted through the antenna but reflected
back. A high reflected power damages the RF unit, and the total reflection may break down the
unit. To avoid the preceding faults, the VSWR alarm post-processing switch must be turned on
for a remote radio unit (RRU) to be added. In this way, if a major VSWR alarm is generated,
the RRU automatically shuts down the faulty transmit (TX) channels and then does not provide
output power. In this scenario, the cell served by the RRU degrades the capacity or becomes
unavailable. The cell coverage and performance also deteriorate.
NOTE
If a major VSWR alarm is generated, the faulty TX channels are automatically shut down. If you have
rectified the related faults, you can run the STR VSWRTEST command or manually modify the TX
channel configuration to open the TX channels. However, the VSWR alarm still exists. It will be cleared
only after the RRU is reset.
PIM Interference
PIM interference is induced by non-linearity of the passive components in the TX system. The
antenna non-linearity is indicated by the intermodulation (IM) suppression degree. For a linear
system, if the input is two signals, the output is also two signals without any additional frequency
component. For a non-linear system, if the input is two signals, new frequency components are
generated in the system and added to the output, and then the output is more than two signals.
The added frequency components are known as the IM products. The process of generating
frequency components is called IM. If the IM products work on frequencies within the receive
(RX) frequency band and accordingly increase the uplink interference or received total wideband
power (RTWP), IM interference is generated. In a high-power and multi-channel system, non-
linearity of the passive components generates high-order IM products. These IM products and
the operating frequency are mixed to from a group of new frequencies, and accordingly a group
of useless spectra is generated and affects the normal communication.
In a linear system, assume that the two input signals work on the frequencies of f1 and f2. Then,
IM components are generated, such as two IM3 components operating on the frequencies of (2
x f1 - f2) and (2 x f2 - f1), and two IM5 components operating on the frequencies of (3 x f1 - 2
x f2) and (3 x f2 - 2 x f1). As shown in the following figure, the input signals and IM components
are marked in green and red, respectively. The IM order of an IM component (m x f2 - n x f1)
is the sum of m and n. These IM components are generated symmetrically on the left and right
of the wanted signals. Their intervals depend on the IM orders and the maximum frequency
spacing (or bandwidth) of the input signals. A higher IM order leads to a lower amplitude for
the IM components and a further distance from the wanted signals, and therefore a smaller
impact.
All passive components encounter intermodulation distortion that may be caused by unreliable
mechanical contacts, poor soldering, or oxidization.
Passive components such as combiners, duplexers, and filters require specific IM suppression
degrees. If the IM suppression degree of an IM order meets the requirements, the IM products
have no impact on the system performance. Generally, cables do not have requirements for PIM
suppression degrees. A cable requiring high PIM suppression degrees can reduce PIM
interference, but it is too expensive to be used widely.
Note that an improper connection is not definitely coupled with the PIM interference. If an RF
unit is properly connected with the antenna system, high-power IM components may also be
generated due to insufficient PIM suppression degrees of the cables.
If the IM components work on frequencies within the RX frequency band, this increases the
noise floor of the RX channels and decreases the sensitivity of the RF unit. For a frequency
division duplex (FDD) system, frequency bands such as 800MHz and 700MHz have small
duplex spacing (spacing between the DL frequency and the UL frequency). Meanwhile, the IM3
and IM5 products of the TX signals work on frequencies within the RX frequency band. In this
scenario, the impact of PIM interference must be paid special attention.
To sum up, the generating conditions for PIM interference are as follows:
The input is TX signals of the eNodeB, or occasionally external interference signals transmitted
through the antenna. The media is cables or passive components such duplexers and antennas.
The output is IM products. The power of the IM components depends on the IM suppression
degree of the passive components or cables.
Add downlink simulated load to increase the TX power. If the RTWP obviously multiplies,
PIM interference exists.
l The RTWP is sensitive to the positions of cables and connectors.
Observe the RTWP while shaking the cable near a connector or hitting a connector. If the
RTWP changes greatly, PIM interference exists.
l The impact of PIM interference increases with the bandwidth.
The impact of PIM interference must be taken into account for frequency bands with the
duplex spacing within 30 MHz.
l The generating mechanism of PIM interference is complicated.
Generally, PIM interference exists when multiple frequency components are generated.
However, in a non-linear system, a single amplitude-modulated signal may generate
frequency components, and this leads to spectrum expansion. These frequency components
are also IM products. Moreover, in a scenario with improper connections, even continuous
wave (CW) signals generate frequency components.
External Interference
Electromagnetic waves are propagated through space in certain directions in the electric field.
Based on the directions (also known as polarization), the electromagnetic waves are classified
into linear polarized waves and circular polarized waves. Antennas with different polarization
can obtain various gains from linear polarized waves.
eNodeBs use orthogonal 45° dual-polarized antennas. Therefore, linear polarized waves
received by these antennas have main and diversity gain differences.
In some cases, external interference may also lead to RTWP imbalance alarms.
For example, linear polarized radio signals from a radar or navigation satellite high up in the air
are propagated without multiple reflections. When the eNodeB receives such interference
signals, the orthogonal dual-polarized antennas can obtain various gains based on the angle
between the interference signals and the antenna polarization. If the interference signals exist
for a long time, an RTWP imbalance alarm can be generated.
Shut down downlink channels and then check whether the RTWP is excessively high.
Yes: Go to 2.
No: There is no PIM interference.
2. Check whether external interference exists. Perform the following steps:
Disconnect an RRU or RFU from the jumper, and then connect the RRU or RFU to a
matched load or direct open-circuit to check whether the RTWP falls within the normal
range.
If the RTWP is normal, external interference exists.
l Two interference signals received by a receiver are correlated but with different power.
They have the same impact on the RTWP.
l External interference occupies a certain bandwidth. Monophony interference does not carry
any useful information, however, it seldom exists.
l External interference is received only by antennas, which simplifies the troubleshooting
procedure.
The following figure shows the structure and working principles of an RET antenna equipped
with an RCU.
Figure 14-3 Structure and working principles of an RET antenna equipped with an RCU
Troubleshooting Flowchart
Troubleshooting Procedure
1. Check whether there is any alarm related to voltage standing wave ratio (VSWR) faults in
the active alarms on the eNodeB or there is any abnormal VSWR test result. If yes,
troubleshoot the VSWR faults. If no, go to 2.
2. Check whether there is any alarm related to RTWP faults in the active alarms on the
eNodeB. If yes, troubleshoot the RTWP faults. If no, go to 3.
3. Check whether there is any alarm related to ALD link faults in the active alarms on the
eNodeB or there are any abnormal ALD links. If yes, troubleshoot the ALD link faults. If
no, go to 4
4. If the fault persists, contact Huawei technical support.
Fault Description
An alarm ALM-26529 RF Unit VSWR Threshold Crossed is reported if there are VSWR faults
in the radio frequency (RF) channels of an RF unit.
Related Information
None
Possible Causes
l The VSWR alarm threshold is set to a low value.
l Hardware installation is improper. For example, a jumper is improperly connected; a feeder
connector is insecurely installed or is immersed in water; the feeder connected to an antenna
port is bent, deformed, or damaged; a feeder is insecurely connected.
l The frequency band supported by the RF unit is inconsistent with that supported by the
components of the antenna system.
l A VSWR-related circuit fault occurs in the RF unit, or other hardware faults occur in the
RF unit.
The execution of the STR VSWRTEST command interrupts services carried by the RF unit.
Run the STR VSWRTEST command to query the offline VSWR value.
NOTE
It is recommended that multiple frequencies within the operating frequency range supported
by the cell be used as the test frequencies.
4. Compare the VSWR values queried by running the STR VSWRTEST and DSP VSWR
commands.
If the two values are the same and are greater than the threshold for reporting VSWR alarms,
onsite investigation is required. Go to 5.
If the two values are significantly different, run the STR VSWRTEST command to
perform VSWR tests on a frequency point at an interval of 1 MHz or smaller within the
bandwidth range to compare tested VSWR values.
l If the values are the same, the feeder between the RF unit and the antenna system may
be insecurely connected and accordingly the queried VSWR values are not stable. In
this case, check the feeder connection at the local end. Then, go to step 4.
l If some of the values are large, a hardware fault may occur in the RF unit. Save the test
results and submit the results together with one-click log files of the main control board
and RF unit to Huawei technical support for further analysis.
5. Check the feeder connection at the local end.
Check whether the frequency band supported by the RF unit is consistent with that
supported by the components of the antenna system according to the network plan. The
antenna system consists of antennas, feeders, jumpers, combiner-dividers, filters, and
tower-mounted amplifiers (TMAs).
It is recommended that a Sitemaster be used to measure the distance between the point with
a large VSWR value and the test point during a VSWR test.
If no Sitemaster is available, locate the fault by using isolation methods. Add load to
different parts of the feeder at the local end. Then, run the STR VSWRTEST to start a
VSWR test on each isolation part of the feeder to locate the fault.
6. If the feeder connection is normal, contact Huawei technical support.
Typical Cases
None
Fault Description
An RTWP-related alarm is reported if there are received total wideband power (RTWP) faults
in the radio frequency (RF) channels of an RF unit.
Related Information
Related alarms are as follows:
l ALM-26522 RF Unit RX Channel RTWP/RSSI Unbalanced
l ALM-26521 RF Unit RX Channel RTWP/RSSI Too Low
Possible Causes
l The setting of attenuation on the RX channel of the RF unit is incorrect.
l The feeder connected to the RF unit is faulty.
l Passive intermodulation (PIM) exists.
l External interference exists.
l The feeder is improperly connected with the antenna.
l The hardware in an RF module is faulty.
l Faults may be caused by other uncertain factors.
If the values on one RSSI curve are significantly greater than the values on other RSSI
curves, PIM interference exists. If values on all RSSI curves are basically the same,
there is no PIM interference and go to 3.
If PIM interference exists according to the preceding investigation, use either of the
following methods to determine the location or device where PIM is introduced:
l Add a simulated load and shake the cable segments by segments from the RF unit top
to the antenna port. If RSSI values change dramatically when shaking a segment, PIM
interference is introduced by this segment.
l Breakpoint-based PIM detection:
By using breakpoints, divide the cable connecting the RF unit top to the antenna port
into several segments by using breakpoints. Disconnect the cable at the breakpoints one
by one along the direction from the RF unit top to the antenna port. Each time the cable
is disconnected at a breakpoint, connect the breakpoint to a matched load or a low-
intermodulation attenuator, add a downlink simulated load, and check whether the
RTWP values increase. Ensure the inserted attenuator has low intermodulation
interference so that it will not add additional PIM interference to the cable. If the RTWP
values increase, PIM interference is introduced by the device or cable before this
breakpoint.
For example, set four breakpoints from the RF unit top to the antenna port, as shown in
Figure 14-8. At first, disconnect the cable at breakpoint 1, connect breakpoint 1 to a
low-intermodulation attenuator, and add a downlink simulation load. If RTWP values
do not change, PIM interference is not caused by the RF unit. If RTWP values increase,
PIM interference is caused by the RF unit. Perform the similar steps to the other
breakpoints.
If the interference is caused by the RF unit, replace the RF unit. If the interference is caused
by the cable, replace the cable and then check whether the interference still exists. If the
interference is removed, no further action is required.
If the interference persists, check whether the interference exists in the antenna.
3. Perform Broadband on-line frequency scan to check whether external interference exists.
Observe the scan result until the ALM-26239 RX Channel RTWP/RSSI Unbalanced
Between RF Units alarm is reported. Then, send the local tracing results, running logs of
RF units, and investigation results to Huawei technical support for fault diagnosis.
For the procedure for performing Broadband on-line frequency scan, see Monitoring
eNodeB Performance in Real Time > Spectrum Detection in eNodeB LMT User
Guide.
4. Check whether a crossed pair connection exists.
Description
RF channels in an RF unit must be used by the same sector except in MIMO mutual-aid
scenarios. The purpose is to ensure the consistency between the direction and coverage of
an antenna so that balanced RTWP values are obtained. If the RF channels of an RF unit
are used by different sectors, the RF unit will have different RTWP values. Note that the
ALM-26522 RF Unit RX Channel RTWP/RSSI Unbalanced alarm is reported only
when the number of UEs is significantly different between two cells with a crossed pair
connection.
The ALM-26522 RF Unit RX Channel RTWP/RSSI Unbalanced alarm caused by a
crossed pair connection has the following characteristics:
l The alarm is reported in at least two sectors under the same eNodeB.
l RTWP variations of different RF channels are uncorrelated.
l RTWP variations are similar in different sectors.
Troubleshooting Method
The cells with a crossed pair connection can be determined by using either of the following
two methods:
l Perform drive tests and trace signaling without interrupting the services.
Make a phone call in a cell (for example, cell 1). Check whether the UE accesses cell
1, where the UE is located. If the UE accesses another cell (for example, cell 3), the
antennas of cells 1 and 3 are cross-connected.
l Run the STR CROSFEEDTST command to start the a crossed pair connection test.
If the antenna system is not equipped with an external filter, the Start Test
Frequency and End Test Frequency parameters do not need to be specified. The test
will be performed in the test frequency band supported by the RF unit. If the antenna
system is equipped with an external filter, specify the Start Test Frequency and End
Test Frequency parameters to the start frequency and end frequency, respectively, for
the external filter.
NOTE
Note the following before starting a crossed pair connection test:
l This test is an offline test and the execution of this command interrupts services. If this command
is executed on a multi-mode RF unit or an RF unit connected to an antenna shared by the local
and peer modes, the services of the peer mode carried by this RF unit are also interrupted.
l This test cannot be performed simultaneously with the VSWR test or distance to fault (DTF) test.
l This command applies to the scenario where RF modules are in 2T2R mode. If this command is
executed in other scenarios, the result may be incorrect.
l The VSWR test has a great impact on the precision of this test because the VSWR will cause a
gain loss. You are advised to perform a high-precision VSWR test before running this command.
If the VSWR is greater than 2.5, you are not advised to run this command.
l This test cannot be applied to 1T2R RF units if RRU combination is not used. Otherwise, the result
may be incorrect.
l This command does not apply to multi-RRU cells, distributed cells, or cells under the eNodeB
with an omnidirectional antenna.
l This command does not apply to the scenario where all antennas of one sector are connected to
another sector.
l Do not start this test if the number of sectors that work in the same frequency band and support
the test is less than two.
l If the bandwidth between the start frequency and end frequency of the external filter is less than
10 MHz, the execution output is not reliable.
The Crossed value of RESULT appears in pairs. If RESULT is Crossed for two
sectors, a cross pair connection exists between the two sectors. Detailed information
about the sectors with a crossed pair connection is displayed in the detection result.
The result is similar to the following:
Handling Suggestion
After the sectors with a crossed pair connection are determined, adjust their antenna
connection. Since there are three types of crossed pair connections (main-main, main-
diversity, and diversity-diversity), several rounds of antenna adjustment may be required
before the test result verifies no crossed pair connection.
5. Check whether random electromagnetic interference exists.
If the fault is not caused by the preceding factors, it may be caused by random
electromagnetic interference. Occasional electromagnetic interference has a small impact
on the network performance. Therefore, ignore it if the RTWP imbalance alarm is not
frequently triggered. If the RTWP imbalance alarm is frequently triggered, contact Huawei
technical support.
6. If the fault persists, contact Huawei technical support.
Typical Cases
None
Fault Description
An ALD-related alarm is reported if there are antenna line device (ALD) link faults in the radio
frequency (RF) channels of an RF unit.
Related Information
Related alarms are as follows:
Possible Causes
Possible causes for ALD-related alarms are listed as follows:
l The setting of the ALD power supply switch is improper.
l The settings of the ALD current alarm thresholds are incorrect.
l The ALD connections are abnormal.
l The ALDs are faulty.
Typical Cases
None
NOTE
Problems that may be encountered during license application are not described in this document. For details,
see eRAN License Management Feature Parameter Description.
Operators can purchase the license to determine the network functions and capacity at a specific
stage, maximizing the return on investment. For details, see eRAN License Management Feature
Parameter Description.
Possible Causes
The possible causes of license faults are as follows:
l Incorrect operations
l Misunderstanding over the license mechanism
l Errors in license files
l Product defects
Troubleshooting Flowchart
The following figure shows the troubleshooting flowchart for license faults that occur in different
scenarios.
Troubleshooting Procedure
1. Determine whether license faults occur during license installation. If so, perform the
procedure for troubleshooting license faults that occur during license Installation. If not,
go to 2.
2. Determine whether license faults occur during network running. If so, perform the
procedure for troubleshooting license faults that occur during network running. If not, go
to 3.
3. Determine whether license faults occur during network adjustment. If so, perform the
procedure for troubleshooting license faults that occur during network adjustment. If not,
go to 4.
4. If the faults persist, contact Huawei technical support.
Fault Description
If license installation fails, the following error messages will be displayed in the MML command
output:
l License check failed; license serial number became invalid; the license file does not match
the product; the license versions do not match.
l The license file has expired; the file type is DEMO.
l The license control items do not match; the configured value exceeds the value in the license
file or the validity date of the control item is earlier than that in the license file.
Related Information
During license installation, the eNodeB checks the license. The check items are as follows:
l Integrity check: Whether the product name in the license file matches the software name;
whether the checks on full-text signature, Service field signature, and feature signature are
successful.
l Accuracy check: Whether the equipment serial number (ESN) in the Service field matches
the ESN of the equipment; whether the VR version number in the Service field matches
the VR version of the software.
l Validity period check: Whether the license for the feature exceeds the validity date; whether
the license for the feature exceeds the validity date and protection period.
l Difference check: Differences between new and old license files, including whether any
function items in the new license files are lost, whether any resource items are reduced or
lost, and whether the validity period for the feature becomes short.
l If the ESNs or VR versions do not match, the system runs based on the function items and resource
configuration defined in the license file. If the system does not read correct function items or resource
items from the license file, the system runs with the minimum configuration.
l If the ESNs or VR versions do not match and the license for the feature exceeds the validity date and
protection period, the feature runs in default mode. Otherwise, the feature runs in trial mode.
l If there is a license file in which the ESNs or VR versions do not match on the system, a license file
with the same error as the existing license file cannot be installed. If a correct license file exists, a
license file in which the ESNs or VR versions do not match can also be installed.
l If the license file to be installed expires, that is, the license for all features exceeds the validity date,
the license file installation fails. If only the license for some features exceeds the validity date, the
license file can be installed and a message prompting that the license for some features exceeds the
validity date is displayed.
l During license installation, if the function items, resource items, and validity period in the license file
are different from those in the previous license file, the installation result indicates the differences and
the user can choose to forcibly install the new license file.
l If the value of a license control item in the license file is smaller than the corresponding configured
value (for example, the number of cells), the license file fails to be installed.
Possible Causes
l The ESNs, VR versions, or product types do not match.
l The license file has expired or the license file type is incorrect.
l The system configuration items do not match the license control items.
Fault Diagnosis
If the license installation fails, an error message will be displayed in the MML command output.
You can diagnose the fault based on the error message. For details, see eRAN License
Management Feature Parameter Description.
Fault Handling
1. Rectify the fault based on the error message by referring to eRAN License Management
Feature Parameter Description.
2. If the fault persists, contact Huawei technical support.
Typical Cases
Fault Description
After eNodeBs at a site were upgraded from eRAN2.0 to eRAN2.1, the eNodeBs experienced
failures to install commercial licenses. The following error message was displayed:
The configured value of the control item is greater than the value in the license
file
Fault Diagnosis
During commercial license installation, the M2000 displayed the following message:
The confitgred valued of the control item is greater than the value in the license
file
This message shows that the configured values on the current eNodeB exceeded the limits of
the license file. Compare the license control items in the license file with the configuration that
has taken effect on the eNodeB to find the configuration items that have been activated on the
eNodeB but were not authorized by the license file.
Fault Handling
1. Query the configured values on the eNodeB with the authorized values in the license file.
Run the DSP LICENSE command to query the configured values on the eNodeB, and
compare the configured values with the allocated values in the license file. The command
output is as follows:
As shown in the figure, Allocated, Config, and Actual Used are the allocated value in the
license file, the configured value on the eNodeB, and the actual value.
When the configured value on the eNodeB exceeds the allocated value in the license file,
the following error message is displayed:
Data Configuration Exceeding Licensed Limit
Fault Description
Related alarms and events are generated.
Related Information
l Related alarms
– ALM-26815 Licensed Feature Entering Keep-Alive Period
– ALM-26816 Licensed Feature Unusable
– ALM-26817 License on Trial
– ALM-26818 No License Running in System
– ALM-26819 Data Configuration Exceeding Licensed Limit
l Related events
– EVT-26820 License Emergency Status Activated
– EVT-26821 License Emergency Status Ceased
Possible Causes
l Licensed Feature Entering Keep-Alive Period
This alarm is generated when the licensed feature exceeds the validity date. You can run
the DSP LICENSE command to check the license control items that exceed the validity
date. After the licensed feature exceeds the validity date, the feature enters the keep-alive
period of 60 days (the keep-alive period is not affected by the system time jumping). During
the keep-alive period, the expired feature operates in the current license settings. After the
keep-alive period, the expired feature operates in the default license settings.
l Licensed Feature Unusable
This alarm is generated when the licensed feature exceeds the keep-alive period.
l License on Trial
This alarm is generated when a license file enters the keep-alive period. The possible causes
are as follows:
– The license file exceeds the validity date.
– The license file is revoked.
– The ESN in the license file is inconsistent with the actual ESN of the eNodeB.
– The eNodeB version in the license file is inconsistent with the running version of the
eNodeB.
– The ESN and eNodeB version in the license file are inconsistent with the actual ESN
and the running version of the eNodeB.
l No License Running in System
This alarm is generated when there is no valid license file on the system. The possible
causes are as follows:
– The license file exceeds the keep-alive period of 60 days.
– The license file is not found or errors occur during the license check when the system
is started.
l Data Configuration Exceeding Licensed Limit
This alarm is generated when the eNodeB configuration exceeds the limits of the license
(including the default license). If this alarm is generated due to data modification during
the system running, the original data configuration is used. If this alarm is generated during
the system startup, the licensed specifications of the feature is used.
l License Emergency Status Activated
This event is generated when the license emergency status is activated. In the license
emergency status, the eNodeB operates with the dynamic count-type resource items and
performance control items (such as traffic and number of users) reaching the maximum
values, and the other control items remain unchanged.
l License Emergency Status Ceased
This event is generated when the license emergency status is ceased automatically seven
days after the eNodeB enters the emergency status or the license file is uploaded again to
the eNodeB in the emergency status.
Fault Diagnosis
Refer to the alarm reference documents to locate the alarm causes and clear the alarms.
Fault Handling
1. Clear the alarms according to the alarm handling suggestions.
2. If the fault persists, contact Huawei technical support.
Typical Cases
None
Fault Description
After a command was run to enable a function, a configuration activation failure occurred due
to license restriction.
Related Information
l License control item classification
License control items are classified into resource items and function items. The DSP
LICENSE command can be used to list all the control items on the maintenance console.
– The allocated value for a resource item generally exceeds 1. Operators determine the
number of resource items in the commercial license they purchase based on the site
requirements. Typical resource items include the cell bandwidth, number of accessed
users, and number of cells.
– The function items are assigned values of 0 or 1 to indicate whether the functions are
purchased. The typical function items include enhanced synchronization (clock
synchronization), IPSec, and IEEE 802.1X-based access control.
License control items can be further classified into the following five categories based on
the configured value and usage:
– Dynamic counting items (resource items): These items are passive control items without
requiring manual configuration. The configured value is NULL. These items
dynamically occupy session resources. When a session starts, the occupied resources
are counted and are subtracted from the total number of resources. When the session
stops, the occupied resources are released.
– Performance items (resource items): These items are passive control items without
requiring manual configuration. The configured value is NULL. When the eNodeB
starts up, the eNodeB learns about the allocated values of these items by queries. During
eNodeB operation, the quantity of occupied resources is ensured to be less than the
allocated values.
– Static counting items (resource items): These items are active control items and require
manual configuration. The corresponding resources are statically configured resources.
When the eNodeB starts up, the eNodeB obtains the configured values of these items
from the configuration file and uses these configured values to apply for the
corresponding types of resource. When the eNodeB stops providing services, the
resources are released.
– Boolean counting items (resource items): These items are active control items and
require manual configuration. The corresponding resources are Boolean resources at
the NE's submodule level. When the eNodeB starts up, the eNodeB decides whether to
apply for the corresponding resources based on the configured values (0 or 1). When a
submodule stops providing services, its resources are released.
– Boolean items (function items): These items are passive control items without requiring
manual configuration. The configured value is NULL, and the corresponding resources
are NE-level Boolean resources. When the eNodeB starts up, the eNodeB checks the
values of these items to see whether the corresponding functions are enabled.
l License control item description
– Power: RF Output Power (per 20W) (FDD)
The power license controls the total required power of radio frequency (RF) modules
in an eNodeB. Each RF module provides 20 W power by default. Extra power must be
purchased in units of 20 W. If the eNodeB operates in default license mode, the licensed
power is 0 W by default.
– Bandwidth: Carrier Bandwidth (per 5MHz) (FDD)
The bandwidth license controls the total required bandwidth of an eNodeB. In the Long
Term Evolution (LTE) system, bandwidth of each carrier is scalable. It can be 1.4 MHz,
3 MHz, 5 MHz, 10 MHz, 15 MHz, or 20 MHz. Bandwidth is purchased in units of 5
MHz.
– CSFB control item
The control items for UTRAN, GERAN, and CDMA control the CSFB function for
these three radio access technologies (RATs).
LLT1CFBU01: CSFB to UTRAN
LLT1CFBG01: CSFB to GERAN
LLT1CFBR01: CSFB (FDD) to CDMA2000 1xRTT
– eNodeB throughput: Throughput Capacity (per Mbps)
This control item specifies the total licensed throughput of the eNodeB, which includes
the uplink and downlink throughput. Users can run the MOD LICRATIO command
to specify the proportion of licensed uplink throughput to the total licensed throughput.
Possible Causes
l No license is running on the eNodeB.
l The license for the eNodeB has expired, and the keep-alive period has expired.
l The license for the eNodeB does not have the permission to apply for license control items.
Typical Cases
None
When faults cannot be rectified by referring to this document, collect fault information for
Huawei technical support to quickly troubleshoot the faults. This section describes how to collect
fault information.
Log file eNodeB Run the LST VER command to query the eNodeB software version.
software
version
Statistics Method 1: If the statistics is included in the BRD logs, refer to the
log collection method for BRD log.
Method 3: Log in to the FTP server on the M2000 through the FPT
client and obtain the statistics logs in /export/home/sysm/ftproot/
pm. The statistics logs of different NEs are distinguished from each
other by the NE names.
M2000 log M2000 logs include the current logs and archived historical logs.
Current logs are saved in /export/home/omc/var/logs of the M2000
server. Historical logs are archived in /export/home/omc/var/logs/
tracebak of the M2000 server. Log in to the FTP server on the
M2000 through the FTP client to obtain the required logs.
Cell DT The cell DT tracing can be performed only on the M2000 and you
tracing can obtain the tracing file as follows:
1. Choose Monitor > Signaling Trace > Signaling Trace
Management from the main window of the M2000. The
Signaling Trace Management window is displayed.
2. In the navigation tree, double-click Cell DT Trace. The Create
Trace Task dialog box is displayed.
3. Set parameters and then click Finish to start the tracing task.
4. After the tracing task is completed, click Export to export the
tracing file to the specified directory.
LTE/EPC The LTE/EPC end-to-end user tracing can be performed only on the
end-to-end M2000 and you can obtain the tracing file as follows:
user tracing 1. Choose Monitor > Signaling Trace > Signaling Trace
Management from the main window of the M2000. The
Signaling Trace Management window is displayed.
2. In the navigation tree, double-click LTE/EPC End To End User
Trace. The Create Trace Task dialog box is displayed.
3. Set parameters and then click Finish to start the tracing task.
4. After the tracing task is completed, click Export to export the
tracing file to the specified directory.
LTE cell The LTE cell tracing can be performed only on the M2000 and you
tracing can obtain the tracing file as follows:
1. Choose Monitor > Signaling Trace > Signaling Trace
Management from the main window of the M2000. The
Signaling Trace Management window is displayed.
2. In the navigation tree, choose Trace Type > LTE > Cell
Trace. Double click Cell Trace. The Cell Trace dialog box is
displayed.
3. Set parameters and then click OK to start the tracing task.
4. After the tracing task is completed, click Export to export the
tracing file to the specified directory.
GTP-U The GTP-U tracing can be performed only on the M2000 and you
tracing can obtain the tracing file as follows:
1. Choose Monitor > Signaling Trace > Signaling Trace
Management from the main window of the M2000. The
Signaling Trace Management window is displayed.
2. In the navigation tree, double-click GTPU Trace. The Create
Trace Task dialog box is displayed.
3. Set parameters and then click Finish to start the tracing task.
4. After the tracing task is completed, click Export to export the
tracing file to the specified directory.
Perfor Spectrum For details, see section "Spectrum Detection" in eNodeB LMT User
mance detection Guide.
monito
ring Interferenc 1. Choose Monitor > Signaling Trace > Signaling Trace
e RSSI Management from the main window of the M2000. The
statistic Signaling Trace Management window is displayed.
detect 2. In the navigation tree, double-click Interference RSSI Statistic
monitoring Detect Monitoring. The Create Trace Task dialog box is
displayed.
3. Set parameters and then click Finish to start the monitoring task.
4. After the monitoring task is completed, click Export to export
the monitoring file to the specified directory.
CPU usage 1. Choose Monitor > Signaling Trace > Signaling Trace
monitoring Management from the main window of the M2000. The
Signaling Trace Management window is displayed.
2. In the navigation tree, double-click CPU Usage Monitoring. The
Create Trace Task dialog box is displayed.
3. Set parameters and then click Finish to start the monitoring task.
4. After the monitoring task is completed, click Export to export
the monitoring file to the specified directory.