Professional Documents
Culture Documents
5G RAN2.0 KPI Introduction: Huawei Technologies Co., LTD
5G RAN2.0 KPI Introduction: Huawei Technologies Co., LTD
0 KPI Introduction
2 KPI Description
Huawei Confidential
Counter Organization
Counter organization:
1. Counter -> Function subset -> Measurement object
2. Counter -> Function subset -> Function set
Huawei Confidential
Service Measurement Object, Function Set, and Function Subset
in 5G RAN2.0
Measurement Object ID Measurement Object Name Description Introduced In
The NRCELL measurement object contains
Measurement of Cell Performance
NRCELL cell-level function subsets. Cells are deployed RAN1.0
(NRCELL)
on gNodeB central units (CUs).
• * In RAN2.0, the NRLOCELL MO is renamed "NRDUCELL" due to configuration object changes. The corresponding function subsets are
also renamed.
• The configuration model of CloudRAN becomes more complicated than that of integrated base stations. Therefore, there are more
measurement objects after CloudRAN is introduced.
Huawei Confidential
Service Function Subsets in 5G RAN2.0
Function Subset ID Function Subset Name Function Set Measurement Object Introduced In
PDCP.Cell PDCP Measurement PDCP NRCELL RAN1.0
User.Cell Cell User Quantity Measurement Traffic NRCELL RAN1.0
Reserve.Cell Cell Reserved Counter Measurement Reserve NRCELL RAN1.0
Thp.DuCell Throughput and Data Volume Measurement Traffic NRDUCELL RAN1.0
PRB.DuCell PRB Measurement RadioRes NRDUCELL RAN1.0
RLC.DuCell RLC Measurement RLC NRDUCELL RAN1.0
MAC.DuCell MAC Measurement MAC NRDUCELL RAN1.0
ChMeas.MCS. DuCell MCS Measurement ChMeas NRDUCELL RAN1.0
ChMeas.CQI. DuCell CQI Measurement ChMeas NRDUCELL RAN1.0
ChMeas.Pwr. DuCell Channel Quality Measurement ChMeas NRDUCELL RAN1.0
RA.DuCell Random Access Measurement RadioRes NRDUCELL RAN1.0
DC.Cell DC Measurement Algo NRDUCELL RAN1.0
Traffic.TRPIP.gNodeB gNodeB Transmission Interface Measurement Transport gNodeB RAN2.0
Traffic.TRPIP.gNBDU gNBDU Transmission Interface Measurement Transport gNBDU RAN2.0
Algo.Cell
Cell Algorithm Measurement Algo NRCELL RAN2.0
Algo.gNodeB gNodeB Algorithm Measurement Algo gNodeB RAN2.0
CallAtt.gNBDU gNodeB DU Call Processing Times Sig gNBDU RAN2.0
CallAtt.gNodeB gNodeB Call Processing Times Sig gNodeB RAN2.0
MIMO.DuCell MIMO Channel Measurement ChMeas NRDUCELL RAN2.0
CA.Cell Cell CA Measurement Algo NRDUCELL RAN2.0
CA.DuCell DU Cell CA measurement Algo NRDUCELL RAN2.0
UlDlDecoupling.Cell Uplink and Downlink Decoupling Measurement Algo NRDUCELL RAN2.0
• * In RAN2.0, the NRLOCELL MO is renamed "NRDUCELL" due to configuration object changes. The corresponding function subsets are
also renamed.
Huawei Confidential
5G Service Counter Report Interval
Report Interval
A gNodeB reports measurement results to the U2020 at the end of each measurement period. Therefore, the length
of a report interval equals the length of measurement period.
The measurement period is configurable on the U2020. The length of a long measurement period can be 30 minutes
or 60 minutes, and the length of a short measurement period can be 5 minutes or 15 minutes. Only one long
measurement period and one short measurement period can be configured.
Huawei Confidential
U2000 Performance Management
Huawei Confidential
Catalog
1 Basic Concepts of Counters
2 KPI Description
Huawei Confidential
5G KPI Architecture
Accessibility In NSA architecture, it is recommended that accessibility
KPIs, retainability KPIs, and mobility KPIs be obtained
from the LTE side.
Retainability In SA architecture, 5G-dedicated accessibility KPIS, SA only
retainability KPIs, and mobility KPIs will be designed. (will support in 5G
RAN2.1)
Mobility
KPI
architecture • User Uplink/Downlink Average Throughput
Service Integrity • Cell Uplink/Downlink Average Throughput
(counter-
based) • Uplink/Downlink Resource Block Utilizing Rate
Utilization • Average CPU load
SA & NSA
Availability • Radio Network Unavailability Rate
Huawei Confidential
KPI Attributes
Object
Description
Name
KPI
Formula
Associated
counter
Huawei Confidential
Service Integrity KPIs
Service integrity KPIs are used to evaluate the service quality of end-users in the 5G RAN.
In RAN2.0, service integrity KPIs include:
User Uplink/Downlink Average Throughput
Note: Since 5G standards in 3GPP protocols are under discussion, the preceding KPIs may be changed in
later versions.
Huawei Confidential
Traffic Volume/Throughput Counter Design
Data transfer illustration in NSA DC architecture Comparison between RAN measurement and UE measurement
gNodeB eNodeB MeNB SgNB UE-LTE Cell UE-5G Cell UE Perception
PDCP traffic MCG bearer+MCG split SCG bearer+SCG split Cell-specific PDCP traffic volume is not 1. Total traffic volume
volume bearer bearer measured. 2. Service rate. In SA
scenarios, the 5QI may
not map to the DRB in
one-to-one mode.
3. Rates of the following
A PDCP PDCP PDCP
transmission
MCG bearer+MCG split SCG bearer+SCG split bearers (for PDCP):
bearer bearer MCG bearer
duration
MCG split bearer
SCG bearer
SCG split bearer
B
scenarios.) CA scenarios.)
RLC RLC SCG bearer
MCG split bearer 2
RLC MCG bearer+MCG split SCG bearer+MCG
SCG split bearer 2
transmission bearer 2+SCG split bearer split bearer 1+SCG
duration 2 split bearer 1
(SCG bearer+MCG
(MCG bearer+MCG split
split bearer 1+SCG
SCG bearer - option 3A (not supported in versions RAN1.0 and MAC
bearer 2+SCG split bearer
split bearer 1)
RAN2.0) 2)
SCG split bearer - option 3X transmission
Duration of transmission
Duration of
duration transmission over the
over the air interface of a
MCG bearer specific DU cell
air interface of a
specific DU cell
MCG split bearer - option 3
1. In DC scenarios, the transmit/receive traffic volume and corresponding rate cannot be accurately measured for 5G at the PDCP layer. It is recommended that UE rates be measured at the RLC layer.
2. In CA scenarios, the rate and traffic volume over the air interface of a specific 5G cell cannot be accurately measured at the RLC layer. It is recommended that cell rates be measured at the MAC layer.
Huawei Confidential
Service Integrity KPIs – User Uplink/Downlink Average Throughput
These KPIs indicate the average uplink and downlink UE throughputs in a cell.
Name User Uplink Average Throughput Name User Downlink Average Throughput
UserULAveThp = UserDLAveThp =
Formula Formula
UserULRmvSmallPktTrafficVolume/UserULRmvSmallPktTransferTime UserDLRmvLastSlotTrafficVolume/UserDLRmvLastSlotTransferTime
Associated User Uplink Average Throughput = (N.ThpVol.UL- Associated User Downlink Average Throughput = (N.ThpVol.DL -
Counter N.ThpVol.UE.UL.SmallPkt)/N.ThpTime.UE.UL.RmvSmallPkt Counter N.ThpVol.DL.LastSlot)/N.ThpTime.DL.RmvLastSlot
RAN1.0 Name User Uplink Average Throughput Name User Downlink Average Throughput
UserULAveThp =
Formula UserULTrafficVolume/UserULTransferTime Formula UserDLAveThp = UserDLTrafficVolume/UserDLTransferTime
Associated User Uplink Average Throughput = Associated User Downlink Average Throughput =
Counter N.ThpVol.UL/N.ThpTime.UL Counter N.ThpVol.DL/N.ThpTime.DL
Note: The throughputs are measured based on RLC SDUs. For the KPI design, see the appendix. Huawei Confidential
Service Integrity KPIs – Cell Uplink/Downlink Average Throughput
These KPIs indicate the average uplink and downlink cell throughputs, which reflect the cell capacity.
Name Cell Uplink Average Throughput Name Cell Downlink Average Throughput
CellULAveThp =
Formula Formula CellDLAveThp = CellDLTrafficVolume/CellDLTransferTime
CellULTrafficVolume/CellULTransferTime
Huawei Confidential
Utilization KPIs
Utilization KPIs are used to evaluate the capabilities, such as the capability to meet traffic
demands, in specific internal conditions.
Note: Since 5G standards in 3GPP protocols are under discussion, the preceding KPIs may be changed in
later versions.
Huawei Confidential
Utilization KPIs – Uplink/Downlink Resource Block Utilizing Rate
These KPIs indicate the busy-hour uplink and downlink RB usages in a cell or RAN.
Name Uplink Resource Block Utilizing Rate Name Downlink Resource Block Utilizing Rate
Associated Uplink Resource Block Utilizing Rate = Associated Downlink Resource Block Utilizing Rate =
Counter (N.PRB.UL.Used.Avg/N.PRB.UL.Avail.Avg) x 100% Counter (N.PRB.DL.Used.Avg/N.PRB.DL.Avail.Avg) x 100%
Unit % Unit %
Huawei Confidential
Utilization KPI – Average CPU Load
Object CPU
Formula MeanCPUUtility
Associated
Average CPU Load = VS.BBUBoard.CPULoad.Mean
Counter
Unit %
Huawei Confidential
Availability KPI
Huawei Confidential
Availability KPI – Radio Network Unavailability Rate
This KPI indicates the percentage of time when cells in a radio network are unavailable. It is used to evaluate
the deterioration of network performance caused by cell unavailability of the radio network during busy hours.
Unit %
Huawei Confidential
Traffic KPIs
Traffic KPIs are used to measure the traffic volume on the 5G RAN. In RAN2.0, utilization
KPIs include:
Uplink/Downlink Traffic Volume
Note: Since 5G standards in 3GPP protocols are under discussion, the preceding KPIs may be changed in
later versions.
Huawei Confidential
Traffic KPIs – Uplink/Downlink Traffic Volume
These KPIs indicate the uplink and downlink traffic volumes in a cell, which are measured at the Radio
Link Control (RLC) layer.
Associated Associated
Uplink Traffic Volume = N.ThpVol.UL Downlink Traffic Volume = N.ThpVol.DL
Counter Counter
Unit kbit Unit kbit
Huawei Confidential
Traffic KPI – Average/Maximum User Number
This KPI indicates the average number of UEs in RRC_Connected mode in a cell. The gNodeB samples and
records the number of UEs every second and then calculates the average value of these samples at the end
of each measurement period.
Associated Associated
Maximum User Number = N.User.RRCConn.Max
Counter Counter
Average User Number = N.User.RRCConn.Avg
Unit N/A Unit N/A
Huawei Confidential
Catalog
1 Basic Concepts of Counters
2 KPI Description
Huawei Confidential
RAN2.0 NSA Architecture and SgNB Evaluation
SgNB
• SgNB PSCell change success rate
EPC modification
S1-C S1-U S1-U
LTE
eNodeB
gNodeB • Number of NSA UEs
Traffic evaluation • NSA option 3X:
Total volume of PDCP traffic
Volume of PDCP traffic
* transferred to MeNB
Data split from SgNB in option 3X
* Data split from MeNB in option 3.
Huawei Confidential
SgNB Addition Procedure and Counters
Huawei Confidential
SgNB Release Procedure and Counters
Counter Counter
UE MN SN S-GW MME Measurement Point
Name Description
3.
RRCConnectionRecon
1. SgNB Release Request
2. SgNB Release Request A
figuration Acknowledge As shown at point A in figure 1, the
4. N.NsaDc.SgNB.Rel counter is incremented
RRCConnectionRecon by 1 each time the gNodeB receives an
figurationComplete
5. SN Status Transfer Total number SgNB Release Request message from the
of SgNB eNodeB. As shown at point B in figure 2,
6. Data Forwarding N.NsaDc.
releases in the the N.NsaDc.SgNB.Rel counter is
7. Secondary RAT Data SgNB.Rel
Volume Report
LTE-NR NSA incremented by 1 each time the gNodeB
DC scenario receives an SgNB Release Confirm
8. Path Update procedure message from the eNodeB. The counter
value is accumulated in the PSCell of LTE-
9. UE Context Release
NR NSA DC UEs.
Huawei Confidential
SgNB Modification Procedure and Counters
Figure 1 Change to an intra-site gNodeB
Counter Counter
Measurement Point
Name Description
A N.NsaDc.In
Number of intra- As shown at point A in figure 1, the
SgNB PSCell N.NsaDc.IntraSgNB.PSCell.Change.Att counter
traSgNB.P
change requests is incremented by 1 each time the gNodeB
SCell.Chan
in the LTE-NR sends an SgNB Modification Required message
ge.Att
NSA DC scenario to the eNodeB to request a PSCell change.
B
6. SgNB Change Confirm
7. SgNB Reconfiguration
Complete
As shown at point B in figure 2, the
Number of
8. Random Access Procedure
Huawei Confidential
Number of SgNB DRB Additions
Figure 1 Counter Counter
Measurement Point
Name Description
As shown at point A in figure 1, when the
gNodeB receives an SgNB Addition Request
message from the eNodeB, the gNodeB adds
the value of E-RAB number contained in "E-
Number of DRB
RABs To Be Added List" to the
addition requests
N.NsaDc.D N.NsaDc.DRB.Add.Att counter.
for LTE-NR NSA
RB.Add.Att As shown at point A in figure 2, when the
DC UEs on the
gNodeB receives an SgNB Modification
SgNB
Request message from the eNodeB, the
gNodeB adds the value of E-RAB number
contained in "E-RABs To Be Added List" to the
N.NsaDc.DRB.Add.Att counter.
Huawei Confidential
Number of SgNB DRB Releases
Figure 1
Counter
Counter Description Measurement Point
Name
As shown at points A and B in figure 1, when the gNodeB receives an SgNB
Modification Confirm message from the eNodeB, the gNodeB adds the value of
E-RAB number in "E-RABs To Be Released Item" of the SgNB Modification
Required message to the N.NsaDc.DRB.Rel counter.
As shown at point B in figure 2, when the gNodeB receives an SgNB Release
Confirm message from the eNodeB, the gNodeB adds the value of E-RAB
Figure 2 number contained in "E-RABs To Be Released Item" to the N.NsaDc.DRB.Rel
Number of DRB counter.
N.NsaDc.DRB releases for LTE-NR As shown at points B and C in figure 3, when the gNodeB receives an SgNB
.Rel NSA DC UEs on the Reconfiguration Complete message from the eNodeB, the gNodeB adds the
SgNB value of E-RAB number contained in "E-RABs Admitted To Be Released Item"
of the SgNB Modification Request Acknowledge message to the
N.NsaDc.DRB.Rel counter.
As shown at point A in figure 4, when the gNodeB receives an SgNB Release
Request message from the eNodeB, the gNodeB adds the value of E-RAB
Figure 3 number contained in "E-RABs To Be Released Item" to the N.NsaDc.DRB.Rel
counter. The counter value is accumulated in the PSCell of LTE-NR NSA DC
UEs.
Huawei Confidential
SgNB Traffic Evaluation
In NSA architecture, traffic volume is evaluated using the counters listed in the following table.
Number of PDCP SDUs for DRBs transmitted to the upper
N.PDCP.UL.TrfSDU.TxPackets
layer in a cell
Number of SDUs for DRBs received at the PDCP layer in a
N.PDCP.DL.TrfSDU.RxPackets
cell
Traffic of PDCP SDUs for DRBs transmitted to the upper layer Number of SDUs transmitted to or
N.PDCP.Vol.UL.TrfSDU.Tx
in a cell received from the upper layer and the
volume of the SDUs
N.PDCP.Vol.DL.TrfSDU.Rx Traffic of SDUs for DRBs received at the PDCP layer in a cell
Number of PDCP PDUs for DRBs transmitted to the RLC layer
N.PDCP.DL.TrfPDU.TxPackets
in a cell
Number of RLC PDUs for DRBs received at the PDCP layer in Uplink PDCP packet loss
N.PDCP.UL.TrfPDU.RxPackets
a cell
Number of PDCP PDUs retransmitted to the RLC layer in a Number of PDUs transmitted to
N.PDCP.DL.TrfPDU.ReTxPackets
cell or received from the lower layer
Traffic of PDCP PDUs for DRBs transmitted to the RLC layer and the volume of the PDUs
N.PDCP.Vol.DL.TrfPDU.Tx
in a cell
Traffic of RLC PDUs for DRBs received at the PDCP layer in a Number of PDUs
N.PDCP.Vol.UL.TrfPDU.Rx
cell
transmitted to LTE and
N.PDCP.UL.TrfSDU.RxPacket.Loss Number of lost uplink PDCP SDUs for DRBs in a cell the volume of the PDUs
Number of PDCP PDUs transmitted in the downlink over the
N.PDCP.DL.X2U.TrfPDU.TxPackets Downlink air
X2 interface in a cell
interface packet loss
Number of PDCP PDUs for DRBs received in the uplink over
N.PDCP.UL.X2U.TrfPDU.RxPackets
the X2
Number of PDCP PDUs retransmitted in the downlink over the
N.PDCP.DL.X2U.ReqRetransPackets
X2 interface in a cell
Traffic of PDCP PDUs for DRBs transmitted in the downlink
N.PDCP.Vol.DL.X2U.TrfPDU.Tx
over the X2 interface in a cell
Traffic of PDCP PDUs for DRBs received in the uplink over the
N.PDCP.Vol.UL.X2U.TrfPDU.Rx
X2 interface in a cell
In the NSA architecture, the average/maximum user number of NSA DC is evaluated using the N.User.NsaDc.PSCell.Avg counter.
In the NSA architecture, the number of RRC users is evaluated using the N.User.RRCConn.Avg counter and the N.User.RRCConn.Max
counter. These two counters are also applicable to SA.
Huawei Confidential
Thank you
www.huawei.com
LTE
eNodeB
gNodeB • Number of NSA UEs
Traffic evaluation • NSA option 3X:
Total volume of PDCP traffic
Volume of PDCP traffic
* transferred to MeNB
Data split from SgNB in option 3X
* Data split from MeNB in option 3.
Huawei Confidential
SgNB Addition Procedure and Counters
UE MeNB SgNB
Counter Name Counter Description Measurement Point
Huawei Confidential
SgNB Release Procedure and Counters
Figure 1
UE MeNB SgNB
A
RRCConnectionReconfiguration
RRCConnectionReconfiguration
Complete
Huawei Confidential
SgNB Modification Procedure and Counters
Figure 1
Counter Name Counter Description Measurement Point
UE MeNB S-SgNB T-SgNB
Huawei Confidential
Number of PCell Change Executions and Successful PCell
Changes in the LTE-NR NSA DC State (Newly Added in RAN2.0)
Figure 1 Counter
Counter ID Counter Name Measurement Point
Description
Total number As shown at point A in figure 1,
of PCell L.NsaDc.PCell.Change.Exec counter is incremented
L.NsaDc.PCell.Ch change each time the source MeNB sends an
ange.Exec executions in RRCConnectionReconfiguration message containing
the LTE-NR the configuration indicator of the SgNB handover to
NSA DC state. UEs.
As shown at point B in figure 1,
L.NsaDc.PCell.Change.Succ counter is incremented
each time the source MeNB receives an UE Context
Release message from the target MeNB if the
RRCConnectionReconfiguration message contains the
configuration indicator of the SgNB handover at point
Figure 2 B.
Total number
As shown at point A in figure 2,
of successful L.NsaDc.PCell.Change.Exec is incremented each time
L.NsaDc.PCell.Ch
PCell changes the source MeNB sends an
ange.Succ
in the LTE-NR RRCConnectionReconfiguration message containing
NSA DC state. the configuration indicator of the SgNB handover to
UEs.
As shown at point B in figure 3,
L.NsaDc.PCell.Change.Succ is incremented each time
the source MeNB receives an
RRCConnectionReconfigurationComplete message
from UE. The counter value is accumulated in the PCell
of the LTE-NR NSA DC UE.
Huawei Confidential
Number of SCG-Related Failures
Huawei Confidential
Traffic Volume and User Number
Counter ID Counter Name Counter Description Measurement Point
Total uplink MeNB traffic volume received by The counter measures the total uplink traffic volume received at
UEs in the PCell from the PDCP layer of the the PDCP layer by LTE-NR NSA DC UEs from the MeNB during
L.Thpt.bits.UL.McgSplit.MeNB
MeNB during LTE-NR NSA DC Option3 uplink Option3 offloading. The volume of successfully received
offloading SDU data is accumulated as the value of this counter.
Total uplink SgNB traffic volume received by The counter measures the total uplink traffic volume received at
UEs in the PCell from the PDCP layer of the the PDCP layer by LTE-NR NSA DC UEs from the SgNB during
L.Thpt.bits.UL.McgSplit.SgNB
MeNB during LTE-NR NSA DC Option3 uplink Option3 offloading. The volume of successfully received
offloading SDU data is accumulated as the value of this counter.
The number of all UEs in connected mode (in both the LTE PCell
Average number of UEs that treat the local and the NR PSCell) that are in the LTE-NR NSA DC state and
L.Traffic.User.NsaDc.PCell.Avg cell as their PCell in the LTE-NR NSA DC treat the local cell as their PCell are sampled per second in a cell.
state At the end of a measurement period, the average of these
sampling results is taken as the counter value.
Huawei Confidential
3GPP PM Protocol Roadmap
• 3GPP has discussed E2E KPI in SA5. Slicing and Impacted existing TS/TR
latency is to be updated in June 2018. The UE Target completion
TS/TR No. Description of change
throughput depending on RAN2 has not been plenary#
discussed yet. 32.425
Add performance measurements for ng-eNB in terms of connectivity with
SA#80 (Jun 2018)
5GC
• The RAN KPI (Layer 2 Measurements) is to be
32.426 Add performance measurements for EPC in terms of connectivity with NR SA#80 (Jun 2018)
discussed in the RAN2, including the UE
32.450 Add KPIs for ng-eNB in terms of connectivity with 5GC SA#80 (Jun 2018)
throughput. The RAN2 mainly deals with the
32.451 Add KPI requirements for ng-eNB in terms of connectivity with 5GC SA#80 (Jun 2018)
NSA/SA basic protocol and has not been planned 32.455 Add KPIs for EPC in terms of connectivity with NR SA#80 (Jun 2018)
for discussion.
New specifications
Series Title For info at TSG# For approval at TSG#
"28.XXX" Performance Management for 5G networks and network slicing; stage 1 SA#79 (Mar 2018) SA#80 (Jun 2018)
"28.XXX" Performance Management for 5G networks and network slicing; stage 2 and stage 3 SA#79 (Mar 2018) SA#80 (Jun 2018)
"28.XXX" Performance measurements and assurance data for NG-RAN Network Functions SA#79 (Mar 2018) SA#80 (Jun 2018)
"28.XXX" Performance measurements and assurance data for 5GC Network Functions SA#79 (Mar 2018) SA#80 (Jun 2018)
End to end KPIs, Performance measurements and assurance data for 5G networks and
"28.XXX" SA#79 (Mar 2018) SA#80 (Jun 2018)
network slicing
Huawei Confidential
The impact of Layer 2 measurement undefined
The contents of LTE Layer 2 Measurements in Protocol 36.314.
Huawei Confidential