Single RAN 21A Software Upgrade

Method of Procedure

This material, including documentation and any related computer programs, is protected by copyright
controlled by Nokia. All rights are reserved. Copying, including reproducing, storing, adapting or translating, any
or all of this material requires the prior written consent of Nokia. This material also contains confidential
information, which may not be disclosed to others without the prior written consent of Nokia.
 Contents
1. General Information .............................................................................................................................................................. 2

1.1 Change History ........................................................................................................................................................................2

1.2 Outage Details.......................................................................................................................................................................... 2
1.3 Roles & Responsibilities (T-Mobile).................................................................................................................................. 2
1.4 Roles & responsibilities (Nokia).......................................................................................................................................... 3
2. Pre-Requisites .......................................................................................................................................................................... 3

2.1 Pre-Checks................................................................................................................................................................................ 3
2.2 CRL bits and Related Features ............................................................................................................................................ 5
3. Software Upgrade.................................................................................................................................................................... 5
3.1 Software Upgrade Procedure ............................................................................................................................................... 5
3.2 Importing SW package to NetAct SW Archive (MRBTS) .......................................................................................... 5
3.3 Upgrading eNodeB SW using NetAct SW Archive ...................................................................................................... 7
4. Post-Checks ........................................................................................................................................................................... 10

4.1 Required Steps ...................................................................................................................................................................... 10

5. Annexes .................................................................................................................................................................................. 15
5.1 BTS OAM site recovery ..................................................................................................................................................... 15
5.2 BBMOD site recovery ........................................................................................................................................................ 15
5.3 RMOD site recovery........................................................................................................................................................... 15
5.4 Disc space check and clean up...................................................................................................................................... 15
5.5 External Alarm Misconfigured (FID 1517). ................................................................................................................ 16

1 / 16 Single RAN 21A Software Upgrade © Nokia

1. General Information
Document Type Method of Procedure

Author Suresh S, Arul Joseph, Idriss Cheurfa

Owner Zavadski, Vadim, Jesús Reyna

1.1 Change History

Ver Status Date Comments Changes by
0.1 Draft 04/05/2021 Draft MOP Idriss C.

0.2 Draft 04/09/2021 Added post check step for issue seen in SRAN20C 3.2MP Idriss C.

0.3 Draft 04/20/2021 Modified for SRAN21A Drop 2. Idriss C.

0.4 Draft 05/03/2021 Modified for SRAN21A Drop 3. Idriss C.

0.5 Draft 05/09/2021 Added sfpOperatorMode. Idriss C.

0.6 Draft 06/14/2021 Modified for SRAN21A Drop 4. Jesús R.

0.7 Draft 06/30/2021 Added post check according to cases still open Idriss C.

0.8 Draft 07/06/2021 Modified for SRAN21A Drop 5 Idriss C.

0.9 Draft 07/17/2021 Added all know WA for open cases Idriss C.

1.0 Finale 07/19/2021 Corrections and other add on. Idriss C.

1.01 Finale 07/20/2021 BSC command corrected Idriss C.

1.2 Outage Details

 Restart Required to activate SW (~20 min no services)

1.3 Roles & Responsibilities (T-Mobile)

 Ensure that eNB hardware and software should be in good working order prior to work. All active alarms should
be addressed
 T-Mobile (TMO) is responsible for all test calls or drive test before and after activity to confirm operability of the
eNB after the feature implementation
 TMO to check the KPI statistics measurement, network health and alarms data in NetAct and topology upload
 Any data fill or RF planning requirements needed for feature activations
 Steps highlighted in green can be taken by the FOPS.

2 / 16 Single RAN 21A Software Upgrade © Nokia

1.4 Roles & responsibilities (Nokia)
 Provide MOP (this document) for new software upgrade
 Backup site configuration before starting work
 Backup eNB active alarms. Critical alarms should be reported straight away and on agreement we should remove
from the upgrade list.
 Post check status report. Trouble shooting on any issues during upgrade procedure

2. Pre-Requisites
SRAN21A release software need to have 5G20B release software in the 5G/4G shared nodes.
For AEHC, RadioMaster should be confiugred as 5G. If not, eNB should be excluded from upgrade list (follow
the AEHC 4G to 5G Prime change MOP v1.4 to correct the situation).
AWHHA radios are not part of this upgrade and should be excluded.
(MegaPlexer and NetAct completed).

2.1 Pre-Checks
STEP  NA20 SP2011+ FP764 P8
1  Make sure the eNodeB is Directly connected to NetAct.
Ping all the sites to make sure they are on air and connected.
STEP
Create a list of sites which fails the ping and mark them as “Pre O&M Down”
2
Create a working set for the remaining sites. Name the working set as
“SRAN21A_OSS_MarketName_Drop#_Date” and continue with Step 3 and onwards
STEP  Perform SW upload using Software Manager to make sure the exact SW Version.
3  Perform the CM Upload and check the “Store BTS Configuration in backup files”
Go to NetAct Directory and you will notice the timestamp will match with your CM Upload and fetch these
STEP
4
SCF’s
/d/oss/global/var/sct/backup_sites/mrbts
 Pull the eNB, and cell status for LTE and other technologies (2G, 3G, 5G).
STEP  Perform Alarm Upload using Monitor to reflect all the alarms in the NetAct.
5  Feature SR2315 does automatic pre check and post check. This feature is a 20C feature, meaning that the
base SW before upgrade must be 20C (and a dependancy on the NetAct version N20).

3 / 16 Single RAN 21A Software Upgrade © Nokia

 


 Each individual NE can be checked:

4 / 16 Single RAN 21A Software Upgrade © Nokia

 STEP 6  Take the Dump of all the parameters using CM Operation for the Work Set created in Step 2 (b)
STEP 7  In case of any critical alarm in history for AAFIA sites, remove them from the upgrade during
deployment and upgrade them during the Cleanup.
STEP 8  Due to 01229769 issue before and after SW download a diskspace check should be performed on any
FSMF (guideline provided in annex 5.4). If any disc space usage is greater than 96% then follow the
guideline to free space. Note: the script can remove swconfig.txt file (this file should not be present in
production network). Please refer to TS-SRAN-SW-0139.

2.2 CRL bits and Related Features

In SRAN21A there is no need to modify any CRL Bits.

The bits are converted automatically from bits to parameter values after the upgrade (i.e. no plan provisioning
needed). So CNI-59522 bit #31 will be translated to new parameter LNBTS-actEnforceHLRLis = “True” (see post
check step #5).

3. Software Upgrade
ACTIVE SW VERSION
PLANNED SW VERSION
 SW SBTS20C_ENB_0000_001474_000000 (SRAN20C M12 AEHC)
 SBTS20C_ENB_0000_001623_000000 (SRAN20C Drop 5)
 SBTS20C_ENB_0000_001722_000001 (SRAN20C 2.1.1)
 SBTS20C_ENB_0000_001784_000000 (SRAN20C 3.0)
 SBTS20C_ENB_0000_001878_000000 (SRAN20C 3.1)
 SBTS20C_ENB_0000_001908_000000 (SRAN20C 3.2)
 SBTS20C_ENB_0000_001908_666326
 SBTS21A_ENB_0000_001181_000000 (SRAN21A Drop 1)
SBTS21A_ENB_0000_001332_000003 (SRAN21A Drop 2)
SBTS21A_ENB_0000_001438_000003 (SRAN21A Drop 3)
SBTS21A_ENB_0000_001643_000000 (SRAN21A Drop 4)
 SBTS21A_ENB_0000_001721_000000 (SRAN21A Drop 5)

3.1 Software Upgrade Procedure

3.2 Importing SW package to NetAct SW Archive (MRBTS)

 Log in to NetAct start page.

 Select Software Manager and go to Software Archive.
 Select MO type = MRBTS. Click on Add software package…

5 / 16 Single RAN 21A Software Upgrade © Nokia

 SW Import Manager will Pop-up. Choose MO Type = MRBTS, Click Add Local Files. Select the zip package.
Click Open.

 Click Detail option, and choose appropriate Release update correct version ID and Package name (here
SBTS21A),then click save option.
 Verify all information is correct as shown above. Then Click Import
 Click Close. To Close the SW Import Manager

6 / 16 Single RAN 21A Software Upgrade © Nokia

3.3 Upgrading eNodeB SW using NetAct SW Archive

 Click Network Status, Select Mo type = MRBTS. Check the Working Set to be upgraded. Click New Task.
New Task window will appear. Click Download, Select the correct SW Package (select
SBTS21A_ENB_0000_001721_000000). Click Next.

 After the SW is downloaded to each FSMF based MRBTS run the Disc Space check/clean script (follow the
guidelines included in annex 5.4, if at this stage any disc space usage is greater than 96%). If the SW was
downloaded previously, please be sure to perform the audit before the Activation of the SW.
 Click Network Status, Select Mo type = MRBTS. Check the Working Set to be upgraded. Click New Task.
New Task window will appear. Click Activation, Select the correct SW Package (select
SBTS21A_ENB_0000_001721_000000). Click Next.

7 / 16 Single RAN 21A Software Upgrade © Nokia

 New Task window 2/3. Schedule definition, select Immediately, click Next.

 New Task window 3/3. Verify all information is correct. Then Click Finish.
 It will load the new SW package to MRBTS. Wait for it to be completed.

8 / 16 Single RAN 21A Software Upgrade © Nokia

  Back to SWM. In the Network Status window. It should show the Provisioning is green meaning completed
without errors.
 Perform new Upload. In the SWM, Click upload. And it should show the Active SW ID is updated.

3.3.1 Updating SBTS version by NetAct Monitor

 Right Click on Site and Click Change Version

 Select Other
 Enter SBTS21A
 Click OK

9 / 16 Single RAN 21A Software Upgrade © Nokia

4. Post-Checks

4.1 Required Steps

 Ping all the sites from the working set created using Pre-Check 2(b) to make sure all are up and running.
STEP
1
 In case of any sites is not pingable, mark it is “Post O&M down” and count under SI Truck Roll.
 For all the sites which are pingable, please following step 2 and onward

 Perform SW upload using Software Manager to reflect the right software.

STEP
 Perform the CM Upload using “Store BTS Configuration in backup files” and fetch them from NetAct
2
directory
/d/oss/global/var/sct/backup_sites/mrbts
 Pull the eNB, and cell status for LTE and other technologies (2G, 3G, 5G).
 Perform Alarm Upload using Monitor to reflect all the alarms in the NetAct.
 Feature SR2315 can perform an automatic post check of the upgraded eNBs. This feature is a 20C
feature, meaning that the base SW before upgrade must be 20C.

STEP
3

10 / 16 Single RAN 21A Software Upgrade © Nokia

 
 Each individual NE can be checked:

 RTWP Checks for all layers needs to be done. If any issues/degradations are found perform a reset. After
STEP
4
the site is back up again, redo a RTWP check.
 Take the Dump of all the parameters using CM Operation for the Work Set created in Step 2 (b).
 Due to case 01938397 on GSM SRAN eNB. It is needed to check that all GSM Cells are up and running.
With this case the GSM cells are grey:
 Summary of workaround:
o Identify which BBMOD is connected to the FSMF
o For the BBMOD identified in step 1, modify radioProtSearchOrder to CPRI
STEP
o Reset site
5  User needs to determine which BBMOD the FSMF SMOD is connected to. Go to the Detailed Site View
and
 locate the cabinet with the FSMF module. Select the interface that connects to the Airscale cabinet.
Click on the interface and the CABLINK will highlight by being shown in bold. You can then trace the
endpoint of the cable. It will be one of the Airscale BBMOD’s. In the example below, it is BBMOD-1.


11 / 16 Single RAN 21A Software Upgrade © Nokia

 
 Now go to parameter editor and locate the BBMOD  MRBTS-xxxxxx/EQM-1/APEQM-1/CABINET-
x/BBMOD-x
 Change the radioProtoSearchOrder to CPRI. Validate and Activate the change.
 Reset the site.

12 / 16 Single RAN 21A Software Upgrade © Nokia

 
STEP
 Due to case open 01867506. Checks should be done for “Fault 10 No connection” to unit on AEHC radio.
6 If alarm is seen please reset the BBMOD.
STEP
 For certain site the alarm 7115 for Fault ID 1517 External alarm misconfigured could be triggered, if this
7 happens then please refer to Annex 5.5.
• Due to open cases, RACH attemps and DL traffic KPI needs to be monitored for TDD eNBs.
 01884869 : If any cells is found not showing any RACH attempts but having normal DL traffic then the
eNB needs to be reset.
STEP
 02078367 : If any cells is found with an increase in RACH Setup Failure rate and a decrease in % RRC to
8 RACH ratio. An eNB reset is needed.
 02075689 : If any cell is seen with an unusual increase in RACH attempts, an eNB reset is needed
 02056809 : No DL traffic and RACH attempts. An eNB reset is needed.
 After recovery KPI needs to be checked again.
 Due to CAS-350481-N4C1, any RFS LTE GSM shared site, a post check for Traffic should be made. An
easy way to identify any potential issue is to run on each BSCs this command to filter out that specific
alarm.
STEP
 Identify GSM nodes with 7708 TRX RESTARTED alarm with ZEOL::NR=7708 ,;
9  Create list to restart the GSM sites.
 GSM site traffic can be recovered with BCF Lock/Unlock (ZEFS from BSC) or BCF reset (ZEFR from
BSC)
 After restart verify traffic is normal.
STEP
• Alarm 7112 BASE STATION CONFIGURATION PROBLEM with FID 4038 RADIO master concflict may
10 appear on AEHC site, an eNB restart is needed to clear the situation. After the restart 5G side may report
incompatible software alarm. In this case please download the 5G software to clear the issue.

STEP
• A new SFP check is introduced in SRAN21A Software and check SFP compliance to Nokia SFP policy.
11 But TMO does not adhere to this policy. Thuse “sfpOperatorMode” parameter should be toglled to “True” to
avoid raising a major alarm on SFP compliance.

13 / 16 Single RAN 21A Software Upgrade © Nokia

  It has been recently discovered that Pmax values may have been wrongly set for AHLOA and AEHC,
and this before a new software check was introduced. Pmax values on this 2 radios needs to be
consistent (we do not ask here for them to be changed).
 Make sure Total configured pMax should not exceeded the AHLOA RF power capacity (60W) for
(B12+ B71+ N71) and bandwidth.
 For AEHC, make sure pMax should not exceeded 37.5 dBm which radio supports whereas T-Mobile
STEP design pMax is 34.9 for 100 MHz. otherwise, you will get Sleepy Cells (RA_MSG3 = 0 & DTCH =0
12 but RA_MSG1 is OK). Actual power will depend on the bandwidth as shown in table below:
Bandwidth pMax
100 34.9
80 34.0
60 32.7
40 31.0
 20 28.0
 An issue in SCF configuration resolved under 01843754, may be still encountered in the network:
STEP
 Signature: [AAHF][FID:1811] Baseband bus configuration was rejected, 1 cell disabled
13
 If seen please check IQ compression parameter (iqcompression) at the related alarm object
location and align the IQ compression parameters for all links (it should be the same on all links).

 A serie of issues were found during the FOA and needs eNB reset to recover from. For each item in
the list below please perform a eNB or RMOD reset as indicated.
[AEHC][FID:10] – No connection to unit Radio reset/eNB reset
STEP [FID:1908] RF Module failure Radio reset
14 [FID:6051] Beamforming calibration failure in RF data path eNB reset
[FID:1920] "No feedback signal" eNB reset
[FID:4153] Reference clock missing in startup eNB reset
[AHLOA][FID:10] – No connection to unit eNB reset
[AAFIA][FID:10] – Failure in optical interface eNB reset

14 / 16 Single RAN 21A Software Upgrade © Nokia

5. Annexes

5.1 BTS OAM site recovery

BTS_OAM Site Recovery-v5-20201105_212628.pdf

5.2 BBMOD site recovery

BBMOD Site Recovery-v1-20201105_212847.pdf

5.3 RMOD site recovery

RMOD Site Recovery-v1-20201105_213126.pdf

5.4 Disc space check and clean up

Verify that you have access to the script (script name: stbDisk). Generate a list of IP addresses of MRBTS (any
FSMF, it includes FSMF, Airscale + FSMF) involved in the upgrade.
1. Before software download
1.1. Run stbDisk script with the generated IP addresses list. Select clean up option. Script will clean up
space if needed.
1.2. Select remove swconfig file option.
2. After software download
2.1. Run stbDisk script with the generated IP addresses list. Select clean up option. Script will clean up
space if needed.
2.2. If still some disc need more clean follow below instructions, otherwise you are all set for software
activation.
3. More disc clean up needed
3.1. Delete the content this folder: /ffs/stb/config/ne3sadapt/, check if /ffs/run/config size is smaller than
the free disc space in /ffs/stb. If yes, then you are all set for software download/activation. If the free
disc space in /ffs/stb is smaller then exclude this MRBTS from the activity and request Nokia support.

15 / 16 Single RAN 21A Software Upgrade © Nokia

5.5 External Alarm Misconfigured (FID 1517).

16 / 16 Single RAN 21A Software Upgrade © Nokia