Professional Documents
Culture Documents
Health Check Point Refer Point Refer Point No. Refer Point Refer Point
No. 10 1,4,7, 8, 16 & 18 No. 13&17 No. 9
Refer Point
No. 3
Refer
Point
No. 2
3 SDL01 & 02 INC000000108860 SDL - Number of transaction failures is 1 which is equal or above
the maximum threshold of 1
4 NCS INC000000112416 NCS - The Template App Podman Containers does not trigger
container memory alarm/, Nokia Container Services
DT02 | NCS | Facing the Alarms on healthy events for ZTH and ZTU
7 NCS INC000000114839
pods for readiness and probe failed
11 FLOWONE INC000000116167 Flow one -All alarms are coming with a same alarm ID 37000 in
NetAct for Flow one Node, Flow One
MS Update - Discussion done with Care & R&D Team. R&D is still working on the
same .
Reminder sent to Care.
Two points raised to care 1. We do not see the container restart count getting
triggered if crosses more than 10; 2. Can not find a trigger for container memory
exceeding 90%, No such trigger was found in the Zabbix prototype.
"Container restart counter if greater than the given threshold no alarm is coming"
query raised to care, response awaited for same.
[NCSFM-10211] JIRA shared by care team.
As per Care discussion, We don't have any template for container-related CPU/Memory
alarms. This is a customer-requested feature.
Care Case:3000605
MS Update - PCAP and credentailas shred with Care team. Care team escalted to the
next level for further analysis.
Call planned to decode SNMP logs & joint troubleshooting at NetaAct end.
SNMP credentials had been shared with to care team to check the logs in AMF.
Case id 03038385 AMF End./ 02nd May : 03040425( NSP End):
MS Update - Waiting for R&D response. Care will take up with RnD team.
Care case raised: 03058856 - Raised to 4LS - Requested log shared and waiting for 4LS
update
MS Update -Activity planned on 26th June.
MOP preparation in progress to apply WA i.e. "enable Autodiscovery feature and
restart NIM_01 process in case we see UDM flapping alarm in NRF(this means
feature stopped working)".
As per 4LS team: The Auto-Discovery timer is not restarted after getting stopped.There
can be many events because of which the Auto-Discovery timer can stop, but it should be
restarted for the feature to work.Enhancement will be provided which will take care of
the continuity of Auto-Discovery feature.
4LS has suggested "NGC_NIM process restart on the Nim pods should ideally retrigger the
Auto-Discovery". Need to discuss same.
SI team raise to 4LS. Update awaited
Care has escalated same to product team. Changed will been done in first Q1 2024.
“Interface P3P1 down” in NCS for this node HG1EDGEBM-7 compute. This is non-service
impacting since other interface are taking the redundancy and alarm got restored within 5
mins and stable now. Checked all the Pods are running fine on this node and no reboot
happened.
Analysis in progress.
6/20/2023
Note
Restart Yes/No Pod/Container Reason Restart Yes/No
AMF NO NO
SMF NO NO
UPF NO Yes/POD
NRD/NRF NO NO
CHF NO NO
NCOM NO NO
istio NO NO
NCS NO NO
Kube-system NO NO
ncms NO NO
gatekeeper-system NO NO
ZTU01 (UDM) NO NO
ZTH01 (HSS) NO NO
jaeger NO NO
btel NO NO
NO
NO
lmg-statefulset-0 lmg-statefulset-0
llb-statefulset-0
lmg-statefulset-1 Due to UPF 22.8R10 Upgrade Yes/POD loam-a-v1-866d6d5566-slp8r
lmg-statefulset-2 activity loam-b-v1-7745765d84-mtx44
lmg-statefulset-3
NO
NO
NO
NO
NO
NO
NO
NO
NO
NO
NO
NO
NO
NO
NO
NO
NO
NO
NO
NO
NO
NO
NO
NO
NO
NO
NO
NO
NO
NO
NO
NO
NO
NO
NO
NO
NO
NO
NO
NO
NO
NO
NO
NO
NO
NO
NO
NO
NO
NO
NO
NO
NO
NO
NO
NO
NO NO
NO NO
NO NO
NO NO
NO NO
NO NO
NO NO
NO NO
NO NO
NO NO
NO NO
NO NO
NO NO
NO NO
NO NO
NO
NO
NO
NO
NO
NO
NO
NO
NO
NO
NO
NO
NO
NO
NO
Reason
Status(2023-05-10)
License ends on Thu Apr 13 23:59:59 UTC 2023 License ends on Thu Apr 13 23:59:59 UTC 2023
ok ok
ok ok
16 3534
16 908
ok ok
ok ok
VPRN 1401- 2.61%
VPRN 1402- 3.54%
0.00% VPRN 1403- 3.57%
License ends on Thu Apr 13 23:59:59 UTC 2023 License ends on Thu Apr 13 23:59:59 UTC 2023
ok ok
ok ok
35 35
35 35
ok ok
ok ok
VPRN 1401- 0.03% VPRN 1401- 0.02%
VPRN 1402- 0.02% VPRN 1402- 0.01%
VPRN 1403- 0.02% VPRN 1403- 0.03%
License ends on Thu Apr 13 23:59:59 UTC 2023 License ends on Thu Apr 13 23:59:59 UTC 2023
ok ok
ok ok
4704 24
7453 24
ok ok
ok ok
VPRN 1401- 7.95% VPRN 1401- 0.03%
VPRN 1402- 5.51% VPRN 1402- 0.02%
VPRN 1403- 0.73% VPRN 1403- 0.01%
License ends on Thu Apr 13 23:59:59 UTC 2023 Tue Jun 13 23:59:59 UTC 2023
ok ok
ok ok
38 36
38 36
ok ok
ok ok
VPRN 1401- 0.04% VPRN 1401- 0.04%
VPRN 1402- 0.09% VPRN 1402- 0.03%
VPRN 1403- 0.02% VPRN 1403- 0.00%
Tue Jun 13 23:59:59 UTC 2023 Tue Jun 13 23:59:59 UTC 2023
ok ok
ok ok
34 13
34 13
ok ok
ok ok
VPRN 1401- 0.05% VPRN 1401- 0.04%
VPRN 1402- 0.05% VPRN 1402- 0.01%
VPRN 1403- 0.01% VPRN 1403- 0.00%
Tue Jun 13 23:59:59 UTC 2023 Tue Jun 13 23:59:59 UTC 2023 Tue Jun 13 23:59:59 UTC 2023
ok ok ok
ok ok ok
14 12 12
14 12 12
ok ok ok
ok ok ok
VPRN 1401- 0.04% VPRN 1401- 0.03% VPRN 1401- 0.03%
VPRN 1402- 0.02% VPRN 1402- 0.00% VPRN 1402- 0.00%
VPRN 1403- 0.00% VPRN 1403- 0.00% VPRN 1403- 0.00%
Tue Jun 13 23:59:59 UTC 2023 Tue Jun 13 23:59:59 UTC 2023 Tue Jun 13 23:59:59 UTC 2023
ok ok ok
ok ok ok
17 72 15
17 72 15
ok ok ok
ok ok ok
VPRN 1401- 0.03% VPRN 1401- 0.03% VPRN 1401- 0.03%
VPRN 1402- 0.00% VPRN 1402- 0.00% VPRN 1402- 0.00%
VPRN 1403- 0.00% VPRN 1403- 0.00% VPRN 1403- 0.00%
Tue Jun 13 23:59:59 UTC 2023 Tue Jun 13 23:59:59 UTC 2023 Tue Jun 13 23:59:59 UTC 2023
ok ok ok
ok ok ok
15 15 25
15 15 15
ok ok ok
ok ok ok
VPRN 1401- 0.03% VPRN 1401- 0.03% VPRN 1401- 0.03%
VPRN 1402- 0.00% VPRN 1402- 0.09% VPRN 1402- 0.09%
VPRN 1403- 0.00% VPRN 1403- 0.00% VPRN 1403- 0.00%
Tue Jun 13 23:59:59 UTC 2023 Tue Jun 13 23:59:59 UTC 2023 Tue Jun 13 23:59:59 UTC 2023
ok ok ok
ok ok ok
21 19 38
21 19 38
ok ok ok
ok ok ok
VPRN 1401- 0.03% VPRN 1401- 0.03% VPRN 1401- 0.03%
VPRN 1402- 0.09% VPRN 1402- 0.09% VPRN 1402- 0.09%
VPRN 1403- 0.00% VPRN 1403- 0.00% VPRN 1403- 0.02%
Tue Jun 13 23:59:59 UTC 2023 Tue Jun 13 23:59:59 UTC 2023 Tue Jun 13 23:59:59 UTC 2023
ok ok ok
ok ok ok
69 35 16
69 35 16
ok ok ok
ok ok ok
VPRN 1401- 0.05% VPRN 1401- 0.05% VPRN 1401- 0.00%
VPRN 1402- 0.12% VPRN 1402- 0.08% VPRN 1402- 0.05%
VPRN 1403- 0.13% VPRN 1403- 0.08% VPRN 1403- 0.02%
Tue Jun 13 23:59:59 UTC 2023 Tue Jun 13 23:59:59 UTC 2023 Tue Jun 13 23:59:59 UTC 2023
ok ok ok
ok ok ok
7 10 3
7 7 3
ok ok ok
ok ok ok
VPRN 1401- 0.00% VPRN 1401- 0.00% VPRN 1401- 0.00%
VPRN 1402- 0.03% VPRN 1402- 0.03% VPRN 1402- 0.03%
VPRN 1403- 0.00% VPRN 1403- 0.00% VPRN 1403- 0.00%
Tue Jun 13 23:59:59 Tue Jun 13 23:59:59 UTC Tue Jun 13 23:59:59 UTC Tue Jun 13 23:59:59
UTC 2023 2023 2023 UTC 2023
ok ok ok ok
ok ok ok ok
19 7 26 27
9 7 26 27
ok ok ok ok
ok ok ok ok
VPRN 1401- 0.01% VPRN 1401- 0.01% VPRN 1401- 0.01% VPRN 1401- 0.01%
VPRN 1402- 0.01% VPRN 1402- 0.01% VPRN 1402- 0.01% VPRN 1402- 0.01%
VPRN 1403- 0.02% VPRN 1403- 0.02% VPRN 1403- 0.02% VPRN 1403- 0.02%
Tue Jun 13 23:59:59 Tue Jun 13 23:59:59 Tue Jun 13 23:59:59 Tue Jun 13 23:59:59
UTC 2023 UTC 2023 UTC 2023 UTC 2023 Tue Jun 13 23:59:59 UTC 2023
ok ok ok ok ok
ok ok ok ok ok
27 36 15 16 13
27 36 15 16 13
ok ok ok ok ok
ok ok ok ok ok
VPRN 1401- 0.01% VPRN 1401- 0.01% VPRN 1401- 0.01% VPRN 1401- 0.00% VPRN 1401- 0.00%
VPRN 1402- 0.01% VPRN 1402- 0.03% VPRN 1402- 0.02% VPRN 1402- 0.01% VPRN 1402- 0.01%
VPRN 1403- 0.02% VPRN 1403- 0.03% VPRN 1403- 0.03% VPRN 1403- 0.03% VPRN 1403- 0.03%
Tue Jun 13 23:59:59 Tue Jun 13 23:59:59 Tue Jun 13 23:59:59 Tue Jun 13 23:59:59
Tue Jun 13 23:59:59 UTC 2023 UTC 2023 UTC 2023 UTC 2023 UTC 2023
ok ok ok ok ok
ok ok ok ok ok
21 25 25 24 24
21 25 25 24 24
ok ok ok ok ok
ok ok ok ok ok
VPRN 1401- 0.01% VPRN 1401- 0.03% VPRN 1401- 0.03% VPRN 1401- 0.03% VPRN 1401- 0.03%
VPRN 1402- 0.02% VPRN 1402- 0.00% VPRN 1402- 0.00% VPRN 1402- 0.00% VPRN 1402- 0.00%
VPRN 1403- 0.02% VPRN 1403- 0.02% VPRN 1403- 0.02% VPRN 1403- 0.02% VPRN 1403- 0.02%
Tue Jun 13 23:59:59 Tue Jun 13 23:59:59 Tue Jun 13 Tue Jun 13 23:59:59 Tue Jun 13 23:59:59
UTC 2023 UTC 2023 23:59:59 UTC 2023 UTC 2023 UTC 2023
ok ok ok ok ok
ok ok ok ok ok
30 97 26 16 15
30 97 26 15 15
ok ok ok ok ok
ok ok ok ok ok
VPRN 1401- 0.03% VPRN 1401- 0.11% VPRN 1401- 0.02% VPRN 1401- 0.02% VPRN 1401- 0.04%
VPRN 1402- 0.02% VPRN 1402- 0.10% VPRN 1402- 0.02% VPRN 1402- 0.01% VPRN 1402- 0.00%
VPRN 1403- 0.01% VPRN 1403- 0.10% VPRN 1403- 0.02% VPRN 1403- 0.00% VPRN 1403- 0.00%
Tue Jun 13 23:59:59 Tue Jun 13 23:59:59 Tue Jun 13 23:59:59 Tue Jun 13 23:59:59 Tue Jun 13 23:59:59 UTC
UTC 2023 UTC 2023 UTC 2023 UTC 2023 2023
ok ok ok ok ok
ok ok ok ok ok
15 17 34 34 19
15 17 34 34 19
ok ok ok ok ok
ok ok ok ok ok
VPRN 1401- 0.02% VPRN 1401- 0.02% VPRN 1401- 0.03% VPRN 1401- 0.03% VPRN 1401- 0.02%
VPRN 1402- 0.01% VPRN 1402- 0.01% VPRN 1402- 0.03% VPRN 1402- 0.03% VPRN 1402- 0.01%
VPRN 1403- 0.00% VPRN 1403- 0.01% VPRN 1403- 0.01% VPRN 1403- 0.01% VPRN 1403- 0.02%
Tue Jun 13 23:59:59 Tue Jun 13 23:59:59 Tue Jun 13 23:59:59 Tue Jun 13 23:59:59 Tue Jun 13 23:59:59
UTC 2023 UTC 2023 UTC 2023 UTC 2023 UTC 2023
ok ok ok ok ok
ok ok ok ok ok
29 29 27 22 20
29 29 27 22 20
ok ok ok ok ok
ok ok ok ok ok
VPRN 1401- 0.04% VPRN 1401- 0.04% VPRN 1401- 0.04% VPRN 1401- 0.03% VPRN 1401- 0.02%
VPRN 1402- 0.00% VPRN 1402- 0.01% VPRN 1402- 0.00% VPRN 1402- 0.00% VPRN 1402- 0.01%
VPRN 1403- 0.01% VPRN 1403- 0.00% VPRN 1403- 0.01% VPRN 1403- 0.02% VPRN 1403- 0.01%
Tue Jun 13 23:59:59 UTC Tue Jun 13 23:59:59 Tue Jun 13 23:59:59 Tue Jun 13 23:59:59 Tue Jun 13 23:59:59
2023 UTC 2023 UTC 2023 UTC 2023 UTC 2023
ok ok ok ok ok
ok ok ok ok ok
28 16 20 14 19
28 17 20 14 19
ok ok ok ok ok
ok ok ok ok ok
VPRN 1401- 0.02% VPRN 1401- 0.02% VPRN 1401- 0.03% VPRN 1401- 0.02% VPRN 1401- 0.02%
VPRN 1402- 0.01% VPRN 1402- 0.00% VPRN 1402- 0.00% VPRN 1402- 0.04% VPRN 1402- 0.00%
VPRN 1403- 0.01% VPRN 1403- 0.01% VPRN 1403- 0.01% VPRN 1403- 0.01% VPRN 1403- 0.01%
Tue Jun 13 23:59:59 Tue Jun 13 23:59:59 Tue Jun 13 23:59:59 Tue Jun 13 23:59:59 Tue Jun 13 23:59:59
UTC 2023 UTC 2023 UTC 2023 UTC 2023 UTC 2023
ok ok ok ok ok
ok ok ok ok ok
22 14 14 35 9018
22 14 14 35 9018
ok ok ok ok ok
ok ok ok ok ok
VPRN 1401- 0.03% VPRN 1401- 0.02% VPRN 1401- 0.04% VPRN 1401- 0.03% VPRN 1401- 6.87%
VPRN 1402- 0.00% VPRN 1402- 0.04% VPRN 1402- 0.00% VPRN 1402- 0.02% VPRN 1402- 6.67%
VPRN 1403- 0.01% VPRN 1403- 0.01% VPRN 1403- 0.01% VPRN 1403- 0.02% VPRN 1403- 7.05%
Tue Jun 13 23:59:59 Tue Jun 13 23:59:59 Tue Jun 13 23:59:59 Tue Jun 13 23:59:59 Tue Jun 13 23:59:59
UTC 2023 UTC 2023 UTC 2023 UTC 2023 UTC 2023
ok ok ok ok ok
ok ok ok ok ok
20 25 21 17 17
20 25 21 17 17
ok ok ok ok ok
ok ok ok ok ok
VPRN 1401- 0.01% VPRN 1401- 0.02% VPRN 1401- 0.01% VPRN 1401- 0.01% VPRN 1401- 0.01%
VPRN 1402- 0.01% VPRN 1402- 0.02% VPRN 1402- 0.01% VPRN 1402- 0.01% VPRN 1402- 0.01%
VPRN 1403- 0.00% VPRN 1403- 0.02% VPRN 1403- 0.00% VPRN 1403- 0.02% VPRN 1403- 0.02%
Tue Sep 01 Tue Sep 01 23:59:59 Tue Sep 01 23:59:59 Tue Sep 01 23:59:59 Tue Sep 01
23:59:59 UTC 2023 UTC 2023 UTC 2023 UTC 2023 23:59:59 UTC 2023
ok ok ok ok ok
ok ok ok ok ok
17 8 14 13 12
17 8 14 13 12
ok ok ok ok ok
ok ok ok ok ok
VPRN 1401- 0.01% VPRN 1401- 0.00% VPRN 1401- 0.00% VPRN 1401- 0.00% VPRN 1401- 0.00%
VPRN 1402- 0.01% VPRN 1402- 0.01% VPRN 1402- 0.01% VPRN 1402- 0.02% VPRN 1402- 0.01%
VPRN 1403- 0.02% VPRN 1403- 0.00% VPRN 1403- 0.02% VPRN 1403- 0.01% VPRN 1403- 0.00%
Tue Sep 01 Tue Sep 01 Tue Sep 01 Tue Sep 01 Tue Sep 01
23:59:59 UTC 2023 23:59:59 UTC 2023 23:59:59 UTC 2023 23:59:59 UTC 2023 23:59:59 UTC 2023
ok ok ok ok ok
ok ok ok ok ok
15 15 15 35 25
15 15 15 35 25
ok ok ok ok ok
ok ok ok ok ok
VPRN 1401- 0.00% VPRN 1401- 0.00% VPRN 1401- 0.00% VPRN 1401- 0.00% VPRN 1401- 0.00%
VPRN 1402- 0.01% VPRN 1402- 0.01% VPRN 1402- 0.01% VPRN 1402- 0.01% VPRN 1402- 0.01%
VPRN 1403- 0.00% VPRN 1403- 0.00% VPRN 1403- 0.00% VPRN 1403- 0.00% VPRN 1403- 0.00%
Tue Sep 01 Tue Sep 01 Tue Sep 01 Tue Sep 01 Tue Sep 01
23:59:59 UTC 2023 23:59:59 UTC 2023 23:59:59 UTC 2023 23:59:59 UTC 2023 23:59:59 UTC 2023
ok ok ok ok ok
ok ok ok ok ok
17 17 67 36 32
17 17 67 36 32
ok ok ok ok ok
ok ok ok ok ok
VPRN 1401- 0.04% VPRN 1401- 0.04% VPRN 1401- 0.05% VPRN 1401- 0.01% VPRN 1401- 0.03%
VPRN 1402- 0.02% VPRN 1402- 0.02% VPRN 1402- 0.02% VPRN 1402- 0.01% VPRN 1402- 0.03%
VPRN 1403- 0.01% VPRN 1403- 0.01% VPRN 1403- 0.05% VPRN 1403- 0.01% VPRN 1403- 0.01%
Tue Sep 01 23:59:59 UTC Tue Sep 01 23:59:59 UTC Tue Sep 01 Tue Sep 01
2023 2023 23:59:59 UTC 2023 23:59:59 UTC 2023
ok ok ok ok
ok ok ok ok
32 32 58 32
32 32 58 32
ok ok ok ok
ok ok ok ok
VPRN 1401- 0.03% VPRN 1401- 0.02% VPRN 1401- 0.02% VPRN 1401- 0.03%
VPRN 1402- 0.01% VPRN 1402- 0.00% VPRN 1402- 0.00% VPRN 1402- 0.02%
VPRN 1403- 0.01% VPRN 1403- 0.01% VPRN 1403- 0.01% VPRN 1403- 0.02%
OK OK OK OK OK
OK OK OK OK OK
OK OK OK OK OK
OK OK OK OK OK OK
OK OK OK OK OK OK
OK OK OK OK OK
OK OK OK OK OK
OK OK