GU IP

Major Transmission Fault Troubleshooting Guide

Issue Date

1.0 2010-5-7

Huawei Technologies Co., Ltd.

Copyright © Huawei Te hnologies Co!" #td! $%&%! 'll rights reser(ed!
No part of this docu ent a! "e reproduced or trans itted in an! for written consent of Huawei Technologies Co., Ltd. or "! an! eans without prior

Trademar)s and Permissions
and other Huawei trade ar#s are the propert! of Huawei Technologies Co., Ltd. $ll other trade ar#s and trade na es holders. entioned in this docu ent are the propert! of their respecti%e

*oti e
The purchased products, ser%ices and features are stipulated "! the co ercial contract ade "etween Huawei and the custo er. $ll or partial products, ser%ices and features descri"ed in this docu ent a! not "e within the purchased scope or the usage scope. &nless otherwise agreed "! the contract, all state ents, infor ation, and reco endations in this docu ent are pro%ided '$( )(' without warranties, guarantees or representations of an! #ind, either e*pressed or i plied. The infor ation in this docu ent is su"+ect to change without notice. ,%er! effort has "een ade in the preparation of this docu ent to ensure accurac! of the contents, "ut all state ents, infor ation, and reco endations in this docu ent do not constitute the warrant! of an! #ind, e*pressed or i plied.

Huawei Technologies Co., Ltd.
$ddress6e"site, ailTel<a*$d inistration .uilding, Huawei Technologies Co., Ltd., .antian, Longgang /istrict, (hen0hen, 511122, 3eople4s 5epu"lic of China http-77www.huawei.co support8huawei.co 0755-21590000 :001;02111 0755-21590111

Issue 1.0 (2010-5-7)

Huawei Proprietary and Confidential Copyright H!"#$I %e&hnologies Co.' (td

iii

ission .)! IP *a+or %rans.ission -ault %rou.aintenan&e tea.0 Description Author %rans.0 (2010-5-7) Huawei Proprietary and Confidential Copyright H!"#$I %e&hnologies Co.leshooting )uide About %his /o&u.ent Issue 1.' (td 0 . of )! deli0ery depart.ent About This Document Document Information Intended Audience Prepared by Reviewed by Approved by Internal Product Name Date Date Date Revision History Date 2010-5-7 Version 1.

..........1 5....................................................................taining 4"* (ogs.......................0 (2010-5-7) Huawei Proprietary and Confidential Copyright H!"#$I %e&hnologies Co.............................)! IP *a+or %rans............................ission................................1 1................................ented).........................ented).......' (td 0ii .............................2 6..............................ission "lar.........1 1....................2 Che&2ing #hether the -ault Is Caused .....................1 Isolating the %rans.o&s!!!!!!!!!!!!!!1 5.............................ethods of -sin& Common Trace Too#s and btainin& ..................ission...................taining %raffi& 5tatisti& /ata.......1 6..........................y %rans....................leshooting Pro&edures........................1 %rans................................................2 Issue 1..ission -ault %rou..............................................1 $..............................................................................1 5......s (to 4e 5upple.......................1 %rou...........leshooting )uide Contents Contents 1 verview!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!! 1 " App#icab#e Versions and $cope!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!1 % Troub#eshootin& for 'mer&ency IP Transmission (au#ts!!!!!!!!!!!!!!!!!!!!1 1...................1 + ........................ergen&ies (to 4e 5upple....................................................................................................................1 ) Information Co##ection Chec*#ist!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!1 3....

pro0e the trans.ission -ault %rou.age -or these e. I.. Help the operator and Huawei trans.   Issue 1.e of lo&ating faults.ine whether the wireless produ&ts are faulty..ergen&y faults (a&&idents) related to IP trans.on %ra&e %ools and 6.' (td 1 .y shortening the ti.pro0e &usto.ethods to reali8e the following purposes7   -ast deter.0 (2010-5-7) Huawei Proprietary and Confidential Copyright H!"#$I %e&hnologies Co.on .ission s2ills of on-site )%5 personnel and rele0ant support personnel.)! IP *a+or %rans.ergen&y handling .taining (ogs 1    verview Co.ent pro0ides &ertain useful e.a+or e.aintenan&e failure 5er0i&e da.ission are as follows7 5er0i&e interruption (on the ser0i&e plane and signaling plane) 4%5 .ission produ&t line in re&tifying faults' there.er satisfa&tion. I.leshooting )uide 5 *ethods of !sing Co.ergen&y faults' this do&u.

0 and later 0ersions %his do&u. Preli.ergen&y IP trans.ent is appli&a.le to the following s&enarios7 9e&eption of .<911 and later 0ersions 59": 1.ent is appli&a.on %ra&e %ools and 6.ission faults fro.)! IP *a+or %rans.' (td 1 .inary &he&2 on other non-e.ergen&y trans.le to the following 0ersions7 !*%5 9":10 !*%5 9":11 *45C..leshooting )uide 5 *ethods of !sing Co.ission faults Issue 1.a+or e.taining (ogs "       App#icab#e Versions and $cope %his do&u.0 (2010-5-7) Huawei Proprietary and Confidential Copyright H!"#$I %e&hnologies Co. the ser0i&e tea.ission -ault %rou.

ergen&y trans. the ping operation and *"C pa&2et &apture for preli.  Issue 1. -or infor.ission fault o&&urs' the on-site &usto.taining (ogs % Troub#eshootin& for 'mer&ency IP Transmission (au#ts %!1 Troub#eshootin& Procedures %he following figure shows the pro&edure for trou.ission engineers to lo&ate the fault.1=Capturing Pa&2ets (*"C Pa&2et Capture).1.ission faults.on %ra&e %ools and 6.a+or IP trans.y trans. or trans. If the fault is &aused .er ser0i&e engineers perfor.inary +udg.ission de0i&es' as2 the operator or Huawei data&o.2=Pinging IP "ddresses= and 1.1.)! IP *a+or %rans.ent and sa0e the rele0ant infor.ission -ault %rou.ation &olle&tion' see se&tions 1.ation. *"C pa&2et &apture for lo&ating the fault.' (td 1 .leshooting e.al' perfor.leshooting )uide 5 *ethods of !sing Co.0 (2010-5-7) Huawei Proprietary and Confidential Copyright H!"#$I %e&hnologies Co..  #hen a .= If the produ&ts are nor.

' (td Issue 1.leshooting )uide 2 Huawei Proprietary and Confidential Copyright H!"#$I %e&hnologies Co..on %ra&e %ools and 6.ission -ault %rou.taining (ogs )! IP *a+or %rans.5 *ethods of !sing Co.0 (2010-5-7) .

.15.11. Issue 1.0 (2010-5-7) Huawei Proprietary and Confidential Copyright H!"#$I %e&hnologies Co.11.)! IP *a+or %rans.leshooting )uide 5 *ethods of !sing Co.2. )37 )31 (/.etween the lo&al end and the peer end.11.21 22.15.11.on %ra&e %ools and 6.oards and ports. #hen the 4%5 is in )! .11 11..and is the ser0i&e IP address of the 4%5 and the IP address of the port of the router &onfigured with the /HCP 9elay fun&tion. #hen the 4%5 is in )6 .ode' the destination IP address in the TraceRt &o. If the fault o&&urs only on one port' &he&2 whether other 4%5s under the port are nor.13. Trace Route  9un TraceRt on site.T( IP1 7 IP27 IP17 IP3 7 IP57 IP@7 IP77 11.taining (ogs %!" Chec*in& /hether the (au#t Is Caused by Transmission %!"!1 Ana#y0in& A#arms and Confi&urations    Che&2 whether the fault o&&urs on .  %!% Iso#atin& the Transmission %!%!1 Tracin& Routes /ete&t the hops .1@. If the fault o&&urs only on one interfa&e .11 11..ultiple 45Cs>4%5s.22.and is the ser0i&e IP address of the :ode4.ultiple interfa&e .ode' the destination IP address in the TraceRt &o.10 22.(C =.ode' the destination IP address in the TraceRt &o.le des&ri.and is the ser0i&e IP addresses of the 4%5 and :ode4.oard' &he&2 whether other 4%5s under the interfa&e .22 /e0i&e IP address of the 45C Port IP address of the 45C IP address of the port on the 45C for &onne&ting to the router IP address of the port on the *4%5 for &onne&ting to the router 5er0i&e IP address of the :ode4 IP address of the port for &onne&ting the :ode4 and 4%5 panel 5er0i&e IP address of the 4%5  %he following ta.al.es the reAuired route tra&e operations on site when faults o&&ur. Che&2 whether the fault o&&urs on .oard are nor.22.' (td 1 . ? ? #hen the 4%5 is in !6 .al..22.10 11.10 11.11.> )3) ? )32 )3. )3 Trans ission )3: 5outer1 5outer2 )35 )39 .13.ission -ault %rou.

taining (ogs )! IP *a+or %rans.ission. Che&2 the route &onfiguration or physi&al trans. Che&2 the route &onfiguration or physi&al trans. this operation only in the &ase of )! &o-trans. -or the 9:C .leshooting )uide TRC IPADDR $ubrac $#o * No! t No! B B $ource IP Addres s IP1 Destinati on IP Address IP3 N 1 Remar*s Che&2 the route &onfiguration or physi&al trans.ission.etween the 45C and the destination end fails.ission. B B IP1 IP@ Cou need to perfor.0 (2010-5-7) . If the result shown in the following figure is returned' it indi&ates that the route . Cou need to perfor.5 *ethods of !sing Co.etween the route to IP3 and the route to IP5.ission -ault %rou.ission.ission.   %he spe&ifi& operations and operation results are des&ri. this operation only in the &ase of )! &o-trans.ission.' (td Issue 1..200' the interfa&e IP2 is used as the sour&e IP address . B B IP1 IP5 Che&2 the route &onfiguration or physi&al trans. 3 Huawei Proprietary and Confidential Copyright H!"#$I %e&hnologies Co.on %ra&e %ools and 6. If the interfa&e IP address is used as the ser0i&e IP address on the 9:C' IP2 ser0es as the sour&e IP address.ission . %he result is !6 or )6.ode' you only need to tra&e the route to IP5 and the route to IP3.ed as follows7 ? %ra&e the route to IP7. B B IP1 IP7   In non-)! &o-trans. %he result +ust pro0ides referen&e for &he&2ing the differen&es .y default.

' (td 5 .)! IP *a+or %rans. ? If the result shown in the following figure is returned' it indi&ates that the route .etween the first hop of router and the 4%5.0 (2010-5-7) Huawei Proprietary and Confidential Copyright H!"#$I %e&hnologies Co. %!%!" Pin&in& IP Addresses Ping a destination IP address fro. Issue 1.al.ission -ault %rou.leshooting )uide 5 *ethods of !sing Co. a spe&ified sour&e IP address to &he&2 whether the IP layer .etween the lo&al end and the peer end is nor. PIN2 IP %he following figure shows the pro&edure for pinging an IP address.taining (ogs In this &ase' &he&2 the &onfiguration of the route .etween the 45C and the destination end is nor..al.on %ra&e %ools and 6.

%he result is !6 or )6. this operation only in the &ase of )! &otrans. %he result pro0ides referen&e for &he&2ing whether the produ&t is &onfigured with the route to the destination address.5 *ethods of !sing Co. If the syste.ission. Cou need to perfor.etween the 45C and the port on the 45C for &onne&ting to the router fails. this operation only in the &ase of )! &otrans.taining (ogs )! IP *a+or %rans.le.es the reAuired ping operations on site when faults o&&ur.> )3) )32 )3.leshooting )uide )37 )31 ( /.on %ra&e %ools and 6. Cou need to perfor..le des&ri. B B IP1 IP@ Cou need to perfor.ission. IP1. Che&2 the route &onfiguration on the 45C>router 1>router 2. this operation on ea&h interfa&e when load sharing is adopted. )3 Trans ission )3: 5outer1 5outer2 )35 )39 . B B IP1 IP7  %he spe&ifi& operations and operation results are des&ri. B B IP1 IP1 Che&2 the 45C route and the &onfiguration of router 1. In this &ase' &he&2 the 45C route and the &onfiguration of router 1' and Auery the "9P ta.ed as follows7 ? 6n the 45C (*%' ping IP1 fro.ission -ault %rou.T(  %he following ta. B B IP1 IP3 B B IP1 IP5 Che&2 the route &onfiguration on the 45C>router 1>router 2>:ode4.' (td Issue 1. Huawei Proprietary and Confidential Copyright H!"#$I %e&hnologies Co.(C =. PIN2 IP $ubrac $#o * No! t No ! B B $ource IP Addres s IP2 Destinati on IP Address IP1 N 1 Remar*s Duery the "9P ta. Che&2 the route &onfiguration on the 45C>router 1>router 2>:ode4. Cou need to perfor. this operation on ea&h interfa&e when load sharing is adopted. returns Request time out' it indi&ates that the IP layer .0 (2010-5-7) @ .le. Che&2 the route &onfiguration on the 45C>router 1>router 2>:ode4.

returns Request time out' it indi&ates that the IP layer .etween the 45C and IP@ fails. returns Request time out' it indi&ates that the IP layer .' (td 7 . IP1.etween the 45C and the port on the *4%5 for &onne&ting to router 2 fails.inute' depending on the spe&ifi& fault. IP1. IP1.oards.y . %he duration of &apturing pa&2ets is a. ? ? ? %!%!% Capturin& Pac*ets 3.  'nab#in& Pac*et Capture 3(or V5R114 Sol ut i on t o I nt ernal Funct i ons of t he W eb LM T $na. IP1.(": I/ on all the interfa&es are &aptured on the a&ti0e and stand. In this &ase' &he&2 the route &onfiguration on the 45C>router 1>router 2>:ode4. If the syste.AC Pac*et Capture4  -or the 45C' the pa&2ets with or without a . 6n the 45C (*%' ping IP@ of the port for &onne&ting the :ode4 and the 4%5 fro. If the syste. returns Request time out' it indi&ates that the IP layer .on %ra&e %ools and 6..etween the 45C and the ser0i&e IP port of the :ode4 fails.(": I/) twi&e on the a&ti0e and stand. If the syste.oards respe&ti0ely.le *"C pa&2et &apture on the 9:C . If the syste. 6n the 45C (*%' ping ser0i&e IP5 of the :ode4 fro. Issue 1.leshooting )uide 5 *ethods of !sing Co. 6n the 45C (*%' ping ser0i&e IP7 of the 4%5 fro.200 a&&ording to the following figure. In this &ase' &he&2 the route &onfiguration on the 45C>router 1>router 2. In this &ase' &he&2 the route &onfiguration on the 45C>router>:ode4.ission -ault %rou.etween the 45C and the ser0i&e IP port of the 4%5 fails.)! IP *a+or %rans. In this &ase' &he&2 the route &onfiguration on the 45C>router>:ode4.y .0 (2010-5-7) Huawei Proprietary and Confidential Copyright H!"#$I %e&hnologies Co.out one . %herefore' you need to &apture the pa&2ets (with or without a .taining (ogs ? 6n the 45C (*%' ping IP3 fro. returns Request time out' it indi&ates that the IP layer .

0 (2010-5-7) Huawei Proprietary and Confidential Copyright H!"#$I %e&hnologies Co.ra&2 :o.5 *ethods of !sing Co.taining (ogs )! IP *a+or %rans.eters 6uter port nu.e used.(": priority F B B $thernet fra.2115PC150' the *"C pa&2et &apture is defe&ti0e and &annot .eters 5u.ission -ault %rou..leshooting )uide -or the 9:C . Parameter $ettin& and '6amp#e Capturin& Pac*ets 4asi& para.(": tag . $nd %o $Eternal para. 5lot :o.e 1500 In0alid "ll 4i-dire&tional Ces "ll "ll 4i-dire&tional :o "ll Issue 1. Port type (6uter) 6uter Inter&ept (ength Interfa&e type (inner) 5tart -ro..on %ra&e %ools and 6.er 6uter tra&e dire&tion .' (td .

6uter 1 with a .on %ra&e %ools and 6.0 (2010-5-7) Huawei Proprietary and Confidential Copyright H!"#$I %e&hnologies Co.ission -ault %rou..' (td < .(": tag Issue 1.(": tag 6uter 2 without a .leshooting )uide 5 *ethods of !sing Co.e type IP Pa&26ut(en IP Pa&2In(en IP GH GH IP GH GH %he following figure shows the .asi& &onfiguration ite.s.)! IP *a+or %rans.taining (ogs Capturin& Pac*ets *"C fra.

le-&li&2 Manage Trace Task in Trace Navigation Tree. 5ele&t a tra&e tas2. %he Trace page is displayed' as shown in the following figure.' (td Issue 1. /ou.on %ra&e %ools and 6. 10 Huawei Proprietary and Confidential Copyright H!"#$I %e&hnologies Co. $uspendin& Pac*et Capture 3V5774 %o suspend pa&2et &apture' pro&eed as follows7 1. 2.ission -ault %rou. 1.leshooting )uide peration After the .0 (2010-5-7) .5 *ethods of !sing Co. Cli&2 Query.AC Pac*et Capture Is $uccessfu##y 'nab#ed "fter setting the &onditions' &li&2 OK..taining (ogs )! IP *a+or %rans.

the . 5.tain the result file of pa&2et &apture' pro&eed as follows7 3.taining (ogs btainin& the Resu#t (i#e of Pac*et Capture %o o. "fter o. to o.leshooting )uide 5 *ethods of !sing Co.on %ra&e %ools and 6. Issue 1.0 (2010-5-7) Huawei Proprietary and Confidential Copyright H!"#$I %e&hnologies Co. 6n-site personnel &an log in to the syste. Cli&2 Query. 9un %!T OMUAR&A during pa&2et &apture to &onfir.ode.ain wor2 area of the 6*!. @. /ou.le-&li&2 Manage Trace Task in Trace Navigation Tree.)! IP *a+or %rans.' (td 11 ..taining the result file' on-site personnel need to send it to the 9I/ engineers for analysis.ission -ault %rou. 5ele&t a response file' and then &li&2 Upload. the path \M !"\ AM\main #ork area\$tp\trace in -%P .tain the result file fro.

taining (ogs ) Information Co##ection Chec*#ist )!1 'mer&encies 3to 8e $upp#emented4 Issue 1.on %ra&e %ools and 6.' (td 1 .)! IP *a+or %rans.0 (2010-5-7) Huawei Proprietary and Confidential Copyright H!"#$I %e&hnologies Co..ission -ault %rou.leshooting )uide 5 *ethods of !sing Co.

If .0 (2010-5-7) Huawei Proprietary and Confidential Copyright H!"#$I %e&hnologies Co.ission alar.s A#arm ID A#arm Name "(*-F51 "(*-F52 $thernet (in2 -ault $thernet (in2 %rans.and to o. .ission -ault %rou. Cou &an run the following &o.o&s +!1 Transmission A#arms 3to 8e $upp#emented4 If the trans. generation ti.)! IP *a+or %rans.leshooting )uide 5 *ethods of !sing Co. If the fault persists' pro&eed with the neEt step.ode' swit&h o0er the interfa&e ...oard are affe&ted.e' and the alar.any $1 &a.s listed in =-$ Port "lar.   +!" btainin& 8A.er to &he&2 the inter.o&s )enerally' 4"* logs in&lude the 4"* logs' operation logs' and alar. Issue 1. 9eset the interfa&e .tain 4"* logs7 COL LOG: TP=BAM.oard. $igure '(' -$ Port "lar.a&2up . If not' pro&eed with the neEt step.oard.' (td 1 .ethods of -sin& Common Trace Too#s and btainin& . "s2 the &usto.e is the sa.e as the fault o&&urren&e ti.oard are faulty' .ission Indi&ation A#arm ID "(*-F51 A#arm Name $thernet (in2 9e&ei0e Indi&ation 5olution  If the interfa&e .ser0e whether the ser0i&es are re&o0ered.s= are generated' the alar.any :ode4s under the interfa&e . logs.taining (ogs + .s seriously affe&t the I!>I!9 interfa&e or I!4 interfa&e' re&o0er the ser0i&es a&&ording to =5olution=.ission or the peer de0i&e' and then &he&2 whether the fault persists.ediate trans.oard wor2s in . 6therwise' pro&eed with the neEt step.on %ra&e %ools and 6. "fter the swit&ho0er' o.les under an interfa&e .

<710 to 10700.e' that is' fro.tain traffi& statisti&s data in . logs' they &an download the $i)*n+o.e (year>.ission -ault %rou.press all the files under the 0arn dire&tory' and then send the. 2 Huawei Proprietary and Confidential Copyright H!"#$I %e&hnologies Co.200.tain the $i)*n+o.100 ..at of traffi& statisti&s data is as follows7 A20081231. AM.a&2 of 0alid data a&&ording to the ti.. If operation logs are reAuired' &o. +!% btainin& Traffic $tatistic Data %he following figure shows how to o.on %ra&e %ools and 6.leshooting )uide "fter you run the &o. AM(-ip file.' (td Issue 1. to the headAuarters.0 (2010-5-7) . If on-site engineers are reAuired to return the operation logs or alar. AM(-ip file in .. %he for.taining (ogs )! IP *a+or %rans.e period.press the file under the Operate%og dire&tory' and then send the file to the headAuarters.b 2 #here' 1223'14' indi&ates the ti.0930+0800-1000+0800_EMS-NORMAL. If alar.onth>date)' and 2542623227'22262322 indi&ates the re&ording ti. AM(-ip file to the lo&al dis2 and de&o.mrf. logs are reAuired' &o.press it. 6n-site engineers &an pro0ide the feed.and' the 4"* logs are stored in the $i)*n+o.5 *ethods of !sing Co. 6n-site engineers &an log in to the 4"* through -%P to o.$T/.