You are on page 1of 113

SPL-330 © 2001, Cisco Systems, Inc. All rights reserved.

1
Troubleshooting Cable
Access Infrastructure
Session SPL-330

SPL-330 © 2001, Cisco Systems, Inc. All rights reserved. 3


8 possible phases for a new service
on a cable network

• Phase 1: vendor selection


• Phase 2: buying equipment
• Phase 3: connecting equipment
• Phase 4: starting service
• Phase 5: earning money
• Phase 6: customer complaints
• Phase 7: spending loads of money to keep
service in the air
• Phase 8: Help !!!!!!!
SPL-330 © 2001, Cisco Systems, Inc. All rights reserved. 4
Again 8 phases

• Phase 1: what do we want to deliver and what must be the


network specification
• Phase 2: network design with design spec phase 1
• Phase 3: vendor selection, buying equipment
• Phase 4: training, install equipment
• Phase 5: test network on specs defined in phase 1
• Phase 6: invest in preliminary maintenance and
monitoring tools
• Phase 7: start your service
• Phase 8: relax and collect your money

SPL-330 © 2001, Cisco Systems, Inc. All rights reserved. 5


Agenda

• Design Considerations and Segmentation


• Preliminary Maintenance
• Troubleshooting physical layer
• Troubleshooting with Cisco IOS®
• Cable Management Tools
• Optimizing the Upstream(CMTS)
• Closing Remarks
• References

SPL-330 © 2001, Cisco Systems, Inc. All rights reserved. 6


Design Considerations and
Segmentation

SPL-330 © 2001, Cisco Systems, Inc. All rights reserved. 7


Network design definition

• Which services do you want to transport?


Design is depending on service availability /
repair time
• What is your road map: 64 QAM / QPSK or later
on 256 QAM and 16 QAM?
• What are the transport frequencies in
downstream, but more important in upstream
direction?
• Can you expand your upstream carriers per
node?
SPL-330 © 2001, Cisco Systems, Inc. All rights reserved. 8
Physical network design upstream 1

• For return laser Use DFB return or Fabry-Perot isolated


lasers type.
• Optical connectors are physical connectors.
Tolerances in fiber lead to reduction of signal quality.
• Often no redundant equipment in upstream path. Can
you design your optical path as a redundant ring?
• Make tap offs at strategic points so that you can
measure the upstream signal without disconnecting
the service.
• Determine the number of transport carriers now and for
the future.

SPL-330 © 2001, Cisco Systems, Inc. All rights reserved. 9


Physical network design upstream 2

• Be aware that upstream level control is an


automatic process.
• Loose connectors can start laser clipping.
• Add margin for tolerances and ingress noise.
• DOCSIS spec is 25 dB C/N but is that all ?
• Oh yes ingress noise but ... that’s it ?
• What about CSO, CTB, hum, CPD, ... do they
have any impact ?

SPL-330 © 2001, Cisco Systems, Inc. All rights reserved. 10


Physical upstream segmentation

• Try to decrease number of homes per CMTS port.


easy troubleshooting
gives higher RF transport quality
lower ingress noise per port
• If carriers are combined back in HE you do not gain
ingress noise reduction.
• Combining nodes over a single fiber and splitting them
up again in the HE reduces laser cost but increases
trouble shooting time extensively!!
• Most operators are combining in the HE for 2 to 4
nodes per upstream port (Traffic / C/N depending).
When more upstream carriers are needed, use block
conversion (up to 200MHz) or more reverse lasers

SPL-330 © 2001, Cisco Systems, Inc. All rights reserved. 11


Head-end reverse set-up
Output
Forward Test Point
up-converter Combiner

Fiber Optic
Pad
Tx
Set-top Boxes
4 or 8-Way
Status Monitoring Combiner

CMTS Fiber Optic


Rx

Telephony
4 or 8-Way
Splitter
Sweep/Monitoring

SPL-330 © 2001, Cisco Systems, Inc. All rights reserved. 12


Carrier-to-Ingress (C/I)

• Ingress noise is from the house into the network


• Higher CPE output =
Greater C/Ingress, but possible interference to other CPE
May need directional couplers
• Lower CPE output to limit interference, use a house
amp at the in-house entering point, but this would
amplify ingress noise.
• What about the use of reverse port pad locations?
Great for troubleshooting but forcing a higher C/Ingress

SPL-330 © 2001, Cisco Systems, Inc. All rights reserved. 13


Reverse Port Pads

H H

Diplex L L Diplex
Filter Filter
Low Pass
Filter DC
LF AMP

H H

Diplex
L L Filter

SPL-330 © 2001, Cisco Systems, Inc. All rights reserved. 14


Measuring data carrier RF levels 1

• Downstream carrier level often at –6 to


-10dB related to TV level.
• A solitaire downstream carrier can be measured
with a power meter (typical method)
• In an operational network in 6 or 8 MHz do not
perform a normal TV peak power measurement.
Special equipment/measurements are needed,
like dB/Hz measurements using a spectrum
analyzer.

SPL-330 © 2001, Cisco Systems, Inc. All rights reserved. 15


Measuring data carrier RF levels 2

• Signal fluctuates too much for standard TV


measuring equipment
• Spectrum analyzers
Use pre-amble method (see related Cisco document)
Zero span
Use peak hold (add ingress noise)
Use sample detector
• With 16 QAM we introduce the Amplitude domain (i.e.
changes in signal level). This makes measurements
even more difficult.
• NEVER use a DOCSIS Carrier for balancing your
return path !!!

SPL-330 © 2001, Cisco Systems, Inc. All rights reserved. 16


Analyzer pictures zero span

SPL-330 © 2001, Cisco Systems, Inc. All rights reserved. 17


Preamble measurement

Left slide is highest ~ 29 dB C/N

Top right shows a fast spike

Bottom right shows a repeating


pattern

SPL-330 © 2001, Cisco Systems, Inc. All rights reserved. 18


Agenda

• Design Considerations and Segmentation


• Preliminary Maintenance
• Troubleshooting physical layer
• Troubleshooting with Cisco IOS®
• Cable Management Tools
• Optimizing the Upstream(CMTS)
• Closing Remarks
• References

SPL-330 © 2001, Cisco Systems, Inc. All rights reserved. 19


Preliminary maintenance

SPL-330 © 2001, Cisco Systems, Inc. All rights reserved. 20


Preliminary maintenance start

• Set-up your optical return path properly and with


care
• Be aware that ingress noise can make your
return laser clip
• Use high pass filters at strategic points to block
ingress noise
• Terminate the unused tap ports with 75 ohm
resistors

SPL-330 © 2001, Cisco Systems, Inc. All rights reserved. 21


Return path behavior

• If the upstream attenuation is low your benefit is


that the modems’ transmission power can be low
to leave you with a lot of headroom
• Negative to it is that if there is an ingress noise
injection into this path. This ingress noise is
dominant due to its low attenuation
• Coax connectors have to be clean and tightened.
Be aware that low frequencies are impacted very
strongly.
• Use coax with good shielding. A broken shield is
on big antenna. Imagine what this will pick up
from a apartment building

SPL-330 © 2001, Cisco Systems, Inc. All rights reserved. 22


Setting up the return path 1

• What you need is at least a 1 CW carrier

• What you must not use for it is the modem


transmit value (IOS) or measure the level of a
DOCSIS carrier !!

• Why ?
A modem is level controlled by the CMTS and the
carrier is therefore not reliable.

SPL-330 © 2001, Cisco Systems, Inc. All rights reserved. 23


Setting up the return path 2

• Inject a CW carrier or better a few


• Align your upstream so that you have enough
headroom for tolerances.
• Be aware that ingress noise is energy and can
clip your laser or decrease amp performance
• If the ingress noise up to 18 MHz is high or at 27
MHz is huge. Try to block it with filters.! Or at
least do measurements for a period of time to
see the behavior of the link.

SPL-330 © 2001, Cisco Systems, Inc. All rights reserved. 24


Home wiring
• 75% of ingress noise is caused in the home and injected
into the reverse path
One house can take down one or multiple nodes!
Monitor network continuously and eliminate problems
quickly
• Why this 75 % ?……..Home installation is often do it
yourself Using poor components and on top poor
craftsmanship
Micro-reflections
Frequency response variation and excessive loss
Leakage and ingress noise
• Replacing it all is best but usually unacceptable because
of cost.
Individual testing is required to bring it up to
standards
SPL-330 © 2001, Cisco Systems, Inc. All rights reserved. 25
The new home network

NID
W W

Directional
Coupler

SPL-330 © 2001, Cisco Systems, Inc. All rights reserved. 26


Network design in cabinets

SPL-330 © 2001, Cisco Systems, Inc. All rights reserved. 27


In-house: outlets examples

SPL-330 © 2001, Cisco Systems, Inc. All rights reserved. 28


In-house level calculation

• Modem level downstream must be > -15dBmV


• TV Input level >3 dBmV on outlet
• Level at TV input must be >0dBmV (depending on
country)
• 1 splitter attenuates 3.6 dB
• At distribution level of –10 dB your data is >-3 dBmV
• Tapping of data using bi-directional couplers (-11 dB)
is putting things to the limit. It will also add 11 dB of
upstream attenuation
• Calculate the max. level and the minimum and start
calculating before you roll out
SPL-330 © 2001, Cisco Systems, Inc. All rights reserved. 29
In-house design
• Good design
modem receive levels are within specification
(>-15, <+15 dBmV)
• Transmit levels are within spec. <52 dBmV (calculate 50 )
• Return path is only open for the interactive connections
return design can handle 256 QAM down and 16 QAM up.
Design is robust, cables to modem are highly shielded

• What is your Benefit?


Low amount of trouble tickets
Quick response time
Quick trouble shooting
Low labour cost
Peace and rest inside the organization
High costumer satisfaction
SPL-330 © 2001, Cisco Systems, Inc. All rights reserved. 30
Return path attenuation

• Tap value (first or last tap), depending on


tap construction
• Type of amplifier (trunk, bridger, line
extender)
• Balancing scenario (port or hybrid)
• Home network architecture
splitters, filters, cabling, connectors

SPL-330 © 2001, Cisco Systems, Inc. All rights reserved. 31


House passives

• High EMI shielding from 5 MHz to 1 GHz


• > 15 dB input/output return loss
• Rugged housing
• Robust ferrite components to eliminate
harmonics
• Wall outlets with defined return path spec !
• > 18 dB isolation between ports
Should be much better than this

SPL-330 © 2001, Cisco Systems, Inc. All rights reserved. 32


Passive isolation
That’s a 28
Ch 3 @ 55.25 MHz
at 3 dBmV
C/G Ratio

Second harmonic
@ 60 MHz
at -25 dBmV
50 dBmV
Splitter • Local Oscillator (LO) presume 2e
@ 30 MHz harmonic at
-55 dB at 60 MHz pretty good ?
• If you use a splitter still good to ?
• -55 dB lower than 50 =-5 dBmV
• Isolation splitter is 20 dB=-25
dBmV
• You need at least to use a directional
coupler but better is to use a filter !

SPL-330 © 2001, Cisco Systems, Inc. All rights reserved. 33


Return leakage detection

• Ingress signals on the return path


Sometimes only present when equipment is really in use
by customer (IF VCR)
Low in level and bursty in nature
• You can’t insert a reverse frequency carrier at the
head-end
The diplex filters would block the carrier
• Some key up a 27 MHz transmitter or walkie-talkie
while driving around the cable plant and observe a
spectrum analyzer in the headend
• Software and hardware is available in the market to
measure downstream leakage in the field and show it
on a map.

SPL-330 © 2001, Cisco Systems, Inc. All rights reserved. 34


Monitoring

• Advanced notice to detect developing problems


Allows operators to respond before real errors occur,
which generate service calls and drives your customer
Satisfaction down
• Go for Performance archiving
• Organize preventative maintenance combined
with your history values.
• Let your monitoring tool find out what you
gained after repair or preventive maintenance !

SPL-330 © 2001, Cisco Systems, Inc. All rights reserved. 35


Example of return path
performance history

• Average noise
floor at 17 MHz
varies
consistently
in time
• Indication of
return path with
an ingress
problem
11:00 PM 7:00 AM 11:00 PM 7:00 AM
• Level may be OK
but maintenance
now may prevent
future problem Single Frequency Time Window for 72 Hours
from One Return Path
SPL-330 © 2001, Cisco Systems, Inc. All rights reserved. 36
Agenda

• Design Considerations and Segmentation


• Preliminary Maintenance
• Troubleshooting physical layer
• Troubleshooting with Cisco IOS®
• Cable Management Tools
• Optimizing the Upstream(CMTS)
• Closing Remarks
• References

SPL-330 © 2001, Cisco Systems, Inc. All rights reserved. 37


Troubleshooting
the Physical Layer

SPL-330 © 2001, Cisco Systems, Inc. All rights reserved. 38


Tracking it down

• Most of the problems are upstream related


• If there are problems in the field with the
downstream, often the TV transmission is
bad, too.

SPL-330 © 2001, Cisco Systems, Inc. All rights reserved. 39


Tracking it down

SPL-330 © 2001, Cisco Systems, Inc. All rights reserved. 40


Tracking it down

SPL-330 © 2001, Cisco Systems, Inc. All rights reserved. 41


Tracking it down
(upstream troubleshooting)

• Before you start running use your analyzing


tools and possibly history values
• Try to find the problem as close to the
source as you can before you start driving
• Don’t start pulling cables. Start measuring,
because you can not stop the service.
• To do this you need measuring points.

SPL-330 © 2001, Cisco Systems, Inc. All rights reserved. 42


Amplifier block diagram
PLUG-IN PIN
PORT PAD IGC DIODE PORT
1 4
H H
L PLUG-IN PLUG-IN L
EQ SCD

PLUG-IN Trunk TP
PLUG-IN
PAD
PAD

PLUG-IN ALC CIRCUIT


EQ

Reverse Input TP

PORT PORT
3 6
H H
L L
PLUG-IN PLUG-IN
PAD PAD
SPL-330 © 2001, Cisco Systems, Inc. All rights reserved. 43
Tracking it down

• In the field you are blind for what is


happening in the headend.
• Use equipment like Stealth to be able to
look back from the headend into the field or
modulate your analyzer with a tv modulator.
• If this is not possible you need a second
person most of the time.

SPL-330 © 2001, Cisco Systems, Inc. All rights reserved. 44


Return path testing

H H
L L

Reverse Input TP

H H
L L

SPL-330 © 2001, Cisco Systems, Inc. All rights reserved. 45


Head-end and remote analyzer

• Can successfully use divide


and conquer technique to
quickly find problem source
• No relying on another
person’s interpretation
• Eliminates inefficient usage
of resources
and employee time
• Verifies if problem really
was fixed
PathTrak Interoperability Feature/Option

SPL-330 © 2001, Cisco Systems, Inc. All rights reserved. 46


Tracking it down

• Look at the type of disturbance.


• If it looks like CPD be careful with
disconnecting cables for if you eliminate
the crystal it’s gone and it can stay away for
weeks

SPL-330 © 2001, Cisco Systems, Inc. All rights reserved. 47


Tracking it down

• If it is time depending follow the network


tree pattern. Put a 6 db attenuator on the
next decision point were it stopped
• If it comes back the ingress noise must be 6
dB lower (if you are in the right path).
• Of course you need the headroom in your
equipment and modems.

SPL-330 © 2001, Cisco Systems, Inc. All rights reserved. 48


Tracking it down

• If you have an open cable in the field you


can pick up the egress noise.
• Use a CW to find out if your network picks
up the signal.
• Pay attention (measure) to the ether. Also
trains, metro, traffic lights can make a lot of
high level ingress noise.

SPL-330 © 2001, Cisco Systems, Inc. All rights reserved. 49


Power addition

15.2 dBmV

RX
Node 15.2 dBmV
15.2 dBmV
20 dBmV
18.2

15.2
• 1000 houses funneling noise equally at
-15 1 dBmV each = 31 dBmV
27 MHz • Using high pass filters on 500 houses
still results in 28 dBmV

SPL-330 © 2001, Cisco Systems, Inc. All rights reserved. 50


Agenda

• Design Considerations and Segmentation


• Preliminary Maintenance
• Troubleshooting physical layer
• Troubleshooting with Cisco IOS®
• Cable Management Tools
• Optimizing the Upstream(CMTS)
• Closing Remarks
• References

SPL-330 © 2001, Cisco Systems, Inc. All rights reserved. 51


Troubleshooting with IOS
Show, Flap List and, Debug Commands

SPL-330 © 2001, Cisco Systems, Inc. All rights reserved. 52


Simple network configuration

uBR7223 Repeat for A,B,C, to US ports 1, 2, 3


Up
convertor
6 Console
A Connection
IF 30
B
US DS ATT
ATT ATT
ATT
RF C
Hi
Lo D
Diplex Filter 3
uBR924
ATT
ATT ATT
ATT
30

Telnet Connection
10Base T Hub

DHCP/DNS/TOD/TFTP
Server

SPL-330 © 2001, Cisco Systems, Inc. All rights reserved. 53


IOS command show…..

• Show version
• Show controller cable x/y downstream
• Show controller cable x/y
• Show cable modem
• Show cable hop
• Show cable detail
• Show cable flap-list
SPL-330 © 2001, Cisco Systems, Inc. All rights reserved. 54
Show version

ubr7246#sh ver
Cisco Internetwork Operating System Software
IOS (tm) 7200 Software (UBR7200-P-M), Version 12.1(2.3)EC1, EARLY DEPLOYMENT
MAINTENANCE INTERIM SOFTWARE
---snip---
BOOTFLASH: 7200 Software (UBR7200-BOOT-M), Version 11.3(6)NA1, EARLY DEPLOYMENT
RELEASE SOFTWARE (fc1)
ubr7246 uptime is 2 weeks, 5 days, 6 hours, 20 minutes
System returned to ROM by power-on
System image file is "slot0:ubr7200-p-mz.121-2.3.EC1"
cisco uBR7246 (NPE200) processor (revision B) with 53248K/12288K bytes of memory.
125K bytes of non-volatile configuration memory.
4096K bytes of packet SRAM memory.
---snip---
20480K bytes of Flash PCMCIA card at slot 0 (Sector size 128K).
4096K bytes of Flash internal SIMM (Sector size 256K).
Configuration register is 0x2102

SPL-330 © 2001, Cisco Systems, Inc. All rights reserved. 55


Show controller x/y downstream

• Cable 3/0 downstream is up


• Frequency 495.0000 MHz, channel width 8 MHz,
64-QAM
• Symbol rate 6.952 Msps
• FEC ITU-T J.83 annex A, R/S interleave
I=12, J=17
• Downstream channel ID: 0

SPL-330 © 2001, Cisco Systems, Inc. All rights reserved. 56


Show controller C4/0 up 0
Cable4/0 Upstream 0 is up
Frequency 29.392 MHz, Channel Width 1.600 MHz, QPSK Symbol Rate 1.280 Msps
Spectrum Group 2
SNR 33.640 dB
Nominal Input Power Level 0 dBmV, Tx Timing Offset 2811
Ranging Backoff automatic (Start 0, End 3)
Ranging Insertion Interval automatic (60 ms) • Most of this shows
Tx Backoff Start 0, Tx Backoff End 4 how the interface
Modulation Profile Group 1 is configured
Concatenation is enabled
part_id=0x3137, rev_id=0x03, rev2_id=0xFF
nb_agc_thr=0x0000, nb_agc_nom=0x0000
• The SNR is calculated
Range Load Reg Size=0x58
Request Load Reg Size=0x0E
• The minislots
Minislot Size in number of Timebase Ticks is = 8 requested/granted
Minislot Size in Symbols = 64 could point to a problem if
Bandwidth Requests = 0x2E they are not equal
Piggyback Requests = 0xE
Invalid BW Requests= 0x0 • The map advance shows how
Minislots Requested= 0x672
Minislots Granted = 0x672 far away
Minislot Size in Bytes = 16 the farthest modem is
Map Advance (Dynamic) : 2454 usecs
UCD Count = 156
DES Ctrl Reg#0 = C000C043, Reg#1 = 0
SPL-330 © 2001, Cisco Systems, Inc. All rights reserved. 57
Show cable modem
Interface Prim Online Timing Rec QoS CPE IP Address MAC Address
Sid State Offset Power

Interface = Interface that the cable modem is connected to

Prim sid = Primary SID for this cable modem

Online state = (See next page)

Timing offset = Current round trip time as seen by the cable modem

Rec power = Power level of the signal that the CMTS is receiving from this SID

QoS = Service class assigned to this cable modem

CPE = Number of devices behind this cable modem

IP address = IP address of this cable modem

MAC address = MAC address of this cable modem

SPL-330 © 2001, Cisco Systems, Inc. All rights reserved. 58


Show cable modem (online state)

offline—modem considered offline


init(r1)—modem sent initial ranging
init(r2)—modem is ranging
init(rc)—ranging complete
init(d)—dhcp request received
init(i)—dhcp reply received; IP address assigned
init(t)—TOD request received.
init(o)—TFTP request was received.
Online—modem registered, enabled for data
online(d)—modem registered, but network access for the CM is disabled
online(pk)—modem registered, BPI enabled and KEK assigned
online(pt)—modem registered, BPI enabled and TEK assigned
reject(m)—modem did attempt to register; reg was refused due to bad MIC
reject(c)—modem did attempt to register; reg was refused due to bad COS
reject(pk)—KEK modem key assignment rejected
reject(pt)—TEK modem key assignment rejected

SPL-330 © 2001, Cisco Systems, Inc. All rights reserved. 59


Show cable modem

Interface Prim Online Timing Rec QoS CPE IP address MAC address
Sid State Offset Power
Cable3/0/U0 2 online 2262 *-0.50 3 0 10.30.128.145 0090.8330.020f
Cable3/0/U0 3 online 2260 0.25 3 0 10.30.128.146 0090.8330.0211
Cable3/0/U0 4 online 2256 *0.75 3 0 10.30.128.143 0090.8330.0216
Cable3/0/U0 7 online 4138 !-1.00 3 1 10.30.128.182 0050.7366.124d
Cable3/0/U0 8 online 4142 !-3.25 3 1 10.30.128.164 0050.7366.1245
Cable3/0/U0 9 online 4141 !-3.00 3 1 10.30.128.185 0050.7366.17e3
Cable3/0/U0 10 online 4142 !-2.75 3 0 10.30.128.181 0050.7366.17ab

• The * symbol indicates that the CMTS is using the


power adjustment method on this modem
• The ! symbol indicates that the modem has reached
maximum transmit power
SPL-330 © 2001, Cisco Systems, Inc. All rights reserved. 60
Show cable modem detail

Interface SID MAC address Max CPE Concat Rx SNR


Cable4/0/U0 1 0050.7366.1db1 3 no 26.50
Cable4/0/U1 2 0050.7318.e97f 3 no 23.87
Cable4/0/U1 3 0050.7318.e965 3 no 23.85
Cable4/0/U0 4 0050.7318.e931 3 no 26.72
• The “Rx SNR” is an estimate of the SNR that the CMTS is
receiving

• Set up “show cable modem remote query” to see the


downstream CM SNR

SPL-330 © 2001, Cisco Systems, Inc. All rights reserved. 61


Show cable hop

Upstream Port Poll Missed Min Missed Hop Hop Corr Uncorr
Port Status Rate Poll Poll Poll Thres Period FEC FEC
(ms) Count Sample Pcnt Pcnt (sec) Errors Errors
Cable3/0/U0 down 1000 * * * frequency not set *** 0 0
Cable3/0/U1 down 1000 * * * frequency not set *** 0 0
Cable4/0/U0 29.408 Mhz 1000 0 10 0% 100% 300 0 2
Cable4/0/U1 admindown 1000 * * * interface is down *** 0 0
Cable4/0/U2 admindown 1000 * * * interface is down *** 0 0
Cable4/0/U3 admindown 1000 * * * interface is down *** 0 0
Cable4/0/U4 admindown 1000 * * * interface is down *** 0 0
Cable4/0/U5 admindown 1000 * * * interface is down *** 0 0

Primary information here is:


• Frequency of the upstream
• Number of correctable and uncorrectable FEC errors
SPL-330 © 2001, Cisco Systems, Inc. All rights reserved. 62
What is the flap list?
• A patent-pending feature that lists flaky modems
maintained in the uBR
• A cable modem is added to flap list when:
CM fails the registration process
Keep alive messaging between CMTS and CM is
impacted by communication errors
CM upstream transmit power is adjusted beyond user-
specified threshold

• Following parameters are settable using CLI:


- Max size of flap list - Age threshold
- Insertion time threshold - Power adjustment threshold
SPL-330 © 2001, Cisco Systems, Inc. All rights reserved. 63
Sample output of cable flap list

Router# show cable flap-list sort-flap


MAC Address CableIF Ins Hit Miss CRC P-Adj Flap
00e0.1eb2.bb7f 3/0 U0 1 2453 0 0 5 902
00e0.1eb2.bbad 3/0 U0 704 0 0 0 3 704
00e0.1eb2.bbcf 3/0 U0 45 1356 234 56007 2 218
00e0.1eb2.bb85 3/0 U0 46 785 240 45985 3 217
00e0.1eb2.bb59 3/0 U0 46 789 236 70234 3 211

Router# show cable flap-list sort-time


MAC Address CableIF Ins Hit Miss CRC P-Adj Time
00e0.1eb2.bb85 3/0 U0 46 785 240 45985 3 Jan 2 00:10:05
00e0.1eb2.bb59 3/0 U0 46 789 236 70234 3 Jan 2 00:10:16
00e0.1eb2.bbcf 3/0 U0 45 1356 234 56007 2 Jan 2 00:10:22
00e0.1eb2.bb7f 3/0 U0 1 2453 0 0 5 Jan 3 23:00:04
00e0.1eb2.bbad 3/0 U0 704 0 0 0 3 Jan 3 20:25:57

SPL-330 © 2001, Cisco Systems, Inc. All rights reserved. 64


Flap list explained

MAC addr Identifies Subscriber

Cable IF Physical Port Identifier

# of Times in 180 Seconds That the Modem Re-starts Initial


Ins
Ranging

# of Times CMTS Sent a Station Maintenance Message and


Hit
Received a Response
# of Times CMTS Sent a Station Maintenance Message and
Miss Didn’t Receive a Response

CRC # of CRC Errors From That Modem

P- Adj # of Times CMTS Told CM to Adjust TX Power More Than 3 Db

Flap Algorithm Based on P- Adj and Ins

Time Most Recent Time That the Modem Dropped off the System

SPL-330 © 2001, Cisco Systems, Inc. All rights reserved. 65


Show cable flap-list
Mac Addr CableIF Ins Hit Miss CRC P-Adj Flap Time
0010.9500.461f C3/0 U1 56 18857 887 0 1 116 Jun 1 14:09:12
0010.9500.446e C3/0 U1 38 18686 2935 0 1 80 Jun 2 19:03:57

Insertions
Link insertion is the process whereby a modem performs an initial maintenance procedure to establish link
with the CMTS. The Ins column is the flapping modem's insertion count and indicates the number of times
the RF link was abnormally re-established. An abnormality is detected when the time between link
re-establishment attempts is less than the user-configurable parameter.
Hit and Miss
The HIT and MISS columns are keepalive polling statistics between the Cisco uBR7200 series and the
cable modem. The station maintenance process occurs for every modem approximately every 25 seconds.
When the CMTS receives a response from the modem, the event is counted as a Hit. If the CMTS does
not receive a response from the cable modem, the event is counted as a Miss. A cable modem will fail to
respond either because of noise or if it is down. Modems which only log Misses and zero Hits are
assumed to be powered off.
Cyclical Redundancy Check (CRC)
This statistic tracks the CRC error counter per modem. CRC errors are usually an indication of noise on a
plant. A low count can be always be expected but a high CRC number calls for some the plant
troubleshooting.

SPL-330 © 2001, Cisco Systems, Inc. All rights reserved. 66


Show cable flap-list
Mac Addr CableIF Ins Hit Miss CRC P-Adj Flap Time
0010.9500.461f C3/0 U1 56 18857 887 0 1 116 Jun 1 14:09:12
0010.9500.446e C3/0 U1 38 18686 2935 0 1 80 Jun 2 19:03:57
Power Adjustments (P-Adj)
The station maintenance poll in the CMTS constantly adjusts the modem transmit power,
frequency, and timing. The P-Adj column indicates the number of times the modem's power
adjustment exceeded the threshold value. The * symbol indicates that the CMTS is using the
power adjustment method on this modem. The ! symbol indicates that the modem has
reached maximum transmit power.
Flap
The Flap counter indicates the number of times the modem has flapped. This counter is
incremented when one of the following events is detected:
• Unusual modem insertion or reregistration attempts. The Flap and the Ins counters are
incremented when the modem tries to reestablish the RF link with the CMTS within a period
of time that is less than the user-configurable insertion interval value.
• Abnormal Miss/Hit ratio. The Flap counter is incremented when N consecutive Misses are
detected after a Hit where N can be user-configurable with a default value of 6.
• Unusual power adjustment. The Flap and P-adj counters are incremented when the
modem's upstream power is adjusted beyond a user-configurable power level.
SPL-330 © 2001, Cisco Systems, Inc. All rights reserved. 67
P- adjust

• The modem is continuously monitored for the level.


• The CMTS expects the modem to come in at ….0…dBmV
• If the CMTS has to change the level it can be that there are bad cable
connections (set flap window).
• If the power correction is out of the window scope the p-adj and flap is
incremented
• Slow level changes caused by heating up (sun) are not taken into
account

Problems can be : overdriving amplifier clipping laser (power reduction)


bad cables, broken amplifier
loose connectors

SPL-330 © 2001, Cisco Systems, Inc. All rights reserved. 68


References

• Understanding system operations


http://www.cisco.com/univercd/cc/td/doc/product/cable/
cab_rout/cr72scg/cr72cnrf.htm
• Understanding show command responses
http://www.cisco.com/univercd/cc/td/doc/product/cable/
bbcwcrg/bbcmts.htm
• Understanding debug commands
http://www.cisco.com/univercd/cc/td/doc/product/cable/
bbcwcrg/bbcmts.htm#xtocid475150

SPL-330 © 2001, Cisco Systems, Inc. All rights reserved. 69


Agenda

• Design Considerations and Segmentation


• Preliminary Maintenance
• Troubleshooting physical layer
• Troubleshooting with Cisco IOS®
• Cable Management Tools
• Optimizing the Upstream(CMTS)
• Closing Remarks
• References

SPL-330 © 2001, Cisco Systems, Inc. All rights reserved. 70


Cable Management Tools

SPL-330 © 2001, Cisco Systems, Inc. All rights reserved. 71


Software products for trouble shooting

• Cable Manager
• Cable Troubleshooter
• Cisco View

SPL-330 © 2001, Cisco Systems, Inc. All rights reserved. 72


Fault management

• Alarm management
Event browsers Alarm propagation
Alarm filtering Trap forwarding
Alarm clearing Customizable event notification
• Launches Cisco View for chassis views
• Threshold based-alarms
• Troubleshooting utilities

SPL-330 © 2001, Cisco Systems, Inc. All rights reserved. 73


Cable Manager

SPL-330 © 2001, Cisco Systems, Inc. All rights reserved. 74


What’s up Gold (WUG) maps

SPL-330 © 2001, Cisco Systems, Inc. All rights reserved. 75


What’s Up Gold (WUG) Maps

• Maps created
by:
Auto discovery
Manual config

• Maps can be
very detailed
• Launch
CiscoView
directly from
Icons

SPL-330 © 2001, Cisco Systems, Inc. All rights reserved. 76


CiscoView

• Real-time display of any Router

SPL-330 © 2001, Cisco Systems, Inc. All rights reserved. 77


Cable Troubleshooter OVERVIEW

• PC-based GUI tool that analyzes and exploits our


patent-pending “flap list”

• Transforms problem conditions into specific


problem buckets using heuristic rules

• Streamlines workflow distribution and


scheduling

• Isolates problems quickly, minimizes guessing


SPL-330 © 2001, Cisco Systems, Inc. All rights reserved. 78
Cable Troubleshooter features

• Sorts RF conditions into specific problem buckets using


heuristic rules:
Provisioning Packet corruption (CRC errors)
Reverse attenuation Reverse noise
• Displays % of modems online per US, min and max
power levels
• Uses CLI over telnet to get flap list
• Supports 11.3(x)NA and later
• Standalone tool supported on both PCs and Unix workstations
• Two levels of user security access control
• Exportable output files in tab-delimited format
• Context-sensitive online help

SPL-330 © 2001, Cisco Systems, Inc. All rights reserved. 79


Troubleshooter 2.0 Modem Monitor screen

SPL-330 © 2001, Cisco Systems, Inc. All rights reserved. 80


UBR list

• User-configurable uBR 7200 CMTS list

SPL-330 © 2001, Cisco Systems, Inc. All rights reserved. 81


Analysis output

SPL-330 © 2001, Cisco Systems, Inc. All rights reserved. 82


Flap list details
• Displays RF statistics for each DOCSIS cable
modem or set-top box

SPL-330 © 2001, Cisco Systems, Inc. All rights reserved. 83


Performance management bar chart

SPL-330 © 2001, Cisco Systems, Inc. All rights reserved. 84


Map launch screen

SPL-330 © 2001, Cisco Systems, Inc. All rights reserved. 85


Agenda

• Design Considerations and Segmentation


• Preliminary Maintenance
• Troubleshooting physical layer
• Troubleshooting with Cisco IOS®
• Cable Management Tools
• Optimizing the Upstream (CMTS)
• Closing Remarks
• References7

SPL-330 © 2001, Cisco Systems, Inc. All rights reserved. 86


Optimizing the Upstream
Configuration and Spectrum Management

SPL-330 © 2001, Cisco Systems, Inc. All rights reserved. 87


CMTS line cards

• 2 types of line cards C and S

• C is available for DOCSIS and


EuroDOCSIS

• S is available only for DOCSIS

• S= spectrum management

SPL-330 © 2001, Cisco Systems, Inc. All rights reserved. 88


Upstream channel width
• 200KHz, 400KHz, 800KHz, 1.6 MHz , and 3.2 MHz
Default is 1.6 MHz (equal for C and S card)

• S card is capable to scan the upstream spectrum for clean


channel widths of different sizes

• The spectrum management card on the MC16S will scan the


upstream spectrum for clean (usable) channels of the greatest
specified bandwidth

• If no acceptable channels of the specified width are found, it


automatically scans the upstream spectrum for the next largest
available channel width

Example; If the spectrum management card is unable to find a usable 1.6


MHz upstream channel, it automatically begins searching for usable
800 kHz channels

SPL-330 © 2001, Cisco Systems, Inc. All rights reserved. 89


MC16S spectrum management card
• First DOCSIS line card to offer an integrated spectrum
analyzer
• Eliminates the need for complicated and costly spectrum
analyzers at each hub

SPL-330 © 2001, Cisco Systems, Inc. All rights reserved. 90


S card advantage

• Hardware-assisted frequency hopping with software


enhancements:
As the card knows the best parts of the spectrum there is no
more blind hopping.

Also great for monitoring


Result: always hop to new center frequency in clear
spectrum

• Flexible configuration choices for pro-active channel


management
The default priority is frequency, modulation, then channel
width

SPL-330 © 2001, Cisco Systems, Inc. All rights reserved. 91


Frequency hopping pros (C and S)

• Great way to increase availability of upstream plant


• Can run modems 3 dB hotter
If you base your levels off of power/Hz
Some of the spectrum is allocated just for redundancy
• Can now hop based on time and/or day
• Can assign different power based on the hop
freqency or range of frequencies (32 ranges)
• Can increase availability even more
Change the modulation and/or bandwidth in addition to
frequency hopping

SPL-330 © 2001, Cisco Systems, Inc. All rights reserved. 92


Frequency hopping cons

• Some people will rely on this for availability


instead of cleaning their plant
• Ingress at 15 MHz can still affect the modem at
28 MHz
Laser clipping, harmonics,…
• More bandwidth must be allocated for
redundancy/hopping
• If it is a blind hop, you could spend more time
hopping then actually transmitting useful data

SPL-330 © 2001, Cisco Systems, Inc. All rights reserved. 93


Spectrum management enhancements

• Hopping criteria based on C/N ratio


• Dynamic modulation selection
• CNR measurements per service ID (SID)
• Interface for Real-Time Spectrum Display

SPL-330 © 2001, Cisco Systems, Inc. All rights reserved. 94


Spectrum data output

• Server performs
Collection/storage
Trend analysis
Graphical histograms/reporting
Alarm generation/fault management

SPL-330 © 2001, Cisco Systems, Inc. All rights reserved. 95


DOCSIS
Cable Modem Test Analyzer (DCMTA)
• Acterna software
Based on Cheetah’s Phasor DSP technology
Simple network management protocol (SNMP)
communication

• Interactive CD with Cisco S card purchases


• 30 day free trial with Acterna license for 25
CMTSs
• Real-time spectrum analysis from 5-42 MHz
• Software resides on any pc w/ a link to the uBR
• Supports MC16S cards: uBR7223, uBR7246, VXR
SPL-330 © 2001, Cisco Systems, Inc. All rights reserved. 96
Test analyzer benefits

• Automatically populated network tree ensures you are


always viewing accurate data from the CMTS
Newly provisioned modems
Even self installs!
• Easily and quickly choose the US port or modem
to analyze and launch the spectrum analyzer view
immediately
Live troubleshooting of an US port or single modem
• Proactively address ingress noise before affecting
customers
• Measure ingress noise on the uBR port
• Easily troubleshoot cable modems in real-time
Identify low/high modem transmit signal levels
• No re-cabling required to support diagnostics

SPL-330 © 2001, Cisco Systems, Inc. All rights reserved. 97


Individual cable modem analysis

Spectrum from an Individual Modem

• Full spectrum view


• Can request real life
CNR calculations as
listed in the MIBs
• Also allows view of
an CNR log for the
active session

SPL-330 © 2001, Cisco Systems, Inc. All rights reserved. 98


3 modes of operation
• Spectrum Analyzer
Single
Continuous

• Amplitude vs Time
Similar to zero-span

• Spectragram
Color coded
interpretation of time
vs freq vs amplitude
SPL-330 © 2001, Cisco Systems, Inc. All rights reserved. 99
Amplitude vs. time

• Monitors an individual
frequency
over time
• Similar to
zero span
• Helpful when
you need to monitor
changes on a specific
frequency

SPL-330 © 2001, Cisco Systems, Inc. All rights reserved. 100


Agenda

• Design Considerations and Segmentation


• Preliminary Maintenance
• Troubleshooting physical layer
• Troubleshooting with Cisco IOS®
• Cable Management Tools
• Optimizing the Upstream (CMTS)
• Closing Remarks
• References
SPL-330 © 2001, Cisco Systems, Inc. All rights reserved. 101
Closing Remarks

SPL-330 © 2001, Cisco Systems, Inc. All rights reserved. 102


Closing remarks

• Changes in CATV network design


• CMTS moved closer to end user :
More control over bandwidth
Behind CMTS redundant Data ring
low timing delay’s for CMTS

• CMTS further away from end user


Space problems in hub locations
concentration of hardware on 1 location
DWDM links
24 by 7 NOC

SPL-330 © 2001, Cisco Systems, Inc. All rights reserved. 103


Organization changes

• Cable TV Engineers were allowed to do repair on the spot.


• Changing amplifiers, disconnecting cables was normal
work procedure.
• Introducing Internet services on the network led quickly
to maintenance windows.
• Introducing VoIP on the network means no disconnection
of service.
• Organization need to change culture and network design.
• Introduce monitoring points. This will limit the number of
disconnections.

SPL-330 © 2001, Cisco Systems, Inc. All rights reserved. 104


Tips and suggestions

• Think over your network design :


Is my network flexible?
Is the upstream capable to handle more payload
or 16 QAM?
Can my downstream cope with 256 QAM?
Are the engineers instructed how to handle?
Is everybody sufficiently trained?
Do they have the right tools?

SPL-330 © 2001, Cisco Systems, Inc. All rights reserved. 105


References

SPL-330 © 2001, Cisco Systems, Inc. All rights reserved. 106


CCO web resources

• DDTS issues
www.cisco.com/support/bugtools/
• Downloading latest images
www.cisco.com/kobayashi/sw-center/sw-ios.shtml
• Documentation
www.cisco.com/univercd/cc/td/doc/product/cable/index.htm
• Release notes
www.cisco.com/univercd/cc/td/doc/product/software/ios113ed/i
os113p/cablern/index.htm
• TAC tips
www.cisco.com/kobayashi/serv_tips.shtml

SPL-330 © 2001, Cisco Systems, Inc. All rights reserved. 107


References
Text References
Web References
• Modern Cable Television
• http://www.cisco.com/cable Technology—Video, Voice, and
Data Communications
• http://www.cablemodem.com Walter Ciciora/James Farmer/David
Large ISBN # 1-55860-416-2
• http://www.cablelabs.com
• Broadband Return Systems for
• http://www.scte.org Hybrid Fiber/coax Cable TV
• http://cable.doit.wisc.edu Networks
Donald Raskin and Dean Stoneback
• http://www.catv.org ISBN # 0-13-636515-9
• Cable Television Proof-of-
• http://www.acterna.com Performance
• http://www.hukk.com Jeff Thomas ISBN # 0-13-306382-8
• Digital Basics for Cable Television
• http://www.cabletoday.com
Systems
Jeff Thomas and Francis Edgington
ISBN # 0-13-743915-6
SPL-330 © 2001, Cisco Systems, Inc. All rights reserved. 108
White paper resources

• Multimedia Traffic Engineering for Cable Networks


www.cisco.com/warp/public/cc/cisco/mkt/access/apath/tech/hfcn_wp.pdf

• Combined Wisdom on the Upstream


www.cisco.com/warp/public/cc/cisco/mkt/access/apath/tech/mllt_wp.pdf

• Successfully Deploying Data over Cable Networks:


An Overview
www.cisco.com/warp/public/cc/cisco/mkt/servprod/tech/dcsis_wp.pdf

• Business Case for Two-Way Service Deployment over


HFC Network
www.cisco.com/warp/public/cc/cisco/mkt/servprod/tech/2way_pl.pdf

SPL-330 © 2001, Cisco Systems, Inc. All rights reserved. 109


Contact info

H.Bogaert

Cisco Systems
Broadband System Engineer

hbogaert@cisco.com

SPL-330 © 2001, Cisco Systems, Inc. All rights reserved. 110


Troubleshooting Cable
Access Infrastructure
Session SPL-330

SPL-330 © 2001, Cisco Systems, Inc. All rights reserved. 111


Please Complete Your
Evaluation Form
Session SPL-330

SPL-330 © 2001, Cisco Systems, Inc. All rights reserved. 112


SPL-330 © 2001, Cisco Systems, Inc. All rights reserved. 113

You might also like