Professional Documents
Culture Documents
317
0901_04F9_c3 © 1999, Cisco Systems, Inc. 2
Copyright © 1998, Cisco Systems, Inc. All rights reserved. Printed in USA.
0901_04F9_c3.scr 1
Complex Network Scalability
Scalable
Stable
Simple
317
0901_04F9_c3 © 1999, Cisco Systems, Inc. 4
Copyright © 1998, Cisco Systems, Inc. All rights reserved. Printed in USA.
0901_04F9_c3.scr 2
Agenda
317
0901_04F9_c3 © 1999, Cisco Systems, Inc. 5
317
0901_04F9_c3 © 1999, Cisco Systems, Inc. 6
Copyright © 1998, Cisco Systems, Inc. All rights reserved. Printed in USA.
0901_04F9_c3.scr 3
IGP Limitations
• Geographically
distributed
• Hierarchical
CORE
• Redundant
• Media
independent
• A clearly
identifiable core
317
0901_04F9_c3 © 1999, Cisco Systems, Inc. 8
Copyright © 1998, Cisco Systems, Inc. All rights reserved. Printed in USA.
0901_04F9_c3.scr 4
iBGP Core
Migration Plan
iBGP Core
Migration Plan (Cont.)
• Route Generation—Example:
!
router bgp 109
network 200.200.200.0
network 201.201.0.0 mask 255.255.0.0
!
ip route 200.200.200.0 255.255.255.0 null0
ip route 201.201.0.0 255.255.0.0 null0
!
317
0901_04F9_c3 © 1999, Cisco Systems, Inc. 10
Copyright © 1998, Cisco Systems, Inc. All rights reserved. Printed in USA.
0901_04F9_c3.scr 5
iBGP Core
Migration Plan (Cont.)
317
0901_04F9_c3 © 1999, Cisco Systems, Inc. 11
iBGP Core
Migration Plan (Cont.)
Copyright © 1998, Cisco Systems, Inc. All rights reserved. Printed in USA.
0901_04F9_c3.scr 6
iBGP Core Before...
Area
40
• IGP carries Area
all the routes 1
Area
2
• The core routers Area Core
Area
may be stressed 3
20
due to the large
number of routes
317
0901_04F9_c3 © 1999, Cisco Systems, Inc. 13
• Core: Area
40
IGP carries only Area
1
core links plus Area
Core
peering address 2
information Area
Area
3 iBGP
Mesh 20
BGP carries
all the routes
Increased Stability!
317
0901_04F9_c3 © 1999, Cisco Systems, Inc. 14
Copyright © 1998, Cisco Systems, Inc. All rights reserved. Printed in USA.
0901_04F9_c3.scr 7
iBGP Core Results
Scaling Issues
Copyright © 1998, Cisco Systems, Inc. All rights reserved. Printed in USA.
0901_04F9_c3.scr 8
Scaling Issues—Solutions
317
0901_04F9_c3 © 1999, Cisco Systems, Inc. 18
Copyright © 1998, Cisco Systems, Inc. All rights reserved. Printed in USA.
0901_04F9_c3.scr 9
Implementation Strategy
317
0901_04F9_c3 © 1999, Cisco Systems, Inc. 19
• Where:
Geography
Department lines
Hierarchy
Etc.
317
0901_04F9_c3 © 1999, Cisco Systems, Inc. 20
Copyright © 1998, Cisco Systems, Inc. All rights reserved. Printed in USA.
0901_04F9_c3.scr 10
eBGP Connections
317
0901_04F9_c3 © 1999, Cisco Systems, Inc. 22
Copyright © 1998, Cisco Systems, Inc. All rights reserved. Printed in USA.
0901_04F9_c3.scr 11
eBGP Connections (Cont.)
CORE
AS65003
A B G
C F
D E
AS65002 AS65004
eBGP Connections—Routing
Copyright © 1998, Cisco Systems, Inc. All rights reserved. Printed in USA.
0901_04F9_c3.scr 12
Confederations
317
0901_04F9_c3 © 1999, Cisco Systems, Inc. 25
Confederations (Cont.)
317
0901_04F9_c3 © 1999, Cisco Systems, Inc. 26
Copyright © 1998, Cisco Systems, Inc. All rights reserved. Printed in USA.
0901_04F9_c3.scr 13
Confederations—NEXT_HOP
180.10.0.0/16 180.10.11.1
Sub-AS
65002
A
Sub-AS B C Sub-AS
D E AS 200
65003 65001
Confederation
100
317
0901_04F9_c3 © 1999, Cisco Systems, Inc. 27
317
0901_04F9_c3 © 1999, Cisco Systems, Inc. 28
Copyright © 1998, Cisco Systems, Inc. All rights reserved. Printed in USA.
0901_04F9_c3.scr 14
Confederations—AS_PATH
Confederation—AS_PATH (Cont.)
180.10.0.0/16 200
A
Sub-AS
65002
B
180.10.0.0/16 (65004 65002) 200 180.10.0.0/16 (65002) 200
C
Sub-AS
65004
Sub-AS D E Sub-AS
65003 G F 65001
H
Confederation
180.10.0.0/16 100 200
100
317
0901_04F9_c3 © 1999, Cisco Systems, Inc. 30
Copyright © 1998, Cisco Systems, Inc. All rights reserved. Printed in USA.
0901_04F9_c3.scr 15
Confederations—Migration I
317
0901_04F9_c3 © 1999, Cisco Systems, Inc. 31
Confederations—Migration II
317
0901_04F9_c3 © 1999, Cisco Systems, Inc. 32
Copyright © 1998, Cisco Systems, Inc. All rights reserved. Printed in USA.
0901_04F9_c3.scr 16
Confederations or Not?
One
Anywhere Instance Medium
Confederations in the Yes Yes
Across the to High
Network
Network
May Need
eBGP Only in the Different Low to
Yes Yes
Connections Core Instances in Medium
Each Region
Route Reflectors
317
0901_04F9_c3 © 1999, Cisco Systems, Inc. 34
Copyright © 1998, Cisco Systems, Inc. All rights reserved. Printed in USA.
0901_04F9_c3.scr 17
Route Reflectors
Route Reflectors—Terminology
Clusters
Clients Clients
Lines Represent Both Physical Links and BGP Logical Connections
317
0901_04F9_c3 © 1999, Cisco Systems, Inc. 36
Copyright © 1998, Cisco Systems, Inc. All rights reserved. Printed in USA.
0901_04F9_c3.scr 18
Route Reflectors—
Terminology (Cont.)
• Route reflector
Router that reflects the iBGP information
• Client
Routers between which the RR reflects updates (may be
fully meshed among themselves)
• Cluster
Set of one or more RRs and their clients
(may overlap)
• Non-client
iBGP neighbour outside the cluster
317
0901_04F9_c3 © 1999, Cisco Systems, Inc. 37
Route Reflectors—
Loop Avoidance
• Originator_ID attribute
Carries the RID of the originator of the
route in the local AS (created by the RR)
• Cluster_list attribute
The local cluster-id is added when the
update is sent to (added by the RR)
bgp cluster-id x.x.x.x
317
0901_04F9_c3 © 1999, Cisco Systems, Inc. 38
Copyright © 1998, Cisco Systems, Inc. All rights reserved. Printed in USA.
0901_04F9_c3.scr 19
Reflection Decisions
317
0901_04F9_c3 © 1999, Cisco Systems, Inc. 39
Route Reflectors—Hierarchy
• Clusters may be
configured
hierarchically
Level 1
RRs in a cluster are
clients of RRs in a
higher level Level 2
Provides a
“natural”
method to limit
routing information
sent to lower levels
317
0901_04F9_c3 © 1999, Cisco Systems, Inc. 40
Copyright © 1998, Cisco Systems, Inc. All rights reserved. Printed in USA.
0901_04F9_c3.scr 20
Hierarchical Route Reflectors
RR A cluster-id 140.10.1.1
cluster-id
B RR C 141.153.17.1
141.153.30.1
routerB>sh ip bgp 198.10.10.0 141.153.17.2
BGP routing table entry for 198.10.10.0/24 D
3
141.153.14.2 from 140.10.1.1 (141.153.17.2)
Origin IGP, metric 0, localpref 100, valid, internal, best
Originator : 141.153.17.2
Cluster list: 144.10.1.1, 141.153.17.1 AS3 141.153.14.2
198.10.0.0
RR A cluster-id 140.10.1.1
cluster-id
B RR C 141.153.17.1
141.153.30.1
routerB>sh ip bgp 198.10.10.0 141.153.17.2
BGP routing table entry for 198.10.10.0/24 D
3
141.153.14.2 from 140.10.1.1 (141.153.17.2)
Origin IGP, metric 0, localpref 100, valid, internal, best
Originator : 141.153.17.2
Cluster list: 144.10.1.1, 141.153.17.1 AS3 141.153.14.2
198.10.0.0
Copyright © 1998, Cisco Systems, Inc. All rights reserved. Printed in USA.
0901_04F9_c3.scr 21
Hierarchical Route Reflectors
RR A cluster-id 140.10.1.1
cluster-id
B RR C 141.153.17.1
141.153.30.1
routerB>sh ip bgp 198.10.10.0 141.153.17.2
BGP routing table entry for 198.10.10.0/24 D
3
141.153.14.2 from 140.10.1.1 (141.153.17.2)
Origin IGP, metric 0, localpref 100, valid, internal, best
Originator : 141.153.17.2
Cluster list: 144.10.1.1, 141.153.17.1 AS3 141.153.14.2
198.10.0.0
Route Reflectors—Redundancy
Copyright © 1998, Cisco Systems, Inc. All rights reserved. Printed in USA.
0901_04F9_c3.scr 22
Multiple Route Reflectors
RR RR
B
routerB>sh ip bgp 198.10.10.0 141.153.17.2
BGP routing table entry for 198.10.10.0/24
3
141.153.14.2 from 141.153.30.1 (141.153.17.2) eBGP
Origin IGP, metric 0, localpref 100, valid, internal, best
Originator: 141.153.17.2 141.153.14.2
Cluster list: 1.1.1.1
198.10.10.0/24s
Lines Represent Both Physical
Links and BGP Logical Connections
317
0901_04F9_c3 © 1999, Cisco Systems, Inc. 45
cluster-id 1.1.1.1
141.153.30.1
RR RR
B
routerB>sh ip bgp 198.10.10.0 141.153.17.2
BGP routing table entry for 198.10.10.0/24
3
141.153.14.2 from 141.153.30.1 (141.153.17.2) eBGP
Origin IGP, metric 0, localpref 100, valid, internal, best
Originator: 141.153.17.2 141.153.14.2
Cluster list: 1.1.1.1
198.10.10.0/24s
Lines Represent Both Physical
Links and BGP Logical Connections
317
0901_04F9_c3 © 1999, Cisco Systems, Inc. 46
Copyright © 1998, Cisco Systems, Inc. All rights reserved. Printed in USA.
0901_04F9_c3.scr 23
Multiple Route Reflectors
• The cluster-id
must be different, B C
RR
RR
otherwise B
will not reflect
any route to A A
if coming from C
Lines Represent Both Physical
B will detect its own Links and BGP Logical Connections
Route Reflectors—Migration
Copyright © 1998, Cisco Systems, Inc. All rights reserved. Printed in USA.
0901_04F9_c3.scr 24
Route Reflectors—Migration
• Step 0:
full iBGP A
mesh
B C
D
E
Logical Links
Physical AND Logical Links
317
0901_04F9_c3 © 1999, Cisco Systems, Inc. 49
Route Reflectors—Migration
• Step 1:
configure D A
as a RR; E
is the client B C
D RR
E
Logical Links
Physical AND Logical Links
317
0901_04F9_c3 © 1999, Cisco Systems, Inc. 50
Copyright © 1998, Cisco Systems, Inc. All rights reserved. Printed in USA.
0901_04F9_c3.scr 25
Route Reflectors—Migration
• Step 2:
eliminate A
unnecessary
iBGP links B C
D RR
E
Logical Links
Physical AND Logical Links
317
0901_04F9_c3 © 1999, Cisco Systems, Inc. 51
Route Reflectors—Migration
• Step 3:
repeat for A
other clusters
and iBGP B C
RR RR
links
D RR
E
Logical Links
Physical AND Logical Links
317
0901_04F9_c3 © 1999, Cisco Systems, Inc. 52
Copyright © 1998, Cisco Systems, Inc. All rights reserved. Printed in USA.
0901_04F9_c3.scr 26
RR: Other Issues
Route Reflectors—Results
Copyright © 1998, Cisco Systems, Inc. All rights reserved. Printed in USA.
0901_04F9_c3.scr 27
To Reflect or Not to Reflect
Anywhere
Confederations Yes Yes Medium Medium
in the to High
Network
Route Anywhere
Reflectors in the Yes Yes Very High Very Low
Network
317
0901_04F9_c3 © 1999, Cisco Systems, Inc. 55
Case Studies
317
0901_04F9_c3 © 1999, Cisco Systems, Inc. 56
Copyright © 1998, Cisco Systems, Inc. All rights reserved. Printed in USA.
0901_04F9_c3.scr 28
RR—Physical Topology
RR—Physical Topology
RR
• Not following C
the physical A
topology Loop!
B
may cause
routing loops! RR
Lines Represent
Physical
Connections
317
0901_04F9_c3 © 1999, Cisco Systems, Inc. 58
Copyright © 1998, Cisco Systems, Inc. All rights reserved. Printed in USA.
0901_04F9_c3.scr 29
RR—Physical Topology
• Symptom
routerC#traceroute 7.7.7.7
Tracing the route to 7.7.7.7
1 10.105.1.71 4 msec 4 msec 8 msec
rtrB 2 140.10.50.6 188 msec 4 msec 4 msec
rtrA 3 140.10.50.5 4 msec 4 msec 4 msec
4 140.10.50.6 4 msec 8 msec 8 msec
5 140.10.50.5 8 msec 8 msec 8 msec
6 140.10.50.6 8 msec 4 msec 8 msec
317
0901_04F9_c3 © 1999, Cisco Systems, Inc. 59
RR—Physical Topology
317
0901_04F9_c3 © 1999, Cisco Systems, Inc. 60
Copyright © 1998, Cisco Systems, Inc. All rights reserved. Printed in USA.
0901_04F9_c3.scr 30
RR—Physical Topology
RR
• Solution: C
A
Follow the
physical topology! B
RR
Lines Represent
Physical
Connections
317
0901_04F9_c3 © 1999, Cisco Systems, Inc. 61
RR—Physical Topology II
• Symptom A
routerD#traceroute 7.1.1.1
1 1.1.1.2 24 msec 24 msec 40 msec Loop!
Lines Represent
Physical Connections
317
0901_04F9_c3 © 1999, Cisco Systems, Inc. 62
Copyright © 1998, Cisco Systems, Inc. All rights reserved. Printed in USA.
0901_04F9_c3.scr 31
RR—Physical Topology II
317
0901_04F9_c3 © 1999, Cisco Systems, Inc. 63
RR—Physical Topology II
• Problem
routerC#show running-config
router bgp 134 A-RR
neighbor 150.10.10.1 remote-as 1
neighbor 150.10.10.1 ebgp-multihop 255
neighbor 150.10.10.1 update-source Loopback0
neighbor 156.1.1.1 remote-as 134 B C-RR
neighbor 156.1.1.1 route-reflector-client
neighbor 156.1.1.1 next-hop-self D
!
Lines Represent
Physical Connections
317
0901_04F9_c3 © 1999, Cisco Systems, Inc. 64
Copyright © 1998, Cisco Systems, Inc. All rights reserved. Printed in USA.
0901_04F9_c3.scr 32
RR—Physical Topology II
• Problem
routerC#show running-config
router bgp 134 A-RR
neighbor 150.10.10.1 remote-as 1
neighbor 150.10.10.1 ebgp-multihop 255
neighbor 150.10.10.1 update-source Loopback0
neighbor 156.1.1.1 remote-as 134 B C-RR
neighbor 156.1.1.1 route-reflector-client
neighbor 156.1.1.1 next-hop-self D
!
ip route 150.10.10.1 255.255.255.255 s0 250 Lines Represent
Physical Connections
317
0901_04F9_c3 © 1999, Cisco Systems, Inc. 65
RR—Physical Topology II
• Solution
Establish the eBGP A-RR
peering permanently
through the
“backup” link B C-RR
Use LOCAL_PREF or D
MED to break any tie!
Lines Represent
Physical Connections
317
0901_04F9_c3 © 1999, Cisco Systems, Inc. 66
Copyright © 1998, Cisco Systems, Inc. All rights reserved. Printed in USA.
0901_04F9_c3.scr 33
Clusters with Multiple RRs
RR-A RR-B
• It is possible to
have multiple RRs
in one cluster for
RR-C
redundancy
• Hierarchical
clusters help
scale your network
Lines Represent Physical
and Logical Connections
317
0901_04F9_c3 © 1999, Cisco Systems, Inc. 67
RR-A RR-B
• A and B are
core routers
Carry routes to the
RR-C
rest of the network
Cluster-id 5
• Symptom
RR-C is not
receiving any routes
Lines Represent Physical
and Logical Connections
317
0901_04F9_c3 © 1999, Cisco Systems, Inc. 68
Copyright © 1998, Cisco Systems, Inc. All rights reserved. Printed in USA.
0901_04F9_c3.scr 34
Clusters with Multiple RRs
• Problem
After resetting the session and using
debug ip bgp:
BGP: 1.1.1.1 Route Reflector cluster loop received cluster-id 0.0.0.5
BGP: 2.2.2.2 Route Reflector cluster loop received cluster-id 0.0.0.5
• Solution
In hierarchical route reflector
configurations, each level must
have a different cluster-id
Recommendation: use a different
cluster-id per route reflector
317
0901_04F9_c3 © 1999, Cisco Systems, Inc. 70
Copyright © 1998, Cisco Systems, Inc. All rights reserved. Printed in USA.
0901_04F9_c3.scr 35
eBGP Multihop
• Symptom
The eBGP peering is established, but
convergence is not complete even after
several hours
routerA#show ip bgp summary
317
0901_04F9_c3 © 1999, Cisco Systems, Inc. 71
eBGP Multihop
Reply to request 0
Record route:
(156.1.1.2)
routerA#show ip route 150.10.10.1 (195.5.5.1)
(10.105.1.134)
Routing entry for 150.10.10.1/32 (150.10.10.1)
Routing Descriptor Blocks: (10.105.1.76)
(195.5.5.2)
10.105.1.71, from 150.20.20.1, 00:06:14 ago, via POS2/1/0 (156.1.1.1)
(211.211.211.1) <*>
* 156.1.1.1, from 150.20.20.1, 00:06:14 ago, via POS2/1/1
routerA#ping 150.10.10.1 Reply to request 1
Record route:
Sending 5, 100-byte ICMP Echos to 150.10.10.1: !!!!! (10.105.1.69)
(140.10.50.5)
Success is 100 percent, round-trip min/avg/max = 4/64/296 ms (150.10.10.1)
(140.10.50.6)
(10.105.1.71)
(211.211.211.1) <*>
317
0901_04F9_c3 © 1999, Cisco Systems, Inc. 72
Copyright © 1998, Cisco Systems, Inc. All rights reserved. Printed in USA.
0901_04F9_c3.scr 36
eBGP Multihop
OC-3 OC-3
A B
T3
317
0901_04F9_c3 © 1999, Cisco Systems, Inc. 73
eBGP Multihop
• Solution
The paths have different number of hops
between them—make sure that the TTL
is enough for the longest path
317
0901_04F9_c3 © 1999, Cisco Systems, Inc. 74
Copyright © 1998, Cisco Systems, Inc. All rights reserved. Printed in USA.
0901_04F9_c3.scr 37
Common Problems—Conclusions
BGP Extensions
There’s More!
317
0901_04F9_c3 © 1999, Cisco Systems, Inc. 76
Copyright © 1998, Cisco Systems, Inc. All rights reserved. Printed in USA.
0901_04F9_c3.scr 38
OPEN Message
0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31
Version
My Autonomous System
Hold Time
BGP Identifier
Optional Parameters
317
0901_04F9_c3 © 1999, Cisco Systems, Inc. 77
Capabilities Negotiation
317
0901_04F9_c3 © 1999, Cisco Systems, Inc. 78
Copyright © 1998, Cisco Systems, Inc. All rights reserved. Printed in USA.
0901_04F9_c3.scr 39
Capabilities Negotiation
• Current capabilities
1 multiprotocol
128 route refresh
129 outbound route filter
317
0901_04F9_c3 © 1999, Cisco Systems, Inc. 79
• Facilitates non-disruptive
policy changes
• No configuration is needed
• No additional memory is used
• clear ip bgp x.x.x.x [soft] in
317
0901_04F9_c3 © 1999, Cisco Systems, Inc. 80
Copyright © 1998, Cisco Systems, Inc. All rights reserved. Printed in USA.
0901_04F9_c3.scr 40
Managing Policy Changes
317
0901_04F9_c3 © 1999, Cisco Systems, Inc. 82
Copyright © 1998, Cisco Systems, Inc. All rights reserved. Printed in USA.
0901_04F9_c3.scr 41
PrefixList-ORF
Multiprotocol Extensions—
rfc2283
MP_REACH_NLRI Attribute
Address Family Identifier (2 Octets)
Subsequent Address Family Identifier (1 Octet)
Length of Next Hop Network Address (1 Octet)
Network Address of Next Hop (Variable)
Number of First SNP As (1 Octet)
Length of First SNP A (1 Octet)
Length of First SNP A (1 Octet)
First SNP A (Variable)
…
Length of Last SNP A (1 Octet)
Last SNP A (Variable)
Network layer Reachability Information (Variable)
317
0901_04F9_c3 © 1999, Cisco Systems, Inc. 84
Copyright © 1998, Cisco Systems, Inc. All rights reserved. Printed in USA.
0901_04F9_c3.scr 42
Address Family Identifiers
Multiprotocol Extensions I
• mBGP
Used to propagate multicast source
information
• The different NLRI types allow for
diverging topologies
The NEXT_HOP information is different
317
0901_04F9_c3 © 1999, Cisco Systems, Inc. 86
Copyright © 1998, Cisco Systems, Inc. All rights reserved. Printed in USA.
0901_04F9_c3.scr 43
Multiprotocol Extensions II
• MPLS VPN
Used to carry both intra- and
inter-VPN routing information
• New AFI—VPN-IPv4
• NLRI format for VPN addresses
Tag
VPNID (32 bits)
Prefix (variable length, 0-32 bits)
317
0901_04F9_c3 © 1999, Cisco Systems, Inc. 87
• Extended range
8 octets
• Structure
Type: value
Value may be of the form AS:xxx
317
0901_04F9_c3 © 1999, Cisco Systems, Inc. 88
Copyright © 1998, Cisco Systems, Inc. All rights reserved. Printed in USA.
0901_04F9_c3.scr 44
Complex Network Scalability
• Scalable
Confederations, route reflectors, and
multiprotocol support
• Stable
Network isolation, capability to
handle large amount of data
• Simple
… But flexible and extendible
317
0901_04F9_c3 © 1999, Cisco Systems, Inc. 89
Copyright © 1998, Cisco Systems, Inc. All rights reserved. Printed in USA.
0901_04F9_c3.scr 45
Please Complete Your
Evaluation Form
Session 317
317
0901_04F9_c3 © 1999, Cisco Systems, Inc. 91
317
0901_04F9_c3 © 1999, Cisco Systems, Inc. 92
Copyright © 1998, Cisco Systems, Inc. All rights reserved. Printed in USA.
0901_04F9_c3.scr 46