Professional Documents
Culture Documents
Objectives
This lab is focused on problems that occur in MPLS network providing Layer 2 VPNs
(L3VPNs) servicing customer networks. You will be given real-life troubleshooting
tickets to solve. You will use the knowledge you acquired in your MASE HP
Enterprise Networks training course, as well as the knowledge you have gathered in
your day-to-day job and apply the troubleshooting methodology you learned in this
course and others.
After completing this module and associated hands-on activities, you will be able to
demonstrate proficiency:
Troubleshooting and resolving issues with remote LDP connections
Troubleshooting and resolving issues with Martini L2 virtual circuits
Troubleshooting and resolving issues with Kompella L2 connections
Troubleshooting and resolving issues with LDP advertisements
Rev. 11.11 L6 – 1
BitSpyder - The Culture of Knowledge
Outline
The Troubleshooting HP Enterprise Networks course is built around standalone labs.
The labs include fairly complex networking issues. Each lab has been designed to
draw upon various areas of technology expertise and learner experience.
In this module you will be troubleshooting routing issues within a Service Provider
network and between that Service Provider and its customer(s).
Analysis and problem isolation in MPLS L2 VPNs is important for troubleshooters and
problem solvers to become adept at because:
It is a service that is prevalent for both traditional service providers and large
enterprises.
The technology combines LDP, L3 routing and virtual L2 connections across a
routed, MPLS domain – and thus issues can be difficult to isolate
This lab will unveil some common problems with L2VPNs (both Martini and
Kompella). You will do these labs and exercises in your assigned lab teams.
L6 – 2 Rev. 11.11
BitSpyder - The Culture of Knowledge
A7506 A7506
L2VC # 2
CE‐1T CE‐2T
A5800 A5800
OSPF
This lab consists of an MPLS core network and multiple Data Center locations. The
Core network equipment is:
Two HP A7506 chassis switches serving as P1 and P2 routers interconnected via
Gigabit Ethernet.
Two student pods, each consisting of
One HP A7503 chassis switch serving as a PE router interconnected to one
P router and two CE Layer 3 Switches via Gigabit Ethernet
Two HP A5800 series switches serving as CE routers for two different Data
Centers connected to their local PE router via Gigabit Ethernet
The IGP for the Service Provider network is OSPF, and CE to CE routing (over the
L2VPN) is either RIP or OSPF.
Rev. 11.11 L6 – 3
BitSpyder - The Culture of Knowledge
Trouble Site or
Minneapolis, MN, USA
Location:
Brief Problem
Linked datacenters in Minneapolis and St. Paul not communicating
Description:
Problem History: 31‐May‐11: Customer is attempting to link data centers via two Martini L2VPNs over their
network core.
31‐May‐11: Remote LDP peer sessions are configured, but don't seem to be established.
31‐May‐11: The Layer 2 Virtual Circuits (l2vc) have been configured but are in a "down"
state.
L6 – 4 Rev. 11.11
BitSpyder - The Culture of Knowledge
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
What priority would you give this problem and why? Capture your recommendation
below.
_______________________________________________________________________
_______________________________________________________________________
Step 2 – Analysis
Replicate the problem
The course facilitator will give you the customer configuration files for your
troubleshooting ticket. Load these configuration files and see if you can simulate the
problem.
Where you able to recreate the problem, Y/N? ____________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
L6 – 6 Rev. 11.11
BitSpyder - The Culture of Knowledge
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
Indicate below the troubleshooting tools you think would be helpful to solve this
problem.
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
Rev. 11.11 L6 – 7
BitSpyder - The Culture of Knowledge
L6 – 8 Rev. 11.11
BitSpyder - The Culture of Knowledge
Step 3 – Hypothesis
Perform technical evaluation
Use the tools you identified and analyze the problem. Based on your analysis what
is the root cause of the problem described in your trouble ticket? Write your
hypothesis below.
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
What is your recommended resolution and how will you validate the solution? Write
the proposed changes and validation below.
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
Rev. 11.11 L6 – 9
BitSpyder - The Culture of Knowledge
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
Are there any possible side effects to your proposed solution? Write them below.
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
Step 4 – Validation
Test your hypothesis
Implement your proposed changes and validate the solution in the manner you
described above.
Did you solution work (Y/N) __________
Whether the hypothesis was correct or flawed, it is always possible to learn
something new about the problem. What did you learn? Write it down and be
prepared to share with the class.
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
L6 – 10 Rev. 11.11
BitSpyder - The Culture of Knowledge
If your solution did NOT work, write below other possible causes that you would like
to validate? Write these causes below. Return to step 3 and restart building your
hypothesis.
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
If your solution did NOT work and you have no more possible causes you should
return to Step 1 Identification and look for additional information that you may have
overlooked.
If you successfully validated your hypothesis, how certain are you that your solution
will work when implemented in the live network? Indicate your assessment below.
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
Discuss these with your course facilitator and decide whether to implement these
steps or continue to the next step.
Rev. 11.11 L6 – 11
BitSpyder - The Culture of Knowledge
Step 5 – Implementation
Develop your implementation plan
Network nodes impacted Proposed changes
______________________ _____________________________________________
______________________ _____________________________________________
______________________ _____________________________________________
______________________ _____________________________________________
______________________ _____________________________________________
______________________ _____________________________________________
______________________ _____________________________________________
______________________ _____________________________________________
Verification process
Step 1: ____________________________________________________________
Step 2: ____________________________________________________________
Step 3: ____________________________________________________________
Step 4: ____________________________________________________________
Step 5: ____________________________________________________________
Step 6: ____________________________________________________________
Step 7: ____________________________________________________________
Step 8: ____________________________________________________________
L6 – 12 Rev. 11.11
BitSpyder - The Culture of Knowledge
Back-out plan
Step 1: ____________________________________________________________
Step 2: ____________________________________________________________
Step 3: ____________________________________________________________
Step 4: ____________________________________________________________
Step 5: ____________________________________________________________
Step 6: ____________________________________________________________
Step 7: ____________________________________________________________
Step 8: ____________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
Rev. 11.11 L6 – 13
BitSpyder - The Culture of Knowledge
Step 6 – Verification
In normal work environments you would run your implementation plan and
verification procedure to determine if successful. In this lab the facilitator and other
students’ feedback on your plan will determine if your plan was successful.
Was your plan deemed successful (Y/N) _____________
Write notes here on how other student plans differ from yours. Make a list of good
ideas you want to take away from this lab.
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
L6 – 14 Rev. 11.11
BitSpyder - The Culture of Knowledge
vpn1
A7506 A7506
vpn2 RIP
vpn3 OSPF
CE‐1T CE‐2T
A5800 A5800
The last two tickets for this lab consist of an MPLS core network and multiple Data
Center locations. The equipment and physical topology are the same as for Ticket
6-1, but the device configurations are different.
Rev. 11.11 L6 – 15
BitSpyder - The Culture of Knowledge
Trouble Site or
Cluj‐Napoca, Romania
Location:
Brief Problem
Linked Datacenters in Cluj‐Napoca and Sibiu not communicating
Description:
Problem History: 25‐Feb‐11: Customer is attempting to link Data Centers via Kompella L2VPN connections
over their network core.
25‐Feb‐11: The MPLS L2VPN configuration on the PE routers seems to be correct, but the
connection vpn1 (from CE‐1K to CE‐2K) shows as down.
L6 – 16 Rev. 11.11
BitSpyder - The Culture of Knowledge
Step 1 – Identification
Describe the symptoms of the problem? Write them below.
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
Describe what the customer wants to do? Write the customer need below.
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
Rev. 11.11 L6 – 17
BitSpyder - The Culture of Knowledge
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
What priority would you give this problem and why? Capture your recommendation
below.
_______________________________________________________________________
_______________________________________________________________________
L6 – 18 Rev. 11.11
BitSpyder - The Culture of Knowledge
Step 2 – Analysis
Replicate the problem
The course facilitator will give you the customer configuration files for your
troubleshooting ticket. Load these configuration files and see if you can simulate the
problem.
Where you able to recreate the problem, Y/N? ____________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
Rev. 11.11 L6 – 19
BitSpyder - The Culture of Knowledge
Indicate below the troubleshooting tools you think would be helpful to solve this
problem.
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
L6 – 20 Rev. 11.11
BitSpyder - The Culture of Knowledge
Step 3 – Hypothesis
Perform technical evaluation
Use the tools you identified and analyze the problem. Based on your analysis what
is the root cause of the problem described in your trouble ticket? Write your
hypothesis below.
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
What is your recommended resolution and how will you validate the solution? Write
the proposed changes and validation below.
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
Rev. 11.11 L6 – 21
BitSpyder - The Culture of Knowledge
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
Are there any possible side effects to your proposed solution? Write them below.
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
Step 4 – Validation
Test your hypothesis
Implement your proposed changes and validate the solution in the manner you
described above.
Did you solution work (Y/N) __________
Whether the hypothesis was correct or flawed, it is always possible to learn
something new about the problem. What did you learn? Write it down and be
prepared to share with the class.
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
L6 – 22 Rev. 11.11
BitSpyder - The Culture of Knowledge
If your solution did NOT work, write below other possible causes that you would like
to validate? Write these causes below. Return to step 3 and restart building your
hypothesis.
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
If your solution did NOT work and you have no more possible causes you should
return to Step 1 Identification and look for additional information that you may have
overlooked.
If you successfully validated your hypothesis, how certain are you that your solution
will work when implemented in the live network? Indicate your assessment below.
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
Discuss these with your course facilitator and decide whether to implement these
steps or continue to the next step.
Rev. 11.11 L6 – 23
BitSpyder - The Culture of Knowledge
Step 5 – Implementation
Develop your implementation plan
Network nodes impacted Proposed changes
______________________ _____________________________________________
______________________ _____________________________________________
______________________ _____________________________________________
______________________ _____________________________________________
______________________ _____________________________________________
______________________ _____________________________________________
______________________ _____________________________________________
______________________ _____________________________________________
Verification process
Step 1: ____________________________________________________________
Step 2: ____________________________________________________________
Step 3: ____________________________________________________________
Step 4: ____________________________________________________________
Step 5: ____________________________________________________________
Step 6: ____________________________________________________________
Step 7: ____________________________________________________________
Step 8: ____________________________________________________________
L6 – 24 Rev. 11.11
BitSpyder - The Culture of Knowledge
Back-out plan
Step 1: ____________________________________________________________
Step 2: ____________________________________________________________
Step 3: ____________________________________________________________
Step 4: ____________________________________________________________
Step 5: ____________________________________________________________
Step 6: ____________________________________________________________
Step 7: ____________________________________________________________
Step 8: ____________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
Rev. 11.11 L6 – 25
BitSpyder - The Culture of Knowledge
Step 6 – Verification
In normal work environments you would run your implementation plan and
verification procedure to determine if successful. In this lab the facilitator and other
students’ feedback on your plan will determine if your plan was successful.
Was your plan deemed successful (Y/N) _____________
Write notes here on how other student plans differ from yours. Make a list of good
ideas you want to take away from this lab.
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
L6 – 26 Rev. 11.11
BitSpyder - The Culture of Knowledge
Trouble Site or
Cluj‐Napoca, Romania
Location:
Brief Problem A follow‐up to Ticket# 2011‐612098 ‐ Customer trying to connect a 2nd pair of Data Centers
Description: over L2VPN
Problem History: 27‐Feb‐11: Though PE routers show L2VPN connection "vpn2" as up, devices attached to CE‐
1T and CE‐2T (as well as the CE devices themselves) are unable to communicate with one
another via subnet 10.YX.100.0/24 (X and Y correspond to the pods of the students working
together, X=odd, Y=even: A=1, B=2, C=3, D=4, etc.).
28‐Feb‐11: Further discovered that L2VPN connection "vpn3" which should connect subnet
10.YX.200.0/24 from CE‐1T and CE‐2T is also not working (connection status is down).
Rev. 11.11 L6 – 27
BitSpyder - The Culture of Knowledge
Step 1 – Identification
Describe the symptoms of the problem? Write them below.
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
Describe what the customer wants to do? Write the customer need below.
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
L6 – 28 Rev. 11.11
BitSpyder - The Culture of Knowledge
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
What priority would you give this problem and why? Capture your recommendation
below.
_______________________________________________________________________
_______________________________________________________________________
Step 2 – Analysis
Replicate the problem
The course facilitator will give you the customer configuration files for your
troubleshooting ticket. Load these configuration files and see if you can simulate the
problem.
Where you able to recreate the problem, Y/N? ____________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
Rev. 11.11 L6 – 29
BitSpyder - The Culture of Knowledge
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
Indicate below the troubleshooting tools you think would be helpful to solve this
problem.
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
Step 3 – Hypothesis
Perform technical evaluation
Use the tools you identified and analyze the problem. Based on your analysis what
is the root cause of the problem described in your trouble ticket? Write your
hypothesis below.
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
What is your recommended resolution and how will you validate the solution? Write
the proposed changes and validation below.
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
Rev. 11.11 L6 – 31
BitSpyder - The Culture of Knowledge
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
Are there any possible side effects to your proposed solution? Write them below.
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
Step 4 – Validation
Test your hypothesis
Implement your proposed changes and validate the solution in the manner you
described above.
Did you solution work (Y/N) __________
Whether the hypothesis was correct or flawed, it is always possible to learn
something new about the problem. What did you learn? Write it down and be
prepared to share with the class.
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
L6 – 32 Rev. 11.11
BitSpyder - The Culture of Knowledge
If your solution did NOT work, write below other possible causes that you would like
to validate? Write these causes below. Return to step 3 and restart building your
hypothesis.
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
If your solution did NOT work and you have no more possible causes you should
return to Step 1 Identification and look for additional information that you may have
overlooked.
If you successfully validated your hypothesis, how certain are you that your solution
will work when implemented in the live network? Indicate your assessment below.
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
Discuss these with your course facilitator and decide whether to implement these
steps or continue to the next step.
Rev. 11.11 L6 – 33
BitSpyder - The Culture of Knowledge
Step 5 – Implementation
Develop your implementation plan
Network nodes impacted Proposed changes
______________________ _____________________________________________
______________________ _____________________________________________
______________________ _____________________________________________
______________________ _____________________________________________
______________________ _____________________________________________
______________________ _____________________________________________
______________________ _____________________________________________
______________________ _____________________________________________
Verification process
Step 1: ____________________________________________________________
Step 2: ____________________________________________________________
Step 3: ____________________________________________________________
Step 4: ____________________________________________________________
Step 5: ____________________________________________________________
Step 6: ____________________________________________________________
Step 7: ____________________________________________________________
Step 8: ____________________________________________________________
L6 – 34 Rev. 11.11
BitSpyder - The Culture of Knowledge
Back-out plan
Step 1: ____________________________________________________________
Step 2: ____________________________________________________________
Step 3: ____________________________________________________________
Step 4: ____________________________________________________________
Step 5: ____________________________________________________________
Step 6: ____________________________________________________________
Step 7: ____________________________________________________________
Step 8: ____________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
Rev. 11.11 L6 – 35
BitSpyder - The Culture of Knowledge
Step 6 – Verification
In normal work environments you would run your implementation plan and
verification procedure to determine if successful. In this lab the facilitator and other
students’ feedback on your plan will determine if your plan was successful.
Was your plan deemed successful (Y/N) _____________
Write notes here on how other student plans differ from yours. Make a list of good
ideas you want to take away from this lab.
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
_______________________________________________________________________
L6 – 36 Rev. 11.11
BitSpyder - The Culture of Knowledge