METRO TRANSPORT

EVOLUTION
Vasily Mukhin
Sr. Product Manager,
Access and Aggregation Platforms/Solutions

© 2018 Juniper Networks Juniper Business Use Only

CONFIDENTIALITY AND LEGAL NOTICE
This material contains information that is confidential and proprietary to Juniper Networks, Inc. Recipient may not distribute,
copy, or repeat information in the document without a signed non-disclosure agreement (NDA).

Any statements of product direction contained in this presentation sets forth Juniper Networks’ current intention and is
subject to change at any time without notice. No purchases are contingent upon Juniper Networks delivering any feature or
functionality depicted in this presentation.

Copyright 2019 Juniper Networks, Inc. All rights reserved. Juniper Networks, the Juniper Networks logo, Juniper, Junos, and
NXTWORK are registered trademarks of Juniper Networks, Inc. in the United States and other countries. All other
trademarks, service marks, registered marks, or registered service marks are the property of their respective owners. Juniper
Networks assumes no responsibility for any inaccuracies in this document. Juniper Networks reserves the right to change,
modify, transfer, or otherwise revise this publication without notice.

© 2018 Juniper Networks Juniper Business Use Only 2

AGENDA
• METRO CHALLENGES and TRENDS
• METRO ARCHITECTURE EVOLUTION
• NEW PLATFORMS
• SELECTED USE CASES
• MANAGEMENT AND AUTOMATION

© 2018 Juniper Networks Juniper Business Use Only 3

METRO ETHERNET TRENDS AND CHALLENGES
Internet Traffic by Domain, 2016 and 2021 Metro Operator Challenges
% of total end-user traffic
58%
Cost Optimization:
• Decreasing Price per Megabit/Port
2016
2020 • Decreasing New Network Node Deployment Time
41%
35% • Decreasing Service Rollout Time
CORE
% of 23% 22%
Traffic 20% Investment Protection:
METRO • Protect Investment into SW and System Integration
% of
Traffic • Leverage White-Box Solutions
Cross-Country Core Regional Core Metro
Source: IHS, Dell'Oro, Ovum
Metro Traffic Growth Drivers: New Revenue Generation:
• Success of 10G Services & Advent of 100G Services • SLA Enforcement

Metro Traffic Pattern Changes: • Increasing Network Visibility

• Distributed Cloud Content Drives Shift to East-West

Traffic Patterns
• Trend Toward Distributed Edge Keeping Traffic Flows
within Metro
© 2018 Juniper Networks Juniper Business Use Only 4
 CHANGING TRAFFIC PATTERNS, EVOLVING NETWORKS
Internet
The Past
• Business and consumer services Business CPE
centralized on services PE Core
• Traffic patterns east/west from access
Basic Layer 2
to core; centralized peering Transport
Services Edge
Telco
The Future MEC Cloud

• Business services move into the cloud; Business

intranet replaced by Internet CPE
• Consumer services split with CUPS; 5G RRH
Core
UP into metro, CP into cloud
R-PHY Metro Simplified
• Distributed content, Internet peering Fabric Edge
IOT
• Edge routing data plane simplifies
© 2018 Juniper Networks Juniper Business Use Only 5
METRO-E AND LTE MOBILE TRANSPORT - TODAY

Mobile
Device

Access Pre-Agg Aggregation Service Edge/Core

eNodeB BNG
(3G, 4G) EPC

1G
N x 1G N x 10G N x 100G N x 100G
Enterprise
Inet GW

BNG

Residential
L2 / L3 L3
Infra
IP/MPLS / Seamless MPLS

L3VPN
Service
L2 PW

© 2018 Juniper Networks Juniper Business Use Only

 METRO-E AND LTE-A/5G NSA MOBILE TRANSPORT - TODAY

vEPC
vCCAP

eNodeB Access Pre-Agg Aggregation Service Edge/Core

(3G, 4G) BNG
EPC
Mobile
Device
10G
gNB NSA
N x 10G 100G N x 100G N x 100G
Cloud
Services /
• VPNs
• Internet Internet
• Hybrid Clouds BNG
Enterprise

L2 / L3 L3
• HD Stream
Infra
• Online Gaming Residential IP/MPLS / Seamless MPLS
• Internet

L3VPN
Service
(H)-VPLS/ L2 PW / EVPN-VPWS

© 2018 Juniper Networks Juniper Business Use Only

 LTE-A/5G NSA MOBILE TRANSPORT - TODAY
Controller / Orchestrator

MEC MEC BNG-C / AGF-C

CRAN vEPC 5GC vCCAP
Mobile Device

eNodeB (3G, 4G)

Access Pre-Agg BNG-U Service Edge/Core
Aggregation BNG
EPC
BW Slice
10G
25G N x 10G Video
gNB NSA 100G Cache N x 100G N x 100G
Latency Slice N x 25G
Cloud
Services /
• VPNs
• Internet Internet
• Hybrid Clouds BNG
• Multi Clouds Enterprise BNG-U

Fixed Mobile < 150us, +/- 65ns G.8275.1 < 10ms, +/- 1.5us
Infra L2 / L3 L3
• UHD Stream
• Online Gaming Segment Routing / SR-TE
• Internet
Residential

Service EVPN (L2 and L3)

© 2018 Juniper Networks Juniper Business Use Only

 ENABLING CONTROLLERLESS INTERDOMAIN TE
CONTROLLERS HIERARCHY (EODN)

PCEP/BGP-LS

PCEP/BGP-LS
PCEP/BGP-LS
R2
R1 Local LSP - Red
Local LSP - Red
Local LSP - Red

Metro Core Metro

Enterprise WAN
Local LSP - Blue
Local LSP - Blue
R3

SR MPLS/SRo6/SRv6/ SR-MPLS/SRo6/ SR MPLS/SRo6/SRv6/

SRv6+/Flex Algo RSVP/LDP/Flex Algo SRv6+/Flex Algo

EVPN (L2 and L3)

© 2018 Juniper Networks Juniper Business Use Only 9

 ENABLING CONTROLLERLESS INTERDOMAIN TE
BGP-LCU

End-to-End
LSP Red

R2
R1 Local LSP - Red
Local LSP - Red
Local LSP - Red

Metro Core Metro

Enterprise WAN
Local LSP - Blue
Local LSP - Blue
Local LSP - Blue
R3
BGP PIC
Anycast SID Anycast SID

End-to-End
SR MPLS/SRo6/SRv6/ SR-MPLS/SRo6/ SR MPLS/SRo6/SRv6/
LSP Blue SRv6+/Flex Algo RSVP/LDP/Flex Algo SRv6+/Flex Algo

BGP-LCU

EVPN (L2 and L3)

https://datatracker.ietf.org/doc/draft-szarecki-idr-bgp-lcu-traffic-steering/
© 2018 Juniper Networks Juniper Business Use Only 10
USE CASES
Business Edge
Ethernet Business Services Ethernet Exchange / COLO

CPE
Aggregation IX
Cabinet CO CO
Service Edge
Core
Residential &
Residential Aggregation & Cable DAA Inet Storage
vBNG
FTTx CO
vCCAP
PHY
RF CO
CO
SaaS
Mobile Backhaul DU Mobile Edge
CU

Cell Site Cabinet CO

RRU
PHY IP Transit
Wholesale Transit

Open Line System

CO CO

© 2018 Juniper Networks Juniper Business Use Only 11

FLEXIBILITY FOR SP INFRASTRUCTURE TRANSFORMATION
Juniper: Leadership Without Technology Religion

Flexible Silicon Options Flexible Junos Options

Standalone
Junos SW
or
or +

Custom Silicon 3rd-Party

Merchant Silicon
Penta Qumran 2
White Box
Triton Jericho 2 HW
Integrated HW + SW

© 2018 Juniper Networks Juniper Business Use Only 12

 CONVERGED METRO ETHERENT PORTFOLIO
JUNOS, ZTD, Automation, Telemetry, Analytics, Multilayer Control & FCAPS
SR-MPLS (SRo4, SRo6), Flex-Algo, PCEP, BGP-LS, eODN, IPVPN/EVPN
ACCESS PRE-AGGREGATION AGGREGATION EDGE CORE
MX240
MX104

PTX3000
MX960
ACX500 ACX1100
2016

UNIVERSAL
ACX2200
ACX5096
ACCESS AND
MX10003 AGGREGATION
ACX5048
2018H2

PTX10008
MX2008
ACX5448 ACX6360
METRO
ACX5448-M
ACX5448-D FABRIC
2019H2

ACX710
ACX753

100/400GE Optimized
2020H2

- New platforms (shipping)

- New upcoming platforms.
10/25/50/400GE Optimized - Future concepts

© 2018 Juniper Networks Juniper Business Use Only

NEW ACX PRODUCT PORTFOLIO AT A GLANCE

ACX710 ACX753
ACX5448 ACX5448-M ACX5448-D ACX6360
(ODIN-100G) (BOLAN)
1H 2020 – 300Gb/s
Availability Shipping Shipping Shipping Shipping 1H 2020
2H 2020 – 2.4Tb/s

High End Metro High End Metro High End Metro High End Metro Core
Use Case 5G CSR, Agg. Router Pre-Agg/Agg Router
Aggregation Aggregation Aggregation and Aggregation LSR
High 1GE/10GE High 1GE/10GE
High 1GE/10GE High 100GE Density in High 1GE/10GE Modular & Redundant
Key Features density, 100GE, 10GE density, 100GE; 100G
density, 100GE 1RU, 100G DWDM density, hardened Chassis; hardened
MACSEC DWDM

Performance 800G 800G 800G 3.6T 320G 320G/2.4T

44 x 1/10GE 36*1/10GE 8*1/10GE

48 x 1/10GE 6 x 100GE 20 x 100GE
Traffic ports 2 x 100GE 24x10GE/1GE 8*10/25GE
4 x 100GE w/MACSEC on 10G 8 x 200GE CFP2-DCO 4x100GE/40GE
ports 2*200G CFP2-DCO 2x100GE and 4*100GE

Form Factor 1 RU, 19 Inch 1 RU, 19 Inch 1 RU 19 Inch, 1RU 19 Inch 1RU, 19 Inch 3RU, 19 Inch, 250mm

Very (Ultra)
Logical Scaling Very High/Premium High High LSP Scale High High/Premium
High/Premium

Ambient Temp 0C to 40C 0C to 40C 0C to 40C 0C to 40C -40C to 65C -40C to 65C

© 2018 Juniper Networks Juniper Business Use Only 14

SELECTED USE CASES

© 2018 Juniper Networks Juniper Business Use Only 15

METRO USE CASES DIFFERENTIATION

Ethernet Business Services Ethernet Exchange / COLO

Ethernet Exchange
Ethernet Business Services
ENNI, E-TRANSIT, high capacity ,
Aggregation IX
E-OAM, E-LINE/E-LAN (Ethernet and MPLS)High
CPE

Cabinet
Capacity, IP-VPN/IP Support
CO CO
ACLs Service Edge
Core

Residential Aggregation & Cable DAA Storage

Residential / FTTH / DAA Cloudification vBNG

E-OAM, E-LINE/E-LANFTTx
(Ethernet and MPLS), IP andCOL2 vCCAP
PHY

Multicast (IGMP snooping), L3VPNCO

RF
EVPN, SR-TE, Automation,
CO
Telemetry SaaS
Mobile Backhaul DU

MBH and Fronthaul CU

E-LAN, E-LINE,CellIP-VPN,
RRU
Site Synch, Ultra
Cabinet Low Latency for
CO

Fronthaul, Timing and Synchronization,

PHY 300 mm Form factor IP Transit
Wholesale Transit

Open Line System

Standardized DCO Optics Multi-layer Control
Interoperable CFP2-DCO, 400G CO
Ready Open and automatedCOplatforms, L0-L3
integration

© 2018 Juniper Networks Juniper Business Use Only 16

FTTH AND BUSINESS SERVICES: DISTRIBUTED MODEL
(MULTIDIMENSIONAL SCALING)
Multidimensional Scaling Tested

Feature ACX5448 Enabled

Yes
VRF Cloud 500
IP TRANSIT Enterprise
PE PE
Routes 500K (VPNv4) Yes
Service Edge IP

BGP Peers IP
500IP Yes
L2

AGN Yes

L2 overlay
AGN VPLS 2K
ACX5448 ACX5448
MAC 64K Yes
IRB 4K Yes
PW
Distributed200
Service Edge Yes
ACCESS Targeted LDP
ACCESS ACCESS
ACX5448 ACX5448 ACX5448 1024 Yes – Partial
IP QoS
IP Policy
IP IP

Ingress QoS MAP L2 L2 L21024 Yes – L2

Partial
PON PON DSLAM
Traffic Class 8 IP Yes- Partial
IP
UNI/ENNI IP IP IP IP IP IP
UNI/ENNI UNI/ENNI RT RT RT HGW HGW HGW L3SW
MEP 128 Yes
Inter Transparent L2 for
CCM 128 Yes
L3 for Enterprise Residential provider Enterprise

© 2018 Juniper Networks Juniper Business Use Only 17

NEW DEPLOYMENT OPTIONS

NEW PROTOCOLS NEW TOPOLOGIES

SPRING (SR) 10GE to 100GE Migration

EVPN SPINE / LEAF
MEF 10.3 Enhancements Aggregation to TOR Links

© 2018 Juniper Networks Juniper Business Use Only 18

 FTTH AND BUSINESS ACCESS USE CASE EVOLUTION
Existing RSVP or Existing RSVP or
SR/SR-TE SR/SR-TE
DC Domain Interworking L3 VPN
Core Domain based Core

CONTROLLER (PCEP, BGP-LS, NETCONF)

based Core
EVPN

service types or subscriber

ISIS\OSPF LFA, LDP
termination
SR, SR-TE, TI-LFA

SR, SR-TE, TI-LFA

ISIS\OSPF , RSVP,

Deployment option 1

SRv6
TOR
L3VPN

N x 100G

N x 100G
Deployment option 2 N x 100G
Video Core

BGP-LU
BGP-LCU
Deployment option N
N x 100G (v)EPC
PWE

Cable OS
Aggregation IGP Domain SPINE SPINE “Breakout” to local
services/networks
SR, SR-TE, IGP TI-LFA

ISIS\OSPF LFA, LDP

Other(VPN
from Spine
ISIS\OSPF , RSVP,
VPLS

PE, EPC, etc)

SRv6

100G
H-VPLS

2 3 N N+

LEAF LEAF LEAF LEAF

Services

IEEE802.3, QinQ, Multiple TPID, 4

EOAM, HQOS, ACL, TrTcm Policers

Remote
Deployment Scenarios LEAF

OLT Business Access DSLAM CMTS DSLAM CMTS

© 2018 Juniper Networks Juniper Business Use Only

 ACX5448 USE CASES SR Features :
VPLS OVER SR, IEEE802.3 NID, PAYG
• Configurable SRGB (ISIS)
• Unnumbered Interfaces (Roadmap)
Core IGP
LDP or RSVP
SR Features Roadmap:
• Anycast SID
• SR to LDP Mapping Server
PAYG Features:
• Licensing per port
• Launch with 40GE and
SR Features:
migrate to 100GE when PS PS VPLS
PHT • Configurable SRGB (OSPF)
needed PHT
- Roadmap
• TI-LFA
FEC128/FEC129
Pseudowire VPLS over SR
AGN
ACX5448
over SR
AGN AGN
ACX5448
802.3 Ethernet, MX10003

QinQ
NID
IEEE 802.3
NID
NID Features:
ACX5448 • 1000 - 4000 EVC
ACX5448 ACX5448 ACX5448 ACX5048
• L2CP transparent forwarding
UNI/ENNI • 4000 -16000 ACLUNI/ENNI
UNI/ENNI terms UNI/ENNI UNI/ENNI UNI/ENNI

• EOAM at scale
© 2018 Juniper Networks Juniper Business Use Only
Business Access
 FTTH USE CASE. EVPN DEPLOYMENT IN AGGREGATION SWITCH
LOGICAL TOPOLOGY

Internet DHCP
Metro Edge routers are MX’s IP/MPLS

- EVPN between Aggregation switch Metro PE 1 Metro PE 2

- DHCP relay v6/v4 on IRB

IP/MPLS

IP-PIM
Aggregation switches are ACX5448

- No local switching in EVP and BD

- IGMP/MLD/DHPC snooping in EVPN
- Sync up ARP, IGMP/MLD via EVPN AG1 AG2
- IRB in EVPN IRB EVPN IRB
EVPN
EVPN
- DHCP Relay on IRB Sync up IGMP/MLD
- PIMv4/v6 on IRB snooping via EVPN

- LACP on access ports towards PON

ACX5448 EVPN ESI 1
ACX5448
Access PON/DSLAM/NID etc. EVPN ESI N

- Connected with active/active LAG with

LAG LAG
EVPN multihoming
PON1 PON2

© 2018 Juniper Networks Juniper Business Use Only

DAA ARCHITECTURE AND USE CASE

© 2018 Juniper Networks Juniper Business Use Only 22

CABLE MSO DAA DEPLOYMENT USECASES
1 Remote-PHY
2 Remote- MAC/PHY
CCAP Core RPD
CCAP Core RMD
DEPI

DEPI/UEPI/GCP
MAC PHY
(US)
Video Cable PTP MAC/
IP Router

(US)

VLAN/GCP
UEPI PHY (US)

IP Router
Modem Video Cable
IP Data VLAN

VLAN
MAC PHY
Regional Area (DS) MAC/
IP Data Modem
(DS) GCP Regional Area PHY (DS)
Network (IP/MPLS) GCP
Network (IP/MPLS)

CIN (DWDM/Ethernet/IP) RFI/COAX CIN (DWDM/Ethernet/IP) RFI/COAX

3 Virtualized CCAP

Source: CableLabs

© 2018 Juniper Networks Juniper Business Use Only 23

DAA USE CASE WITH CENTRALIZED ARCHITECTURE
CORE
Centralized architecture with collapsed
PTP GM
PE
PTP GM
aggregation spines and leaves
Servers PE Servers
Aggregation Router:
Video Core Video Core
• MX10003

N x 10 Break-out
N x 10 Break-out

• 100G/40G or Nx10GE via breakout

100GE
100GE

OOB Core OOB Core

2 x 10 Break-out
2 x 10 Break-out

• 2 line-cards 6x100G + 32x10G

Cable OS Cable OS
• Control plane redundancy
MX10003 • Avoids MC-LAG config

100G
Cable OS
100G

Cable OS

100G
100G

IRB
Aggregation Switch
• ACX5448
2x100G 2x100G
PTP concept
ACX5448 ACX5448
• MX in PTP unaware mode or TC (Roadmap)

VNS Cluster • PTP BC IPv4 (PTP o IPv6 roadmap)

RPD 16 x VNS Clusters RPD
RPD
3xRPD RPD RPD
RPD per switch 802.1x (Roadmap)

© 2018 Juniper Networks Juniper Business Use Only

DAA USE CASE: LEAF-SPINE ARCHITECTURE

CORE PTP GM
PTP GM

PE PE
ACX5448 vCCAP aggregation leaf
100GE

Servers
• Data/Control Plane Redundancy

100GE
vCCAP
ACX5448 vCCAP ACX5448 • Inter Chassis LAG
Leaf1.1 IRB IRB Leaf1.2
• Interconnect with Core
• Very high ARP Scale
• Multicast with IRB
QFX5200-XX QFX5200-XX • DHCP Relay
Spine1 Spine2
• PTP TC, BC
ACX5448 ACX5448 • MACsec
Access Access
Leaf3.1 Leaf3.2

RPD RPD
RPD
RPD
RPD RPD

© 2018 Juniper Networks Juniper Business Use Only

 DAA USE CASE: DISTRIBUTED LEAF-SPINE ARCHITECTURE

ACX6360 as distributed spine

vCCAP
• Optics
vCCAP
Leaf1.1 IRB IRB Leaf1.2 • Up to 8x 200GE (color)
ACX5448 ACX5448 • Up to 16x100GE (grey)
• MPLS:
Nx100G Nx100G
Spine1.2
• RSVP-TE
Spine1.1
ACX6360 ACX6360 • SR/SR-TE (Road map)
4x200G 4x200G
• PTP unaware mode
• MACSec
DWDM
ACX5448-D as access leaf
Spine1.3 2x200G 2x200G Spine1.4 2x100G
• Optics
ACX6360 ACX6360 • 2x 200GE (color)
• 48 x 10GE + 2 x 100GE (grey)
Nx100G Nx100G
• MPLS:
ACX5448-D
• RSVP-TE, SR, LDP
Nx10G Leaf3.1 Leaf3.2 Leaf3.3 Nx10G Leaf4.1 • Multiservice Access Switch
RPD RPD RPD RPD
RPD RPD RPD
RPD
RPD RPD RPD RPD • EVPN, VPLS, PWE, IEEE802.3
bridging, E-OAM etc.
© 2018 Juniper Networks Juniper Business Use Only • PTP BC
NETWORK MANAGEMENT

© 2018 Juniper Networks Juniper Business Use Only 27

JUNOS NETWORK MANAGEMENT AND AUTOMATION TOOLKIT
ON-BOX AND OFF-BOX SOLUTIONS
ON BOX AUTOMATION TOOLS OFF BOX AUTOMATION TOOLS

AUTOINSTAL, PYTHON, SLAX PYTHON, RUBY,

YANG, JSON, XML ANSIBLE, JinJa2

Junos Space and

YANG, OPENCONFIG ATOM EMS

CSD, Northstar
NETCONF, REST, CLI

JET API OPEN SOURCE PROJECTS

TELEMETRY SENSORS AppFormix, Grafana, etc

SNMP, STREAMING, gRPC

© 2018 Juniper Networks Juniper Business Use Only

AUTOCONFIGURATION FUNCTION
AUTOINSTALLATION

• Autoinstallation DHCP/BOOTP client supports options:

✓ Router-address (option 3)
✓ DHCP Server ip-address (option 54)
✓ tftp-server ip-address (option 150)
✓ Option 60 class ID (Identifies type of platform)
✓ Boot file Name (option 67; relative path)

• Autoinstallation function is part of the factory default

configuration. Router sends BootP discoveries on active
physical ports for 5 min. If no valid DHCP received a
system reboot is required to reinitiate an auto
installation.
• Options to run script from USB when booted for
operational customization - example establish SSH to
management server
© 2018 Juniper Networks Juniper Business Use Only
ZTD USE CASE WITH MPLS IN THE ACCESS
Decoupling MPLS Data from ZTD Management (OAM) Plane

MPLS DATA and

SERVICE PLANE

ZTD Management Plane is

required to provide L2
connectivity between any newly
connected node and AGN. There
two options:
✓ Use a dedicated VLAN shared
across access ring (IEEE802.3
Layer 2 OAM and bridging)
MANAGEMENT PLANE
✓ Enable Layer 2 service on top
of the provisioned MPLS
infrastructure

Zero Touch Deployment in Access and Aggregation Design and Implementation Guide
© 2018 Juniper Networks Juniper Business Use Only
NORTHSTAR MODES : CONTROLLER AND PLANNER
NorthStar-Controller (PCE) NorthStar-Planner REST/RESTCONF

NS Controller NS Planner
Topology Discovery MPLS capacity planning
JUNOS Control Path Comp
LSP Control/Modification Exhaustive Failure Analysis Plane Intelligence

BGP-LS PCEP CLI NETCONF

REAL-TIME NETWORK MPLS LSP PLANNING & NETCONF CLI

FUNCTIONS DESIGN
▪ Topology acquisition via
▪ Dynamic Topology updates
NorthStar-PCE (snapshot)
via BGP-LS / IGP-TE
▪ LSP provisioning via REST API
▪ Dynamic LSP state updates ▪ Exhaustive failure analysis &
via PCEP capacity planning for MPLS LSPs
▪ Real-time modification of ▪ MPLS LSP design (P2MP, FRR,
LSP attributes via PCEP JUNOS config’let, …)
(ERO, B/W, pre-emption, …)
© 2018 Juniper Networks Juniper Business Use Only
HEALTHBOT. ENABLING AI NETOPS

ML Based Community
Juniper
anomaly Cloud of
Intelligence Customer
detection and knowledge
Contrail Service
prediction
Healthbot
Normalized Programmable Closed loop Automated
protocols Playbooks automation remediation

Support the Netconf, CLI, Open Config

Real time
legacy SNMP, Syslog Telemetry

Network Infrastructure

© 2018 Juniper Networks Juniper Business Use Only 32

JUNIPER ROUTING FABRIC

Agile Infrastructure Extensible Services Adaptive Software

End to End Portfolio Service Scale Simplified Operations

Open Line System Flex Architectures Multi-Layer Control

Carrier Grade & Cloud Secure Telemetry

Scale

Juniper’s Metro Fabric vision is service focused with optimum deployment options and on/off box
© 2018 Juniper Networks architecture that drives rich capabilities and operational simplicity.
Juniper Business Use Only
 THANK YOU

© 2018 Juniper Networks Juniper Business Use Only 34