Z REDES Keynote - Cambron PDF

Designing Global Networks
Keith Cambron
President & CEO, AT&T Labs
© 2010 AT&T Intellectual Property. All rights reserved. AT&T and the AT&T logo are trademarks of AT&T Intellectual Property.
How have networks changed, and how
do we design and operate them?
Networks – before 1990
- Shaped by the PSTN providers & standards
- Largely voice, ISDN introduced in mid 1980s.
- One converged network for voice and data
- Predictable port growth, about 3% per year
- Predictable traffic patterns
- 3 ccs residence or 8% line occupancy in the
busy hour
- 5 ccs business or 14% line occupancy in the
busy hour
2 © 2010 AT&T Intellectual Property. All rights reserved. AT&T and the AT&T logo are trademarks of AT&T Intellectual Property.
Networks – before 1990 ...
- Hierarchical networks
- Static routing set by PSTN engineers
- Clear division, networks & terminals
- Backbone traffic throttled by access
- All traffic is unicast
- All sessions used 64 kbps bandwidth
- Common channel signaling
- Sessions are blocked, not queued
- Blocking occurs at origination
Networks – after 2010
- Mesh - network of networks

Peers
- Dynamic routing set by the network
- Mobility and IP are the centerpieces
- Blurred boundary, apps & net Content Backbone Consumers
- No explicit congestion control

Regional
- Traffic is unicast & multicast Access
Enterprise
Wireless
- Session bandwidth is unspecified
- Services fail at the weakest point
- No end to end service management
- Lack of global standards for services
Foundational Changes in Networks
Then –
Converged networks optimized capital deployment.
Networks were predictable and centrally managed.
The network and the service were one.
Devices and applications followed the network.
Now –
Devices and applications lead the networks.
Traffic demand and modalities shift in dramatic fashion.
There is no clear owner of service management.
Global mobility and video drive investment.
Today’s Network
Global Reach and Consistency
•  IP in over 200 countries •  38 Internet data centers •  60,000 cell sites in US
•  Over 4,000 nodes •  168,000 routers •  93M wireless subscribers
•  1,000,000+ ports •  Over 135,000 WiFi Hotspots •  19,000 text msgs/second
•  Over 900,000 fiber miles •  Ethernet at 1,500 access points •  7.5B records/day
Existing Fiber Routes

New Undersea Fiber
New Core Routers
New to AT&T Global Network
TPE Existing IP/MPLS Hubs
AAG
The AT&T network carries
more than 21
Sydney-Hawaii Petabytes* of data
traffic on average
business day
Simplified map: not all nodes/links/routes shown
* Enough data to transmit the digitized contents of the Library of Congress more than 400 times every day
** MPLS technology enables high-quality delivery to multiple services over a single IP Network Infrastructure
Page 6© 2010 AT&T Intellectual Property. All rights reserved. AT&T and the AT&T logo are trademarks of AT&T Intellectual Property.
Designing & Operating Today’s Networks
How do we begin?
• Trends That Matter

• Technologies That Matter
• The Technology Pipeline
• The Operational Model
Trends That Matter
Device Adoption
PC Adoption
Mobile Phone Adoption

Computer Industry Almanac
Device adoption is going to

mobile in US, and growing at
15 - 30% CAGR globally.
Device bandwidth
consumption is growing at ~
40% CAGR for smart WikiInvest.com
devices.
Trends That Matter
Internet Video
2009
Oprah Inauguration
March Book
12000 Madness Club
2008 2008
10000
Un-cached
Unicast
8000
BW x Miles
Well-Cached
6000
Unicast
4000
2000
Multi-cast
20 40 60 80 100 120 140 160 180 200

Number of Subscribers to a Live Event in 1000s
Video accounts for 40% of backbone traffic, and is growing at 75% CAGR
Trends That Matter
Cutting the cord
• iPad, iTablets – dramatic increases in screens

• Multi-tasking – Pandora
• Mobile LANs – tethering and vans
• Invisible Computing – 4G pallets & collars
• Venues – replays and captures at the stadium
• IPV6 – interworking and routing tables
Technologies that Matter
• MPLS/IP Core – foundational

• Access Technologies – opening the gates
• Optical Technologies – trenching & Moore’s Law
• Information Sciences – processing, data mining
• IP & Media Evolution – IPv6, HTML5
Velocity of Transformation
The rate and periodicity of change
• Applications – daily change, dramatic shifts in

months with long periods of stability
• Devices – 2x in 2 years, Moore’s Law
• MPLS/IP Core – 4x improvement every 6 years
• Wireline Access – 10x every 10 years
• Mobility Access – 4x every 4 years
Access technologies have long deployment cycles and

are capital intensive. You’d better be right.
The Technology Pipeline
Keeping Pace With Demand
Demand –
application
Volume
& device driven Capacity –

technology & capital
driven
Research Develop Deploy Operate
time
Components and Chips to Systems
Network Element
IC Design Design
Research
Systems Eng
Systems Network Element
Integration Certification
Transmission
Systems Eng
Transmission Engineering Element Systems Engineering

Network Characteristics & Models, Use Cases & Models
IC Supplier AT&T Labs Systems Supplier
Systems to Networks and Services
Service Definition
Network Services Design

Engineer & Integration
Systems Operations
Integration IT
Engineer
Operations &
Performance Engr
Network Design & Engineering Operations & Systems Design
Network Topology, Flows and Policies
Info Tech AT&T Labs Marketing & Sales
Network Technology Introduction
Research and Engineering Teams
Core Research
Development
Incubation & Ops
Systems Engineers
Σ (1 + x) n
Test Engineers
Network Engineers
for( int i = 0; i < x; i++ ) {

Node n = new Node(i);
The Operational Model
NOC NOC
Network Management Service Management Customer Care Engineering
Reporting Visualization Analysis Planning Field Operations
Design Audits Fault Engineering Fraud
Data Collection
Topology Performance Events Customer

Networks Data
17
The Operational Model
AT&T Labs Mobility Network Design Regime
Service Driven Element Driven

Design Work Element & EMS Element/EMS MIB Design Work
Requirements Inventory
Element Engr. & Data Collector Installation

End to End Service Ops Review Design & Impl. Guides / MOPs
Requirements
Engr & Ops Rules / Engr & Fault
Service/Network Guidelines Analysis Platforms Testing /
Design & Budgets Certification
Configuration / Work Group
Service Trending Gold Standards Reports, Portals & Views
and Impacts
Operations Driven
Design Work
Customer
Churn Analysis
Availability & QoS & Policy Traffic Demand Chronic Trouble Tier 4
Device Failover Analysis Design Models Analysis Support
Analysis
A – Z Network
Control Plane Network Optimization Configuration PSL
Analysis &
MD&E (McElroy) Design & Design Audits & Tools
Design
Responsibility
Network Driven
Design Work
Page 18
AT&T Proprietary (Restricted)

Applying Research – Dynamic Control
Intelligent Routing Service Control Point (IRSCP)
Network & Application Aware – Load Balancing
OSPF selected path Edge Routers

using network topology Altered policy injected into Backbone Switch
IRSCP/RR servers
IRSCP/RR servers
Content Servers
MPLS Transport
Site 2
Topology independent
preferred path based on
Site 1 latency or other factors
19
Applying Research
Traffic Analysis System
Technology components quickly assembled, hardened and delivered to customers
U
Documentation/Training S
Production
E
Processes:
R
• Testing
• Release Mgmt
S
• Operations
U
Analytics • Tier 3 Application
P
Support
P
• ETE Security
O
• Audits/Controls
Algorithms Production Environment R
Stable/scalable code T
Daytona
TAS was delivered within 45 days; from technology into

a documented system operating in a production environment
Applying Research
Traffic Analysis System
Applying Research
Ptolemy
Loss of many
links out of
Japan
Snapshot from
March 15th 2011
Page 22
Applying Research
Ptolemy
Loss of many
links out of
Japan. What’s
left?
Page 23
Applying Research
Ptolemy
Ptolemy is built on top of a wide range of research innovations:
•  Darkstar/Data: Massive repository of network data, normalized for easy correlation
•  OSPFMON: Monitoring link status
•  NETDB: Topology views, capacities
•  Graphivz: Logical topology views
•  …
Ptolemy design detected issues in other systems e.g.,

•  Missing alarms
•  Majority performance alarms erroneously turned off for 6 months – Ops flying blind!
•  System bugs (e.g., NetDB capacities)…
Page 24
Our Biggest Challenge
Excellence at Scale
• 400 platforms – ADSL modem to CRS-1

• > 10,000 services – POTS to AVPN, Cloud
• > 1,000 active projects

• > 100 software projects
• Staffing – Talent, breadth, depth
• Supplier engagement – Quality, R&D

Z REDES Keynote - Cambron PDF

Uploaded by

Document Information

Original Title

Copyright

Available Formats

Share this document

Share or Embed Document

Sharing Options

Did you find this document useful?

Is this content inappropriate?

Copyright:

Available Formats

Z REDES Keynote - Cambron PDF

Uploaded by

Copyright:

Available Formats

Designing Global Networks

- Mesh - network of networks

- No explicit congestion control

Existing Fiber Routes

TPE Existing IP/MPLS Hubs

• Trends That Matter

Mobile Phone Adoption

Device adoption is going to

20 40 60 80 100 120 140 160 180 200

• iPad, iTablets – dramatic increases in screens

• MPLS/IP Core – foundational

• Applications – daily change, dramatic shifts in

Access technologies have long deployment cycles and

Keeping Pace With Demand

& device driven Capacity –

Research Develop Deploy Operate

Transmission Engineering Element Systems Engineering

IC Supplier AT&T Labs Systems Supplier

Network Services Design

Info Tech AT&T Labs Marketing & Sales

Incubation & Ops

for( int i = 0; i < x; i++ ) {

Reporting Visualization Analysis Planning Field Operations

Design Audits Fault Engineering Fraud

Topology Performance Events Customer

Service Driven Element Driven

Element Engr. & Data Collector Installation

AT&T Proprietary (Restricted)

OSPF selected path Edge Routers

TAS was delivered within 45 days; from technology into

• OSPFMON: Monitoring link status

• NETDB: Topology views, capacities

• Graphivz: Logical topology views

Ptolemy design detected issues in other systems e.g.,

• System bugs (e.g., NetDB capacities)…

• 400 platforms – ADSL modem to CRS-1

You might also like

- Mesh - network of networks

- No explicit congestion control

• Trends That Matter

• iPad, iTablets – dramatic increases in screens

• MPLS/IP Core – foundational

• Applications – daily change, dramatic shifts in

•  OSPFMON: Monitoring link status

•  NETDB: Topology views, capacities

•  Graphivz: Logical topology views

•  System bugs (e.g., NetDB capacities)…

• 400 platforms – ADSL modem to CRS-1