NORDUnet

Nordic Infrastructure for Research & Education

40G & 100G Overview

Network Architectural Workshopp in

Brussels - March 31st 2009

Tony
y Breach
Optical Network Manager
NORDUnet A/S
NORDUnet More Bandwidth with a Twist of QoS
Nordic infrastructure for Research & Education

Broadband
TDM
Time Division Multiplexing
SDM
Space Division Multiplexing

WDM
Wave Division Multiplexing

The major drivers for 10G and now 40G deployments were the need to:
‰ Connect Core routers
g capacity
‰ High p y demanding
g users communities like radio astronomers and high-
g
energy physicist
‰ Better economics versus yesterdays high end transmission capacity
‰ Network capacity exhaust

These have been the dominant cited factors most often given when
moving towards high transmission speeds.
NORDUnet
Nordic infrastructure for Research & Education
Benefits of 100G Networking
10G interfaces 100G interfaces
10G I/O
10G I/O On high-end core 100G I/O
Better utilization of
10G I/O
10G I/O
/
routers - Fabric 100G I/O fabric bandwidth
10G 10G I/O capacity
it iis poorly
l 100G d
due tto improved
i d
10G I/O utilized with lower 100G I/O
access into the
10G I/O
10G I/O
speed I/O. 100G I/O fabric.
10G
10G
10G
On high-end core The price of 100G interface
10G routers: 10 x 10G on router will be much
interfaces subscribe lower than 10 x 10G for the
10G
100G
10G
10G
10G
100G of bandwidth.
bandwidth same capacity.
capacity
10G
10G

A high capacity
Small capacity
wavelength
l th is
i bbetter
tt able
bl
wavelengths limit
to accommodate peak
bandwidth bursts or
bandwidth limiting the
increases the need for
need for Link Aggregation
Link Aggregation Groups.
Groups
Groups.

Large wavelength count Efficient use of DWDM grid.

N x 10G
consumes the DWDM
grid resulting in a higher
network complexity and
cost. (*) Example: Juniper T-1600
100G
No parallel wavelengths
means lower OAM cost and
fewer managed entities.
NORDUnet
Nordic infrastructure for Research & Education
40G Status Q1 2009
40G is commercially available and
has a service window until 2011.

40G is widely deployed

RHnet

Reykjavik

FUNET

SUNET

UNINETT
Stockholm East

Oslo
Helsinki
¾ 40G Client i/o standardized
40G ¾ 40G Transport i/o autonomous
FSKnet
¾ Small cost reduction bit/bit
Copenhagen compared to 10G
Hamburg

London
Amsterdam
West
GEANT2
NORDUnet
Nordic infrastructure for Research & Education
100G Main Standardisation Org.

Component and equipment suppliers, network operators and

standards bodies like IEEE, the International Telecommunications
Union (ITU) and Optical Internetworking Forum (OIF) have joined
forces to create a healthy 100G ecosystem.
NORDUnet
Nordic infrastructure for Research & Education
40G and 100G Client Interface
IEEE P802
P802.3.ba
3b d draft
ft standard
t d d covering
i th
the following
f ll i areas:
¾ Support full-duplex operation only
¾ Preserve the 802.3 Ethernet frame format utilizing the 802.3 MAC
¾ P ese e max.
Preserve ma and min.
min frame
f ame size
si e of current
c ent 802.3
802 3 standard
standa d
¾ Support a BER better than or equal to 10-12 at the MAC/Physical Layer
¾ Provide appropriate support for Optical Transport Network
¾ Support MAC data rates of 40G and 100G

Distance/Medium 40 GbE 100 GbE

1 m Backplane 40GBASE-KR4
40GBASE KR4
10 m Copper 40GBASE-CR4 100GBASE-CR10
100 m MMF 40GBASE-SR4 100GBASE-SR10
10 km SMF 40GBASE-LR4 100GBASE-LR10
40 km SMF 100GBASE-ER10
Physical Layer specifications
NORDUnet
Nordic infrastructure for Research & Education
100G Transport Interface
G.709 OTN ODU2-4v ODU3 ODU4 (130 Gbps)
OTU-4
STM-256 STM-256 STM-256 STM-256 STM-256

OTU-4 is rate optimized

for transporting 100
GbE - approximately 40 GbE 40 GbE 40 GbE 40 GbE 40 GbE

112 Gbps

ODU2-11v
ODU2 11v ODU3-3v ODU4 (112 Gbps)

100 GbE 100 GbE 100 GbE

Expected performances for the 100G Transport Standard awaits IEEE

¾ Transparent reach greater than 1.000 km P802.3ba standard –
¾ Channel spacing equal 50 GHz OUT-4 expected
¾ Channel count equal to the extended C-band finalized summer
¾ Compatible
p with existing
g installed DWDM base 2010
¾ Smooth integration into 50 GHz systems
¾ Compatible with existing 10G & 40G channels
NORDUnet
Nordic infrastructure for Research & Education
100G Optical Interworking
Dual Polarization - Quadrature Phase Shift Keying
Dual-Polarization
Vertical
Consensus within the Industry - Polarization
identified DP-QPSK
DP QPSK modulation with a
Horizontal
coherent receiver as the chosen 100G
Polarization
modulation technique for integrated
photonic
h t i components.t Dual
Polarization

Single CFP slot 100G DP-QPSK Line module

Programmable Signal Processing SFI-S 10x
11.2Gbps SFI-S 4x 28 Gbps
Client i/o 90°

100G
100GbE SERDES
SFI-S
OTU-4
Driver 112 Gbps
OTU-4 Pre-coder
0,1/10/40 Km OUT-4 or
TRX 130 Gbps
FEC
40G/10G Coding
STM-x/OC-x
PSC
OTU-x
(MAC)
x-GbE
SFI-S

0,1/2/40/80 Km

DSP Quad ADC Photo Hybrid

DEMUX Diodes DEMUX
NORDUnet
Nordic infrastructure for Research & Education
100G Optical Interworking Cont.

Forward Error Correction for 100G DP-QPSK

Message
sequence Codeword

010 011 110 (6,3) 101010 101010 000 110

Block
Encoder Parity Message
bits bits
FEC Illustration Example

The OIF members have defined a common basis for a FEC schema.

OIF has defined that full DWDM inter-operability is outside their

current work scope.
 NORDUnet Carbon Dioxide Footprint Reduction
Nordic infrastructure for Research & Education

Average Power Consumption normalized to 2005

Router

IP Connectivity

D evice tyype
Ethernet Switch

Sonet/SDH Switch
Packet Transport

ODU Switch Circuit Transport

OOO Switch (25%

add/drop) Photonic Transport
0 200 400 600 800 1000 1200 1400 1600 1800

Power Consumption (Watts/100Gbps)

Optics & Serdes FEC Framer/MAC Data processing Queuing Switching Control Misc OA Source:
2009 figures are roughly 1KW/100Gbps for Routers & 500W/100Gbps for Switches

Power efficiency is a strong motivator to push functionality to lower

layers due to direct power costs and indirect MTBF.
10 | ICELINK | February 2009
NORDUnet
Nordic infrastructure for Research & Education
Re-emerged Protection Schema
GMPLS hash become
b one Thi will
This ill lead
l d to
t emerging
i photonic
h t i
of the key Control Plan functionality like:
Management Protocols
• Network and Resource Discovery
which have found its
way to the photonic area • Dynamic Provisioning
and is expected
p to take • Distributed Automatic Restoration
off in the beginning of
2010.

X
R
Recovery ti
time ffor multiple
lti l
failures < 25 to 50 msec.

Ph t i iimpairments
Photonic i t are
included into the calculation

Protection for external IP failures can consequently be moved down

to the less costly photonic layer.
NORDUnet
Nordic infrastructure for Research & Education
100G Fitting into NGN Architecture
40/100 G
IP/MPLS Core
nx10/40 G
10 G
nx 10/40/100 G Ethernet
Virtuel via DWDM T-MPLS
PBT

Super Computer B A External

InfiniBand C Connections
FiberChannel D

DWDM

E
J
F H I
G
Domain I

Sustainable environmental impact due to less power

intensive electronic devices.

Switch where you can, route where you must.

NORDUnet
Nordic infrastructure for Research & Education
Summery
40G
Commercial
available – Service
window until 2011.
100G
Initial deployment 2010.
Quickly adaption –
Service window until 2016
NORDUnet
Nordic infrastructure for Research & Education

Thank you

Questions...

Presentation an report
p can be found at: wiki.nordu.net

Presentation – Directory “Presentation Library”

Report – Directory “Document Repository”