“Canada’s National Optical Internet”

June 1999
Bernard Turcotte
Director Special projects www.canarie.ca
TURCOTTE@canarie.ca www.canet3.net
 Background: Yesterday
 Telcos: What is the Internet anyway?
 If you want a real network use X.25!
 You will never need anything faster that DS3!
 Commercial institutions will NEVER use the
Internet because it can NEVER be secure.
 Home users will NEVER be able to understand IP
 Background: Today
 World’s largest bookstore is Amazon.com
 Most major banks offer Internet based services
 Major retailers all offer Internet based shopping
 Transmission speed limitations are starting to fade
 Basic Internet usage is thought in grade school
 Telework is becoming a reality
 Background: Tomorrow
 IP telephony will be common and will
fundamentally alter the business model for
carriers
 MP3 is becoming a defacto standard for music
and will fundamentally alter the business model
for recording and distribution houses.
 MPEG2 is the standard for digital video and
will fundamentally alter the business model for
the film, video, television, cable and satellite
industries
 Telework, telelearning and telehealth will
become commonplace.
 CANARIE Inc
 Mission: To facilitate the development of Canada’s communications infrastructure and
stimulate next generation products, applications and services
 Canadian equivalent to Internet 2 and NGI
 private-sector led, not-for-profit consortium
 consortium formed 1993
 federal funding of $104.5 M (1993-99)
 total project costs estimated over $500 M
 currently over 140 members; 21 Board members
 Phase III funding to be announced 1998-2001
 $55 million announced for Optical Internet -March 1998
 CA*net 2 Network
CA*net II 2xOC3
GigaPOP
RAN

WURCnet MRnet
SRnet
DS3 OC12 ACORN
OC3 St. John’s
Calgary Regina
Winnipeg RISQ
BCnet Charlottetown
OC48 Fredericton
ONet
Montreal DS3
OC3
Vancouver Ottawa Halifax

OC12 - OC3 OC3 to Europe

T3 + OC3 to US Toronto
Windsor
 ARDNOC
 to provide traditional NOC as well as advanced network services
support to the CA*net II/3 user (R&E) community.
 to facilitate and coordinate development, testing and deployment
of next generation Internet networks, applications and services
between CA*net II users as well as international R&E users
 to explore, modify, test and deploy new services, tools, and
techniques that could be required in future commercial NOCs
 to document and disseminate knowledge
 The Year in Review
 13 GigaPOPs up and running
 over 30 universities and research institutes connected
 Over 20 Demos of advanced applications
 about half between Europe and North America
 Several “persistent” high performance applications e.g.
 NRC BioInformatics
 Callisto video server
 ARDNOC up and running with 8 staff
 Qbone about to start in 5 sites
 The Year in Review
 Still some problems with ATM switches and SVCs
 MBGP multicast now working
 Native IPv6 network up and running
 Hierarchical Cache now working with 5 GigaPOPs & 12
universities
 Stats & Measurements - Surveryor and OC3mon working
 Peering with 5 international next gen Internets - 12 more
expected next year
 Close collaboration with Internet 2, NSF and NGI
 CA*net 3 Objectives
 In partnership with industry, universities and research
community carry out R&D in optical Internet technologies,
services and applications
 To showcase different Canadian technologies, applications and
services - Cambrian, PMC Sierra, Newbridge, etc
 To facilitate a partnership between industry, carriers, RAN’s
and R&E community in order to accelerate the deployment of
next generation Internet products and services; and
 To catalyze the building of a sustainable virtual high
performance R&E network

1999 Program
Network to be fully deployed 1st quarter
 2 x OC-48 wavelengths with POS - 5 Gbps
 Layer 3 restoral & route diversity provided by CA*net 2 (IP over ATM) running in
parallel
 Fast restoral and explicit routing with MPLS
 Optical Internet Exchange - 3rd quarter
 Gigabit Ethernet over WDM in metro - 1st quarter
 10xGbE on additional wavelengths- 3rd quarter
 Cut through wavelengths - 4th quarter
 Use of both sides of fiber ring with layer 3 restoral - 4th quarter
 Several Schoolnet Caching Pilots underway - 2nd quarter
 High Speed Video Delivery - 3rd quarter
 Advanced route diversity - 1st qtr 2000
 CA*net 3 National Optical Network
CA*net 3
GigaPOP
RAN

WURCnet SRnet MRnet

OC3 DS3 OC12
BCnet ACORN
OC3 Calgary St. John’s
Regina
Winnipeg RISQ
ONet OC48
Charlottetown
OC12
Fredericton
Teleglobe
Vancouver Montreal

Ottawa Halifax
Seattle

STAR TAP
Toronto
Chicago
New York
 National IP/WDM Network

Edmonton

Possible 10xGbE over DWDM

Saskatoon

Winnipeg
Ottawa
Calgary Regina
Montreal Charlettown
Vancouver
St. John’s
Seattle
Fredericton Teleglobe
Toronto
Chicago Halifax
- CANARIE Drop Site
New York

16 Wavelengths per route CANARIE OC-192 Route

8 for CANARIE CANARIE OC-48 Route
8 reserved for traditional SONET 4/BLSR
by carrier
 Exciting Developments in 10xGbE
 Several companies have announced long haul 10xGbE CWDM with
transceivers at 50km spacing
 Costs are less than $12K US per node (or transceiver) for OC-192 data
rates
 Future versions will allow rate adaptive clocking for use with “gopher
bait” fiber, auto discovery, CPE self manage
 Excellent jitter specification
 Most network management and signaling done at IP layer
 Anybody with LAN experience can build a long haul WAN – all you
need is dark fiber
 Maybe the beginning of the end of managed bandwidth
 Interesting parallel with time share computing of the 60s & 70s
 Third Generation Router
 Terabit routing - 32 x OC 192 - “Tiny Tera”
 Juniper, Pluris, Nortel Avici, CISCO, Argonne, Ironbridge, Torrent, Nexabit,
Terabit Corp, Netcore
 5 Tiny Tera = all existing switch capacity in North America
 Routing on a chip with no caching
 wire speed routing with HPCC techniques
 BGP+, CBQ and MPLS Only
 “let it smoke” packets
 Integrated OADM with SONET path/link protection services and Fast IP
framing
 Advanced routing functions like multicast, interior routing be handled by
GigaPOP or CPE router
 National Film Board of Canada
VOD Project
 Joint project between NFB, CANARIE and RISQ
 800 documentary films on-line on CA*Net 2 and soon on
CA*Net 3.
 100 simultaneous connections
 Currently looking at:
 Creating an international VOD exchange site
 IP owners workshop
 MPEG2 version
 Integration the Canadian Broadcasting Corporation (CBC)
 Connectedness
 Canada has highest penetration of telephone and cable
 Highest ranking of G7 countries on technology potential
 World leader in optical networking technology
 Major government initiative on connecting all schools
 Major government initiative on community access
 World first high speed optical Internet backbone
 Connectedness seems to be a unique Canadian strength
 So, maybe our next grand challenge is…..
 Gigabit Internet to Every
Canadian School, Library &
eventually Home?
 Building on CA*net 3, a new research initiative in
partnership with industry, R&E, federal
government provinces to explore and develop the
technology that can be used deliver extreme high
speed Internet to every school and library in
Canada, and eventually to every home
 Why should we do this??
 Many school boards and provinces are deploying T1 and DSL
services to the schools
 But is this fast enough?
 Particularly if want to connect every class room
 And each class room is downloading their own video stream
 Soon we will need 10/100/1000 Mbps each school
 Schools and universities are in many ways early adopters of
information technology
 By leveraging our research in optical Internets this might enable
early deployment of high speed Internet to the school and then
eventually an architecture for high speed Internet to the home
 Promote Canadian Content
 One of the big costs of Internet delivery is not the network, but
buying Internet access from a US service provider
 But a Gigabit Network to every school could be used to
promote development of Canadian high speed multimedia
content
 Canadian content would be fast, immediate and exciting and
very low cost
 Foreign content would be slow and expensive
 Early examples of GITS
 Palo Alto has built a municipal owned regional network to
deliver 100 Mbps Internet to every home and school
 Cost $40 per month
 MFS has proposed building a new sewer system for Palo Alto
so it can pull fiber into the home
 Bell South has a 10/100 Mbps Internet service trial
 no telephone, no video - just the Internet
 Washington State is deploying Gigabit Ethernet to every school
 approx $100 month
 Sweden has deployed Gigabit Internet to major universities
 $3500 per month including Internet access
 Possible GITS program
 CANARIE, industry and government establish a research program to
investigate the technologies and develop a possible framework for
GITS
 Build on the lessons and technology that we are developing with
CA*net 3 and the regional optical Internets
 Many research issues in scalability, management, low cost DWDM,
layer 3 optical Internet services, IPv6, etc
 Leading to early field trials and pilots across Canada
 Actual deployment will be done by private sector
 Competitive equal access at all levels essential
 competition not technology that drives innovation and reduced pricing
 Possible GITS Concepts
 A third commercial network running in parallel to telephone
and cable
 Avoids regulatory and technical issues of 911, number
portability, etc
 Encourages SMEs and entrepreneurs to build the infrastructure
 Deliver high speed Internet only
 IP telephony and IP video maybe can be added at a later date
 Build on the infrastructure we are putting in place for CA*net
3 with optical RANs, GigaPOPs, etc
 Possible GITS Concepts
 Federal and Provincial government encourages deployment by
funding schools as first customer and early adopter
 But governments specify an architecture that guarantees
competitive access that can lead to deployment to every home
 Electric utility companies, municipal governments, CLECs,
and traditional telco and cableco can participate equally
 Preliminary Analysis
 Early Fiber to the Home was too expensive because it assumed
fiber from every home to a CO
 expensive terminal equipment required to provide voice and video
 but voice traffic is going wireless
 and broadcast is going by satellite
 GITS requires no CPE, only 10/100/1000 NIC card
 With low cost DWDM, PON, new architectures that feature
competitive equal access ...
 GITS may be marginally more expensive than xDSL or cable
modems
 and with 1000 times the bandwidth!!!
 Possible GITS Architecture
CA*net 3 GigaPOP Commercial Internet

ISP A ISPC

POS
ATM GigaBit Ethernet
OADM
OADM
OADM
Optical RAN ring
in partnership OADM
OADM
with cableco, OADM
OADM
telco, or CLEC
OADM

Local WDM Fiber Local WDM Fiber

OADM
Ring Provided by OADM Ring Provided by
OADM
Cable Company, Cable Company,
Telco or CLEC Telco or CLEC

OADM
OADM
Major University
 Gigabit to the Home
ISPC Internet Connection

ISPA Internet Connection

POM OADM

Multi carrier ring

Single carrier ring provided by competitive

OADM
with individual fibers access provider with
using POM separate wavelengths
or fiber assigned to
ISP B
each ISP

POM ISP C OADM

Competitive
Access ISP A
Routing POM
Pedestal Puck
ISP B

10 Base T
Copper
100 Base T 2 Fibers Pair 2 wavelengths

House Dual Homed

 Opportunity for Canada
 World leadership in optical Internet technologies
 PMC Sierra, QNX, Cambrian, Nortel, Newbridge, CISCO, etc
 Opportunity to quickly incorporate and act on lessons learned from
CA*net 3 and ORANs
 Opportunity to promote and encourage Canadian high bandwidth
multimedia content for schools and libraries
 Canada has the highest penetration and lowest cost first residential
network
 Canada was the first country to build the second residential network -
cable TV
 Canada can be the first country to build a “third” residential network -
high speed Internet- and continue to be the most connected nation in the
world