Professional Documents
Culture Documents
Energy Consumption in Optical IP Networks
Energy Consumption in Optical IP Networks
Abstract—As community concerns about global energy con- switching centers and especially data centers are becoming a
sumption grow, the power consumption of the Internet is becoming matter of increasing concern [2]. This raises the issue of whether
an issue of increasing importance. In this paper, we present a net- the Internet may ultimately be constrained not by the capacity
work-based model of power consumption in optical IP networks
and use this model to estimate the energy consumption of the
of optical and electronic technologies, but rather by their energy
Internet. The model includes the core, metro and edge, access and consumption [2]–[8].
video distribution networks, and takes into account energy con- In this paper, we present a new network-based model of the
sumption in switching and transmission equipment. We include power consumption in an optical IP network formulated using
a number of access technologies, including digital subscriber line data from major equipment vendors. The new model uses a sim-
with ADSL2+, fiber to the home using passive optical networks, ilar methodology to our previous work on this topic [4]–[6], but
fiber to the node combined with very high-speed digital subscriber
line and point-to-point optical systems. In addition to estimating includes a higher level of detail in the network model and in-
the power consumption of today’s Internet, we make predictions corporates a model of improvements in equipment energy effi-
of power consumption in a future higher capacity Internet using ciency over time. Our model includes the network infrastructure
estimates of improvements in efficiency in coming generations required to service increasing per customer traffic volumes, in-
of network equipment. We estimate that the Internet currently cluding core, metro, and access networks, and takes account of
consumes about 0.4% of electricity consumption in broadband-en-
abled countries. While the energy efficiency of network equipment
energy consumption in switching and transmission equipment.
will improve, and savings can be made by employing optical by- A video distribution network (VDN) that provides Internet Pro-
pass and multicast, the power consumption of the Internet could tocol Television (IPTV) services, such as multicast video and
approach 1% of electricity consumption as access rates increase. video on demand (VOD), is included in the model. In the access
The energy consumption per bit of data on the Internet is around network, we consider established digital subscriber line (DSL)
75 J at low access rates and decreases to around 2–4 J at an technologies, as well as a number of competing high-speed tech-
access rate of 100 Mb/s.
nologies including passive optical networks (PON), fiber to the
Index Terms—Access networks, Internet power consumption, IP node (FTTN), and point-to-point (PtP) optical systems.
routers, optical bypass.
In order to gauge the energy consumption of an IP network,
we calculate the network power consumption as a function of
I. INTRODUCTION the access rate to customers. To calculate the power consump-
tion for a given access rate, we have carried out a “paper de-
Fig. 1. Schematic of a network structure with access network options including an asymmetric digital subscriber line (ADSL), a passive optical network (PON),
fiber to the node (FTTN) and point-to-point optical (PtP). The public Internet includes all equipment in the metro edge and core networks except the edge Ethernet
switch. A is the total per customer capacity, A the per customer capacity in the public Internet, and A the per customer capacity in the VDN.
summary of methods that may be used to mitigate the increase In the following, we describe the elements in Fig. 1 in greater
in energy consumption. detail.
We have deliberately modeled a minimalist network, based on
a national-scale operator. We have not included the internetwork A. Access Network
gateways used when multiple service providers share network
facilities. In addition, it must be noted that any future network The access network connects each home to one of the edge
will inevitably incorporate a large amount of legacy network switches in the provider’s network. There are several different
equipment, such as IP over asynchronous transfer mode (ATM) technologies in use today, and more are in development [10].
over synchronous digital hierarchy (SDH) over wavelength di- Shown in Fig. 1 is the commonly used DSL and three promising
vision multiplexed (WDM) fiber. Such overlays in legacy net- candidates for future high access rates PON, FTTN, and PtP
works often result in large power inefficiencies because of the optical systems.
need for electronic processing to interface between the network With ADSL, copper pairs, originally installed to deliver a
layers. This paper therefore provides a conservative (i.e., under) fixed-line telephone service, are used to also deliver a broad-
estimate of the energy consumption. band service [10]. The telephone service, which uses the band
below 3.4 kHz, is left in place, and the higher frequency band is
II. NETWORK STRUCTURE used for high-speed broadband services.
A traditional IP network, as used by Internet service providers Copper pair-based access technologies, such as ADSL, are
(ISPs), can logically be split into three main domains—the ac- limited in capacity by usable bandwidth and reach, so many
cess network, the metropolitan and edge network, and the net- ISPs have begun installing fiber-based technologies. Fiber to the
work core, as shown in a simplified form in the top part of Fig. 1. premises installations most commonly use a passive shared op-
As service providers move to offer IPTV services, additional in- tical network (PON), in which a single fiber from the network
frastructure to deliver video program content to the access node node feeds one or more clusters of customers through a pas-
will be needed, and one method to achieve this is a VDN as sive splitter [10]. An access concentrator or optical line terminal
depicted in Fig. 1. The public Internet commonly refers to the (OLT) is located at the local exchange, and serves a number of
switching, routing and transport equipment in the metro, edge access modems or ONUs located at each customer premises.
and core networks. In our paper, we share the edge Ethernet Each customer ONU in a cluster connects via a fiber to the
switch between the “public Internet” and the VDN. In this sec- splitter, and from there shares the same fiber connection to the
tion, we outline technologies commonly used in high-capacity OLT. ONUs communicate with the OLT in a time multiplexed
IP-based networks and the network models for which we de- order, with the OLT assigning time slots to each ONU based on
velop power consumption metrics. its relative demand.
The architecture in Fig. 1 represents a minimal network con- In areas where customers are already served by good-quality
figuration for a single network provider having dedicated infra- copper pairs, a hybrid FTTN technology may be used [10]. Ded-
structure at each of the core, metro, and access domains, and a icated fiber is provided from a network switch to a DSL access
video delivery network. Smaller regional service providers may multiplexer (DSLAM) in a street cabinet close to a cluster of
operate infrastructure at the access and the metro domains, then customers, and high-speed copper pair cable technologies such
peer with other regional operators or large network operators be- as very high-speed digital subscriber line (VDSL) are used for
fore connecting to the core network domain. This entails addi- the final feed to the customer premises.
tional gateway and peering routers which we have not included As demand for services and the resulting traffic per customer
in this analysis, and as pointed out above, the results reported grows, PON and FTTN architectures can be enhanced through
here are thus somewhat conservative (i.e., under estimate). the use of additional wavelength channels (WDM) [11].
BALIGA et al.: ENERGY CONSUMPTION IN OPTICAL IP NETWORKS 2393
The highest access speed network today would employ a ded- would in any case perform at its own server. The power con-
icated fiber between the customer premises and the network ac- sumption of these servers and authentication systems are not in-
cess node in a PtP optical network [10]. The customer premises cluded in our model. The VDN has a tree structure, unlike the
would employ an optical media converter (OMC) to convert the meshed structure of the core network, with the server at the root
electrical signal used inside the home to an optical signal. of the tree and links to the edge Ethernet switch at the ends of
For each of these technologies, the terminal unit (DSLAM for the branches [12]. The VDN has redundant routers and links
ADSL, OLT for PON and FTTN, and the Ethernet switch for PtP that are not shown in Fig. 1 for simplicity, but are included in
in Fig. 1) commonly takes the form of a switch, with line cards our model.
appropriate to the access technology (PON, FTTN, PtP) facing
the subscriber. The switch has parallel backhaul links to the D. Core Network
metro and edge network and facilitates concentration of traffic. The core network comprises a small number of large routers
This concentration/aggregation of traffic reduces demands in the in major population centers. These core routers perform all the
core, VDN, metro and edge networks. necessary routing and also serve as the gateway to neighboring
The total per customer capacity of the network , is shown core nodes. The core routers of any one network are often highly
in Fig. 1. The per customer capacity is the total number of meshed, but have only a few links to the networks of other
downstream bits, measured at the network side of the terminal providers. High-capacity WDM fiber links interconnect these
unit, divided by the number of customers connected to that ter- routers and connect to networks of other operators. Typically,
minal unit. can be smaller than the average bit rate seen by a the WDM links in today’s network comprise 10 Gb/s Packet
customer if there is multicasting, because some downstream bits over SONET (PoS), SDH, or 10 Gb/s Ethernet, or for longhaul
are being shared by customers. Note that we define a “customer” links 40 Gb/s PoS or SDH.
as one household. In this paper, we use the terms “customer”,
“subscriber,” and “home” interchangeably. is given by
III. NETWORK MODEL
To calculate the power consumed by the entire network, we
(1) model all parts of the network in Fig. 1 using data representative
of commercial equipment. The equipment used in our model is
where and are the per customer capacities in the public representative of the equipment for which manufacturers openly
Internet and VDN, respectively. is the multicast video publish power consumption data. The stated capacity of equip-
traffic. The significance of (1) is described in a greater detail ment in this paper is the full-duplex capacity.
in Section III-B.
A. Access Network
B. Metro and Edge Network
In this section, we describe the equipment used in our model
The metro and edge network serves as the interface between of the access network.
the access network and the core network. The metro and edge 1) Asymmetric digital subscriber line: Typical consumer
network includes edge Ethernet switches, broadband network DSL services are ADSL services with download speeds higher
gateway (BNG) or broadband remote access server (BRAS) than upload speeds. One of the most common DSL tech-
routers, and provider edge routers. Edge Ethernet switches nologies currently in operation is ADSL2+, which provides
concentrate traffic from a large number of access nodes and theoretical maximum speeds of 24 Mb/s downstream and
uplink to two or more BNG or BRAS routers. The edge switch 1 Mb/s upstream. In our model, the DSLAM is an Alcatel
connects to two or more BNG or BRAS routers to provide Stinger FS+ DSL Access Concentrator [13] and each customer
redundancy. The BNG or BRAS routers perform access rate uses a D-Link DSL-502T modem [14]. Dedicated copper pairs
control, authentication, and security services, and connect are used to connect each customer modem to the DSLAM at
to multiple provider edge routers to increase reliability. The the local exchange.
provider edge routers connect to the core of the network. 2) Passive optical network: The capacity available per cus-
tomer in PON networks is determined by backhaul capacity,
C. Video Distribution Network ONU access rates, and the number of ONUs that share a connec-
The performance requirements for an IPTV multicast and tion to an OLT. The number of customers that share a connection
video-on-demand (VOD) service are markedly different to those to an OLT is generally 32 or 64 [15]. In our model, we consider a
of a traditional Internet service, especially in terms of allowable G-PON access network, providing asymmetric 2.4 Gb/s down-
packet delay variation and packet loss [12]. This traffic could be stream and 1.2 Gb/s upstream from the ONU to the OLT. The
carried over the same physical metropolitan and core networks particular equipment from which specifications were taken for
above, in reserved streams configured to provide quality of ser- the model are the Wave7 ONT-G1000i ONU [16] and the Hi-
vice (QoS) guarantees, but is generally transported over a ded- tachi 1220 OLT [15].
icated network and combined with “best effort” Internet traffic 3) Fiber to the node: In an FTTN network using VDSL,
at the edge Ethernet switch [12]. As shown in Fig. 1, the VDN each remote node houses a VDSL DSLAM which communi-
bypasses the BRAS or BNG routers and so frees them from the cates with several homes through the copper wire and connects
workload involved in authenticating, accounting, and manage- back to the OLT through an ONU. The equipment used in the
ment functions. These are functions that the content provider model is an NEC AM3160 multiservice access platform [17] at
2394 JOURNAL OF LIGHTWAVE TECHNOLOGY, VOL. 27, NO. 13, JULY 1, 2009
the remote node and an NEC VF200F6 VDSL modem [18] at each individual channel to each network edge, and replicate
each home. that copy at the edge node for delivery to those customers
4) PtP optical access network: In our model of a PtP net- requesting that channel. This process is known as multicasting.
work, a Cisco 4503 Ethernet switch provides a gigabit Ethernet Although multicasting places added demands on the edge
link to up to 116 homes [19]. Each home uses a TC Commu- switches, it reduces metropolitan, core, and VDN traffic. In our
nications TC3300 optical media converter [20] to convert the model, is multicast video traffic on the final link to the
electrical signal used in the home network to an optical signal customer and is given by
for transmission over fiber.
(3)
B. Oversubscription
Most data traffic is bursty in nature, and traffic from common where in PON, FTTN, and PtP, is the number of backhaul
Internet applications today (e.g., web browsing, email) is es- links from the terminal unit (OLT for PON and FTTN, and Eth-
pecially so. Customers are often offline, and when active com- ernet switch for PtP in Fig. 1) to the metro and edge network
monly send or receive brief bursts of data interspersed with pe- to carry multicast video services. As we will see, the per cus-
riods of reading. Network operators take advantage of the vari- tomer capacity required in the VDN to support multicast traffic
ations in traffic from individual customers by statistically mul- is negligibly small. is the number of customers sharing a
tiplexing the traffic flows from a large number of customers. terminal unit and is fully defined in Section IV-A.
Packets of data from individual customers are initially buffered, VOD and other premium IP services can also be provided
then delivered through the transport network at a time deter- through the VDN, but these services are not suitable for mul-
mined by the availability of network capacity and the relative ticast. Demand for these services may be restricted in order to
priority of the packet in relation to other packets awaiting trans- match the capacity available by means of session admission con-
port. In periods of network congestion, the capacity available trol. Examples of premium IP services include voice and other
to each customer is reduced, and traffic flows are moderated services with a guaranteed level of QoS. In our model, (see
through selective dropping of packets. Fig. 1) is the per customer guaranteed capacity into the OLT re-
In this paper, we characterize the capacity available to each served for VOD and premium IP services. We note that when
customer by the peak access rate. The peak access rate is the ac- choosing , a network provider will generally assume that
cess rate advertised and sold to customers by the ISP. However, only a small percentage of customers will access VOD and/or
backhaul and core networks are dimensioned by network oper- premium IP services simultaneously.
ators to provide a lower worst case minimum transmission rate
to every customer. The ratio of the advertised peak access rate C. Metro and Edge Network
to this minimum rate is referred to as the oversubscription rate. On the network side, the access network terminal units are
As IP networks are increasingly used for large file transfers, and typically connected by Gigabit Ethernet (GE) lines to an edge
for streaming services such as conferencing, IP telephony, and Ethernet switch. The number of DSLAMs (ADSL), OLTs (PON
ad hoc IP video, traffic demand is becoming both much greater and FTTN), and small Ethernet switches (PtP) that are supported
and relatively more constant. As a consequence, there will be by the edge Ethernet switch depends on the details of the ac-
increased pressure in the future for network operators to reduce cess technologies, access rates, and the oversubscription rate.
the oversubscription rate. We have modeled each access network such that the edge Eth-
We model the network in terms of a peak access rate of ernet switch is filled to capacity. The edge Ethernet switch used
Mb/s per customer and an oversubscription rate for public in our model is the Cisco Catalyst 6513 switch [19]. The Eth-
Internet traffic. During the busiest period of the day, the min- ernet switch uplinks to two or more BNG routers, which perform
imum capacity available to a customer from the public Internet traffic management and authentication. The minimum of two
is (see Fig. 1), given by uplinks is for redundancy, and in this model we include redun-
dancy for all network elements on the network side of the edge
(2) Ethernet switch. In our model, we use the Cisco 10008 router as
our BNG router [19]. Each Cisco 10008 router has eight 1 Gb/s
where is the oversubscription rate. In the model, we assume connections to Ethernet switches and eight 1 Gb/s connections
all statistical multiplexing gain occurs at the DSLAM in ADSL, to provider edge routers.
at the OLT in PON and FTTN, and at the small Ethernet switch The provider edge routers groom and encapsulate the IP
in the case of PtP. The network traffic from the access network packets into a SONET/SDH format for transmission to the
entering the metropolitan network is assumed to be smooth and network core [19], [21]. The provider edge router functions
at near capacity, with little to no fluctuation that would enable as a label edge router in a multiprotocol label switching
further statistical multiplexing gains. (MPLS)-enabled core network, setting up label switched paths
In an oversubscribed network, variations in packet delay and attaching MPLS headers to IP packets. As we are modeling
(jitter) and packet loss events arise, and these present problems a high-growth and high-capacity scenario, we use the large
for real-time services such as IPTV. Hence operators com- Cisco 12816 [19] as a provider edge router. This device is
monly provide a dedicated VDN, or dedicated capacity in their typical of large routers available from other manufacturers.
metropolitan and core networks for those services. In the case Each provider edge router connects to the core network via up
of IPTV, the operator need only transport a single stream of to 14 10 Gb/s packet-over-SONET (PoS) links, and to 20 BNGs
BALIGA et al.: ENERGY CONSUMPTION IN OPTICAL IP NETWORKS 2395
each via 8 1 Gb/s links. We do not consider architectures clude improvements in power consumption of the Internet by
where provider edge routers interconnect directly, but assume incorporating estimates of future efficiency gains.
that all routing is handled by the network core routers. Using an exponential model of efficiency improvement, if a
state-of-the-art router or switch has capacity and has power
D. Video Distribution Network consumption , then in years a state-of-the-art router will
The VDN transports video and other premium service traffic have a capacity and power consumption given by
from the content servers to the metro and edge network. The
VDN includes a number of QoS-enabled routers. In this anal-
ysis, we have employed the Cisco 7613 router [19] as represen- (4)
tative of this class of router. As noted earlier, the VDN connects
directly to Ethernet switches in the metro network, and its traffic where is the annual rate of improvement of state-of-the-art
does not pass through the BNG or BRAS routers. The VDN in- technology. In [7], Neilson found that over the past ten years
stead uses its own per stream, rather than per customer, authen- a 2 increase in throughput of the state-of-the-art equipment
tication systems. has been accompanied by a 1.4 increase in power. In addition,
Our model includes the routing and transport components of router capacity per rack has increased by 1.56 per year. Com-
the VDN and does not include the authentication servers or con- bining these two trends, Neilson concluded that state-of-the-art
tent servers which are more typical of data center infrastructure. router efficiency is improving by 20% per annum. This corre-
Transport through the VDN is performed using 10 Gb/s PoS or sponds to a technology improvement rate in (4).
SDH links to achieve high reliability. Routers at the edge of the To achieve a technology improvement rate of 20% per annum
VDN connect to the edge Ethernet switches via 10 Gb/s Ethernet across the whole network would require the network operator
links and to other VDN routers via 12 10 Gb/s PoS links. to regularly replace all of its network equipment with state-of-
the-art equipment. In practice, most equipment will remain in
E. Core Network service for a number of years. Therefore, the overall technology
In today’s network, routing is performed by large core routers improvement factor across the network will be somewhat less
[19], [21]. An example of a core router is the Cisco CRS-1 [19]. than the 20% figure for the new equipment added each year.
The core routers are interconnected through 40 Gb/s PoS links Our objective in this paper is to calculate power consumption
and connect to the edge routers through 10 Gb/s PoS links. The as a function of the capacity required to support a given access
number of links required to interconnect the routers depends rate. To include estimates of efficiency improvements we must
entirely on the composition of the traffic. relate the peak access rate to router efficiency. It is widely
Currently, most IP packets transit multiple core routers and acknowledged that Internet traffic is growing exponentially and
are fully processed by the routers in each intermediate node. that this trend will continue. The relation between the current
This significantly increases the energy consumed in transporting access rate and the future access rate after years is
that packet from source to destination. However, increasingly
bypass is being used at the SONET/SDH layer or the optical (5)
transport layer as a means to reduce the need for such processing
at the intermediate routers [22]. Both avoid the processing as- A recent Cisco white paper [24] predicts that consumer public
sociated with IP routing, including switching, buffering, and IP Internet traffic will grow at 42% per year (double every two
table lookup at every node. Optical bypass allows the packet to years). This corresponds to in (5).
remain in the optical domain and thus avoid O-E-O conversions The trends in router capacity and energy efficiency are
and associated overheads [5]. In our model, we determine en- mapped over time in Fig. 2. The figure shows (on the left
ergy consumption as a function of the average number of core vertical axis) the peak access rate against time for oversub-
router hops taken by packets. This is compared against scenarios scription rates and , and a per-year traffic
where optical add/drop multiplexers and all-optical crosscon- growth rate of 42%, i.e., . This curve is based on a
nects implement optical bypass of intermediate routers thereby 2008 per customer public Internet capacity kb/s, cor-
reducing the number of core router hops. responding to a peak access rate Mb/s and
Mb/s for oversubscription rates of 10 and 25, respectively.
F. Equipment Efficiency and Capacity We assume a current per customer public Internet capacity
Today’s high-end routers such as the Cisco CRS-1 and the Ju- kb/s because the highest speed networks currently
niper T1600 provide throughputs of around 1 Tb/s and consume deployed deliver at most 100 kb/s per customer capacity
approximately 10 kW of power. This corresponds to an energy to residential customers. We note that the important parameter
consumption of about 10 nJ per bit of data. It is reasonable to ex- is the per customer public Internet capacity and not the
pect that the efficiency of future generations of router will show oversubscription rate . The per customer Internet capacity
improvements over this figure, largely due to improvements in determines the size and power consumption of the Internet.
CMOS technology. In recent years, there have been exponential The oversubscription rate simply translates the per customer
improvements in efficiency of routers and switches [7], [23]. capacity to the peak access rate, which is the access rate adver-
Our previous estimates of power consumption in the Internet tised/sold to customers.
[4]–[6], [8] did not include estimates of increased efficiency in The right vertical axis in Fig. 2 is the energy consumption
future generations of routers and switches. In this paper, we in- per bit of a core router against time for technology
2396 JOURNAL OF LIGHTWAVE TECHNOLOGY, VOL. 27, NO. 13, JULY 1, 2009
the maximum power values, which in turn are often the rated
power of the power supplies. To handle this uncertainty in the
data, where possible, we use the heat dissipation of the given
network equipment to estimate the power consumption. To cal-
culate cooling requirements, we assume that for every watt of
power consumed in metro and core networks, another watt of
power is required for cooling [25].
(8)
TABLE I
VALUES OF ACCESS NETWORK PARAMETERS USED IN SECTIONS IV-A AND V-A
where the first term is due to the limit of port capacity, and the from the VDN where it is replicated to the terminal units that re-
second term is due to the limit of switching capacity. quest that channel. This results in over 20 000 customers sharing
Gb/s of capacity from the edge Ethernet switch to the
B. Power Consumption of the Metro and Edge Network VDN. The per customer capacity from the edge Ethernet switch
The per customer power consumption of the metro network to the VDN required to support multicast is therefore negligibly
can be expressed as small.
2) Gateway routers: The Cisco 10008 gateway router con-
(10) sumes 1.1 kW and has a capacity to support 8 Gb/s [19].
3) Provider edge routers: A Cisco 12816 router consumes
where is the per customer power consumption of the edge 4.21 kW and in the configuration used in our model has a ca-
Ethernet switches, while and are the total pacity of 160 Gb/s [19].
power consumption of a gateway router and provider edge
C. Power Consumption of the Video Distribution Network
router, respectively. The parameters and
are the capacities of the gateway routers and provider edge It will be recalled that multicasting in the VDN markedly
routers, respectively. In the following paragraphs, we give reduces the traffic volumes in the network for multicast mate-
estimated values for these parameters. The first factor of 2 is rial. Our model thus does not include the power consumption to
to include the requirements for cooling. The second factor of 2 transport multicast traffic through the VDN as the per customer
is to include the requirements for redundancy upstream of the power consumption of this transport is negligibly small.
Ethernet switch. A Cisco 7613 router consumes 4.6 kW and serves a capacity
1) Ethernet switches: The number of Ethernet switches is of 120 Gb/s [19]. If we assume that traffic through the VDN
determined by the number of ports required, which is in turn takes two hops, the per customer power consumption of the
determined by the number of OLTs or small Ethernet switches. VDN to support VOD and premium IP services, , is given
As the access rate increases, the number of OLTs or Ethernet by
switches required increases. A Cisco Catalyst 6513 switch has
384 GE ports, a switching capacity of 720 Gb/s and consumes (12)
3.21 kW [19]. The per customer power consumption of the Eth-
ernet switches is given by where the factor of 4 accounts for the power requirements for
cooling and redundancy. The factor of 3 is included because
(11) three routers are transited for two hops.
where the first term in the numerator represents the number of D. Power Consumption of the Core Network
GE ports used by a single terminal unit. The second and third A single-rack Cisco CRS-1 core router consumes approx-
terms in the numerator represent the number of ports taken to imately 10.9 kW and has a full-duplex switching capacity of
connect customers connected to that terminal unit to the VDN 640 Gb/s [19]. As the interconnection structure of the core
and public Internet, respectively. The numerator is normalized routers is highly dependent on the nature of the traffic, we
by the number of customers per terminal unit and multiplied estimate the total power consumed by the core network by con-
by the power consumption of the Ethernet switch, giving us the sidering the total switching capacity required and the average
power per customer. The factor of 2 is to include the require- number of routers through which traffic is required to pass.
ments for redundancy upstream of the Ethernet switch. As be- In today’s Internet, packets traverse an average of 12–14 hops
fore, is the number of backhaul links from the terminal unit between source and destination [27]. Most Internet traffic is
to the edge Ethernet switch to support multicast video services from the customer premises to a web server, which is often
(see Section III-B). For multicast video, at most one copy of connected directly to the network core. In our model, customer
a channel is sent to each terminal unit, where it is replicated traffic must traverse three hops to reach the network core so we
to the customers that request that particular channel. Similarly, assume an average 10 core hops, giving us an average of 13 hops
only one copy of a channel is sent to the edge Ethernet switch in total. Peer-to-peer traffic may traverse fewer than 10 core
2398 JOURNAL OF LIGHTWAVE TECHNOLOGY, VOL. 27, NO. 13, JULY 1, 2009
routers but will traverse a greater number of metro and edge 1 A of dc is used to power the repeaters [31]. A repeater is re-
routers. Our results remain conservative (i.e., under estimate) quired every 50 km and each repeater consumes 40 W [31]. The
because these metro and edge routers are in general smaller and terminal systems used are similar to those used in terrestrial
less efficient than core routers. WDM systems, but do include special transponders and con-
The per customer power consumed by the core node is sume 9 kW per cable [29], [31]. Assuming 80% efficiency in
the power feeder equipment and a transpacific link of 8 000 km,
(13) the per customer power consumed by the undersea WDM sys-
tems is given by
where denotes the number of core node hops. The factor of
8 at the front is required firstly because core routers are usu- (15)
ally provisioned for future growth of double the current peak
demand [28], secondly to account for the power requirements where the factor of 4 includes a factor of 2 for redundancy and
for cooling and finally a factor of 2 for redundancy. a further factor of 2 because undersea WDM systems are gener-
ally provisioned for future growth of double the current demand.
E. Transport Systems The figure of 280 W is the cumulative power per channel. The
Edge and core routers can be provisioned with interfaces power required to cool the power feeder equipment and terminal
suitable for operation on a dedicated fiber over city-scale systems has been included. From (14) and (15), it is clear that the
distances up to approximately 80 km. Longer links between increased length of undersea systems results in approximately
metro edge router sites and core router sites, and intercity 4–5 times more power usage than in core terrestrial systems. In
links more commonly employ WDM transport systems. These our analysis, we will assume that 20% of traffic uses undersea
provide very long system spans, but require optical signals systems .
to be generated by high-performance modulators on specific
wavelengths. A network operator may elect to provision routers V. RESULTS
with short-reach optical interfaces and WDM transport systems We use the above model to calculate the total per customer
with optical transponders to deliver the higher signal quality power consumption of the Internet for peak access rates from
required for longhaul systems, or may elect to provision routers 1 Mb/s to 400 Mb/s. We also use the model to determine the
with more costly, but higher performance interfaces that are proportion of the total power that is used in each part of the
directly compatible with the WDM transport system. The latter network and analyze some of the network architecture choices
option is more energy efficient, and has been assumed for this that affect power consumption.
model. The terrestrial WDM line terminal in this case provides
mainly optical functions of channel power matching, ampli- A. Power Consumption of Access Networks
fication, and dispersion compensation. We model terrestrial Table I shows the per customer backhaul capacity (maximum
links from edge routers to core routers, and both terrestrial and ) and per customer power consumption of each access net-
undersea links between core routers. work. The power consumption of each access network is de-
1) Terrestrial WDM systems: The Fujitsu Flashwave 7700 pendent on the equipment used and its capacity. Per customer
WDM terminal systems consume 811 W for every 44 channels capacity can be increased by increasing backhaul capacity and
[29], with each channel operating at 40 Gb/s. If the distance be- switching capacity, or reducing the number of customers that
tween the two terminal systems is greater than 100 km, an in- share the terminal unit (DSLAM for ADSL, OLT for PON and
termediate line amplifier is required and consumes 622 W for FTTN, and Ethernet switch for PtP in Fig. 1). However, in-
every 44 channels [29]. In this model, the average distance be- creasing per customer capacity will result in increased power
tween terrestrially connected core routers is 1 500 km and so
consumption. The per customer backhaul capacity can in theory
14 intermediate line amplifiers and two terminal system are re-
be increased up to the technology limit of the access technology.
quired for every 44 channels. The per customer power consumed
We again note that the average data rate seen by the customer
by the core terrestrial WDM links is given by
can be greater than the maximum and this occurs when mul-
(14) ticasting is performed at the terminal unit. In a network with
multicasting, multiple customers are using/sharing some of the
where is the average number of core hops, and is the pro- bits.
portion of traffic going to neighboring nodes through undersea Table I also shows the energy consumption per bit for each
WDM systems. The figure of 235 W is the cumulative power access network when it is operating at full capacity. Operating
per channel. The factor of 4 at the front accounts for the power an access network below its full capacity results in increased
requirements for cooling and redundancy. In addition, we halve energy per bit consumption. The most energy efficient of the
the number of hops because many of the core hops are intra-of- access networks we considered is PON for low access rates and
fice and so WDM transport is not used. Edge routers are pre- PtP for very high access rates. ADSL2+ is efficient at low access
sumed to be located within 80 km of a core router and so do not rates, but is only capable of peak access rates of 10–20 Mb/s
require WDM transponder systems. over distances below 2 km. PON has a reach of 20 km and has a
2) Undersea WDM systems: Current undersea cables sup- peak access rate of 2.4 Gb/s that is independent of the distance.
port 64 wavelengths at 10 Gb/s using four fiber pairs [30]. The A network using an FTTN access network consumes 1.5 times
cable power feed has a resistance of 1 /km, and approximately the power of a network using a PON access due to the extra
BALIGA et al.: ENERGY CONSUMPTION IN OPTICAL IP NETWORKS 2399
H :
Fig. 8. Power consumption of the network with 0.5 core hops ( = 0 5) in-
Fig. 7. Power consumption of a network with video distribution performed via cluding VDN, public Internet, PON access network, and total power consump-
the public Internet. Includes power consumption of public Internet, access net- tion. Optical bypass has reduced the number of core hops to 0.5. Also shown
for comparison is the total power consumption of a network with 10 core hops
work, and total power consumption. Also included is the total power consump-
tion of a network where video is distributed through a VDN. (H = 10).
to these few centrally located buildings and dissipating the re- in the optical domain and thus avoid transiting through the IP
sultant heat will be a formidable engineering challenge [2]. router. Thus, where traffic can be groomed into streams that do
not require routing at particular intermediate sites, it is possible
E. Video Distribution Via the Public Internet for those streams to bypass those routers and reduce energy
We now consider an alternative scenario where video distri- consumption. As an example, a 128 128 Calient optical
bution is performed through the public Internet, for example, crossconnect consumes under 100 W [35]. At 40 Gb/s per
on a managed peering basis, rather than a dedicated VDN. With port, this corresponds to 5.12 Tb/s of capacity and therefore
this network structure, customers are free to access video from consumes almost two orders of magnitude less energy per bit
a large range of sites rather than be restricted to video program- than a large core router of equivalent capacity.
ming available from their service provider. We assume SD video A lower bound for the total network power consumption can
usage, with a per customer rate of 2 Mb/s for video. The per cus- be found by reducing the number of hops in the model to 0.5
tomer public Internet capacity rises to Mb/s. core network hops, and is shown in Fig. 8 for a network with a
The per customer rate for video is added to the public Internet PON access network. The figure of 0.5 core network hops cor-
rate because a household may use the Internet and watch videos responds to 50% of the traffic in a core router being directed
simultaneously. The total per customer capacity be- to or from its dependent edge routers, and 50% directed to or
cause there is no VDN . Fig. 7 shows the per cus- from a peer core router. The internal traffic thus uses zero core
tomer power consumption of the network versus peak access hops, while the other 50% traverses just one core hop to a peer
rate when video is distributed via the public Internet. Also in- router. This lower bound thus represents an extensive use of op-
cluded in Fig. 7 is the power consumption of the network when tical bypass to create a virtual fully-meshed network and results
video is distributed via a VDN. At low access rates, a network in a dramatic reduction in the power consumed in the network
that distributes video content through the public Internet con- with high access rates. At high access rates there is a 70% re-
sumes 50% more power than a network that distributes video duction in the power consumption of the public Internet and a
content through a dedicated VDN. The increase in power con- corresponding 30% reduction in total power consumption by the
sumption is due to the increased capacity required in the metro, extensive use of optical bypass.
edge and core networks. The counterintuitive dip in power con-
sumption at peak access rates from 2.5 Mb/s to 17 Mb/s arises B. Optical Packet and Burst Switching
from the assumption that the video bit rate remains constant over A number of authors have suggested that optical packet
time but router efficiency improves as peak access rates increase switching [36] and optical burst switching [37] may provide
over time. an attractive alternative to electronic routers. It is beyond the
scope of this paper to explore this question in detail. However,
VI. MANAGEMENT OF POWER CONSUMPTION IN we note that to compete with high-capacity electronic routers,
THE NETWORK optical packet and burst switches will need to consume less en-
ergy than existing and future generations of electronic routers.
A. Optical Bypass As pointed out earlier, today’s high-end routers consume about
Optical bypass can be used to reduce the number of hops in 10 nJ per bit of data. To compete with future generations of
the network and thus the capacity requirements of core routers electronic routers, optical packet and burst switches will need
[22], [34]. All-optical crossconnects or reconfigurable optical to consume less than about 1 nJ per bit [38]. This could prove
add-drop multiplexers (ROADMs) route whole wavelengths to be a considerable challenge [39].
2402 JOURNAL OF LIGHTWAVE TECHNOLOGY, VOL. 27, NO. 13, JULY 1, 2009
VII. CONCLUSION [6] J. Baliga, R. Ayre, W. V. Sorin, K. Hinton, and R. S. Tucker, “Energy
consumption in access networks,” in Proc. Opt. Fiber Commun./Nat.
We have presented a network-based model of the power con- Fiber Opt. Eng. Conf. (OFC)/(NFOEC), San Diego, CA, Feb. 2008
[Online]. Available: http://ieeexplore.ieee.org/xpl/freeabs_all.jsp? ar-
sumption in optical IP networks. We estimate the energy con- number=4519173
sumption of ADSL, PON, FTTN, and PtP access networks as [7] D. T. Neilson, “Photonics for switching and routing,” IEEE J. Sel.
well as the metro, edge, core and video distribution networks. Topics Quantum Electron., vol. 12, no. 4, pp. 669–678, Jul./Aug. 2006.
[8] R. S. Tucker, R. Pathiban, J. Baliga, K. Hinton, R. W. Ayre, and W. V.
We estimate the power consumption of the Internet to be about
Sorin, “Evolution of WDM optical IP networks: A cost and energy per-
0.4% of electricity consumption in broadband-enabled coun- spective,” J. Lightw. Technol., vol. 27, no. 3, pp. 243–252, Feb. 2009.
tries and forecast that this could approach 1% as access rates in- [9] M. Webb, “Smart 2020: Enabling the Low Carbon Economy in the
crease. The energy consumption per bit of data on the Internet is Information Age,”. London, U.K., 2008.
[10] P. Chanclou, S. Gosselin, J. F. Palacios, V. L. Alvarez, and E.
around 75 J at low access rates and decreases to around 2–4 J Zouganeli, “Overview of the optical broadband access evolution:
at access rates above 100 Mb/s. A joint article by operators in the 1ST network of excellence
The power consumption of the Internet in the short to medium e-photon/one,” IEEE Commun. Mag., vol. 44, no. 8, pp. 29–35, Aug.
term future will be dominated by the customer premises equip- 2006.
[11] S. S. Wagner and H. L. Lemberg, “Technology and system issues for
ment and this should be an area of design attention. An auto- the WDM-based fiber looparchitecture,” J. Lightw. Technol., vol. 7, pp.
mated sleep mode in parts of the ONU/modems is one method 1759–1768, Nov. 1989.
to significantly reduce this power consumption. The combined [12] K. K. Ramakrishnan and R. D. Doverspike, “IPTV challenges,” in Proc.
Opt. Fiber Commun./Nat. Fiber Opt. Eng. Conf. (OFC)/(NFOEC), San
power consumption of the switching and routing equipment in Diego, CA, Feb. 2008, pp. 1–33.
the Internet will grow as a percentage of total power consump- [13] Alcatel-Lucent Data Sheets, [Online]. Available: http://www.alcatel-
tion as access rates increase. A key parameter that will effect lucent.com
growth of energy consumption of the network is the rate at [14] D-Link Data Sheets, [Online]. Available: http://www.dlink.com.au
[15] Hitachi Data Sheets, [Online]. Available: http://www.hitachi.com
which the energy efficiency of the network equipment in the in- [16] Wave7 Data Sheets, [Online]. Available: http://www.wave7optics.com
frastructure improves with successive generations of new tech- [17] NEC Australia Data Sheets, [Online]. Available: http://www.nec.
nology. The overall energy efficiency of the network will de- com.au
[18] NEC Japan Data Sheets, [Online]. Available: http://www.nec.co.jp
pend on how rapidly network operators choose to replace older
[19] Cisco Data Sheets, [Online]. Available: http://www.cisco.com
equipment with newer technology. [20] TC Commun. Data Sheets, [Online]. Available: http://www.tc-
Managing the supply of electricity to these high energy-den- comm.com
sity centers, and removing the resulting heat dissipation is likely [21] Juniper Data Sheets, [Online]. Available: http://www.juniper.net
[22] A. A. M. Saleh and J. M. Simmons, “Evolution toward the next-genera-
to become a formidable engineering challenge. Video content tion core optical network,” J. Lightw. Technol., vol. 24, pp. 3303–3321,
distribution through a dedicated video distribution network is 2006.
more efficient than distribution through the public Internet. Op- [23] G. Epps, “System power challenges,” in Proc. Cisco Routing
tical bypass will be an important strategy for managing growth Res. Symp., San Jose, CA, Aug. 2006 [Online]. Available:
http://www.cisco.com, [Online]. Available
in network power consumption and has the potential to reduce [24] Global IP Traffic Forecast and Methodology, 2006–2011, , 2008 [On-
total power consumption by up to 30% at access rates above 100 line]. Available: http://www.cisco.com
Mb/s. [25] J. Koomey, H. Chong, W. Loh, B. Nordman, and M. Blazek, “Net-
work electricity use associated with wireless personal digital assis-
tants,” ASCE J. Infrastructure Syst., vol. 10, pp. 131–137, Aug. 2004.
[26] NEC Australia Oct. 15, 2007, private communication.
ACKNOWLEDGMENT [27] P. V. Mieghem, Performance Analysis of Communications Networks
and Systems. New York: Cambridge Univ. Press, 2005.
[28] E. Desurvire, “Capacity demand and technology challenges for light-
The authors thank P. Magill of AT&T Labs for his extensive wave systems in the next two decades,” J. Lightw. Technol., vol. 24, pp.
helpful comments and suggestions. 4697–4710, Dec. 2006.
[29] Fujitsu Data Sheets, [Online]. Available: http://www.fujitsu.com
[30] Tyco Telecomms, [Online]. Available: http://www.tycotelecom.com
[31] N. Bergano, Jul. 17, 2007, private communication.
REFERENCES [32] M. Gupta, S. Grover, and S. Singh, “A feasibility study for power man-
agement in LAN switches,” in Proc. Int. Conf. Netw. Protocols (ICNP),
[1] M. Gupta and S. Singh, “Greening of the Internet,” in Proc. SIG- Oct. 2004, pp. 361–371.
COMM’03: Applications, Technologies, Architectures, and Protocols [33] NationMaster [Online]. Available: http://www.nationmaster.com
for Computer Communications, Karlsruhe, Germany, 2003, pp. [34] R. Parthiban, R. S. Tucker, and C. Leckie, “Waveband grooming and
19–26. IP aggregation in optical networks,” J. Lightw. Technol., vol. 21, pp.
[2] A. Vukovic, “Data centers: Network power density challenges,” 2476–2488, Nov. 2003.
ASHRAE J., vol. 47, pp. 55–59, 2005. [35] Calient Data Sheets [Online]. Available: http://www.calient.net
[3] K. J. Christensen, C. Gunaratne, B. Nordman, and A. D. George, “The [36] S. J. B. Yoo, “Optical packet and burst switching technologies for the
next frontier for communications networks: Power management,” future photonic Internet,” J. Lightw. Technol., vol. 24, pp. 4468–4492,
Comput. Commun., vol. 27, pp. 1758–1770, 2004. Dec. 2006.
[4] J. Baliga, K. Hinton, and R. S. Tucker, “Energy consumption of [37] C. Qiao and M. Yoo, “Optical burst switching (OBS)—A new para-
the Internet,” in Proc. COIN/ACOFT, Melbourne, VIC, Jun. 2007 digm for an optical Internet,” J. High Speed Netw., vol. 8, pp. 69–84,
[Online]. Available: http://ieeexplore.ieee.org/xpl/freeabs_all.jsp? 1999.
arnumber=4528538 [38] R. S. Tucker, “The role of optics and electronics in high-capacity
[5] J. Baliga, R. Ayre, K. Hinton, and R. S. Tucker, “Photonic switching routers,” J. Lightw. Technol., vol. 24, pp. 4655–4673, Dec. 2006.
and the energy bottleneck,” in Proc. Photon. Switching, San Francisco, [39] R. S. Tucker, “Optical packet switching: A reality check,” Opt.
CA, Aug. 2007, pp. 125–126. Switching Netw., vol. 5, pp. 2–9, 2008.
BALIGA et al.: ENERGY CONSUMPTION IN OPTICAL IP NETWORKS 2403
Jayant Baliga received the B.Sc. degree in computer Wayne V. Sorin (S’78–M’80–SM’98–F’01) re-
science and the B.E. degree in electrical and elec- ceived his Ph.D. in electrical engineering from
tronic engineering (first class honors) in 2007 from Stanford University in 1986.
the University of Melbourne, Australia. He is cur- He then spent over 14 years as a scientist in
rently working toward the Ph.D. degree in electrical the area of fiber optics at Hewlett-Packard/Agilent
engineering at the same university. Laboratories. In the year 2000 he joined the start-up
His research interests include optical network ar- company Novera Optics where he worked in the area
chitectures and wireless communications. of acousto-optic interactions within optical fibres
and then on WDM passive optical networks. Later
he joined the University of Melbourne as a Senior
Research Fellow. He is an inventor on 78 US patents
and an author on over 65 journal and conference papers. He was a contributing
author for the textbook Fiber Optic Test and Measurement (Prentice Hall, 1997)
and has spent 4 years on the part-time faculty of San Jose State University.
Robert W. A. Ayre received the B.Sc. degree of Dr. Sorin has been an Associate Editor for the IEEE PHOTONICS
in electronic engineering from George Washington TECHNOLOGY LETTERS and has served a three-year term on the Board of Gov-
University, Washington, DC, in 1967, and the ernors for the IEEE Photonics Society, formerly the Lasers and Electro-Optics
B.E. and M.Eng.Sc. degrees from Monash Uni- Society (LEOS). He was also the General Co-Chair for OFC’2002 (Optical
versity, Melbourne, Australia, in 1970 and 1972, Fiber Communications conference).
respectively.
In 1972, he joined the Research Laboratories of
Telstra Corporation, working in a number of roles pri-
marily in the areas of optical transmission for core
and access networks, and in broadband networking. Rodney S. Tucker (M’76–SM’81–F’89) received
In 2007, he joined the ARC Special Centre for Ultra- the B.E. and the Ph.D. degrees from the University
Broadband Networks (CUBIN) at the University of Melbourne, continuing work of Melbourne, Melbourne, Australia, in 1969 and
on networking and high-speed optical technologies. 1975, respectively.
He is a Laureate Professor at the University
of Melbourne and Director of the ARC Special
Research Centre for Ultra-Broadband Information
Networks. He has held positions at the University of
Kerry Hinton was born in Adelaide, Australia, in Queensland, the University of California, Berkeley,
1955. He received the B.Eng. (hons), B.S. (hons.), Cornell University, Plessey Research, AT&T Bell
and M.S. degrees in mathematical sciences from the Laboratories, Hewlett Packard Laboratories, and
University of Adelaide, Australia, in 1978, 1980, and Agilent Technologies.
1982, respectively. He received the Ph.D. degree in Prof. Tucker is a Fellow of the Australian Academy of Science and a Fellow
theoretical physics from the University of Newcastle of the Australian Academy of Technological Sciences and Engineering He was
Upon Tyne, U.K., and the Diploma in industrial re- awarded the Institution of Engineers Australia Sargent Medal in 1995 for contri-
lations from the Newcastle Upon Tyne Polytechnic, butions to Electrical Engineering, and was named IEEE Lasers and Electro-Op-
U.K., in 1984. tics Society Distinguished Lecturer for the year 1995–1996. In 1997, he received
In 1984, Dr. Hinton joined Telstra Research Lab- the Australia Prize for his contributions to telecommunications, and in 2007 he
oratories (TRL), Victoria, Australia, and worked on was awarded the IEEE Lasers and Electro-Optics Society Aron Kressel Award.
analytical and numerical modeling of optical systems and components. His work
has focused optical communications devices and architectures, physical layer is-
sues for Automatically Switched Optical Networks (ASONs) and monitoring in
all-optical networks. Dr. Hinton was also a laser safety expert within Telstra.
In 2006, Dr. Hinton joined the ARC Special Centre for Ultra-Broadband Infor-
mation Networks, Australia, at the University of Melbourne, Australia, where
he is undertaking research into the energy efficiency of the Internet and optical
communications technologies.