Cloud Computing

By: Ahmad Ali UoT (APS), Nowshera

Datacenter Networking - Basics

●
Basic Concepts
●
Components of Datacenter
 Cloud Computing Datacenter
●
Datacenter are centers that host hundreds of thousands of servers which
concurrently support many services and applications.
●
Data center (DC) is a physical facility that enterprises use to house
computing and storage infrastructure in a variety of networked formats.
●
It is the brain of a company and the place where the most critical process
are run.
 Cloud Computing Datacenter
●
It is a facility that contains storage, compute, network and other IT resources
to provide centralized data-processing capabilities.
Core Elements of a datacenter
1. Applications
2. Database management system (DBMS)
3. Host or computer
4. Network
5. Storage
These core elements work together to address data-processing requirements
 Datacentre Network
Communications infrastructure – Could be described by:
●
Topology
●
Routing / switching equipment
●
Protocols
 Cloud Computing Datacenter
●
Host (Compute)
Resource that run applications with the help of underline computing
components including servers, laptop, mainframe computers, desktop, tablets
etc.

●
Hardware components
Include CPU, memory and input/output devices.
 Cloud Computing Datacenter
●
Software components
Include OS, device driver, file system and volume manager and so on.
●
Storage
Stores data created by individuals or organizations.
Examples of storage devices are:
1. Media card in a cellphone or digital camera
2. DVD, CD-ROM’S
3. Disk drives
4. Tapes etc.
Evaluation of storage architecture
 Requirements for modern Datacenter
●
Various aspects of the datacenter includes:
●
Facilities, layout, power/cooling, physical security
●
System infrastructure: servers, storage, networking and security.
●
Applications
●
Service management
 Datacenter physical infrastructure
●
A datacenter can occupy one room of a building or more floors or entire
building according to the requirements.
●
Most of the equipment is often in the form of servers
●
The aim is to create a master plan with parameters such as number, size,
location, topology, IT floor system layout and power and cooling technology
and configurations.
Datacenter: Online order transaction system example
 Cloud Computing Datacenter
●
A datacenter is a facility on some location where multiple servers or
machines are engaged in collection, storing, processing and distribution of
massive amount of data.
●
The security and reliability of datacenters and their information is a top
priority for organizations.
 Where is the World’s Largest Datacenter?

●
(2018) China Telecom. 10.7 Million sq. ft.
●
(2017) “The Citadel” Nevada. 7.2 Million sq. ft.
●
(2015) In Chicago!
• 350 East Cermak, Chicago, 1.1 MILLION sq. ft.
• Shared by many different “carriers”
• Critical to Chicago Mercantile Exchange
●
See:
– https://www.gigabitmagazine.com/top10/top-10-biggest-data-centres-world

– https://www.racksolutions.com/news/data-center-news/top-10-largest-data-centers-world/
13
 Servers

Front Back

In Some highly secure (e.g., financial info)

14
●
Power

Off-site

On-site
•WUE = Annual Water Usage / IT Equipment Energy (L/kWh) – low is good
•PUE = Total facility Power / IT Equipment Power – low is good
(e.g., Google~1.1)

15
●
Cooling

Air sucked in from top (also, Bugzappers) Water purified

Water sprayed into air 15 motors per server bank

16
 Why we need of Datacenter?
●
For storing massive amount of data.
●
For providing 24x7 services to customers
●
For data safety and security
●
For conducting day to day business operations.
 Cloud Computing Datacenter
– Main function is to deliver utilities needed
by the equipment and personnel:
●
Power
●
Cooling
●
Shelter
– Security
– Size of typical data centers:
●
500 – 5000 sqm buildings
●
1 MW to 10-20 MW power (avg 5 MW)
 Components of Datacenter
●
A datacenter consists of bunch of servers connected through
network to run complex applications.
●
A cooling system to manage the heat released by the machines.
●
Proper ventilation system to ensure optimal air-flow.
●
Power distribution and backup units for smooth execution using
power supply unit.
 The Role of Datacenter
Data centers are an integral part of the enterprise, designed to support
business applications and provide services such as:
●
Data storage, management, backup and recovery
●
Productivity applications, such as email
●
High-volume e-commerce transactions
●
Powering online gaming communities
●
Big data, machine learning and artificial intelligence
Datacenters around the globe
 Modern DC for the Cloud architecture
– Geography:
●
Two or more regions
●
Meets data residency requirements
●
Fault-tolerant from complete region failures
 Modern DC for the Cloud architecture
– Availability Zones:
●
Unique physical locations within a region
●
Each zone made up of one or more DCs
●
Independent power, cooling, networking
●
Inter-AZ network latency < 2ms
●
Fault tolerance from DC failure
 Traditional Vs. Modern DC
– Traditional data centers
●
Host a large number of relatively small- or medium-sized
applications, each running on a dedicated hardware infrastructure
that is decoupled and protected from other systems in the same
facility
●
Usually for multiple organizational units or companies
– Modern data centers (a.k.a., Warehouse-scale computers)
●
Usually belong to a single company to run a small number of large-
scale applications
– Google, Facebook, Microsoft, Amazon, Alibaba, etc.
●
Use a relatively homogeneous hardware and system software
●
Share a common systems management layer
●
Sizes can vary depending on needs
 DC Architecture
Scale-up vs. scale-out
– Scale-up: high cost powerful CPUs, more cores, more memory
– Scale-out: adding more low cost, commodity servers
– Supercomputer vs. data center
– Scale
●
Blue waters = 40K 8-core “servers”
●
Microsoft Chicago Data centers = 50 containers = 100K 8-core
servers
– Network architecture
●
Supercomputers: InfiniBand, low-latency, high bandwidth protocols
●
Data Centers: (mostly) Ethernet based networks
Main components of a datacenter

src: The Datacenter as a Computer – Barroso, Clidaras, Holzle

Src: the datacenter as a computer – an introduction to the
design of warehouse-scale machines
A Row of Servers in a Google Data Center
 Inside a modern data center
- Today’s DC use shipping containers packed with 1000s servers each.

– For repairs, whole containers are replaced

 Costs for operating a data center

DCs consume 3% of global electricity

Monthly cost = $3’530’920
supply (416.2 TWh > UK’s 300 TWh)

DCs produce 2% of total greenhouse

gas emissions
4%
Servers
DCs produce as much CO2 as The 13%
Netherlands or Argenti Networking
Equipment

18% Power Distribution

57% & Cooling

8% Power

Other
45,978 servers, 3yr server & 10 yrInfrastructure
infrastructure amortization
45,978 servers, 3yr server & 10 yr infrastructure amortization
 Evolution of datacenter design

 Gen 6: scalable form factor (2017)

- Reduced infrastructure, scale to demand
- 1.17-1.19 PUE

 Gen 7: Ballard (2018)

- Design execution efficiency
- Flex capacity enabled
- 1.15-1.18 PUE

 Gen 8: Rapid deploy datacenter (2020)

- Modular construction and delivery
- Equipment skidding and preassembly
- Faster speed to market

 Project Natick (future) – 1.07 PUE or less

 DC Challenges
Large-Scale
– 10’s to 100’s of thousands of servers
– High bandwidth and low latency (measure of delay) is critical
Availability and High Performance
- Redundancy of all critical components
- 99.9% availability
Security and performance isolation
- Controlled access to infrastructure
- Secure the data
 Why do we need a datacenter?
●
Datacenter play an important role in our society and economy.
●
Everything that happens online, is housed in a data center. Dutch
data centers house many digital applications and thus form the
foundation of our Internet. In these buildings full of servers and other
digital equipment, videos and other files are stored, important
software runs and data is exchanged between different networks that
form a data distribution hub.
●
Data centers in the Netherlands support a wide range of activities of
the government, business and society.
What is their purpose?