Centros de Datos

Doctorado en Ingeniería – Mención Computación Mayo - junio 2021

Curso de Posgrado – Modalidad Virtual

T1. Historia y Motivación de los Centros

de Datos
Chus (Jesús) Alastruey Benedé y Víctor Viñals Yúfera
Área de Arquitectura y Tecnología de Computadores
Grupo de
Arquitectura de Computadores
Universidad de Zaragoza
 Índice

 Historia
 Década 1960
 Década 1970
 Década 1980
 Década 1990
 Década 2000
 Década 2010
 Motivación
 Proyectos recientes en Latinoamérica, Portugal y España
 Empleo y empleabilidad
 Consumo de energía

Historia y Motivación
 Data Center Milestones (1956  2021 ~65 años)
IBM ASCC (Automatic Sequence Controlled Calculator)
First electromechanical decimal computer. Aka Harvard Mark I
ENIAC (Electronic Numerical Integrator And Computer) Intel 4004 (4 bit, integer)
First binary electronic general-purpose computer First microprocessor

19 19 19 19
40 4 6 9 50 5 6 60 4 70 1 8

2nd World War Raised Floor IBM 701

Pilot ACE, Mark 1, EDSAC
Alan Mathison Turing. NPL-Manchester
Williams, Kilburn y Tootill. Manchester
Wilkes. Cambridge
Sungard Availability Systems. First U.S.
commercial disaster recovery business
Mainframes, direct liquid cooling
- IBM 701, 1st gen. Vacuum tubes IBM System
- IBM 7090, 2nd gen. Discrete transistors 360/370/39
- IBM 360, 3rd gen. TTL Integrated circuits
… … air cooling
- IBM 390, 5th gen CMOS Integrated circuits

Boom of datacenters came during the dot-com bubble.

Microcomputers (now called “servers”)
start to populate the old computer rooms
which were called “datacenters”
IT companies needed non-stop operation and Internet connectivity
Tier I-IV
Uptime Institute OpenCompute Project, Facebook IOT - Edge Computing
1st big Google data Center
at Douglas County, Georgia

19 19 20 20 20
80 1 5 90 5 7 00 2 3 4 7 10 11 18 20

1st Supercomputing facilty, Modular Datacenter: built into a standard 6-

IBM-NSF at Cornell Univ. meter shipping container (Sun Microsystems)

IBM PC (Personal Computer) Amazon Web Services ASHRAE TC9.9 “Thermal Guidelines for Data
”semi-open” hardware platform Cloud-based storage & computation Tema 1. Historia
Processing Environments” AirflowyManagement.
Motivación 3
 (rackspace.com/blog/… roto) Data Center Evolution: 1960 to 2000  1960´s

 Starting in 1960, computers converted from

vacuum tube to solid state transistors,
which last much longer, are smaller, more
energy-efficient, more reliable, and cheaper
 In the early 1960s mainframes cost about
$5 million each, and time could be rented
for $17,000 per month
 In 1960 American Airlines and IBM teamed
up to develop a reservation program
termed Sabre. It was installed on 2 IBM
7090 computers, located in a specially
designed computer center in New York.
The system processed 84,000 telephone
calls per day
 By the mid 1960s, computer use developed
commercially and was shared by multiple
parties
 Computer memory slowly moved away
from magnetic core devices to solid-state
IBM System/360 at the IRS (Internal Revenue Service) - 1966 -1967
static and dynamic semiconductor memory,
Computer History Archives ~ 4 min which greatly reduced the cost, size and
youtu.be/JaRzExHoUl0 power consumption

+ Computer Classic: "System Technology" circa 1960 System Development Corporation,

https://youtu.be/f1sLdchvZiQ Historia y Motivación 4
 Centralized Computer Room

Some practices to design the centralized computer room

can be thought as antecedents of current data centers:
 Strict control of temperature, humidity and dust
 to prevent failures in machines operating with paper
 punch card machines (punching and reading) 
 continuous feed printers
 to prevent failures in magnetic tape reader/recorder machines
 to minimize electrostatic discharge,
which can cause transient or permanent errors in electronics ↓

 Technical floor (or raised floor)

 to hide pipes and cabling
 reinforced to support heavy equipment
 1956: First “Raised” Floor Room Appears  IBM 701 Defense Calculator

Historia y Motivación 5
 Raised Floor 1 of 2

“In the 1950′s IBM came to the Washington Aluminum Company

with a problem. IBM had started manufacturing and selling a new
piece of equipment called the mainframe computer.
IBM needed someone to build a stand or platform to support the
weight of this machine and create easy access for the wires and
pipes (direct liquid cooling) of the equipment.
Sitting in that room were a few people
including Earnie Liskey
and Jim (Bill) Irvine.
This was the beginning
of the raised floor industry.
...”
2 ft x 2 ft (24’’ x 24’’)
or
60 cm x 60 cm x 48 mm
Source: Irvine Access Floors Historia y Motivación 6
 Precedente: hipocausto

Hypocaust under the floor in a Roman villa in Vieux-la-Romaine, near Caen, France (Wikipedia) Historia y Motivación 7
Pasillo frio- pasillo caliente (cold-hot aisle)

Historia y Motivación 8
 Rack – Tile alignment (24’’ x 24’’ tile examples)

 searchdatacenter ... Work-from-the-ground-up-

with-a-data-center-raised-floor

 www.42u.com/cooling/hot-aisle-cold-aisle.htm

Cabinet alignment with 24’’ deep cabinets:

3-1-2-1 pattern

3
1 48’’ deep = 121.92 cm
2
1 or
3 120 cm deep with 60 cm tiles
1
2
1 Historia y Motivación 9
 Data Center Evolution: 1970´s

 In 1971, Intel released the world’s first commercial

microprocessor: the Intel 4004
 Datacenters in the US began documenting formal
disaster recovery plans in 1973. However, if
disaster did strike, it wouldn’t necessarily affect
business operations, as most computer tasks were
bookkeeping duties
 In 1978, SunGuard developed the first commercial
disaster recovery business, a leased 30,000 sq. feet of
space at 401 Broad Street, where it is still located
 In 1973, the minicomputer Xerox Alto was a
landmark step in the development of personal
computers because of its graphical user interface,
bit-mapped high-resolution screen, large internal
and external memory storage and mouse
 In 1977, the world’s first commercially available
Local Area Network, ARCnet was operative at
Chase Manhattan Bank, NY, as a beta-site.
It was the simplest and less expensive type of LAN,
using a token-ring architecture
(2.5 Mbps, up to 255 computers)
 Mainframes required special cooling and in the
late 1970s, smaller air-cooled computers moved
into offices. Consequently, datacenters stayed 1970s UK office - secretaries, typing and 70s technology
inside the big companies and corporations http://www.youtube.com/watch?v=F43S6DSTZMU

Historia y Motivación 10
 Xerox Alto, 1973

The Xerox Alto was

an experimental
workstation,
not a commercial
product.
It incorporated many
now-standard
features like a
mouse, clickable
windows, icons and
menus, and cut-copy-
paste editing

Historia y Motivación 11
 Data Center Evolution: 1980´s

 During the 1980s, the computer industry

experienced the boom of the
microcomputer era thanks to the birth of
the
IBM Personal Computer (1981, Intel 8088)
 Computers were installed everywhere,
and little thought was given to the specific
environmental and operating requirements
of the machines
 Starting in 1985, NSF + IBM provided
more than $30 + $30 million in products and
support during 5 years a supercomputer
facility at Cornell Univ. in Ithaca, New York1
 In 1988, IBM introduces the Application
System/400 (AS/400), and quickly becomes
one of the world’s most popular business
computing systems (CPU= 5+2 CMOS chips)
 As information technology operations
SIGECO Computer Room, 1983
started to grow in complexity, companies
http://www.youtube.com/watch?v=Wz6A0bdeUPM
grew aware of the need to control IT
resources
1. 1985: IBM 3084, 1986: 4-processor 3090/400VF. 1987: 6-processor 3090/600E. 1988 a second 3090/600E.
Other: Intel iPCS/2, Transtech NT 1000, Topologix T1OOO, 2 Connection Machines, Encore Multimax, and Historia y Motivación 12
Alliant FX/80.
 Data Center Evolution: 1990´s

 Microcomputers (now called “servers”)

started to find their places in the old
computer rooms and were being called
“data centers”
 Companies were putting up server
rooms inside their company walls
with the availability of inexpensive
networking equipment
 The boom of data centers
came during the dot-com bubble1.
Companies needed fast Internet Occupying 336 square feet,
connectivity and non-stop operation to the Unisys Clearpath IX 4400 and 6 tape drives
deploy systems and establish a were purchased by the Census Bureau in 1995
www.census.gov/ces/dataproducts/recovered/
presence on the Internet
 Rackspace Hosting opened their first
Video Tour of a Mainframe Computer Room circa 1990
colocation datacenter to businesses http://www.youtube.com/watch?v=hdNxaRa4roo
in 1999
1. The dot-com bubble (dot-com boom, Internet bubble, or IT bubble) was a historic speculative
bubble covering 1997–2000, during which stock markets in industrialized nations saw their equity Historia y Motivación 13
value rise rapidly from growth in the Internet sector. http://en.wikipedia.org/wiki/Dot-com_bubble
 Data Center Evolution: 2000´s 1 of 2

El concepto de pasillo frio–caliente fue presentado en 1993, pero no se generalizó hasta 2006.
Sin embargo, hasta el 2008, no se marcaron los criterios de diseño que ahora emplea la industria. Historia y Motivación 14
 Data Center Evolution: 2000´s 2 of 2

2007
 The average datacenter consumes as
much energy as 25,000 homes
 There are 5.75 million new servers
deployed every year
 The number of USA government data
centers has gone
from 432 in 1999 to 1,100+
 Data centers account for 1.5% of USA
energy consumption and demand is
growing 10% per year
 As online data grows exponentially,
there is opportunity (and need)
to run more efficient data centers
data center at Spirit Telecom in Columbia, S.C
http://www.youtube.com/watch?v=M7bHYbPsThg

Historia y Motivación 15
 2011, Facebook, OpenCompute Project
 Started with the Facebook experience  Data Center (electrical & mechanical specs)
in its Prineville data center at Oregon  Open Rack
that used
 Server Design
 38% less energy to do the same work as
their other facilities  Storage
 while costing 24% less  Networking

Historia y Motivación 16
Figure 3 of “Facebook – Wedge-100 32x100GE Top of Rack Switch”. Top View of Open Rack 19-In SKU
 2013, Google
 Google invested $7.35 billion in its  Expansion
infrastructure in 2013  $600M, The Dalles, Oregon
 Largest construction effort in the history  $400M, Council Bluffs, Iowa
of the datacenter  $600M, Lenoir, North Carolina
 Most expansion projects represents an  New construction
additional phase at an existing campus  $600M, South Carolina DC campus
where Google has already built at least in Berkeley County
one data center.  $390M, DC in Belgium
Building multiple facilities at a single site  $24.5M purchasing a 13 hectares
can be cheaper than building in a new former Gatorade factory in Pryor,
site, as basic infrastructure for power Oklahoma
and connectivity is typically installed
during the buildout of the first facility

Mayes County, Oklahoma Historia y Motivación

google.com/about/datacenters/inside/locations/mayes-county/working-here.html 17
 Índice

 Historia
 Motivación
 Proyectos “recientes” en Latinoamérica, Portugal y
España
 Empleo y empleabilidad
 Consumo de energía

Historia y Motivación
 Proyectos recientes en Latinoamérica, Portugal y España1

 8 proyectos en 2011-13 !!
 la inversión 2011-13 en proyectos modulares ha crecido un 99%
 diseño basado en contenedor, 2011-13 ha crecido un 88%
 en Perú y Chile se espera un incremento de casi un 800%

1. Revista DatacenterDynamics FOCUS. nº 15, tercer trimestre 2013

www.datacenterdyamics.es Historia y Motivación 19
 Proyectos recientes en Latinoamérica, Portugal y España1

1. Revista DatacenterDynamics FOCUS. nº 15, tercer trimestre 2013

www.datacenterdyamics.es Historia y Motivación 20
 Proyectos recientes en Latinoamérica, Portugal y España1

1. Revista DatacenterDynamics FOCUS. nº 15, tercer trimestre 2013

www.datacenterdyamics.es Historia y Motivación 21
 Proyectos recientes en Latinoamérica, Portugal y España1

1. Revista DatacenterDynamics FOCUS. nº 15, tercer trimestre 2013

www.datacenterdyamics.es Historia y Motivación 22
 Proyectos recientes en Latinoamérica, Portugal y España1

 El mayor de España

1. Revista DatacenterDynamics FOCUS. nº 15, tercer trimestre 2013

www.datacenterdyamics.es Historia y Motivación 23
 www.datacentermap.com (colocation) may 2021
 125 colocation data
centers in LATAM
 Argentina: 13
 Córdoba
 San Nicolás de los Arroyos
 BA x11

The Latin America data center market by investment is expected to grow

at a CAGR of 7.6% during 2021–2026
 Tier IV facilities are witnessed in Brazil, Chile, Colombia, Ecuador,
Mexico, Uruguay, Costa Rica, Guatemala, and the Dominican Republic
 Ascenty, Axtel, ODATA, Equinix, Angola Cables, CenturyLink, GTD
Group, Telefonica, and KIO Networks are major Uptime Institute
certified data center operators
 Brazil is expected to observe the highest investments in the Latin
America data center market
 45 out of 185 Tier III certified facilities in Latin America are in Brazil
 With the increasing internet penetration among consumers and the
growing cloud-based services by businesses in the region, data centers’
demand is growing significantly, which can be identified through
continued investment in data center operations
 The growing demand for cloud-based services, the Internet of Things
(IoT), and big data analytics in Chile has increased data center
investments in recent years
 In Chile, the high usage of social media platforms such as Facebook,
Instagram, Twitter, and Snapchat will increase data generation and
increase the need for storage 24
Historia y Motivación
www.datacentermap.com (colocation) may 2021

 66 colocation data
centers in Spain
 Tier III: 6
 Tier IV: 1

25
Historia y Motivación
 Ejercicio T1.1: descripción de un Centro de Datos

EDCBUE01, EdgeConneX, Parque Industrial Pilar (BA, Ar.)

1. Tipo de centro de datos. Tier ?
1.1 Enterprise, colocation o managed hosting ?
1.2. Líneas de negocio y servicios
2. Elementos de edificación y acometidas
2.1. Dimensiones tanto de la parte IT como del resto de superficies
2.2. Nº de acometidas (desde el exterior): electricidad, agua?, aire?, internet
2.3 Seguridad física: acceso, incendios, alarmas, …
3. Instalación eléctrica
3.1. Número de caminos independientes
3.2. Sistemas de respaldo de energía, características
4. Instalación mecánica. Climatización de las salas IT
4.1. Tipo de enfriamiento del aire
4.2. Redundancia
5. Comunicaciones de datos
6. Salas IT: racks, tipos, distribución de electricidad y comunicaciones, etc.
7. Métricas.
7.1. Densidad de potencia en las salas IT, en W/m2
7.2. Potencias por rack: min, max, media
7.3. Potencia IT y Potencia Total
7.4. Disponibilidad
Historia y Motivación 28
 Índice

 Historia
 Motivación
 Proyectos recientes en Latinoamérica, Portugal y
España
 Empleo y empleabilidad
 Consumo de energía

Historia y Motivación
 2013-2015

Crecimiento del empleo en el data Center

Revista DatacenterDynamics Abril/Junio 2015

Tema 1. Historia y Motivación 30
30
 Dificultades para contratar personal especializado en data center

 Estudio-encuesta reciente de 451 Research (Christian Perry, director de

investigación, 2017)
 casi 75% de las empresas tienen problemas moderados de contratación
 la mayoría prevé que la necesidad de personal especializado se mantendrá
o crecerá, lo que llevará a una escasez de personal cualificado
 Tres razones principales de la escasez
 falta de candidatos especializados y experimentados
 falta de solicitantes locales
 los candidatos exigen salarios más altos de lo disponible
 Resultado de la falta de personal especializado
 20,5%  reducir personal del centro de datos propio y
gastar más en la nube pública
 5,4%  lo mismo y gastar más en colocation (hosting)
 20%  recurrir a un proveedor de servicios administrados (housing)
https://www.dcd.media/noticias/dificultades-para-contratar-personal-especializado-en-data-center/
Celia Villarrubia , DatacenterDynamics, Septiembre 18, 2017 Historia y Motivación 31
 Informe de Uptime Institute 5 de abril de 2021

 Figure 1. Global data center staff requirement projections.

Informe Colocado en Campus Virtual en “Materiales”. Historia y Motivación 32

 Informe de Uptime Institute 5 de abril de 2021

 Net staff growth in LATAM between 2019 and 2025 in LATAM: 21000

Historia y Motivación 33
 Informe de Uptime Institute 5 de abril de 2021

La capacitación será  Rhonda Ascierto, Vice

"fundamental para la fuerza President of Research at
laboral futura", dijo Ascierto a Uptime Institute
DCD, pero hay una "escasez de
capacitación en centros de
datos a nivel mundial".

Ella argumentó que se debe

alentar a las escuelas y
universidades a participar en
esto, ya que es una buena
manera de atrapar a las
personas temprano.

www.datacenterdynamics.com/es/noticias/los-centros-de-datos-necesitan-encontrar-300000-
empleados Historia y Motivación 34
 Índice

 Historia
 Motivación
 Proyectos recientes en Latinoamérica, Portugal y
España
 Empleo y empleabilidad
 Consumo de energía

Historia y Motivación
 Consumo de Energía 1 de 2

Clicking clean: who is winning the race to build a green internet?

Green Peace Inc., January 2017. Historia y Motivación
 Consumo de Energía 2 de 2

x109

Clicking clean: who is winning the race to build a green internet?

Green Peace Inc., January 2017. Historia y Motivación