Open Compute Project

Openstack Design Summit

April 27th, 2011

eran@fb.com
 Efficiency
Economy
Environment
Openness
38% 24%
energy cost
efficiency savings
gained
 Servers Data Center

Server AMD Intel

Chassis Motherboard Motherboard

Electrical Mechanical

Power Battery Triplet

Supply Cabinet Rack
1
Data Center
2 Servers
1
Data Center
2 Servers
15
0m
it
o
Po
rtla
nd

Prineville
2,67
0m
i mi
2,5 to A
75 shb
mi urn
to , VA

lo Alto
Fo
res
tC
ity
,N
C

560 mi to Pa
Construction
Phase A/B Phase C/D

A B C D
 Grid to Gates

Power Data Server Mother-

Grid Center board
 Power Distribution Loss
11% to 17% 2%
Total loss Total loss
up to server up to server

Typical Prineville
Data Center Power Data Center Power
 Typical Data Prineville Data
Center Power Center Power
Utility Transformer Utility Transformer
480/277 VAC 480/277 VAC
2% loss 2% loss

AC/DC UPS 99.999%

6% - 12% loss Availability
DC/AC
480VAC 99.9999% Availability

ASTS/PDU 3% loss
208/120VAC 480/277VAC

SERVER PS FB SERVER 48VDC DC UPS

PS (Stand-by)

Total loss up to server: Total loss up to server:

11% to 17% 2%
▪ Overhead cable tray
distribution
▪ Overhead supply air
opening
▪ 14’ ceiling height
▪ Slab on grade / No
raised access floor
▪ Hot aisle
containment system
LED Lighting System
! Flexible lighting solution
! Power over Ethernet to LED light fixtures
! Automatic light level control

LED Driver
Data Center Innovation
1. 480 volt electrical distribution system
providing 277 volts directly to each server
2. Localized uninterruptible power supply
each serving six racks of servers
3. Ductless evaporative cooling system
1
Data Center
2 Servers
Short or Tall?
Big or small?
Chassis
▪ 1.5U (2.65 in.) tall
▪ 1.2mm pre-plated steel
▪ Integrate cable management
▪ 60mm fans
▪ Spring loaded plungers
▪ Tool-less motherboard standoffs
▪ Hard drive mounting cage (up to 6
drives)
▪ 4 rear facing fans
▪ Front cable access only
 450W power
drive cage
supply

AMD / Intel
motherboards

fans
Intel motherboard
▪ Custom spread design
▪ 2 Intel Xeon 5500 or 5600 series
processors
▪ Intel 5000 I/O hub with 24 PCI-E
lanes
▪ 192GB maximum memory
▪ Intel 82574 or 82580 NIC, reboot on
LAN
▪ Custom debug card
▪ 93% efficient voltage regulators
AMD motherboard
▪ Custom shadow design
▪ 2 AMD Opteron 6100 series 12
and 8 core processors
▪ AMD SR5650 chipset,22 PCI-E
lanes
▪ 256GB maximum memory
▪ Intel 82574 or 82580 NIC, reboot
on LAN
▪ Custom debug card
▪ 93% efficient voltage regulators
▪ Onboard HDD power
450W power supply
▪ 48VDC back-up circuit
▪ 90 second run-time on backup
circuit with seamless switching
▪ 190 – 290 VAC input range
▪ 94.5% efficient
▪ Low iTHD, peaks at 3%
▪ High power factor 0.99
▪ Board to board mating connector
▪ Pin and plunger mounting
▪ Single low speed cooling fan
Optimized power distribution
Triplet Rack
▪ Triplet design – 90 servers
▪ Fast deployment, rolling casters
with levelers
▪ Welded 2” tube frame, powder coat
finish
▪ Hot/cold isle containment
▪ Sheet metal wall panels with
punch-out shelves
▪ 6 1U auxiliary shelves
▪ High switch port utilization
Cabling
▪ Front access only
▪ Network cable
management harness
▪ Custom 277VAC 30
outlet power strip
▪ Custom 48VDC 30 outlet
power strip
▪ Custom 277VAC and
48VDC power cords
Battery Cabinet
▪ Custom DC UPS
▪ 56kW or 75kW, 277VAC, 3-phase input
▪ Six 48VDC output
▪ 45 sec back-up time at full load
▪ Rectifier to charge batteries
▪ 20 sealed VRLA batteries
▪ Battery monitoring system –
impedance, voltage, temperature
▪ Two 50A 48VDC aux outputs
Backup Scheme
48VDC Battery
Cabinet 277VAC
48VDC
277VAC Battery
Charger
Server PS

Back up AC to DC
4x12V converter
Batt 48VDC-12VD 277VAC –
C 12VDC
N+1 4x12V
battery Batt 48VDC
standby
4x12V 12VDC
Batt

4x12V
Batt
MOBO
4x12V
LEGEND Batt
Normal Power
Backup Power
Server Innovation
1. 94.5% efficient power supply that accepts
both AC and DC power
2. Vanity Free Design: 22% fewer materials
3. Increased height giving room for larger
and more efficient heat sinks and fans
Thanks! Questions?
http://opencompute.org/