[Reference Design 105]

46 MW (ANSI), Chilled Water, 430560 ft2

DESIGN OVERVIEW
Data Center IT Capacity
Initial delivery of 3.8 MW
Scalable to 45.8 MW
Regional Voltages and Frequency
69-230kV, 13.8kV, 400-480V
60Hz
Redundancy Levels
Power: 2N distribution to load, 2N
UPS, N+2 generators
Cooling: N+2 CRAHs, N+1 pumps,
N+1 chillers
INTRODUCTION
This Reference Design is optimized for large co-location companies with an emphasis on
redundancy, time to market (TTM), and initial capital expense (CapEx). The data center
is to be built out in twelve increments of 3.8 MW blocks. Each block contains two
electrical rooms, two IT rooms, and a cooling system that serves the entire block. Each
IT room has two distinct zones: a high density zone containing 112 racks a t 9kW/rack,
and a lower density zone containing 150 racks at 6 kW/rack. Together, these rooms and
systems constitute the building blocks for the data center. Therefore, each data center
expansion is designed to occur in increments of 3816 kW of IT load.

DESIGN HIGHLIGHTS
High reliability
Reduced TTM
Scalable design
Minimized initial CapEx
Flexible IT space
[Reference Design 105] 2

Facility Power
UTILITY CONNECTION
The data center is designed for a maximum demand of 80 MVA, which requires a connection to the electric utility’s high voltage (HV)
sub-transmission network. Responsibility for substation construction and the point of common coupling, POCC, may vary with the
region and negotiated rate structure. The location of the utility meter is shown on the high voltage side of the transformer but may be
located on the medium voltage side of the transformer. Substation construction, equipment procurement responsibilities and meter
location are determined during the interconnection application process.

PRIMARY MEDIUM VOLTAGE (MV) DISTRIBUTION

The HV/MV substation design allows for concurrent maintenance of the equipment without needing to run the generator set. Two HV
utility incomers feed two HV single busbars, which are connected through a bus section for 2N redundancy. Four 40 MVA power
transformers with on-load tap changer (OLTC) supply twelve IT blocks. The MV distribution voltage may be determined by the data
center customer, where 15 kV is the most common. The short circuit impedance of the HV/MV transformer is based on the ANSI
standard and is determined by the HV Basic Insulation Level (BIL). The MV distribution is 2N redundant, comprising four Masterclad
switchgear lineups rated at 15 kV and 25 kA with a 2000 A busbar, ensuring better cost optimization. Each pair of these Masterclad
lineups feed six IT load blocks for A and B-side distribution.

HV/MV Substation and Primary MV Distribution

Utility A Utility B

KWh KWh

52 52

40MVA 40MVA 40MVA 40MVA

HV HV HV HV
138kV- 138kV- 138kV- 138kV-
MV MV MV MV
13.8kV 13.8kV 13.8kV 13.8kV

MV Primary Dist. MV Primary Dist. MV Primary Dist. MV Primary Dist.

SWG A1 SWG A2 SWG B1 SWG B2 Masterclad
2000A, 13.8kV 2000A, 13.8kV 2000A, 13.8kV 2000A, 13.8kV

BLOCKS BLOCKS BLOCKS BLOCKS

1-3 4-6 7-9 10-12

FACILITY POWER HV/MV SUBSTATION ATTRIBUTES

Name Value Unit

Utility voltage >115 kV
Number of blocks supported 12
© 2015 Schneider Electric. All rights reserved.

Power path Dual

Quantity of HV/MV transformer(s) 4
HV/MV transformer size 40 MVA
HV/MV transformer short circuit impedance 9.5 %
Quantity of MV primary distribution switchgear lineups 4
MV primary distribution bus amps 2000 A
MV primary distribution bus voltage 13.8 [15 kV Class] kV
MV primary distribution switchgear short time withstand current 25 kA

Document Number RD105DS Revision 0

[Reference Design 105] 3

Facility Power
SECONDARY MEDIUM VOLTAGE DISTRIBUTION

This design aims for a simple MV distribution, optimizing the number of MV feeders in order to minimize MV cabling cost. Each section
feeds a group of three IT blocks, along with a dedicated MV backup diesel generator power plant. Automatic transfer between mains
power and backup generators is built into the design.
Eight HVL/cb switchgear lineups, rated at 15 kV, 1200 A and 25 kA make up the entire MV secondary distribution. Each pair of HVL/cb
lineups feeds three IT blocks in a 2N architecture, to provide A and B-side power. The two switchgear lineups are connected by a
“coupling cable” to maintain redundancy downstream of a failure.
The diesel generator backup power is connected to the MV distribution network via a HVL/cb switchgear lineup, rated at 15 kV, 1200 A
and 25 kA. Thirteen 2500 kVA, 480 V generators with N+2 redundancy are coupled to the MV network with a LV/MV step-up 2500 kVA
Power Dry II VPI cast resin transformer with a 5.75% short circuit impedance. This backup generator plant configuration provides high
reliability and safety, while minimizing cost. For full Tier III compliance, a set of redundant HVL/cb MV switchgear could be added to the
design. Fuel storage and piping can also be added to the design in accordance with country habits and regulations.

MV Primary Dist. Secondary MV Distribution MV Primary Dist.

SWG A SWG B

Three Blocks
DESIGN OPTIONS
G 13x 2500 kVA units G This reference design can be modified
2500kVA 2500kVA
480V LV LV 480V as follows without a significant effect on
13.8kV MV MV 13.8kV
5.75%Z 5.75%Z the design’s performance attributes:
Genset SWG 1200A, 13.8kV

PLC PLC
 Redundant generator switchgear set
MV Secondary MV Secondary  Provision for load bank
Dist. SWG A Dist. SWG B HVL/cb  Add/change standby generator options:
1200A, 13.8kV 1200A, 13.8kV
 Location
BLOCK
 Tank size
BLOCK
 Fuel type
BLOCK

FACILITY POWER MV DISTRIBUTION ATTRIBUTES

Name Value Unit

Per 3 blocks
Number of MV secondary distribution switchgear lineups 2
MV secondary distribution bus amps 1200 A
MV secondary distribution bus voltage 13.8 [15 kV Class] kV
© 2015 Schneider Electric. All rights reserved.

MV secondary distribution switchgear short time withstand current 25 kA

Generator redundancy N+2
Number of Generators 13
Generator size 2500 kVA
Generator voltage 480 V
Number of MV Generator switchgear lineups 1 (per generator)
MV Generator bus amps 1200 A
MV Generator bus voltage 13.8 [15 kV Class] kV
MV Generator switchgear short time withstand current 25 kA

Document Number RD105DS Revision 0

[Reference Design 105] 4

Facility Power
LOW VOLTAGE DISTRIBUTION
Downstream of the MV secondary distribution, each block is composed of three pairs of A-side and B-side MV/LV transformers that
serve LV switchboards. Two of these pairs are dedicated to the two IT rooms in the block, while the third pair is dedicated to the
block’s cooling system and auxiliaries. In total, 72 Power Dry II 2500 kVA transformers in a close coupling installation are used: the 48
transformers dedicated to the IT load transform power from 15 kV to 415 V with 5.75% impedance, while the 24 transformers
dedicated to the cooling system and auxiliary loads transform power from 15 kV to 480 V with 5.75% impedance. Similarly, a total of 72
QED 6 LV switchboards continue the LV distribution, with the 48 switchboards dedicated to the IT load rated at 415 V and 85 kA with a
4000 A bus, and the 24 switchboards for the cooling system and auxiliares rated at 480 V, 65 kA and a 4000 A bus. This busbar
nominal current rating is maximized to achieve cost-effectiveness and make the most of the IT capacity.
The power train for each IT room is made up of two QED 6 switchboards that feed Symmetra MW UPSs in a 2N configuration, allowing
for A and B-side power distribution in the IT room. Finally, a combination of LV switchgear and iBusway systems with built-in
intelligence feeds 2N power to the IT load. The power train for a single block’s cooling system and auxiliaries is comprised of two QED
6 LV switchboards providing A and B-side distribution to chillers, pumps, lighting, monitoring, security and automation systems, etc.,
while providing fault protection to cooling units in the IT and electrical rooms.
The facility power system is designed to also support integrated peripheral devices like fire panels, access control systems, and
environmental monitoring and control devices. Power meters in the electrical path monitor power quality and allow for predictive
maintenance & diagnostics of the system. These meters, as well as digital (MV/LV) relays also integrate with StruxureWare Power
Monitoring Expert.
Every component in this Reference Design is built and tested to the applicable ANSI standards. Further design details and schematics
are available in the engineering package available upon request.

DESIGN OPTIONS
This reference design can be
modified as follows without a
significant effect on the design’s
performance attributes:

 Change UPS batteries

 Location
 Type

FACILITY POWER LV DISTRIBUTION ATTRIBUTES

DESIGN OPTIONS
Name Value This reference Unit can be
design
IT in each block modified
Cooling as
in each block follows without a
Number of MV/LV transformer 4 significant
2 effect on the design’s
© 2015 Schneider Electric. All rights reserved.

MV/LV transformer size 2.5 performance

2.5 attributes:MVA
Number of LV critical switchboard 4 2
LV critical bus amps 4000 
4000 Change UPS batteries
A
LV critical bus voltage 415 480  LocationV

LV critical switchboard kA 85 85  Type kA

2N for IT coolers and pumps

UPS redundancy 2N
N for UPS coolers
Total UPS capacity per block 4500 180 kW
UPS runtime @ rated load 5 5 minutes
UPS output voltage 415 480 V

Document Number RD105DS Revision 0

[Reference Design 105] 5

Facility Power
POWER MONITORING

The power monitoring system is part of the DCIM

(Data Center Infrastructure Management System)
system which measures, monitors tracks, and
controls all aspects of the physical data center in a User
User
real time. In addition, it optimizes planning, as well Interface
Interface
as continuous improvement in asset management to
drive operational efficiency. Power monitoring
system offers the following features:
Preserve availability and reliability of the
Electrical Distribution system
Optimize quality of power
Reduce maintenance costs
Block 1,2,3 Block 4,5,6 Block 7,8,9 Block 10,11,12
Quick diagnosis helps reduce time to resolve MV SWBD MV SWBD MV SWBD MV SWBD

issues
Centralization in one or several places of all control Block1 Block 1 Block 1 Block 4 Block 4 Block 4 Block 7 Block 7 Block 7 Block 10 Block 10 Block 10
IT room 1 IT room 2 Mechanical IT room1 ITroom 2 Mechanical ITroom 1 ITroom 2 Mechanical ITroom1 ITroom2 Mechanical
and monitoring information for the electrical network
Block2 Block 2 Block 2 Block 5 Block 5 Block 5 Block 8 Block 8 Block 8 Block 11 Block 11 Block 11
Historic and archival data building for analysis ITroom 1 ITroom 2 Mechanical ITroom1 ITroom 2 Mechanical ITroom 1 ITroom 2 Mechanical ITroom1 ITroom2 Mechanical

and capacity planning. Block3 Block 3 Block 3 Block 6 Block 6 Block 6 Block 9 Block 9 Block 9 Block 12 Block 12 Block 12
ITroom 1 ITroom 2 Mechanical ITroom1 ITroom 2 Mechanical ITroom 1 ITroom 2 Mechanical ITroom1 ITroom2 Mechanical

POWER MONITORING SYSTEM MAIN FEATURES

© 2015 Schneider Electric. All rights reserved.

Document Number RD105DS Revision 0

[Reference Design 105] 6

Facility Cooling
This facility cooling system is optimized for oceanic climates, in Cooling system for 1 Block
places like San Francisco, with warm summers and cool winters, (Shown 1 of 12)
though it can be easily adapted to work in other types of climates. CHWR CHWS CHWS CHWR
IT & ER IT & ER IT & ER IT & ER
The design is made up of twelve identical stand-alone cooling
systems, one dedicated for each block. Each chilled water system DAS DAS

VFD
VFD

VFD

VFD

VFD

VFD
is comprised of a dual-path piping system with six air-cooled 1100 ET ET

kW packaged chillers with free cooling, accompanied by a

primary-secondary pumping scheme, with variable speed Thermal Thermal
Storage Storage
secondary pumps, all in an N+1 configuration. Also, a redundant
piping system across all the IT and electrical distribution rooms in
the block provide an alternate path for chilled water, in case of
equipment failure. Chiller Chiller Chiller Chiller Chiller Chiller

Economization is achieved with dry coolers integrated within each

chiller, to save energy during favorable outdoor conditions. In
Piping detail for 1 block
addition, thermal storage systems are offered to provide
continuous cooling after a power outage or chiller restart. These Batt. A

tanks would be sized accordingly for the ramp-up time of the ED A

chillers and building topology. IT Room 1 IT Room 2
Batt B
The redundant piping architecture of the mechanical system feeds
InRow RC units in the IT rooms and Uniflair chilled water room- ED B

based computer room air handlers (CRAHs) in both IT rooms and

in the LV electrical room. Additional air handling units are added CHWR
CHWS CHWS CHWR

to supply fresh air in the building and direct expansion (DX) units
are provisioned for the rooms containing the generator switchgear,
MV switchgear and UPS batteries.
DESIGN OPTIONS
This design is instrumented to work with StruxureWare Building This reference design can be modified as follows without a
Operation for cooling control and monitoring. Further design
significant effect on the design’s performance attributes:
details such as dimensions, equipment placement, temperature
set points, pipe sizing, flow rates, and pressure drops are
 Add StruxureWare Building Operation
available in the engineering package.

FACILITY COOLING ATTRIBUTES

Name Value Unit

Total facility cooling capacity 66 MW
Name Each block Value Unit
Total facility cooling capacity 66 MW
© 2015 Schneider Electric. All rights reserved.
Sub-system cooling capacity 5500 kW
Input voltage 480 Each block V
Sub-system
Heat rejection medium cooling capacity Chilled water 5500 kW
Number ofInput voltage
chillers 6 400 V
Heat
Mechanical rejection medium
redundancy N+1 Chilled water
Number of chillers 6
Packaged air-cooled chiller
Outdoor heat exchange
Mechanical redundancy with free-coolingN+1

Coolant supply temperature 15

Packaged chiller with free-°C
Outdoor heat exchange
cooling
Coolant return temperature 20.6 °C
EconomizerCoolant
type supply temperature Water-side 15 °C
Coolant return temperature 20.6 °C
Document Number RD105DS Storage tank size per sub-system 65.6 m3 Revision 0

Ride-through time 5 minutes

Economizer type Water-side

FACILITY COOLING ATTRIBUTES

[Reference Design 105] 7

IT Space
Twelve independent IT blocks can be built one by one to make up the IT DESIGN OPTIONS
space of this design. One block includes two IT rooms of 1908 kW This reference design can be modified
apiece. Each room is split into two zones: a medium-density area with
as follows without a significant effect on
150 NetShelter racks of 6 kW each, and a high-density area with 112
the design’s performance attributes:
NetShelter racks of 9 kW each. Altogether, they constitute 45.8 MW of IT
capacity for the whole site.
 Add environmental and security
In this design, each IT room is powered by redundant (2N) iBusway management
systems. Every rack has the capacity to accept dual power feeds, since  Change rack options
each is configured with redundant (2N) metered rack-mount power  Tall
distribution units (PDUs) which offer remote monitoring for improved  Wide
efficiency and capacity management.  Deep
 Change rack power distribution options
In medium-density zones, heat is removed by Uniflair chilled water room-  Basic
based CRAHs in an N+2 redundant configuration at the room level. In  Metered
high-density zones, heat is removed by InRow RC-HT units in an N+2  Switched
redundant configuration for each pair of rows. Considerations can be  Add StruxureWare Data Center Expert
made with respect to return air ducting systems and/or raised floors, to
improve the coolers’ performance. Redundant valves and piping are also
added to ensure continuous cooling with high reliability.
The security of the room is maintained at multiple points. At the rack
level, access is controlled by a door lock and sensor. At the room level,
security cameras are utilized for monitoring.

IT SPACE ATTRIBUTES

Name Value Unit

Total IT load 45.8 MW
Total number of blocks 12
IT load per block 3816 kW
IT room per block 2
IT load per room 1908 kW
IT floor space per room 730 m2
High Density Zone Medium Density Zone
IT zone load 1008 900 kW
Supply voltage to IT 415 415 V
Average density 9 6 kW/rack © 2015 Schneider Electric. All rights reserved.

Number of racks 112 150 racks

Single or dual cord Dual Dual
Chilled water InRow-HT Chilled water room-
CRAC/CRAH type
CRAHs based CRAHs
CRAC/CRAH redundancy N+2 per pair of rows N+2 per room

Document Number RD105DS Revision 0

[Reference Design 105] 8

Advantages of this Reference Design

 Extra-large size aims to deliver data centers for multi-tenant, co-location businesses with heterogeneous IT loads
 Highly scalable to control initial Capital Expenses and improve ROI
 Highly reliable with predictable performance
 Flexibility to populate IT space with different levels of power density, without compromising space utilization and efficiency
 This "end-to-end" solution considers constraints from utility to rack, for consistency and right sizing throughout the entire facility
 Chosen switchgear ratings are optimized to meet a balance between cost-efficiency and high performance
 Operating principles available to understand dynamics, maintenance and recovery situations
 High-end power monitoring systems are included to manage real time values, planning, and support optimization throughout
the entire life cycle of the data center

Schneider Electric Life-Cycle Services

Team of over 7,000 trained specialists covering
every phase and system in the data center

Standardized, documented, and validated

methodology leveraging automation tools and
repeatable processes developed over 45 years

Complete portfolio of services to solve your

technical or business challenge, simplify your
life, and reduce costs

Get more information on this design

Contact your Schneider Electric Account Manager to receive the Engineering Package for
this design which contains the electrical one line diagrams, piping diagrams, dimensioned
© 2015 Schneider Electric. All rights reserved.

floor layouts, and equipment lists.

Document Number RD105DS Revision 0