[Reference Design 106]
23.5 MW (ANSI), Chilled Water, 270000 ft2
DESIGN OVERVIEW
Data Center IT Capacity
Initial delivery of 3 MW
Scalable to 23.5 MW
Regional Voltage and Frequency
230kV, 69kV, 13.8kV, 400-480V
60Hz
Redundancy Levels
Power: 2N distribution to load, 2N
UPS, N+2 generators
Cooling: N+2 CRAHs, N+1 pumps,
N+1 chillers
DESIGN HIGHLIGHTS
Reduced TCO
High energy efficiency
Good reliability
Scalable design
Diverse IT load densities
INTRODUCTION
This data center design, optimized for IT Service Providers and Telecommunication
customers, aims for a reduced total cost of ownership (TCO), with a simplified and
standardized building-blocks approach.
Additional design benefits include high energy efficiency during operation, good reliability
with full redundancy by using a flexible dual path architecture, and a high degree of
scalability. This design allows for standardization of facilities worldwide, since only some
of the equipment selection would vary based on local standards. The data center is to be
built in six increments: two 3 MW blocks, two 4 MW blocks, and two 5MW blocks,
promoting scalability as IT demands increase.
This Data Center is made up by three types of building blocks, and each differs in the
density of the racks in the IT space while maintaining a similar footprint. Each block
contains two electrical rooms, two IT rooms, and a cooling system that serves the entire
block. Blocks 1 and 2 are referred to as type 1 and deliver 8 kW/rack per IT room, Blocks
3 and 4 are type 2 with 10 kW/rack, and Blocks 5 and 6 deliver 12 kW/rack as type 3.
These pieces constitute the building blocks for the data center; therefore, they make up
the final build-out and deliver 23520 kW of total IT load.
[Reference Design 106] 2

Facility Power
UTILITY CONNECTION
The data center is designed for 38 MVA maximum demand, which requires a connection to the electrical utility high voltage (HV)
sub-transmission network. Responsibility for substation construction and the point of common coupling, POCC, may vary with the
region and negotiated rate structure. The location of the utility meter is shown on the high voltage side of the transformer but may
be located on the medium voltage side of the transformer. Substation construction, equipment procurement responsibilities and
meter location are determined during the interconnection application process.

PRIMARY MEDIUM VOLTAGE (MV) DISTRIBUTION

This electrical architecture offers high reliability since the HV/MV substation design ensures full redundancy, allowing for concurrent
maintenance of the equipment without having to run the generator set. Two HV utility incomers feed two HV single busbars, which
are connected through a bus section for 2N redundancy. Then, two 38 MVA power transformers with on-load tap changer (OLTC)
supply all six IT blocks. The MV distribution voltage may be determined by the data center customer - 15 kV distribution voltage is
most common. Transformer short circuit impedance is based on the ANSI standard and is determined by the HV Basic Insulation
Level (BIL). The primary MV distribution for this data center design is 2N redundant, comprising twelve units of Masterclad
switchgear, each one rated at 15 kV and 25 kA with a 2000 A busbar to ensure cost optimization. Each pair of these Masterclad
switchgear lineups feed one IT block, for A and B-side distribution.

HV/MV Substation and Primary MV Distribution

Utility A Utility B

KWh KWh

52 52

38MVA 38MVA
HV HV
138kV- 138kV-
MV MV
13.8kV 13.8kV

MV Primary Dist. MV Primary Dist.

SWG A SWG B Masterclad
2000A, 13.8kV 2000A, 13.8kV
BLOCK 1
BLOCK 2
BLOCK 3
BLOCK 4
BLOCK 5
BLOCK 6

FACILITY POWER HV/MV SUBSTATION ATTRIBUTES

Name Value Unit

Utility voltage >115 kV © 2015 Schneider Electric. All rights reserved.

Number of blocks supported 6

Power path Dual
Quantity of HV/MV transformer(s) 2
HV/MV transformer size 38 MVA
Number of MV primary distribution switchgear 2
MV primary distribution bus amps 2000 A
MV primary distribution bus voltage 13.8 [15 kV Class] kV
MV primary distribution switchgear kA 25 kA

Document Number RD106DS Revision 0

[Reference Design 106] 3

Facility Power
SECONDARY MEDIUM VOLTAGE DISTRIBUTION

To reduce initial investment and ensure a good scalability approach, each block is independent in terms of primary and secondary
MV distribution. However, a MV back up diesel generator power plant is shared across two blocks to reduce the total cost.
Automatic transfer between main power and backup generators is built into the design.
A total of 56 HVL/cb switchgear lineups make up the secondary set of medium voltage distribution for all blocks, with distribution
switchgear rated at 15 kV, 1200 A. 12 of the HVL/cb switchgear lineups feed Type 1 blocks (two per IT room and two per cooling
system), 20 feed Type 2 blocks (four per IT room and two per cooling system), and 24 feed Type 3 blocks (four per IT room and
four per cooling system), all in a 2N architecture where half of the units provide A-side power and the other half B-side power.
The diesel generator backup power is coupled to the MV network with a LV/MV step-up 2500 kVA Power Dry II VPI cast resin
transformer with a 5.75% short circuit impedance and HVL/cb switchgear lineup rated at 15 kV with a 1200 A rated busbar.
Seven and nine 2500 kVA, 480 V generators, correspondingly, provide N+1 LV power for each pair of block types 1 and 2, while
eleven 2500 kVA generators provide N+2 power for type 3 blocks. This choice of backup generator plant configuration provides
high reliability and safety, while minimizing cost. Fuel storage and piping can also be added to the design in accordance with
regional requirements and regulations.
Secondary MV Distribution
MV Primary Dist. MV Primary Dist.
SWG A SWG B

Two Blocks
N units DESIGN OPTIONS
G N=7 Blocks 1&2 G
2500kVA N=9 Blocks 3&4 2500kVA This reference design can be modified
480V LV N=11 Blocks 5&6 LV 480V
13.8kV MV MV 13.8kV as follows without a significant effect on
5.75%Z 5.75%Z

Genset SWG
the design’s performance attributes:
1200A, 13.8 kV

 Redundant generator switchgear set

 Provision for load bank
ATS ATS ATS ATS
 Add/change standby generator options :
MV Secondary MV Secondary MV Secondary MV Secondary
Dist. SWG A Dist. SWG A Dist. SWG B Dist. SWG B HVL/cb  Location
1200A, 13.8 kV 1200A, 13.8 kV 1200A, 13.8 kV 1200A, 13.8 kV  Tank size
BLOCK
 Fuel type
BLOCK

Name Value
FACILITY POWER MV DISTRIBUTION ATTRIBUTES Unit
Blocks 1, 2 Blocks 3, 4 Blocks 5, 6
Number of MV secondary distribution switchgear per block 6 10 12
MV secondary distribution bus amps 1200 1200 1200 A
MV secondary distribution bus voltage 13.8 [15 kV Class] 13.8 [15 kV Class] 13.8 [15 kV Class] kV
© 2015 Schneider Electric. All rights reserved.

MV secondary distribution switchgear short time withstand

25 25 25 kA
current
Generator redundancy N+1 N+1 N+2
Number of Generators per block 7 9 11
Generator size 2500 2500 2500 kVA
Generator voltage 480 480 480 V

Document Number RD106DS Revision 0

[Reference Design 106] 4

Facility Power
LOW VOLTAGE DISTRIBUTION

Downstream from the MV secondary distribution, each block is comprised of three parts with MV/LV transformers which serve LV
switchboards. Two of these groups are dedicated to two IT rooms and the other group to the cooling system and auxiliaries that
serve the whole block.
A total of 56 Power Dry II transformers, ranging from 1250 to 2000 kVA, are used in this design to transform power from 15 kV to 415
V with 5.75% impedance for the IT rooms and from 15 kV to 480 V with 5.75% impedance for cooling and auxiliaries, in a close-
coupling installation. The same number of LV QED 6 LV switchboards makes up the LV distribution and is distributed as follows: for
each type 1 block there are four switchboards rated at 415V, 85 kA with a 4000 A bus for IT and two switchboards rated at 480V, 85
kA with a 4000 A bus for cooling; for type 2 blocks there are eight units rated at 415V, 85 kA with a 4000 A bus for IT and two more
at 480V, 85 kA with a 4000 A bus for cooling; and, finally, for each type 3 block there are eight switchboards rated at 415V, 85 kA
with 4000 A bus for IT, and four for cooling rated at 480V, 85 kA, with 4000 A bus.
On each IT power train the QED 6 switchboards feed 2N Symmetra PX arranged for an A and B-side distribution. Downstream from
the electrical rooms to the IT space there is a combination of LV switchgear and iBusway systems with built-in intelligence for 2N
power distribution. In the mean time, the QED 6 units that make up the cooling power train provide A- and B-side distribution to
chillers, pumps, lighting, monitoring, security and automation systems, etc., while providing fault protection to cooling units in the IT
and electrical rooms.
The facility power system is designed to also support integrated peripheral devices like fire panels, access control systems, and
environmental monitoring and control devices. Power meters in the electrical path monitor power quality and allow for predictive
maintenance & diagnostics of the system. These meters as well as digital [MV & LV relays] also integrate with StruxureWare Power
Monitoring Expert.
Every component in this Reference Design is built and tested to the applicable ANSI standards. Further design details and
schematics are available in the engineering package, which can be requested at the end of this document.

DESIGN OPTIONS
This reference design can be
modified as follows without a
significant effect on the design’s
performance attributes:

 Change UPS batteries: © 2015 Schneider Electric. All rights reserved.

 Location
 Type

Document Number RD106DS Revision 0

[Reference Design 106] 5

FACILITY POWER LV DISTRIBUTION ATTRIBUTES

Name Value Unit

Blocks 1, 2 Blocks 1, 2 Blocks 3, 4 Blocks 3, 4 Blocks 5, 6 Blocks 5, 6
(IT) (Cooling) (IT) (Cooling) (IT) (Cooling)
Number of MV/LV
8 4 16 4 16 8
transformer per block
MV/LV transformer size 2 2 1.25 2.5 1.6 1.6 and 2 MVA
Number of LV critical
8 4 16 4 16 8
switchboard
LV critical bus amps 4000 4000 4000 4000 4000 4000 A

LV critical bus voltage 415 480 415 480 415 480 V

© 2015 Schneider Electric. All rights reserved.

LV critical switchboard kA 85 85 85 85 85 85 kA
2N for IT coolers 2N for IT coolers 2N for IT coolers
and pumps and pumps and pumps
UPS redundancy 2N 2N 2N
N for UPS N for UPS N for UPS
coolers coolers coolers
Total UPS capacity per
3600 288 4200 288 5400 360 kW
block
UPS runtime @ rated load 5 5 5 5 5 5 minutes

UPS output voltage 415 480 415 480 415 480 V

Document Number RD106DS Revision 0

[Reference Design 106] 6

Facility Power
POWER MONITORING

The power monitoring system is part of the DCIM

(Data Center Infrastructure Management System)
system which measures, monitors tracks, and
controls all aspects of the physical data center in a
real time. In addition, it optimizes planning, as well User
as continuous improvement in asset management to User
Interface
Interface
drive operational efficiency. Power monitoring
system offers the following features:
Improve availability and reliability of the Electrical
Distribution system
Optimize quality of power
Reduce maintenance costs
Quick diagnosis helps reduce time to resolve
issues
Centralization in one or several places of all control
Block 1&2 Block 3&4 Block 5&6
and monitoring information for the electrical network MV SWBD MV SWBD MV SWBD

Historic and archival data building for analysis

and capacity planning.
Block1 Block 1 Block 1 Block 3 Block 3 Block 3 Block 5 Block 5 Block 5
IT room 1 IT room 2 Mechanical IT room 1 IT room 2 Mechanical IT room 1 IT room 2 Mechanical

Block2 Block 2 Block 2 Block 4 Block 4 Block 4 Block 6 Block 6 Block 6

IT room 1 IT room 2 Mechanical IT room 1 IT room 2 Mechanical IT room 1 IT room 2 Mechanical

POWER MONITORING SYSTEM MAIN FEATURES

POWER MONITORING SYSTEM MAIN FEATURES

© 2015 Schneider Electric. All rights reserved.

Document Number RD106DS Revision 0

[Reference Design 106] 7

Facility Cooling
This facility cooling system is meant for climates in places like
Boston, with warm summers and cold, snowy winters, though it Cooling system for Type 1 Blocks (shown as example)
can be easily adapted to work in other climates. CHWR CHWS CHWS CHWR
IT & ER IT & ER IT & ER IT & ER
The facility cooling design is made up of six stand-alone cooling
systems sized specifically to serve each type of block. Every DAS DAS

VFD
VFD

VFD

VFD

VFD

VFD
chilled water system is comprised of a dual-path piping system ET ET

with N+1 redundant air-cooled packaged chillers with free cooling,

accompanied by a primary-secondary pumping scheme, with Thermal Thermal
Storage Storage
variable speed secondary pumps, all in an N+1 configuration.
Also, a redundant piping system across all the IT and electrical
distribution rooms in the block provide an alternate path for chilled
water, in case of equipment failure. Chiller Chiller Chiller Chiller Chiller Chiller

In this cooling system design, economization is achieved with dry

coolers integrated within each chiller, to save energy during
Piping detail for 1 block
favorable outdoor conditions. In addition, thermal storage systems
are offered to provide continuous cooling after a power outage or Batt. A

chiller restart. These tanks would be sized accordingly for the ED A

ramp-up time of the chillers and building topology. IT Room 1 IT Room 2
Batt B
The redundant piping architecture of the mechanical system feeds
InRow RC units in the IT rooms and Uniflair chilled water room- ED B

based computer room air handlers (CRAHs) in the LV electrical

rooms. Additional air handling units are added to supply fresh air CHWR
CHWS CHWS CHWR

in the building and direct expansion (DX) units are provisioned for
the rooms containing the generator switchgear, MV switchgear
and UPS batteries.
DESIGN OPTIONS
This design is instrumented to work with StruxureWare Building This reference design can be modified as follows without a
Operation for cooling control and monitoring. Further design ` significant effect on the design’s performance attributes:
details such as dimensions, equipment placement, temperature
set points, pipe sizing, flow rates, and pressure drops are
 Add StruxureWare Building Operation
available in the engineering package.

DESIGN OPTIONS
FACILITY COOLING ATTRIBUTES
Facility
Name
Cooling This reference design can be modified as follows without a
significant effect on the design’s performance
Value Unit attributes:
Total facility cooling capacity 27 MW
This facility cooling system is meant for climates in places
Blocks 1, 2 like Blocks 3, 4 Add StruxureWare Building Operation
Blocks 5, 6
Name
Boston orSub-system
Malmö, with warm summers and cold, snowy
Value
winters,
Unit
© 2015 Schneider Electric. All rights reserved.
cooling capacity 3375 4500 5625 kW
Total facility
though it can easilycooling capacity 66 MW
Inputbevoltage adapted to work in other climates.
480 480 480 V
The facilityHeat
cooling design
rejection is made up of six stand-alone
medium Each
Chilled water block Chilled water
cooling Chilled water
Sub-system
systems sized
Number coolingto
specifically
of chillers capacity
serve each type of block. 5 5500
Every 6 kW 7
chilled water system
Input voltage is comprised
Mechanical redundancy of a dual-path piping
N+1 system
400 N+1 V N+1
with N+1 redundant air-cooled
Heat rejection medium packaged chillers with freeChilled
cooling,water
Packaged air-cooled Packaged air-cooled Packaged air-cooled
accompanied Outdoor
by heat exchange
a primary-secondary pumping scheme, withchiller with free-cooling chiller with free-cooling
chiller with free-cooling
Number of chillers 6
variable speed secondary pumps, all in an N+1 configuration.
Coolant supply
Mechanical temperature
redundancy 15 N+1 15 15 °C
Also, a redundant piping system across all the IT and electrical
Coolant return temperature 20.6 20.6 20.6 °C
distribution rooms in the block provide an alternate path for chilled
Packaged chiller with free-
Outdoor heat
Economizer exchange
type Water-side cooling Water-side Water-side
water, in case of equipment failure.
Coolant
In this cooling supply
system temperature
design, economization is achieved with 15dry °C
coolers Coolant
integrated return
Document Number RD106DS
temperature
within each chiller, to save energy 20.6
during °C Revision 0
favorable outdoor
Storage conditions. In addition, thermal storage systems
tank size per sub-system 65.6 m3
are offeredRide-through
to provide continuous
time
cooling after a power outage5 or minutes
chiller restart. These tanks would be sized accordingly for the
ramp-up timeEconomizer type and building topology.
of the chillers Water-side
[Reference Design 106] 8

IT Space
Six IT blocks are built one by one to make up the IT space of this design.
DESIGN OPTIONS
One block includes two IT rooms with 196 NetShelter racks each, so all
This reference design can be modified
rooms have a similar footprint even though they have different IT
as follows without a significant effect on
capacities. In type 1 blocks, each IT room houses racks of 8kW each, in
type 2 blocks the rack density is 10kW, and in type 3 blocks the rack the design’s performance attributes:
density is 12kW. Altogether they provide 23.52 MW of IT capacity for the
 Add environmental and security
whole site.
management
In this design, each IT room is powered by redundant (2N) iBusway  Change rack options
systems. Every rack has the capacity to accept dual power feed, since  Tall
each is configured with redundant (2N) metered rack-mount power  Wide
distribution units (PDUs) to enable remote monitoring of the units for  Deep
efficiency and capacity management.  Change rack power distribution options
 Basic
In all rooms, heat is removed by InRow RC-HT units in an in an N+2  Metered
redundant configuration for each pair of rows. Considerations can be  Switched
made with respect to return air ducting systems and/or raised floors, to  Add StruxureWare Data Center Expert
improve the coolers’ performance. Redundant valves and piping are also
added to ensure continuous cooling with high reliability.
The security of the room is maintained at multiple points. At the rack
level, access is controlled by a door lock and sensor. At the room level,
security cameras are utilized for monitoring.

IT SPACE ATTRIBUTES

Name Value Unit

Total IT load 23.52 MW
Block 1, 2 Block 3, 4 Block 5, 6
IT load per block 3136 3920 4704 kW
IT rooms per block 2 2 2
IT Room IT Room IT Room
IT load per room 1568 1960 2352 kW
Input voltage/ supply voltage to IT 415 415 415 V
Average density 8 10 12 kW/rack
Number of racks 196 196 196 racks
2
IT floor space 584 584 584 m
© 2015 Schneider Electric. All rights reserved.

Single or dual cord Dual Dual Dual

Chilled water InRow- Chilled water InRow- Chilled water InRow-
CRAC/CRAH type
HT CRAHs HT CRAHs HT CRAHs
CRAC/CRAH redundancy N+2 per pair of rows N+2 per pair of rows N+2 per pair of rows

Document Number RD106DS Revision 0

[Reference Design 106] 9

Advantages of this Reference Design

 Large size aims to deliver data center for private cloud or hosting managed services businesses with evolving IT
 Optimize CapEx and OpEx for reaching the best possible TCO from day one
 Highly reliable solution with predictive performance value (outstanding people safety, efficiency, footprint)
 Comply with high efficiency requirements to optimize the OpEx
 Proposed evolving IT equipment density to achieve the best performance along the life-cycle
 End-to-end solution considering constraints from "utility to rack" for full architecture consistency and right sizing
 Equipment ratings chosen are optimized for components sizing to meet an excellent low cost/ high performance ratio
 Operating principles available to understand dynamics, maintenance and recovery situations
 High-end power monitoring systems included to manage real time data, planning and support optimization in the data center
life-cycle

Schneider Electric Life-Cycle Services

Team of over 7,000 trained specialists covering
every phase and system in the data center

Standardized, documented, and validated

methodology leveraging automation tools and
repeatable processes developed over 45 years

Complete portfolio of services to solve your

technical or business challenge, simplify your
life, and reduce costs

Get more information on this design

Contact your Schneider Electric Account Manager to receive the Engineering Package for
© 2015 Schneider Electric. All rights reserved.

this design which contains the electrical one line diagrams, piping diagrams, dimensioned
floor layouts, and equipment lists.

Document Number RD106DS Revision 0