[Reference Design 104]

14 MW (IEC), Chilled Water, 28000 m2

DESIGN OVERVIEW
Data Centre IT Capacity
Initial delivery of 1.73 MW
Scalable to 13.8 MW
Regional Voltage and Frequency
22 kV, 400 V
50 Hz
Redundancy Levels
Power: 2N distribution to load, 2N
UPS, N+1 generators
Cooling: N+2 CRAHs, N+1
pumps, N+1 chillers
INTRODUCTION
This Reference Design is optimized for telecommunication companies and service
providers located in densely populated areas, with an emphasis on initial capital expense
(CapEx), redundancy, time to market (TTM), and footprint. The data centre is meant to
be built out in eight increments of 1.73MW blocks. Each block is located on a single floor
of a multi-story building, made up of two IT rooms, two electrical rooms and a cooling
system that is shared by two blocks. Every IT room has two distinct zones: a higher
density zone containing 72 racks at 7kW/rack, and a lower density zone containing 72
racks at 5 kW/rack. Together, these rooms and systems constitute the building blocks for
the data centre. Each data centre expansion, therefore, is designed to occur in
increments of 1728 kW of IT load.

DESIGN HIGHLIGHTS
Minimized initial CapEx
High reliability
Reduced TTM
Optimized footprint in multi-story
building design
Flexible IT space
[Reference Design 104] 2

Facility Power
UTILITY CONNECTION
The data centre is designed for a maximum demand of 23 MVA, which requires a connection to the electric utility’s medium voltage
(MV) distribution network. Depending on the country and region, the supply voltage could vary from 6.6/22/66 kV (e.g. Singapore),
to 10/110 kV (e.g. China) and up to 11/33/132 kV (e.g. Hong Kong). In this design the supply voltage is considered to be below 24
kV. Depending on the country requirements, the substation may or may not be built, owned and operated by the utility or owner. For
example, in Singapore the building owner will be responsible for building the MV substation within the building premises based on
the requirements by the utility company, who will control and maintain the substation since it will provide MV gear, cables, metering
equipment for “A” and “B” sides, etc. Then, an additional space is required to house the building’s MV equipment for taking in the
supply from the utility and for further distribution.

MAIN MEDIUM VOLTAGE (MV) DISTRIBUTION

The main MV distribution equipment is located in the lowest level of the building and is designed to allow for concurrent
maintenance of the equipment without needing to run the generator set. The site is supplied by four incomers 22kV (2x2 incomers in
redundancy) on the main MV switchboard, which is split by a bus tie to separate the paths A & B. Electricity is then distributed to the
data centre through four GMAe switchgear lineups rated at <24 kV and 25 kA (1s) with a 630 A busbar, for A and B-side distribution.
These GMAe lineups connect all the IT and cooling blocks of the data centre, other cooling and non-critical auxiliaries in the
building, and the generator plants. This equipment selection significantly reduces switchgear footprint and ensures optimum
operation in harsh environments with high levels of humidity.

MV Substation and MV Distribution

Utility A Utility A Utility B Utility B

KWh KWh KWh KWh

MV Dist. SWG MV Dist. SWG MV Dist. SWG MV Dist. SWG

A1 A2 B1 B2 GMAe
630A, <24kV 630A, <24kV 630A, <24kV 630A, <24kV

Cooling & BLOCKS BLOCKS Genset Genset

auxiliaries 1-4 5-8 SWG 1 SWG 2

FACILITY POWER MV SUBSTATION ATTRIBUTES

Name Value Unit

Utility voltage 24 < Un kV
Number of blocks supported 8
Power path Dual
© 2015 Schneider Electric. All rights reserved.

Quantity of HV/MV transformer(s) N/A

HV/MV transformer size N/A MVA
HV/MV transformer short circuit impedance N/A %
Quantity of MV primary distribution switchgear lineups 4
MV primary distribution bus amps 630 A
MV primary distribution bus voltage 24 < Un kV
MV primary distribution switchgear short time withstand
25 (1) kA (s)
current

Document Number RD104DS Revision 0

[Reference Design 104] 3

Facility Power
GENERATOR BACKUP POWER AND MEDIUM VOLTAGE DISTRIBUTION

Downstream of the main MV distribution, there are twenty GMAe switchgear lineups rated at <24 kV and 25 kA (1s) with a 630 A
busbar. Eight pairs of GMAe lineups feed eight IT blocks in a 2N architecture, to provide A- and B-side power. Each pair is
connected by a “coupling cable” to maintain redundancy downstream of a failure. The rest of the lineups feed four cooling systems
shared across the eight IT load blocks. Other cooling and non-critical auxiliaries receive power directly from the main MV
distribution switchgear.
There are two diesel generator plants that can be built in stages as business scales, each one serving four blocks. There is an
automatic transfer capability between mains and backup power built into the design. A total of 15 generators with 2500 kVA
capacity, rated at 400 V with N+1 redundancy serve the entire data centre: eight units in the first plant serve blocks 1 to 4 plus
comfort cooling and non-critical auxiliary loads, and seven in the second plant serve blocks 5 to 8. Each unit is coupled to the MV
network through LV/MV step-up 2500 kVA Trihal cast-resin transformers with 6% short circuit impedance, and additional GMAe
switchgear lineups. This backup generator plant configuration provides high reliability and safety, while minimizing cost. For full
Uptime Tier III compliance, a set of redundant GMAe MV switchgear could be added to the design. In addition, fuel storage and
piping can also be added to the design in accordance with country habits and regulations. The generator plants are located in the
third and fourth floors of the data centre building, above the main MV distribution and office floors, with provisioned ventilation and
cooling.

Utility A
MV Distribution to Blocks Utility B DESIGN OPTIONS
Four Blocks (1-4)
This reference design can be
G G 8 x 2500 kVA units
(blocks 1-4) modified as follows without a
LV LV
MV MV significant effect on the design’s
Genset SWG 630A, performance attributes:
<24kV
ATS ATS

 Redundant generator
MV Dist. SWG A1 MV Dist. SWG B1
GMAe switchgear set
630A, <24 kV 630A, <24kV
 Provision for load bank
 Add/change standby
generator options:
MV IT
A
MV IT
B
MV IT
A
MV IT
B
MV IT
A
MV IT
B
MV IT
A
MV IT
B
MV MV
Cool. A Cool. B  Location

COOLING
 Tank size
BLOCK BLOCK BLOCK BLOCK COOLING COOLING & AUX.
 Fuel type

FACILITY POWER MV DISTRIBUTION ATTRIBUTES

Name Value Unit © 2015 Schneider Electric. All rights reserved.

Per 4 blocks
Number of MV distribution switchgear lineups 2
MV distribution bus amps 630 A
MV distribution bus voltage 24 < Un kV
MV distribution switchgear short time withstand
25 (3) kA (s)
current
Generator redundancy N+1
Number of Generators 7 or 8
Generator size 2500 kVA
Generator voltage 400 V

Document Number RD104DS Revision 0

[Reference Design 104] 4

Facility Power
LOW VOLTAGE DISTRIBUTION

Downstream from the MV distribution, the 2N redundant electric supply is separated into LV sections. 16 sections feed one IT block
each, four feed the cooling systems for all blocks, and two more feed additional cooling and non-critical auxiliaries. A and B-side
distribution is made with a total of 26 Trihal transformers (at 6% impedance), used to transform voltage from 22 kV to 400 V.
The LV distribution for all IT rooms is made up by 16 Trihal 2000 kVA transformers coupled with the same number of Okken LV
lineups, each rated at 400 V and 50 kA (1s) with a 3200 A bus to minimize cost and maximize the IT capacity per bus. Each Okken
lineup feeds 4 Galaxy 7000 UPSs in a 2N configuration, as an A and B-side distribution, which then feed the IT load through a
combination of 2N LV switchgear and iBusway systems, with built in intelligence.
Cooling systems and auxiliary loads for all blocks receive power from eight Okken lineups, each coupled with a MV/LV Trihal
transformer rated at 1600 kVA for blocks 1 and 2 and rated at 1250 kVA for blocks 3 to 8. They provide A and B-side distribution to
chillers, pumps, cooling towers, and auxiliaries. Additional cooling and auxiliary loads for the building are fed from the non-critical
path through two Trihal 2500 kVA transformers. They supply redundant power for comfort cooling and accessories in the building,
and for 2N Galaxy 7000 UPSs feeding secondary pumps and perimeter coolers in the critical spaces.
The facility power system is designed to also support integrated peripheral devices like fire panels, access control systems, and
environmental monitoring and control devices. Power meters in the electrical path monitor power quality and allow for predictive
maintenance & diagnostics of the system. These meters also integrate with StruxureWare Power Monitoring Expert.
Every component in this Reference Design is built and tested to the applicable IEC standards. Further design details and
schematics are available in the Engineering Package available upon request.
LV Distribution to final loads per Block
MV Dist. SWG A1 MV Dist. SWG B1 DESIGN OPTIONS
Blocks 1&2 (shown two of eight blocks) This reference design can
be modified as follows
MV IT A MV IT B MV IT A MV IT B MV Cool. A MV Cool. B without a significant effect
Trihal
MV 2MVA
MV
LV
MV 2MVA
MV
LV
MV
LV
1.6MVA
MV
LV
MV 2.5MVA MV on the design’s
LV LV LV LV
Cooling Cooling performance attributes:
LV Crit. A1 LV Crit. B1 LV Crit. A2 LV Crit. B2 LV Cool. A LV Cool. B
& aux. A & aux. B
3200A, 400V 3200A, 400V 2500A, 400V  Change UPS
UPS UPS UPS UPS
Okken UPS UPS batteries
LV Dist. A LV Dist.B LV Dist. A LV Dist.B
 Location
Block 1 Block 2 Cooling & Auxiliaries CRAHs & Non-crit.  Type
IT Rooms 1&2: 1728 kW IT Rooms 1&2: 1728 kW Blocks 1&2 Pumps

FACILITY POWER LV DISTRIBUTION ATTRIBUTES

Name Value DESIGN

Unit OPTIONS
IT in each block Cooling for all blocks This reference design can
be modified as follows
© 2015 Schneider Electric. All rights reserved.
Number of MV/LV transformer 2 10
without a significant effect
MV/LV transformer size 2 1.25-1.6-2.5 MVA
on the design’s
Number of LV critical switchgear 2 10
performance attributes:
LV critical bus amps 3200 2000-2500-4000 A
LV critical bus voltage 400 400 V
 Change UPS
LV critical switchgear short time withstand current 50 (1) 30 (1)-40 (1)-70 (1) kA (s)
batteries
UPS redundancy 2N 2N
 Location
Total UPS capacity 2000, per block 1000 kW  Type
UPS runtime @ rated load 5 5 minutes
UPS output voltage 400 400 V

Document Number RD104DS Revision 0

[Reference Design 104] 5

Facility Power
POWER MONITORING

The power monitoring system is part of the DCIM

(Data Center Infrastructure Management System)
system which measures, monitors tracks, and
controls all aspects of the physical data centre in a
real time. In addition, it optimizes planning, as well
as continuous improvement in asset management to
drive operational efficiency. Power monitoring
system offers the following features:
Improve availability and reliability of the Electrical Utility
Connection
Distribution system
Block 1,2,3,4 Block 1,2,3,4 Block 5,6,7,8 Genset Block 5,6,7,8
Genset
Optimize quality of power MV switchboard
A SWBD
MV switchboard
B
MV switchboard
A SWBD MV switchboard
B

Reduce maintenance costs

Quick diagnosis helps reduce time to resolve Aux
Panel
Block
IT 1
Block
IT 2
Block
IT 3
Block
IT 4
Block
IT 5
Block
IT 6
Block
IT 7
Block
IT 8
issues
Chillers Chillers Chillers Chillers Chillers Chillers Chillers Chillers
Office 1-A 1-B 2-A 2-B 3-A 3-B 4-A 4-B
Centralization in one or several places of all control SWBD
Critical Critical Critical Critical Critical Critical Critical Critical
and monitoring information for the electrical network Pump A Pump B Pump A Pump B Pump A Pump B Pump A Pump B

Historic and archival data building for analysis Chiller Chiller

room room
and capacity planning. cooling A cooling B

POWER MONITORING SYSTEM MAIN FEATURES

© 2015 Schneider Electric. All rights reserved.

Document Number RD104DS Revision 0

[Reference Design 104] 6

Facility Cooling
This facility cooling design is optimized for hot and humid climates in Cooling system for 2 Blocks
places like Singapore or Hong Kong. However, it can be easily
adapted to work in other climates. It is made up of five stand-alone MUWP MUWP
Make up Make up
systems with water-cooled chillers and cooling towers: four identical water tank water tank
systems serve the blocks and one serves the offices with comfort CWP CWP CWP

cooling.
Chiller Chiller Chiller Chiller Chiller
Each pair of blocks share one cooling system comprised of six water-
PCHWP PCHWP PCHWP PCHWP PCHWP
cooled Uniflair BRRC-4802A chillers, primary-secondary variable flow
pumps, and three cooling towers, all in an N+1 configuration. In Thermal Thermal
addition, thermal storage and make up water systems are offered to Storage Storage

provide continuous cooling. These tanks would be sized accordingly

VFD

VFD

VFD

VFD

VFD
SCHWP SCHWP SCHWP SCHWP SCHWP
for ramp-up time of the chillers and building topology.
DAS DAS

A redundant piping system distributed across each IT floor provides ET ET

Batt. A
an alternate path for chilled water in case of equipment failure. The
ED A
IT Room 1 IT Room 2
piping architecture feeds InRow RC units and Uniflair chilled water (Block 2) (Block 2)
ED B
room-based computer room air handlers (CRAHs) in the IT, LV Batt. B
electrical distribution, and battery rooms. Additional air handling units
are added to supply fresh air in the building and direct expansion Batt. A
(DX) units are provisioned for the rooms containing the generator IT Room 1 ED A IT Room 2
(Block 1) (Block 1)
Batt B
switchgear, MV switchgear and UPS batteries. ED B

The cooling equipment for the whole data centre is distributed as

follows: cooling towers and condenser water pumps are placed in the
roof; chillers, primary-secondary loop pumps and their electrical DESIGN OPTIONS
distribution equipment are located in the top floor; and thermal This reference design can be modified as follows
storage and make-up water tanks are located in lower levels. without a significant effect on the design’s performance
This design is instrumented to work with StruxureWare Building attributes:
Operation for cooling control and monitoring. Further design details  Add StruxureWare Building Operation
such as dimensions, equipment placement, temperature set points,
pipe sizing, flow rates, and pressure drops are available in the
Engineering Package.

FACILITY COOLING ATTRIBUTES

Name Value Unit

Total facility cooling capacity 23.5 MW
Name Each blockValue Unit
Sub-system cooling
Total facilitycapacity
cooling capacity 5345 66 kW MW © 2015 Schneider Electric. All rights reserved.
Input voltage 400 Each block V
Heat rejection mediumcooling capacity
Sub-system Chilled water5500 kW
Number of chillers
Input voltage 6 400 V
Number of cooling
Heat towers
rejection medium 3 Chilled water
Mechanical redundancy
Number of chillers N+1 6
Mechanical redundancy Water-cooled chiller
N+1
Outdoor heat exchange
coupled with cooling tower
Packaged chiller with free-
Outdoor
Coolant supply heat exchange
temperature 15 °C
cooling
Coolant return temperature
Coolant supply temperature 20.6 15 °C °C
Economizer type return temperature
Coolant Water-side 20.6 °C
3
Storage tank size per sub-system 65.6 m
Document Number RD104DS Revision 0
Ride-through time 5 minutes

Economizer type Water-side

FACILITY COOLING ATTRIBUTES

[Reference Design 104] 7

IT Space
Eight independent IT blocks can be built one by one to make up the IT DESIGN OPTIONS
space of this design. One block includes two IT rooms of 864 kW apiece This reference design can be modified
on each floor of the data center. Each room is split into two zones: a
as follows without a significant effect on
medium-density area with 72 NetShelter racks of 5 kW each, and a high-
the design’s performance attributes:
density area with 72 NetShelter racks of 7 kW each. Altogether, they
constitute 13.8 MW of IT capacity for the whole site.
 Add environmental and security
In this design, each IT room is powered by redundant (2N) iBusway management
systems. Every rack has the capacity to accept dual power feeds, since  Change rack options (tall, wide, deep)
each is configured with redundant (2N) metered rack-mount power  Change power distribution options (rack
distribution units (PDUs) which offer remote monitoring for improved PDU type: basic, switched)
 Add StruxureWare Data Centre Expert
efficiency and capacity management.
In lower-density zones, heat is removed by Uniflair chilled water room-
based CRAHs in an N+2 redundant configuration at the room level. In
higher-density zones, heat is removed by InRow RC-HT units in an N+2
redundant configuration for each pair of rows. Considerations can be
made with respect to return air ducting systems and/or raised floors, to
improve the coolers’ performance. Redundant valves and piping are also
added to ensure continuous cooling with high reliability.
The security of the room is maintained at multiple points. At the rack
level, access is controlled by a door lock and sensor. At the room level,
security cameras are utilized for monitoring.

IT SPACE ATTRIBUTES

Name Value Unit

Total IT load 13.8 MW
Total number of blocks 8
IT load per block 1728 kW
IT room per block 2
IT load per room 864 kW
2
IT floor space per room 407 m
High Density Zone Medium Density Zone
IT zone load 504 360 kW
Supply voltage to IT 230 / 400 230 / 400 V
Average density 7 5 kW/rack © 2015 Schneider Electric. All rights reserved.

Number of racks 72 72 racks

Single or dual cord Dual Dual
Chilled water InRow-HT Chilled water room-
CRAC/CRAH type
CRAHs based CRAHs
CRAC/CRAH redundancy N+2 per pair of rows N+2 per room

Document Number RD104DS Revision 0

[Reference Design 104] 8

Advantages of this Reference Design

 Large size aims to deliver data centres for co-location, telecommunication, and, potentially, enterprise businesses with
heterogeneous IT loads
 Highly scalable to control initial CapEx
 Highly reliable with predictable performance
 Multi-story architecture for data centres located in areas of limited footprint available
 Cooling system adapted to tropical zones with hot and humid climates
 Flexibility to populate IT space with different levels of power density, without compromising space utilization and efficiency
 This "end-to-end" solution considers constraints from utility to rack, for consistency and right sizing throughout the entire
facility
 Chosen switchgear is optimized to meet a balance between cost-efficiency and high performance, while reducing footprint
and ensuring proper functioning in harsh environments
 Switchgear selection is optimized to reduce footprint
 Operating principles available to understand dynamics, maintenance and recovery situations
 High-end power monitoring systems are included to manage real time values, planning, and support optimization throughout
the entire life cycle of the data centre

Schneider Electric Life-Cycle Services

Team of over 7,000 trained specialists covering
every phase and system in the data centre

Standardized, documented, and validated

methodology leveraging automation tools and
repeatable processes developed over 45 years

Complete portfolio of services to solve your

technical or business challenge, simplify your
life, and reduce costs © 2015 Schneider Electric. All rights reserved.

Get more information on this design

Contact your Schneider Electric Account Manager to receive the Engineering Package for
this design which contains the electrical one line diagrams, piping diagrams, dimensioned
floor layouts, and equipment lists.

Document Number RD104DS Revision 0