You are on page 1of 9

[Reference Design 103]

23.5 MW (IEC), Chilled Water, 25000 m2


DESIGN OVERVIEW INTRODUCTION
Data Centre IT Capacity This data centre design, optimized for IT Service Providers and Telecommunication
Initial Delivery of 3 MW customers, aims for a reduced total cost of ownership (TCO), with a simplified and
Scalable to 23.5 MW standardized building-blocks approach.
Regional Voltage and Frequency Additional design benefits include high energy efficiency during operation, good reliability
90-140kV, 10-15kV, 400V with full redundancy by using a flexible dual path architecture, and a high degree of
50Hz scalability. This design allows for standardization of facilities worldwide, since only some
. of the equipment selection would vary based on local standards. The data centre is to be
Redundancy Levels built in six increments: two 3 MW blocks, two 4 MW blocks, and two 5MW blocks,
Power: 2N distribution to load, 2N promoting scalability as IT demands increase.
UPS, N+2 generators
This Data Centre is made up by three types of building blocks, and each differs in the
Cooling: N+2 CRAHs, N+1
density of the racks in the IT space while maintaining a similar footprint. Each block
pumps, N+1 chillers
contains two electrical rooms, two IT rooms, and a cooling system that serves the entire
DESIGN HIGHLIGHTS block. Blocks 1 and 2 are referred to as type 1 and deliver 8 kW/rack per IT room, Blocks
3 and 4 are type 2 with 10 kW/rack, and Blocks 5 and 6 deliver 12 kW/rack as type 3 .
Reduced TCO
These pieces constitute the building blocks for the data centre; therefore, they make up
High energy efficiency the final build-out and deliver 23520 kW of total IT load.
Good reliability
Scalable design
Diverse IT load densities
[Reference Design 103] 2

Facility Power
UTILITY CONNECTION
The data centre is designed for 42 MVA maximum demand, which requires a connection to the electrical utility high voltage (HV) sub-
transmission network. Depending on the country, the supply voltage could vary from 90 kV (e.g. France), 110 kV (e.g. Finland) up to
132 kV (e.g. UK). The utility company will be responsible for building the HV substation which provides metered supplies A and B.
Therefore, the change of ownership occurs after the metering point, which means that the data centre owner will specify and procure
the HV/MV transformer.

PRIMARY MEDIUM VOLTAGE (MV) DISTRIBUTION


This electrical architecture offers high reliability since the HV/MV substation design ensures full redundancy, allowing for concurrent
maintenance of the equipment without having to run the generator set. Two HV utility incomers feed two HV single busbars, which are
connected through a bus section for 2N redundancy. Then, two 42 MVA Minera power transformers with on-load tap changer (OLTC)
supply all six IT blocks. The MV distribution voltage can be chosen according to country practices (e.g. 10 kV in Finland, 11 kV in UK,
and 15 kV in Belgium). The short circuit impedance of the HV/MV transformer is chosen at 17% to avoid exceeding 25 kA short circuit
current on the MV distribution network. The primary MV distribution for this data centre design is 2N redundant, comprising twelve
units of PiX air-insulated switchgear lineups, each one rated at 17.5 kV and 25 kA (3 s) with a 2500 A busbar, ensuring cost
optimization. Each pair of these PiX lineups feed one IT block, for A and B-side distribution.

HV/MV Substation
Utility A Utility B
KWh KWh

HV HV
42MVA 42MVA
MV MV
2500A, 10kV 2500A, 10kV
MV Primary Dist. MV Primary Dist.
SWG A SWG B PiX

BLOCK 1
BLOCK 2
BLOCK 3
BLOCK 4
BLOCK 5
BLOCK 6

FACILITY POWER HV/MV SUBSTATION ATTRIBUTES


Name Value Unit
Utility voltage 90 < Un < 140 kV
Number of blocks 6
© 2015 Schneider Electric. All rights reserved.

Power path Dual


Number of HV/MV transformer 2
HV/MV transformer size 42 MVA
HV/MV transformer short circuit impedance 17 %
Number of MV primary distribution switchgear lineups 2
MV primary distribution bus amps 2500 A
MV primary distribution bus voltage 10 < Un < 15 kV
MV primary distribution switchgear short time withstand current 25 (3) kA (s)

Document Number RD103DS Revision 0


[Reference Design 103] 3

Facility Power
SECONDARY MEDIUM VOLTAGE DISTRIBUTION

To reduce initial investment and ensure a good scalability approach, each block is independent in terms of primary and secondary
MV distribution. However, to reduce the total cost a MV back up diesel generator power plant is shared across two blocks.
Automatic transfer between main power and backup generators is built into the design
A total of 56 Premset switchboards make up the secondary set of medium voltage distribution for all blocks, each rated at 17.5 kV,
1250 A and 25 kA (3s). Six of the Premset switchboards feed Type 1 blocks, ten feed Type 2 blocks, and twelve feed Type 3
blocks. All in a 2N architecture, where half of the units provide A-side power and the other B-side power and both sides are
connected by a “coupling cable” to maintain redundancy downstream of the failure on all blocks. The diesel generator backup
power is connected to the MV distribution network via a Premset switchoard. Seven 2500 kVA generators for each pair of blocks
type 1 and nine 2500 kVA generators for each pair of blocks type 2, provide N+1 LV power, while eleven 2500 kVA generators
provide N+2 power for the two type 3 blocks. Each generator is coupled to the MV network with a LV/MV step-up 2500 kVA Trihal
cast resin transformer with a 6% short circuit impedance. This choice of backup generator plant configuration provides high
reliability and safety, while minimizing cost. For full Tier III compliance, a set of redundant Premset MV switchgear could be added
to the design. Fuel storage and piping can also be added to the design in accordance with country habits and regulations.

MV Primary Dist. MV Distribution to Blocks MV Primary Dist. DESIGN OPTIONS


SWG A SWG B
This reference design can be
Two Blocks
G G N x 2500 kVA units modified as follows without a
N=7 for Blocks 1&2
N=9 for Blocks 3&4 significant effect on the design’s
LV LV
MV MV N=11 for Blocks 5&6 performance attributes:
Genset SWG 1250A,
10kV
 Redundant generator
switchgear set
ATS ATS ATS ATS
 Provision for load bank
MV Secondary MV Secondary MV Secondary MV Secondary
Dist. SWG A Dist. SWG A Dist. SWG B Dist. SWG B Premset
 Add/change standby generator
1250A, 10kV 1250A, 10kV 1250A, 10kV 1250A, 10kV options:
BLOCK  Location
 Tank size
BLOCK  Fuel type

FACILITY POWER MV DISTRIBUTION ATTRIBUTES

Name Value Unit © 2015 Schneider Electric. All rights reserved.


Blocks 1, 2 Blocks 3, 4 Blocks 5, 6
Number of MV secondary distribution switchgear lineups 6 10 12
MV secondary distribution bus amps 1250 1250 1250 A
MV secondary distribution bus voltage 10 < Un < 15 10 < Un < 15 10 < Un < 15 kV
MV secondary distribution switchgear short time withstand current 25 (3) 25 (3) 25 (3) kA (s)
Generator redundancy N+1 N+1 N+2
Number of Generators per block 7 9 11
Generator size 2500 2500 2500 kVA
Generator voltage 400 400 400 V

Document Number RD103DS Revision 0


[Reference Design 103] 4

Facility Power
LOW VOLTAGE DISTRIBUTION

Downstream from the MV secondary distribution, each block is separated into three with MV/LV transformers and LV switchboards.
Two of these groups are dedicated to two IT rooms and the other group to the cooling system and auxiliaries that serve the whole
block.
A total of 56 Trihal transformers, ranging from 1250 to 2500 kVA, are used in this design to transform power from 17.5 kV to 400 V
with 6% impedance, in a close-coupling installation. The same number of LV Okken switchboards makes up the LV distribution,
each rated at 400V, distributed as follows: for each type 1 block there are six switchboards rated at 50 kA (1s) with a 3200 A bus
(four for IT and two for cooling); for type 2 blocks there are eight units rated at 50 kA (1s) with a 2000 A bus for IT and two more at
80 kA (1s) with a 4000 A bus for cooling; and, finally, for each type 3 block there are eight switchboards rated at 50 kA (1s) with
2500 A bus for IT, and four for cooling rated at 50 kA (1s) (two with a 2500 A bus and two with a 3200 A bus).
On each IT power train the Okken switchboards feed 2N Symmetra PX arranged for an A and B-side distribution. Downstream from
the electrical rooms to the IT space there is a combination of LV switchgear and iBusway systems with built-in intelligence for 2N
power distribution. In the mean time, the Okken units that make up the cooling power train provide A- and B-side distribution to
chillers, pumps, lighting, monitoring, security and automation systems, etc., while providing fault protection to cooling units in the IT
and electrical rooms.
The facility power system is designed to also support integrated peripheral devices like fire panels, access control systems, and
environmental monitoring and control devices. Power meters in the electrical path monitor power quality and allow for predictive
maintenance & diagnostics of the system. These meters also integrate with StruxureWare Power Monitoring Expert.
Every component in this Reference Design is built and tested to the applicable IEC standards. Further design details and
schematics are available in the engineering package, which can be requested at the end of this document.

LV Distribution to final loads per Block Type 1 DESIGN OPTIONS


MV Secondary MV Secondary
Dist. SWG A Dist. SWG B
This reference design can
be modified as follows
without a significant effect
Trihal Blocks 1 and 2 (shown one of two blocks)
MV MV MV MV MV MV
on the design’s
2MVA 2MVA 2MVA 2MVA
LV LV LV LV LV LV performance attributes:
LV Crit. SWB A LV Crit. SWB B LV Crit. SWB A LV Crit. SWB B LV Crit. SWB A LV Crit. SWB B
Okken
3200A, 400V 3200A, 400V 3200A, 400V 3200A, 400V  Change UPS

UPS UPS
batteries
UPS UPS
 Location
LV Dist. A LV Dist.B LV Dist. A LV Dist. B
© 2015 Schneider Electric. All rights reserved.

 Type
IT Room: 1.6MW IT Room: 1.6MW Cooling

Document Number RD103DS Revision 0


[Reference Design 103] 5

MV Secondary
LV Distribution to final loads per Block Type 2 MV Secondary
Dist. SWG A Dist. SWG B

Trihal Blocks 3 and 4 (shown one of two blocks)


MV MV MV MV MV MV MV MV MV MV
1.25MVA 1.25MVA 1.25MVA 1.25MVA 2.5MVA
LV LV LV LV LV LV LV LV LV LV

LV Crit. LV Crit. LV Crit. LV Crit. LV Crit. LV Crit. LV Crit. LV Crit. LV Crit. LV Crit.
Okken SWB A SWB B SWB A SWB B SWB A SWB B SWB A SWB B SWB A SWB B
2000A, 400V 2000A, 400V 2000A, 400V 2000A, 400V 4000A, 400V
UPS UPS UPS UPS UPS UPS UPS UPS

LV Dist. A LV Dist. B LV Dist. A LV Dist. B LV Dist. A LV Dist. B LV Dist. A LV Dist. B

IT Room: 1.96MW IT Room: 1.96MW Cooling

MV Secondary
LV Distribution to final loads per Block Type 3 MV Secondary
Dist. SWG A Dist. SWG B

Blocks 5 and 6 (shown one of two blocks)


Trihal
MV MV MV MV MV MV MV MV MV MV MV MV
1.6MVA 1.6MVA 1.6MVA 1.6MVA 2MVA 2MVA
LV LV LV LV LV LV LV LV LV LV LV LV

LV Crit. LV Crit. LV Crit. LV Crit. LV Crit. LV Crit. LV Crit. LV Crit. LV Crit. LV Crit. LV Crit. LV Crit.
Okken SWB A SWB B SWB A SWB B SWB A SWB B SWB A SWB B SWB A SWB B SWB B
SWB A
2500A, 400V 2500A, 400V 2500A, 400V 2500A, 400V 3200A, 400V 3200A, 400V
UPS UPS UPS UPS UPS UPS UPS UPS

LV Dist. A LV Dist. B LV Dist. A LV Dist. B LV Dist. A LV Dist. B LV Dist. A LV Dist. B

IT Room: 2.4MW IT Room: 2.4MW Cooling

FACILITY POWER LV DISTRIBUTION ATTRIBUTES

Name Value Unit


Blocks 1, 2 Blocks 1, 2 Blocks 3, 4 Blocks 3, 4 Blocks 5, 6 Blocks 5, 6
IT Cooling IT Cooling IT Cooling
Number of MV/LV
8 4 16 4 16 8
transformer per block
MV/LV transformer size 2 2 1.25 2.5 1.6 1.6 and 2 MVA
Number of LV critical
8 4 16 4 16 8
switchgear
2500 and
LV critical bus amps 3200 3200 2000 4000 2500 A
3200 © 2015 Schneider Electric. All rights reserved.

LV critical bus voltage 400 400 400 400 400 400 V


LV critical switchgear
short time withstand 50-1 50-1 50-1 80-1 50-1 50-1 kA-s
current
UPS redundancy 2N 2N 2N 2N 2N 2N
Total UPS capacity per
3600 288 4200 288 5400 360 kW
block
UPS runtime @ rated
5 5 5 5 5 5 minutes
load
UPS output voltage 400 400 400 400 400 400 V

Document Number RD103DS Revision 0


[Reference Design 103] 6

Facility Power
POWER MONITORING

The power monitoring system is part of the DCIM


(Data Center Infrastructure Management System)
which is a holistic solution to measure, monitor,
track, and control all aspects of the physical data
centre in a real time operation. In addition, it User
User
proposes to optimize planning, as well as continuous Interface
Interface
improvement of assets to enhance business of end-
customers. Power monitoring system brings the
following features:
Preserve availability and reliability of the
Electrical Distribution system,
Optimize quality of energy power consumed
costs,
Cut of the maintenance costs of the electrical
equipment,
Block 1&2 Block 3&4 Block 5&6
MV SWBD MV SWBD MV SWBD
Diagnosis helps in case of disturbance on the
power distribution network.
Centralization in one or several places of all control
Block1 Block 1 Block 1 Block 3 Block 3 Block 3 Block 3 Block 3 Block 3
and monitoring information for the electrical network, IT room 1 IT room 2 Mechanical IT room 1 IT room 2 Mechanical IT room 1 IT room 2 Mechanical

Historic and archive building for data analysis and Block2 Block 2 Block 2 Block 4 Block 4 Block 4 Block 4 Block 4 Block 4
IT room 1 IT room 2 Mechanical IT room 1 IT room 2 Mechanical IT room 1 IT room 2 Mechanical
capacity planning.

POWER MONITORING SYSTEM MAIN FEATURES

© 2015 Schneider Electric. All rights reserved.

Document Number RD103DS Revision 0


[Reference Design 103] 7

Facility Cooling
Cooling system for Type 1 Blocks (shown as example)
This facility cooling system is meant for climates in places like
CHWR CHWS CHWS CHWR
Boston or Malmö, with warm summers and cold, snowy winters, IT & ER
IT & ER IT & ER IT & ER
though it can be easily adapted to work in other climates.
The facility cooling design is made up of six stand-alone cooling DAS GF GF DAS

VFD
VFD

VFD

VFD

VFD

VFD
systems sized specifically to serve each type of block. Every ET ET
chilled water system is comprised of a dual-path piping system
with N+1 redundant Uniflair air-cooled packaged chillers with Thermal Thermal
Storage Storage
free cooling, accompanied by a primary-secondary pumping
scheme, with variable speed secondary pumps, all in an N+1
configuration. Also, a redundant piping system across all the IT
and electrical distribution rooms in the block provide an alternate
Chiller Chiller Chiller Chiller Chiller
path for chilled water, in case of equipment failure.
In this cooling system design, economization is achieved with
dry coolers integrated within each chiller, to save energy during
favorable outdoor conditions. In addition, thermal storage
systems are offered to provide continuous cooling after a power Piping in electrical and IT rooms
outage or chiller restart. These tanks would be sized accordingly

CHWR
for the ramp-up time of the chillers and building topology.
ER A

CHWS CHWS
The redundant piping architecture of the mechanical system
feeds InRow RC units in the IT rooms and Uniflair chilled water IT Room IT Room
room-based computer room air handlers (CRAHs) in the LV 1 2
electrical rooms. Additional air handling units are added to

CHWR
ER B
supply fresh air in the building and direct expansion (DX) units
are provisioned for the rooms containing the generator
switchgear, MV switchgear and UPS batteries.
This design is instrumented to work with StruxureWare Building DESIGN OPTIONS
Operation for cooling control and monitoring. Further design This reference design can be modified as follows without a
details such as dimensions, equipment placement, temperature significant effect on the design’s performance attributes:
set points, pipe sizing, flow rates, and pressure drops are  Add StruxureWare Building Operation
available in the engineering package.

FACILITY COOLING ATTRIBUTES

Name Value Unit


Total facility cooling capacity 27 MW
Name Blocks 1, 2 Blocks 3, 4 Value Blocks 5, 6 Unit
Sub-system cooling capacity 3375
Total facility cooling capacity 4500 66 5625 MW kW © 2015 Schneider Electric. All rights reserved.

Input voltage 400 400 Each block 400 V


Heat rejection medium Chilled
Sub-system cooling water
capacity Chilled water 5500 Chilled water kW
Number of chillers Input voltage 5 6 400 7 V
Mechanical redundancy Heat rejection medium
N+1 N+1 Chilled water N+1
Number of chillers
Packaged air-cooled Packaged air-cooled 6 Packaged air-cooled
Outdoor heat exchange chiller with free- chiller with free- chiller with free-
Mechanical redundancy N+1
cooling cooling cooling
Packaged chiller with free-
Outdoor heat exchange
Coolant supply temperature 15 15 15 °C
cooling
Coolant return temperature 20.6
Coolant supply temperature 20.6 15 20.6 °C °C
Economizer type Water-side
Coolant return temperature Water-side 20.6 Water-side °C
Storage tank size per sub-system 65.6 m3
Document Number RD103DS Revision 0
Ride-through time 5 minutes

Economizer type Water-side


FACILITY COOLING ATTRIBUTES
[Reference Design 103] 8

IT Space
Six IT blocks are built one by one to make up the IT space of this design. DESIGN OPTIONS
One block includes two IT rooms with 196 NetShelter racks each, so all This reference design can be modified
rooms have a similar footprint even though they have different IT
as follows without a significant effect on
capacities. In type 1 blocks, each IT room houses racks of 8kW each, in
the design’s performance attributes:
type 2 blocks density is 10kW, and in type 3 blocks the rack density is
12kW. Altogether they provide 23.52 MW of IT capacity for the whole site.
 Add environmental and security
In this design, each IT room is powered by redundant (2N) iBusway management
systems. Every rack has the capacity to accept dual power feed, since  Change rack options (tall, wide, deep)
each is configured with redundant (2N) metered rack-mount power  Change power distribution options (rack
distribution units (PDUs) to enable remote monitoring of the units for PDU type: basic, switched)
 Add StruxureWare Data Centre Expert
efficiency and capacity management.
In all rooms, heat is removed by InRow RC-HT units in an in an N+2
redundant configuration for each pair of rows. Considerations can be
made with respect to return air ducting systems and/or raised floors, to
improve the coolers’ performance. Redundant valves and piping are also
added to ensure continuous cooling with high reliability.
The security of the room is maintained at multiple points. At the rack level,
access is controlled by a door lock and sensor. At the room level, security
cameras are utilized for monitoring.

IT SPACE ATTRIBUTES

Name Value Unit


Total IT load 23.52 MW
Block 1, 2 Block 3, 4 Block 5, 6
IT load per block 3136 3920 4704 kW
IT rooms per block 2 2 2
IT Room IT Room IT Room
IT load per room 1568 1960 2352 kW
Input voltage/ supply voltage to IT 230 / 400 230 / 400 230 / 400 V
Average density 8 10 12 kW/rack
Number of racks 196 196 196 racks
2
IT floor space 584 584 584 m © 2015 Schneider Electric. All rights reserved.

Single or dual cord Dual Dual Dual


Chilled water InRow- Chilled water InRow- Chilled water InRow-
CRAC/CRAH type
HT CRAHs HT CRAHs HT CRAHs
CRAC/CRAH redundancy N+2 per pair of rows N+2 per pair of rows N+2 per pair of rows

Document Number RD103DS Revision 0


[Reference Design 103] 9

Advantages of this Reference Design


 Large size aims to deliver data centre for private cloud or hosting managed services businesses with evolving IT
 Optimize CapEx and OpEx for reaching the best possible TCO from day one
 Highly reliable solution with predictive performance value (outstanding people safety, efficiency, footprint)
 Comply with high efficiency requirements to optimize the OpEx
 Proposed evolving IT equipment density to achieve the best performance along the life-cycle
 End-to-end solution considering constraints from "utility to rack" for full architecture consistency and right sizing
 Equipment ratings chosen are optimized for components sizing to meet an excellent low cost/ high performance ratio
 Operating principles available to understand dynamics, maintenance and recovery situations
 High-end power monitoring systems included to manage real time data, planning and support optimization in the data centre
life-cycle

Schneider Electric Life-Cycle Services


Team of over 7,000 trained specialists covering
every phase and system in the data centre

Standardized, documented, and validated


methodology leveraging automation tools and
repeatable processes developed over 45 years

Complete portfolio of services to solve your


technical or business challenge, simplify your
life, and reduce costs

Get more information on this design © 2015 Schneider Electric. All rights reserved.

Contact your Schneider Electric Account Manager to receive the Engineering Package for
this design which contains the electrical one line diagrams, piping diagrams, dimensioned
floor layouts, and equipment lists.

Document Number RD103DS Revision 0

You might also like