You are on page 1of 11

TIER III CERTIFICATION OF DESIGN DOCUMENTS

LINK DATA CENTER ‒LYNK DATA CENTER

Report Issued 25 February 2022

© 2022 Uptime Institute Professional Services, LLC


Confidential—Not for Disclosure Outside Link Data Center
Lynk Data Center

Tier indicates findings that must be correlated to meet the requirement for Tier III. 1
Note indicates additional comments offered for consideration.
Operate indicates Operational Sustainability 2 recommendations that will enhance the long-term availability of the site but are not required to meet Tier III.
Item Drawing/Page Type Comments Status

This review is based on documents submitted on 27 January 2022 for the Tier III
Certification of Design Documents for Link Data Center Lynk Data Center located
in Erbil, Iraq.
The data center and electrical room are located in the basement of the building.
The data center has a 42-square meter (m2) area. The electrical room area is
unclear.
The data center is powered by 2 diesel engine generators with stated 302-kilowatt
(kW) and 282-kW prime capacities. The engine generators are in an N+N
configuration where N=1. Both engine generators are installed within the same
enclosure structure. Both engine generators are connected through the same
connection pipe to (2) 7,500-liter (L) capacity fuel tanks. A single piping connection
to both fuel tanks is not Tier III compliant. It is unclear whether these engine
generators are dedicated to data center or whether they also handle other building
loads. The 302-kW engine generator has a 73.8-liter per hour (L/h) fuel
consumption and the 282-kW engine generator has a 68.89-L/h fuel consumption,
Project
AA General which results in approximately 101 hours of fuel storage capacity supporting N
Summary
engine-generator operations.
The data center has (8) 3-kW racks for a 24-kW IT load. The IT load is supported
by (2) 24-kW uninterruptible power supply (UPS) systems in an N+N configuration
where N=1, with 1 UPS supporting the A path and the other supporting the B path.
The type of batteries and design runtime is unclear for both UPS. Both UPS are
fed from the same single main distribution board (MDB) which is not Tier III
compliant.
Data center cooling is provided by 2 air-cooled direct expansion (DX) computer
room air conditioning (CRAC) units located inside the room feeding 2 rows of 4 IT
racks in an open aisle configuration. Each CRAC unit has a 19.9-kW net sensible
cooling capacity. The manufacturer’s tolerance is unclear. The data center room
has a stated 29.5-kW heat load which requires both CRAC units to support the
data hall critical cooling operations. This results in an N configuration with a
39.8-kW N CRAC net sensible cooling capacity. Both CRAC units are electrically
fed from a single source panelboard.

1 Please refer to the Tier Standard: Topology at www.uptimeinstitute.com.


2 Please refer to the Tier Standard: Operational Sustainability at www.uptimeinstitute.com.

Tier III Certification of Design Documents Page 1 of 10


Lynk Data Center

Item Drawing/Page Type Comments Status


The electrical room is defined as a critical space but no cooling details were
provided.
It is unclear whether an emergency power off (EPO) system is considered in the
design.
It is unclear whether the fire system is interfaced with the electrical or cooling
Project equipment.
BB General
Summary It is unclear whether a building management system (BMS) or data center
infrastructure management (DCIM) system is used in data center.
The telecommunication path from the boundaries of the buildings to the 1st point of
demarcation is unclear
It is unclear whether water leak detection and fuel leak detection systems are used
and interfaced with the electrical or cooling equipment.
Tier Certification requires that data center names be highly specific and distinctly
different from all other sites.
“Lynk Data Center” is highly generic and does not meet this requirement as it
merely repeats the client name with an alternate spelling and could apply to any
and all (current or future) data centers for Link Data Center.
Basis of
1 Tier Provide a specific and distinct data center name (which may include some need for
Design.pdf
identification of the specific building since this data center appears to be a multi-
building campus) for this site and update the Basis of Design (BOD) and design
documentation accordingly, including appropriate phasing, if applicable.
Additionally, provide the exact location of the data center to confirm the nearest
ASHRAE weather station.
The BOD document shows the critical spaces are the data center and electrical
room.
Clarify whether there are other IT rooms that are critical for data center operations,
such as electric rooms, low-voltage (LV) rooms, a network operations center
Basis of (NOC), staging areas, telecom rooms, meet-me rooms (MMRs), etc. If there are
2 Tier
Design.pdf other critical rooms or if other rooms have actively powered equipment, provide
updated design documentation showing the IT load, cooling load calculations, and
the Concurrently Maintainable power and cooling arrangement for these rooms.
Additionally, provide revised documentation indicating the location of all noncritical
spaces that may have potential impact on the critical infrastructure.

Tier III Certification of Design Documents Page 2 of 10


Lynk Data Center

Item Drawing/Page Type Comments Status


The BOD document indicates that the data center is part of a campus with
5 additional floors in the same building.
Basis of Provide updated documents indicating if the building floors share engine
3 Tier generators with the data center. If so, include all power calculations for the shared
Design.pdf
loads. Identify the measures taken to ensure these additional loads will not exceed
the calculated expected loads. Additionally, clarify whether there are any other
data centers in other buildings or on other floors.
The BOD document shows the electrical room as a critical space; however, no
cooling calculations or cooling equipment information were provided for the
Basis of electrical room.
4 Tier
Design.pdf
Provide updated documents showing the cooling equipment and room environment
set points for all critical spaces.
Document GGV387.pdf shows a 282-kW prime power rating engine-generator
capacity. Document GVP 415.pdf shows a 302-kW prime power rating engine-
generator capacity. As defined by ISO8528-1, a prime rating is based on variable
loads and the average 24-hour load cannot exceed 70% of the nameplate prime
rating. However, a data center load is constant. As such, Tier III requires the
engine-generator rating to be based on the engine-generator units’ constant-load
unlimited-runtime rating. Additionally, the rating must take into account the local
extreme ambient conditions based on the 2017 ASHRAE Handbook—
Fundamentals n=20 years maximum dry bulb temperature of 50°C for Mosul, Iraq,
which is the nearest weather station referenced for the site ambient.
Provide updated documentation showing the engine-generator units’ constant-load
GGV387.pdf, unlimited-runtime rating based on the 2017 ASHRAE Handbook—Fundamentals
GVP 415.pdf, n=20 years maximum dry bulb temperature of 50°C for Mosul, Iraq. Further,
5 Derating Tier provide a temperature rise calculation associated with the ventilation provisions,
TAD1342GE, and clarify any derating due to a temperature rise above this maximum dry bulb
and TAD1343.pdf temperature at full design load in the core of the radiator due to an enclosure, such
as a container, canopy, or room, which must be considered and highlighted.
Finally, provide details of the measures taken into account to allow the engine
generators to start and operate at the 2017 ASHRAE Handbook—Fundamentals
n=20 years minimum dry bulb temperature of -5.9°C for Mosul, Iraq. Provide
updated documentation that factors in the above considerations or provide a
manufacturer’s letter signed by an authorized technical authority from the vendor
that includes the specified engine-generator set models, engine/alternator models,
and the unlimited-runtime capacity in kilowatts at constant load based on the
applicable site ambient. Additionally, the letter must be project specific to clearly
show the applicable site location. Letter Derating TAD1342GE and TAD1343.pdf
does not detail the above factors.

Tier III Certification of Design Documents Page 3 of 10


Lynk Data Center

Item Drawing/Page Type Comments Status


Basis of The referenced documents do not include the UPS battery calculations, including
Design.pdf the expected runtime.
6 Tier
APC Smart-UPS Provide updated documents indicating the designed batteries’ runtime. Provide
VT.pdf battery calculations, including the charging power.
The referenced document shows the net sensible cooling capacity for CRAC units
as 19.9 kW; however, the document does not include manufacturing tolerances
even though a specific unit model (Uniflair TDAV1021A) has been selected for the
Performance actual site installations.
Calculation - Provide an updated document indicating the manufacturing tolerances for each
7 Tier
TDAV1021A + CRAC unit or provide a manufacturer's letter signed by a recognized technical
CAP1802.pdf authority detailing the tolerances. In addition, provide details on the measures
taken into account to allow the CRAC units and condensers to start and operate at
the 2017 ASHRAE Handbook—Fundamentals n=20 years minimum dry bulb
temperature of -5.9°C for Mosul, Iraq.
Document Performance Calculation - TDAV1021A + CAP1802.pdf details the net
Performance sensible cooling capacity as 19.9 kW, whereas Document Mechanical Load
Calculation - Calculations.pdf shows the stated demand heat load is 29.5 kW. As such, the
TDAV1021A + existing 2 CRAC units will only serve the N demand load and no redundant cooling
8 CAP1802.pdf, Tier unit will be available. Tier III Concurrently Maintainable systems must have at least
Mechanical Load N+1 cooling units.
Calculations.pdf Provide updated documents clarifying this discrepancy and showing Concurrent
Maintainability.
Document data center elec board1-Model.pdf includes a single-line diagram
showing single main power board (MDB) feeding both complementary UPS for the
critical loads; this is not Tier III compliant as there are no redundant distribution
data center elec paths. Similarly, both CRAC units are single fed from same breaker; there is no 2nd
9 Tier
board1-Model.pdf distribution path.
Provide an updated single-line diagram drawing showing redundant distribution
paths and clarifying the stated discrepancies.

Tier III Certification of Design Documents Page 4 of 10


Lynk Data Center

Item Drawing/Page Type Comments Status


Document Electric Generator and Section B-B.pdf shows the main electric power
line with no clear path to the MDB, LV transformer, or engine generators, which are
not shown in the single-line diagram (Drawing data center elec board1-Model.pdf).
Additionally, the details on the autonomous electric switching from utility to engine
data center elec
generators are unclear. Tier III requires that the engine-generator system be able
board1-Model.pdf
to autonomously start and assume the load upon a utility power outage.
10 Electric Tier
Provide an updated single-line diagram that includes all electric panels and
Generator and
connections, including main power cables, transformers, ATS, engine generators,
Section B-B.pdf
DX outdoor condensers’ power source, engine-generator auxiliary power supplies,
BMS/DCIM power supplies, and fire detection/fighting supplies. Single-line
diagrams must include each and every power component feeding the data center
and essential for data center operation.
The referenced document shows the CRAC units are equipped with humidifiers
and Drawing Electric Generator and Section B-B.pdf shows the drainage system
for the CRAC units. However, no water supply drawings for the CRAC units were
Performance submitted. Additionally, the humidification process (dependent on the type of
Calculation - humidifier selected) may add a heat gain to the data hall cooling load and CRAC
11 Tier
TDAV1021A + cooling capacity.
CAP1802.pdf
Provide updated drawings indicating the water supplies for each CRAC unit to
identify the temperature set point for each critical room. Clarify the humidifier
design and whether the associated humidification process will add to the heat load.
The referenced document shows both engine generators have the same label
Electric ("diesel generator") as do the fuel tanks ("diesel storage").
12 Generator and Tier Provide updated drawings showing each and every system component with a
Section B-B.pdf unique and consistent label. Labeling must be consistent and aligned within and
across all documents.
The referenced layout drawing shows both engine generators are fed with the
same fuel pipe; this will impact N fuel system operations when any planned
maintenance activities (replacement, upgrade, or maintenance) are required for
Electric this pipe. Tier III requires that each and every fuel system component and
13 Generator and Tier distribution path element can be isolated for maintenance while sustaining N
Section B-B.pdf engine-generator operations.
Provide a detailed fuel supply schematic diagram that includes all valves, feeds,
return pipes, and day tanks. Ensure each and every fuel system component has a
unique and consistent label within and across all documents.
The submitted document shows the freon pipes and power cables for the direct
Electric expansion (DX) outdoor condensers have the same route for both CRAC units.
14 Generator and Tier
Section B-B.pdf Provide updated drawings showing the measures taken to facilitate maintaining the
trays supports without affecting the N cooling units essential for the critical load.

Tier III Certification of Design Documents Page 5 of 10


Lynk Data Center

Item Drawing/Page Type Comments Status


The submitted document showing electric switch distributor as one enclosure in
electrical room feeding both UPSs and CRAC units. This is not Concurrently
Maintainable as the isolation of the electric switchgear or panelboard will impact
both complementary UPS system operations. Tier III requires each and every
power backbone element can be isolated for maintenance while sustaining N
15 Data Center.pdf Tier critical power supplies.
Provide a revised drawing showing the redundant distribution path for each UPS
and CRAC units used. Additionally, highlight manufacturing drawings detailing how
1 main distribution panel can be safely disconnected without exposing operators to
live voltage for planned activities (replacement, upgrade, or maintenance) without
affecting the critical IT load.
The referenced document shows freon pipes paths between each CRAC unit and
its outdoor condensers, with no indication of the equivalent length for the path.
16 Data Center.pdf Tier
Provide manufacturer documents showing the maximum equivalent length and
height difference of refrigerant pipe runs without derating the CRAC unit.
Document Electrical Equipment Schedules.pdf shows rack-mounted power
distribution units (PDUs) for all IT racks. However, the document shows a single
Electrical PDU is used for CAB05 and CAB06, identified as CAB05-PDU01 and CAB06-
17 Equipment Tier PDU01, whereas Document data center elec board1-Model.pdf shows each rack is
Schedules.pdf fed from 2 separate PDUs.
Provide updated documents clarifying these discrepancies and showing each rack
PDU is supplied from different source.
The submitted drawing shows a main board; however, it is unclear where it is
installed. Moreover, the main power board has 2 different loads identified as Load
ATS1 and Load ATS2, with different breaker capacities of (630 amperes [A] and
Main Power 400 A) interpreted as different loads.
18 Tier
Board.pdf Provide a detailed panel schedule, including the location of each power panel.
Provide a detailed single-line diagram showing all connected loads and taking into
account that each and every breaker must have a unique and consistent label
across all documents.
The referenced document shows a room adjacent to the data center which could
be interpreted as a future expansion for the data center.
19 Data Center.pdf Tier Provide more details about the data center’s phasing plans. Indicate if future
expansion will have shared electrical or cooling infrastructure with the current
phase and clarify whether any further buildouts or expansions are intended to be
included in the Certification. If so, provide full design details for review.

Tier III Certification of Design Documents Page 6 of 10


Lynk Data Center

Item Drawing/Page Type Comments Status


The referenced drawing shows the power cable path from the engine-generator
area to the electrical room.
20 Data Center.pdf Tier Provide an updated drawing detailing this power cable path and showing whether it
is a common path for both electric power supplies. Include section drawings if
needed.
The referenced document includes an electric power calculation which details a
DC Power 5-kW load for equipment listed in the sizing calculator, in addition to the 0.9-kW
Requirement lighting load.
21 Tier
Calculation
Worksheet.pdf Provide updated documentation specifying the load details and panels used to
supply this load, as this is unclear in the single-line diagram drawing.
The submitted power calculation (Document DC Power Requirement Calculation
Worksheet.pdf) shows the power feeding the cooling demand is 40.6 kW, whereas
DC Power
Document Performance Calculation - TDAV1021A + CAP1802.pdf states that for
Requirement
used CRAC units, the maximum absorbed power is 14.1 kW and the condenser
Calculation
absorbed power is 1.6 kW. Additionally, the electric heaters consumed power is
Worksheet.pdf
22 Tier 9 kW. As such, it is interpreted that the maximum demand power for 1 CRAC unit
Performance is 24.7 kW.
Calculation -
Provide updated documents to clarify this discrepancy. Provide updated electric
TDAV1021A +
load calculations with consistent power consumption between all documents taking
CAP1802.pdf
into account the measures taken while cycling between the on-duty and standby
CRAC units for any planned maintenance.
DC Power The submitted power calculation (Document DC Power Requirement Calculation
Requirement Worksheet.pdf) shows the UPS inefficiency and the battery charging, with total of
Calculation 9.28 kW, whereas Document APC Smart-UPS VT.pdf shows the UPS inefficiency
23 Worksheet.pdf Tier to be 0.94 kW while the charging power is not mentioned.
APC Smart-UPS Provide updated documents clarifying this discrepancy. Provide updated electric
VT.pdf load calculations showing a consistent power consumption between all documents.
The referenced document shows the mechanical load calculations but does not
Mechanical Load include the envelope heat gain calculations. Moreover, the mechanical load
24 Tier calculations for the electrical space (defined as critical space) were not provided.
Calculations.pdf
Provide updated documents to clarify these discrepancies.
Mechanical Load
Document DC Power Requirement Calculation Worksheet.pdf shows the lighting
Calculations.pdf
load as 0.9 kW, whereas Document Mechanical Load Calculations.pdf shows the
25 DC Power Tier lighting load as 0.6kW
Requirement
Provide updated calculations clarifying the discrepancy and showing consistent
Calculation
and aligned information.
Worksheet.pdf

Tier III Certification of Design Documents Page 7 of 10


Lynk Data Center

Item Drawing/Page Type Comments Status


DC Power The submitted document indicates the IT load is exactly equal to the UPS load.
Requirement
26 Tier Provide the detailed distribution losses from each UPS to the IT load as it may
Calculation
Worksheet.pdf result in delivering lower power than the N demand needed per each UPS

The submitted document shows a rack air distribution unit is used in the racks
where cold air is pulled in from below the raised floor by dual blower fans.
Rack Air Provide aa detailed document for the rack distribution units showing whether this
Distribution Unit unit is independent from the rack assembly. If so, detail its power consumption and
27 Tier
Distribution inlet power redundancy level. Moreover, indicate if the racks have front/back
Diagram.pdf perforated doors and the measures taken into account when planned activities
(replacement, upgrade, or maintenance) for these rack air distribution units is
performed such that there is no impact to the critical IT load cooling air supply.
The document states high-level fuel system criteria.
Fuel System
28 Tier Provide a detailed fuel schematic and net usable tank volumes, along with valves
Schematics.pdf
and fuel pump arrangement and power feeds.
The telecommunication providers’ cable routing pathways for supporting data
center operations were not provided. The1st points of demarcation for the
telecommunications network gears are unclear.
29 Telecom Tier Provide detailed information on the telecommunication provider entrance rooms
and the rooms (inside or outside the data center building) in the telecommunication
cable pathways supporting data center operations. These rooms must be
supported by Tier III-compliant power and cooling systems if any actively powered
critical IT equipment is contained in these rooms.
It is unclear if the engine generators are synchronized and, if so, the
synchronization methodology.
Provide documentation clarifying whether the engine generators are synchronized.
30 General Tier Include any corresponding cabling and how all of it can be isolated and removed
for maintenance. Additionally, clarify that the equipment can be manually
modulated, started, and stopped when the means of synchronization are isolated
for maintenance.
It is unclear if the UPS are synchronized and, if so, the synchronization
methodology.
31 General Tier Provide documentation clarifying whether the UPS are synchronized. Include any
corresponding cabling and how all of it can be isolated and removed for
maintenance. Additionally, clarify that the equipment can be manually operated
and stopped when the means of the synchronization are isolated for maintenance.

Tier III Certification of Design Documents Page 8 of 10


Lynk Data Center

Item Drawing/Page Type Comments Status


It is unclear whether there is an EPO system considered in the design.
If there is an EPO system utilized, provide documentation showing that the EPO
32 General Tier system can be fully isolated and removed for maintenance or replacement without
impacting more than the redundant number of capacity components or distribution
path elements.
It is unclear whether the fire system is interfaced with either the power or cooling
equipment.
33 General Tier If there is a connection, provide further details as to the connection type and
connector used. Additionally, provide details showing that the fire system can be
fully isolated and removed for maintenance or replacement without impacting more
than the redundant number of capacity components or distribution path elements.
It is unclear whether there is an BMS or DCIM system considered in the design.
If such systems are utilized, provide detailed BMS and DCIM network diagrams,
control schematics, all I/O panel locations, and power sources indicating all
34 General Tier interfaced equipment. Moreover, indicate the physical connection types used and
whether they are hardwired or unpluggable type. Finally, provide details to show
that isolation of the BMS/DCIM system does not impact more than the redundant
number of capacity components or distribution paths.
The design documentation does not include information on a fuel leak detection
system.
35 General Tier If a fuel leak detection system will be used within the data center, provide
information to clarify that the leak detection system can be isolated and removed
for maintenance without impacting the operation of the engine generators.
The design documentation does not include information on a water leak detection
system.
36 General Tier If a water leak detection system will be used within the data center, provide
information to clarify that the leak detection system can be isolated and removed
for maintenance without impacting the operation of the cooling units in all critical
rooms.
No information was provided on the fresh air supply, extraction, or pressurization of
the data center. Tier III requires comprehensive information to ensure a complete
understanding of the design intention and to verify that noncritical systems do not
impact upon critical equipment supporting the IT load.
37 General Tier Provide documentation that clarifies any fresh air supply, extraction, or
pressurization details, including details to show how the ventilation system has
been sized, to verify that no additional heat load is added to each critical space.
Additionally, clarify that these items can be isolated and removed for maintenance
without impacting upon the critical equipment supporting the IT load in each room.

Tier III Certification of Design Documents Page 9 of 10


Lynk Data Center

Item Drawing/Page Type Comments Status


Clarify whether the transformer room cooling is a forced ventilation system.
If so, provide heat load calculations to show the heat load in the room and the
38 General Tier available design volume flow from the ventilation system. In addition, provide
electrical details of the ventilation system. Moreover, provide the maximum
temperature in the room compared to the transformer manufacturer recommended
operating temperature.
Provide information on the control power to the motorized circuit breakers that
39 General Tier
support transition from utility to engine-generator power.
Unique labeling of each and every site infrastructure system component and
distribution path element supporting the critical environment is required for Tier III
review. This includes consistent nomenclature within and across all drawings, such
as engine generators, UPS modules, CRAC/outdoor condensing units, variable
refrigerant volume (VRV) outdoor units and indoor FCUs, fuel tanks, switchboards,
40 General Tier breakers, panelboards, end-feed boxes, bus duct tap-off units, ATS, room/riser
identifiers, valves, dampers, control devices, etc.
Provide updated documentation/drawings with unique labels for each and every
site infrastructure system component and distribution path element supporting the
critical environment.
The submitted document indicates that the designed return air temperature is
Performance 35°C. This will be difficult to achieve in the racks’ open aisle configuration, where
Calculation - mixing of cold and hot air will occur and may negatively affect the CRAC units'
41 Operate
TDAV1021A + efficiency and cooling capacity.
CAP1802.pdf
Cold/hot Air separation is recommended to achieve the design return temperature.
The data center name must be distinctly different from other sites, including
42 General Note applicable phases, buildings, or rooms, and should be specifically identified in the
BOD and aligned consistently across the documentation submitted.
When submitting the responses, provide a response to each item, and submit only
the documents that have been updated or are needed to fully address and close
43 General Note an item. When the response is an updated drawing or document, indicate that in
the response, and indicate the update on the drawing or document. Indicate all
changes on the drawings, even if they are not directly related to a Tier comment.
END OF COMMENTS

Tier III Certification of Design Documents Page 10 of 10

You might also like