Professional Documents
Culture Documents
Research Paper
h i g h l i g h t s
a r t i c l e i n f o a b s t r a c t
Article history: In this study, influences of various blockage arrangements as well as cold-aisle containment on the over-
Received 5 July 2016 all efficiency of a container datacenter are reported. The test container datacenter contains ten racks and
Revised 8 October 2016 the cold air is supplied from drop ceiling. The experiments are performed with each rack equally deliv-
Accepted 12 October 2016
ering a power of 3 kW. Eight different layouts are examined. Appreciable hot air recirculation prevails
Available online 13 October 2016
especially at the entrance of cold aisle. Adding blockage plates to the computer room air handler
(CRAH) at the entrance of computer racks only improve marginally the associated rack cooling index
Keywords:
(RCI). Layout with enclosing the end of cold aisle while let open the entrance of cold aisle also performs
Datacenter
Thermal management
poorly. Full containment of the cold aisle with high jet air flowrate from the supplied grilles gives the
Rack cooling index worst performance. Layout with enclosing at the entrance of cold aisle but let open the end of cold aisle
Cold-aisle containment shows a much superior temperature distribution and a rather high RCI of 99%. Higher supplied flow may
Supplied heat index induce jet airflow pattern, causing the Coanda effect to result in fluctuating behaviors of RCI and SHI
Coanda effect alongside the cold aisle (zigzag phenomenon). A lower supplied air flowrate without Coanda effect for
a full containment design give the best overall performance.
Ó 2016 Elsevier Ltd. All rights reserved.
http://dx.doi.org/10.1016/j.applthermaleng.2016.10.089
1359-4311/Ó 2016 Elsevier Ltd. All rights reserved.
134 C.-H. Wang et al. / Applied Thermal Engineering 112 (2017) 133–142
Nomenclature
H height, m Superscripts
L length, m r rack
n total number of intakes
Q the total heat dissipation from all the racks in the data Subscripts
center, W Avg average value
dQ the rise in enthalpy of the cold air before entering the HI high
racks, W in inlet
RCI rack cooling index, dimensionless LO low
SHI supplied heat index, dimensionless max maximum value
T temperature, °C max-rec maximum recommended
W width, m max-all maximum allowable
min-rec minimum recommended
min-all minimum allowable
out outlet
ref CRAH supply
pre-calibrated thermocouples (with calibration accuracy within ters and fans in parts 1, 3, and 5 are turned on with each one being
±0.1 °C), and they are evenly distributed on a loose metal mesh 1 kW while the fan and heaters in 2 and 4 are turned off to simu-
in accord with the frontal opening of the computer rack. The sig- lates a sparse and non-uniform heating of data rack in operation.
nals are then gathered by four HIOKI LR8400-20 (240 channels) Yet in some cases, parts 2 and 4 are blocked with plates to prevent
hybrid recorders. As shown in Fig. 2, the CRAH is an upflow design short circuit of airflow. The details of the test cases are schemati-
(TECO company, model PHWP-K1500CUL1, maximum flowrate cally shown in Table 1. The reference case, case 1, represents a pre-
4.0 m3 s1). The airflow is directed by a rectangular air duct scribed total airflow rate of 3.52 m3 s1 from the grilles, and the
(1.61 m 0.46 mm) with 7 grilles alongside the duct. The diameter cold airflow are from the grilles 2–6 are supplied. In the meantime,
of the round grilles is 0.285 m and their locations can be found in blockage is made above the rack and drop ceiling. In this study, the
Fig. 2(a) with encircled number starting from 1 to 7. The opening of control power to the DC fans of all racks are fixed, and the corre-
grilles is located at the center of computer racks. The airflow vol- sponding total airflow rate are about 3.52 m3 s1 which are about
ume out of the grilles can be regulated with an inherited damper, the same as the supplied airflow from all grilles. However, the air-
and the air flowrate from the grille can be measured by an air- flow rate of this measurement is carried out once which does not
capture-hood (Trust Science Innovation, model PH73) with a mea- reflect the actual flowrates for other cases but the supplied power
suring resolution of 0.006 m3 s1. to all the DC fans stays the same for all cases. Case 2 is similar to
In the present study, a total of eight cases designating various case 1 except additional block plates are aligned vertically toward
blockage layouts and containments are conducted and compared CRAH next to racks A1 and A2. Case 3 is similar to case 2 except an
with an inlet supplied air temperature at grilles of 21 °C. The total enclosed door locates at the end of cold aisle. In contrast to case 4,
power from the ten racks is fixed at 30 kW with equally delivering an enclosed door is installed at the entrance of cold aisle A1/A2
power of 3 kW of each rack. Note that each rack contains five heat- while left open the end of the cold aisle near E1/E2 racks. Case 5
ing elements and each one is capable of delivering 3 kW with an represents a full cold-aisle containment although the heaters/fans
uncertainty 10 W. A photo of back view showing the installation in part 2 and part 4 is turned off instead of fully blockage. The
of heaters and fans are shown in Fig. 3. In the present study, hea- blockage plates are installed at the entrance of the computer racks.
136 C.-H. Wang et al. / Applied Thermal Engineering 112 (2017) 133–142
P
ðT minrec T x ÞT minrec >T x
RCILO ¼ 1 100% ð2Þ
ðT minrec T minall Þn
Fig. 3. Photos of the simulation rack – back view to see the installed heaters and dQ
fans. SHI ¼
Q þ dQ
Enthalpy rise due to infiltration in cold aisle
¼ ð3Þ
Case 6 represents the full cold-aisle containment with parts 2 and Total Enthalpy rise at the rack exhaust
4 being blocked entirely. Note that the airflow from grilles are fixed
at 3.52 m3 s1 for cases 1–6. Cases 7 and 8 are also identical to P P h i
j i T rin T ref
cases 6 except a lower supplied total air flowrate of 2.83 m3 s1
i;j
SHI ¼ P P h i ð4Þ
for Case 7 and a higher volumetric flowrate of 3.93 m3 s1 for case j i T rout i;j
T ref
8. Before the experimental tests, a separate experiment was con-
ducted to measure the inlet flowrate and the corresponding inlet where Q: The total heat dissipation from all the racks in the data
and outlet temperatures for each rack using the abovementioned center. dQ is the rise in enthalpy of the cold air before entering
apparatus, and the relevant energy unbalance in and out of the test the racks. T represents temperature. The superscript r denotes rack
racks were maintained to be less than 5%. and the subscripts in, out, and ref indicate inlet, outlet and reference
CRAH supply, respectively.
The temperatures in front of the computer rack may be associ-
3. Data reduction ated with the infiltration, convective mixing amid hot and cold air
stream, airflow bypassing, leakage between computer rack, air flow
Evaluation of the data center efficiency and thermal perfor- entrainment due to imbalanced pressure, and the like. Hence, Eqs.
mance is often characterized by the intake temperatures in front (1)–(4) are quite helpful for they can be used to quantify specific
of the server racks. The equipment intake temperatures character- influences. In the following section, temperature distribution as
ize the thermal environment. Despite the message is very impor- well as these indexes subject to various arrangements will be elab-
tant to ensure the appropriate ambient environment for orated in more details.
C.-H. Wang et al. / Applied Thermal Engineering 112 (2017) 133–142 137
Table 1
Test cases of the present study.
Block
Case 7
Full containment, parts 2 and part 4 are blocked
Small flow rate = 2.83 m3 s1
Block
Case 8
Full containment, parts 2 and part 4 are blocked
Large flow rate = 3.93 m3 s1
Block
138 C.-H. Wang et al. / Applied Thermal Engineering 112 (2017) 133–142
Fig. 4 shows the measured temperature distribution contour for Case Tmax (°C) Tavg (°C)
all cases and Fig. 5 show the corresponding influence of aisle clap- Case1 35.1 25.6
ping or containment on the measured intake temperature distribu- Case 2 33.6 25.4
tion and RCI and SHI for cases 1–5. The measured temperatures are Case 3 33.6 25.3
Case 4 28.9 24.2
almost symmetry alongside the cold aisle due to symmetrical lay-
Case 5 38.3 25.3
out of computer racks, grilles, supplied power, and fan revolutions. Case 6 35.9 24.1
In this regard, only representative results of A1-E1 racks are dis- Case 7 33.7 23.6
played. The average and maximum temperatures for all cases are Case 8 43.3 24.8
shown in Table 2. In Fig. 5, the reference case (case 1) holds a low-
est average RCI of 87% and a comparatively high SHI value of 0.37.
This can be made clear from the temperature distribution as shown press hot air circulation at the upper part of A1 rack as shown in
in Fig. 4(a) where a much higher temperature occurs especially at Fig. 4(b). The slight improvement is attributed to lengthening the
the upper part of A1 rack, indicating part of the return hot air is cir- hot air circulation path. For further improvement of the tempera-
culated back to the rack inlet, and the maximum inlet temperature ture distribution of case 2, an enclosed door is made available at
can be as high as 35.1 °C. This phenomenon occurs not only at the the end of the cold aisle (case 3). Apparently, the hot air re-
upper portion of rack A1 but also prevails in the lower part of A1. circulation at E1 rack is conspicuously improved as shown in
This is because the air return of CRAH in this study is located at the Fig. 4(c). However, the corresponding mean RCI and SHI does not
lower middle half region. Thus hot air is forced toward the lower reflect this improvement by E racks. In fact, the higher temperature
part of CRAH while some hot air was entrained toward the lower contour shifts toward the end of the cold aisle (especially for A1
part of A1 to incur recirculation. Note that the last rack E1 also and B1 racks), suggesting a lower RCI there. The results imply
reveals some hot air recirculation with a much less extent. This enclosing the door at the end of cold aisle casts little improvements
is somewhat expected for the air return grille of CRAH is close to on the overall RCI and SHI provided the entrance of the cold aisle is
A1. To improve the hot air recirculation occurring at A1, additional open, implying enclosing the entrance of the cold aisle may be
two plates are vertically aligned to A1/A2 racks toward CRAH to more effective. In this regard, some further modifications such as
divert the hot air back to A racks. However, this design can only enclosing the entrance of cold aisle but leave the open end (case
marginally improve the mean RCI to 91%, and the maximum tem- 4) and fully cold-aisle containment (case 5) are tested and the cor-
perature is slightly reduced to 33.6 °C. The deign may slightly sup- responding temperature distribution is seen in Fig. 4(d) and (e).
Interestingly, it is found that the full containment shows a much
inferior temperature distribution (case 5) than enclosing only at
the entrance of cold aisle. Although the RCI is 91% which is slightly
100 better than the reference case but the corresponding SHI is
increased to 0.39, indicating severe hot air recirculation as com-
pared to the reference case. On the other hand, the mean RCI is
80 over 99% and the SHI is lower to 0.27 for case 4. Note that the max-
imum intake temperature for full containment reaches 38.3 °C
RCI[%]
100
95
RCI[%]
90
85 Case5
Case6
80
A1 B1 C1 D1 E1
Rack ID
0.5
0.3
0.2 Case5
Case6
0.1
A1 B1 C1 D1 E1
Rack ID
90
flow pattern from the grilles will jeopardize the RCI and SHI
significantly.
Case7
80 Case6 5. Conclusions
Case8
The present study experimentally investigates the relevant
blockage layouts as well as cold-aisle containment on the overall
70
A1 B1 C1 D1 E1 efficiency of a datacenter within a typical container size datacenter
with a total of 10 racks. Tests are performed with an constant inlet
Rack ID
air temperature of 21 °C at all grilles and airflow is supplied from
drop ceiling. The total power generated from the ten racks is
0.5
30 kW with equally delivering power of 3 kW for each rack. A total
of eight arrangements are examined and compared, including ref-
0.4 erence case, case 1 with a prescribed total airflow rate of
3.52 m3 s1 from the grilles, and other cases are subject to various
blockage arrangement, containment types, and supplied air flow-
0.3 rates. Based on the foregoing discussions, the following conclu-
SHI
0.2
(1) An appreciable hot air recirculation occurs for the reference
Case7 case without any blockages or containment (in full or in par-
0.1 Case6 tial), and adding a blockage plates vertical to the CRAH at the
Case8 entrance of cold aisle can only improve marginally the asso-
ciated RCI.
0.0 (2) Layout with enclosing the end of cold aisle while let open
A1 B1 C1 D1 E1 the entrance of cold aisle also performs poorly.
Rack ID (3) Full containment of the cold aisle with a high jet airflow pat-
tern from the supplied grilles gives the worst performance
Fig. 8. Measured RCI and SHI for cases 6, 7, and 8. and the highest intake temperatures due to significant hot
air reversal across the upper part of computer racks.
(4) Layout with enclosing door at the entrance of cold aisle but
as case 6 and case 8, show a zigzag behavior (A1..E1) and the RCI let open the cold aisle shows a much superior temperature
reveals a very slight increasing trend from rack A1 to E1. There distribution and a rather high RCI of 99%. This is applicable
are two reasons for this result. Firstly, with the presence of even at a high jet airflow rate due to sufficient pressure bal-
enclosed door at both ends of cold aisle and the corresponding ancing of the cold and hot aisle.
jet air flow will introduce the so-called Coanda effect which is (5) A full containment design having higher jet airflow pattern
the phenomena in which a jet flow attaches itself to a nearby sur- with full containment layout may cause the Coanda effect
face and remains attached even when the surface curves away that lead to zigzag results of RCI and SHI. A lower supplied
from the initial jet direction. This phenomenon becomes more pro- air flowrate without Coanda effect for a full containment of
nounced for a higher flowrate such as case 6 and case 8. In this cold aisle gives the best overall performance.
regard, the main flow from A1 and E1 grille is directed toward
the enclosed doors and only comparatively lower portion of the
air flow is directly heading toward the bottom of A1 and E1 racks.
This eventually leads to an increase of the static pressure at part 1, Acknowledgements
and suppresses the flow reversal from hot aisle. Thus, a compara-
tively higher RCI and a lower SHI in association with B1 or D1 racks The authors are indebted to the financial support from Ministry
emerge. The corresponding comparatively higher static pressures of Science and Technology, Taiwan under contract 105-3113-E-
at A1/E1 will enforce some air flow toward B1/D1 that may 009-003.
increase the effective airflow volume from B1/D1 further down-
stream. The comparatively high stream airflow of B1/D1 produces
References
a local low pressure zone and entrain some air flow from C1 grille.
As a result, the effective air flow heading toward C1 rack is reduced [1] J.G. Koomey, Worldwide electricity used in data centers, Environ. Res. Lett. 3
which result in another local high pressure zone at part 1, thereby (2008) 034008.
[2] J.G. Koomey, Growth in Data Center Electricity Use 2005 to 2010, Analytics
increasing the RCI of C1 rack. Secondly, although the RCI displays a
Press, 2011 (August 1).
zigzag trend, it also shows a slightly increasing tendency from A1 [3] S.V. Garimella, T. Persoons, J. Weibel, L.-T. Yeh, Technological drivers in data
to E1. This is associated with the branching design of air supplying centers and telecom systems: multiscale thermal, electrical, and energy
duct. The static pressure normally increases from the first (A1) to management, Appl. Energy 107 (2013) 66–80.
[4] ASHRAE TC 9.9, Thermal Guidelines for Data Processing Environments –
the last (E1), despite the variation is small, it will impose some Expanded Data Center Classes and Usage Guidance, Whitepaper prepared by
effect to prevent airflow reversal and reveals an increasing trend. ASHRAE Technical Committee (TC) 9.9, 2011.
142 C.-H. Wang et al. / Applied Thermal Engineering 112 (2017) 133–142
[5] S.A. Nada, K.E. Elfeky, A.M.A. Attia, Experimental investigations of air [10] K.S. Saurabh, R.C. Andrew, I. Mahmoud, Quantitative comparison of air
conditioning solutions in high power density data centers using a scaled containment systems, in: Proceedings of the Intersociety Conference on
physical model, Int. J. Refrig. 63 (2016) 87–99. Thermal and Thermomechanical Phenomena in Electronic Systems (ITherm)
[6] V.K. Arghode, V. Sundaralingam, Y. Joshi, W. Phelps, Thermal characteristics of (2012), San Diego, CA, 2012, 30 May–1 June, 2012.
open and contained data center cold aisle, J. Heat Transf. 135 (6) (2013) [11] S. Vikneshan, K.A. Vaibhav, J. Yogendra, Experimental characterization of cold
061901. aisle containment for data centers, in: Proceedings of the 29th IEEE SEMI-
[7] M. Takahashi, T. Uekusa, M. Kishita, H. Kaneko, Aisle-capping method for THERM Symposium, Atlanta, GA 30332, USA, 2013.
airflow design in data centers, in: Proceedings of the International [12] M.K. Herrlin, Rack cooling effectiveness in data centers and telecom central
Telecommunications Energy Conference (INTELEC) (2008), San Diego, CA, offices: the rack cooling index (RCI), ASHRAE Trans. 111 (1) (2005) 725–731.
September 14–18, 2008. [13] R.K. Sharma, C.E. Bash, C.D. Patel, Dimensionless parameters for evaluation of
[8] R. Schmidt, A. Vallury, M. Iyengar, Energy savings through hot and cold aisle thermal design and performance of large-scale data centers, in: Proceedings of
containment configurations for air cooled servers in data centers, in: the Eighth ASME/AIAA Joint Thermophysics and Heat Transfer Conference, St.
Proceedings of the Pacific Rim Technical Conference and Exposition on Louis, MO, 2002.
Packaging and Integration of Electronic and Photonic Systems (InterPACK) [14] R.K. Sharma, C.E. Bash, Dimensionless parameters for energy efficient data
(2011), Portland, OR, July 6–8, 2011. center design, in: Proceedings of the IMAPS Advanced Technology Workshop
[9] S. Gondipalli, S. Bhopte, B. Sammakia, M. Iyengar, R.R. Schmidt, Effect of on Thermal Management.
isolating cold aisles on rack inlet temperature, in: Proceeding of the 11th IEEE
ITHERM Conference 2008, Orlando, FL, USA, 2008.