Professional Documents
Culture Documents
Energy Efficiency Studies Through
Energy Efficiency Studies Through
Energy Efficiency Studies Through
PII: S0378-7788(11)00004-1
DOI: doi:10.1016/j.enbuild.2010.12.031
Reference: ENB 3092
This is a PDF file of an unedited manuscript that has been accepted for publication.
As a service to our customers we are providing this early version of the manuscript.
The manuscript will undergo copyediting, typesetting, and review of the resulting proof
before it is published in its final form. Please note that during the production process
errors may be discovered which could affect the content, and all legal disclaimers that
apply to the journal pertain.
ENERGY EFFICIENCY STUDIES THROUGH 3D LASER SCANNING AND THERMOGRAPHIC
TECHNOLOGIES.
1 1 1 1
S. Lagüela , J. Martínez , J. Armesto , P. Arias ,
1
ETSE Minas, University of Vigo. Rúa Maxwell s/n, Campus Lagoas-Marcosende, 36310 Vigo, Spain.
t
Corresponding author: susiminas@uvigo.es; 986813499
ip
cr
KEYWORDS: thermography, laser scanning, energy efficiency, building, historical heritage conservation,
metric calibration.
us
an
ABSTRACT:
Infrared thermography is generally used in energy efficiency studies in buildings, as well as in moisture
M
detection studies and building inspections for heat losses. Commonly, thermographic studies are qualitative,
based on detection of differences of temperature between points; and they only include thermal
d
measurements on specific points or areas, associated to many other factors such as the thermal properties
te
of the materials and environmental temperature and humidity. But this way of working presents a lot of
models are simple in geometry and thermographies include geometrical distortions introduced by the camera
ce
Laser scanning technology can be an optimal complement for the thermographic measurement, because it
Ac
provides the metric information that allows the quantification of the thermal studies if the clouds of points are
In this paper a methodology for registering thermographies in clouds of points is explained, with the following
steps: procedure for processing the metric calibration of the thermal camera, register of thermographies in
the cloud of points based on control points, and finally, processing the textured cloud of points to obtain
1.1 INTRODUCTION.
Page 1 of 24
Nowadays, special attention is paid to energy saving in the building sector, which is put in relevance with the
output of new regulations, such as the Directive 2002/91/CE of the European Parliament and Council, that
defines energy efficiency in buildings, both existing and in construction. In the case of ancient buildings, the
energetic study is usually complicated because plans of the building are not commonly available, which
makes it difficult to have enough information of the building. Although there are many factors that determine
t
energy efficiency in buildings, such as installation efficiency and assessment, one of the most important
ip
parameters is the composition of façades and cover because the charge in HVAC depends mainly on
cr
infiltrations, thermal bridges and isolation material condition. Infrared thermography is a technique that can
be applied to the study of these parameters, as can be seen in projects where this technique is applied to
us
materials and defects location, and also to humidity areas identification ([1], [2], [3]).
Infrared thermography is the technique of producing an image from infrared light, invisible to the human eye,
an
which all the bodies emit due to their thermal conditions, because bodies radiate energy proportionally to
their temperature [2]. This emitted radiation detected by thermographic cameras belongs to the thermal
M
infrared range, in a wavelength between 7 and 15 µm. Thermographic cameras have sensors that capture
the emitted or reflected thermal radiation from the objects, and they generate an image where each pixel is
associated to a digital value, proportional to the amount of received energy. This measurement is carried out
d
in a no invasive way (no contact, no destructive), and this fact makes thermography be a widely applied
te
technique, for fields such as building and electrical installation inspections([4], [5], [6], [7]),, in industrial
p
environments ([8], [9]) and in difficult access objects[10], but also in medicine and veterinary science ([11],
[12]).
ce
However, today's thermographic studies present several limitations, as distortion of the thermographic lens
Ac
allows neither to obtain georeferenced temperature data, nor to map the thermographies with isotherms of
the objects studied. What is more, the analyses are qualitative, based on the visual detection of peculiar
thermal regions, like cold and hot points, by evaluating the thermographies looking for air leaks and thermal
bridges. Quantitative studies allowed by the usual working method, as the experience shown in [13], are the
calculation of the surface temperature in a determined and limited number of points in the thermography. All
these limitations disappear when thermographies include metric information that allows the carrying out of
distance and area measurements to achieve a deeper knowledge of the façade and to broaden the variety of
Page 2 of 24
Non contact techniques for built up structures survey and documentation have evolved significantly in the
last decade allowing the metric survey, the image gathering and the 3D modelling of the whole structure,
structural parts and faults through integrated technologies of high reliability and accuracy. 3D laser scanning
and close range photogrammetry should be considered as exponents of the evolution of the surveying
techniques since they provide clouds of thousands or millions of points measured over the structure surface
t
within few millimetres accuracy, texture information and the possibility of building 3D detailed models of the
ip
structure. These techniques have become especially useful as 3D modelling tools in heritage applications,
cr
where surfaces are complex, and the direct contact might be kept to a minimum [16]; and also in large high
structures, where physical access to the structure involves important risk for operators. Referring to
us
terrestrial laser scanning (TLS), its applications to building construction are mainly related to state condition
studies, as can be seen in [17] and [18], and stability, as demonstrated in [19] and [20].
an
The possibility of combining laser scanning with different techniques has been widely exploited, as can be
seen in [20], [21] and [22], where laser data has been used with ground penetrating radar and laser induced
M
fluorescence data among others, in order to achieve multi-sensor information of linear and building
structures. There are also some works where thermography is combined with laser data so that the first
complements the latest, and the two of them together give users a higher level of knowledge of the object
d
This article develops a working methodology to combine metric information from the terrestrial laser scanner
p
with thermal information from the thermographic camera. As a consequence, a calibration field is designed in
ce
order to determine the parameters of interior orientation of the thermographic camera and to correct the
distortion of its lens. Then, a topographic and thermographic surveying is designed, together with the
Ac
processing of scanning data and thermographies. This methodology is applied to the building of the School
of Technical Industrial Engineering in Vigo, chosen as a consequence of its antiquity: its construction began
in the year 1930, which makes it the oldest university educational centre in Galicia.
1.1.1 Equipment.
The equipment used in this work was a thermographic camera NEC TH9260, that measures temperatures in
a range from -20 to 60ºC, with a thermal resolution of 0.06ºC at 30ºC (30Hz). The detectors form an
Uncooled Focal Plane Array (UFPA), and its size is 640x480. The instant field of view of the camera is 0.6
mrad, and the field of vision is of 21.7º in the horizontal plane and 16.4º in the vertical plane. The software
Page 3 of 24
used for the regeneration of the thermographies from their thermal format to an image format is Matlab v
7.0.1, and for the metric calibration of the camera the photogrammetric station Photomodeler Pro v5 is
applied.
For the metric surveying, a 3D long-range TLS (TOF) Riegl LMS-Z390i is used. This equipment measures
distances in a range of 1.5 to 400 m, with a nominal precision of 4 mm, 50 m distance in normal illumination
t
ip
and reflectivity conditions. The vertical field of vision has amplitude of 80 sexagesimal degrees, and 360
degrees in the horizontal plane. It has a maximum of 0.002 degrees, and the rate of measurement of points
cr
oscillates between 8,000 and 11,000 points per second. The software used for the recording and alignment
us
1.2 METHODOLOGY.
an
1.2.1 Metric calibration of thermographic camera.
The objective of the metric calibration of the camera is to determine the geometric model of the camera,
M
described by its interior orientation parameters [24].
It is necessary to calibrate the thermographic cameras thermally, with an extended black body and its
d
corresponding emissivity [25], but there is no history of their metric calibration. As a result, a calibration field
te
is designed in this work. Although many authors present 3-dimmensional calibration fields [26], [27], a
planar array, based on the solution presented by [28] and [29], was chosen with the objective of having a
p
This field consists on a wood plank, with a surface of 1m2, with 64 light bulbs, chosen due to their suitability
for being detected by the thermographic camera when turned on. Light bulbs are disposed in an 8x8 matrix
Ac
[28], as shown in figure 1 a. Since the position of each target is evaluated through their image barycentre,
temperature in each light bulb must present a radial distribution, being higher in the centre, where the
tungsten filament is, and gradually decreasing as the sphere’s radius increases, as shown in figure 1b.
The thermographic camera calibration was performed following a self-calibration bundle adjustment method
Since the thermographic camera used in this article has an electronic focus, the calibration procedure is
repeated 10 times, minimum number of measurements valid for a statistical study [32], in repeatability
Page 4 of 24
conditions [33]. The experiment took place indoors, under restricted temperature and natural illumination
conditions to avoid the effects of external thermal radiation in the measurement. The calibration field was
The thermographies were processed in a photogrammetric station, Photomodeler Pro v5, and the results
t
ip
cr
1.2.2 Thermographic work.
us
Thermographic surveying is realized before sunrise to avoid surface heating by direct radiation from the sun
[2], [3]. Thermographies are taken with the same focus the camera is calibrated for, from an orthogonal
an
position respecting to the considered façade, and with an overlap of 50% between consecutive
thermographies. In order to evaluate the temperature values measured with the thermographic camera and
to correct their possible deviations, the last phase of thermal data acquisition involves the measurement of
M
air temperature and humidity, together with some temperature direct measurements in several points of the
After field working a pre-processing of the thermographies is developed with Matlab. The purpose of this
te
treatment is to regenerate thermographies in image format from their own thermographic format, which
consists on a matrix of temperatures, so that it can be assimilated to a greyscale image, with just one
p
1. Thermal scale selection. Temperatures under 0ºC, corresponding to the sky, are change to 0;
temperatures above 40ºC are changed to 40. As a result, temperatures are limited to the interval 0-40ºC.
Ac
2. Assignment of a digital value scale. A scale of 1/40 is applied to the matrix values to move them to the
3. Application of a colour palette. A colour palette is designed to transform thermographies from greyscale to
colour images. This palette consists on a 256x3 matrix, where the 256 rows represent the grey intensities,
and the 3 columns are associated to the three channels (RGB). With this palette, the lowest temperatures
adopt the black colour, and increasing temperatures adopt, in this order, blue, green, red, and white for the
Page 5 of 24
4. Radiometric enhancement. Given that the thermal contrast between areas in the building is low, a
radiometric enhancement treatment is applied to magnify the contrast in the images: the input values are
limited between 30 and 70%, so black represents areas below 12ºC and white appears in areas where
Once this sequence is completed, thermographies are suitable for following work.
t
ip
cr
1.2.3 Laser scanning procedure.
us
The first step of a scan project is planning the location and number of scans and their resolution in order to
minimize the number of scans and time required, maximize the information acquire and avoid occlusions. For
an
the TLS survey of the façade of the EUIT Industrial, two scans were performed (Figure 5).
Two scans were made from each scan position. The first scan was based on a minimum resolution scan
M
(angular interval of 0.2º) of the entire field of vision (360º with respect to the Z axis and 80º for vertical
amplitude); this minimum resolution enables the scanning operation to last only 1.5 minutes. The second
scan covered only the façade under study, and had an angular interval of 0.05º, which is equivalent to a
d
After data acquisition, data processing is carried out, with the following activities:
ce
1. Alignment of the clouds of points. This was carried out by means of common targets between successive
scans combined with a surface matching system based on the iterative closest point (ICP) algorithm [34].
Ac
2. Cleaning and segmentation. Isolated points were eliminated and the mesh was regularized. The resulting
3. Triangulation. In order to develop a solid 3D model of the façade, a 2D Delaunay flat triangulation was
applied with respect to the visualization plane, limiting the length of the edges to 0.3 m and the angle
Page 6 of 24
After this step, scan data is adequate to be combined with data from other sensors, commonly
photographies, as done [20]. The objective of this article is to do an approach to the combination of scan
t
Thermographies are imported to the scanning project in Riscan, and associated to the camera calibration
ip
parameters calculated in previous steps. Next step is the registration of each thermography with the scan,
cr
which is done by marking control points in both thermography and cloud of points. The minimum number of
points needed for the correct placement of the thermography is 6, although accuracy increases
us
proportionally to the number of points. After marking points in each thermography, the orientation and
rotation matrix is calculated, together with the orientation deviation. Each registered thermography is
an
undistorted in order to correct radial and decentering distortions; this is possible thanks to the calibration
values calculated in the first step of this methodology. Once all thermographies are registered and
undistorted, the cloud of points is textured with them, so that a thermographic 3D model is obtained.
M
Finally, the thermographic 3D model is projected in a plane parallel to its main surface, so an
1.3 RESULTS.
Values of focal length, format size, principal point and radial and decentering distortion are calculated for the
Focal length, format size and principal point are analyzed through the calculation of their means,
experimental standard deviation, and experimental standard deviation of the mean. Results obtained are
shown in table 1.
Distortion parameters are studied according to their effect on the distortion equations:
2 4 6
dr = K1 * r + K2 * r + K3 * r (1)
2 2
dpx = P1 * (r + 2 * x ) + 2 * P2 * x * y (2)
2 2
dpy = P2 * (r + 2 * y ) + 2 * P1 * x * y (3)
Page 7 of 24
where: dr = radial distortion of the lens.
t
K1, K2 and K3 = radial distortion parameters.
ip
P1, P2 =decentering distortion parameters.
cr
The values for radial and decentering distortion parameters calculated are:
us
K1 = 0.0006135; K2 = 0.0001478; K3 = 0.0000228
-5 -7
P1 = 3.541· 10 ; P2 = -2.05·10
an
Comparing the values of distortion using the analytical results and the experimental results of the parameters
the difference found is below 0.1%, which makes the study valid.
M
1.3.2 Thermographic 3D models.
d
After laser data processing, the final cloud of points of the façade in study is formed by 122710 points.
te
Thermographies are placed in the cloud of points by marking 8 control points common for each
thermography and the original cloud of points; with a maximum orientation error of 2.96258 pixels, a
p
minimum error of 0.43437 pixels, and an average error of 1.08965 pixels for the orientation of 64
ce
thermographies, this value is considered as acceptable, taking into account the image size, of 307200 pixels.
1.3.3 Ortothermograms.
A projection plane is defined, parallel to the main surface of the façade, so that the textured cloud of points is
projected orthogonally. This ortothermogram, shown in figure 8, is the final result of this methodology, and
combines both thermal and metric information, in an adequate format for the direct measurement of
1.4 CONCLUSIONS.
Page 8 of 24
This article describes a methodology for combining metric information acquired with laser scanning
technologies and thermal information from a thermographic camera. The first step in this methodology is the
metric calibration of the thermographic camera, essential to the development of the methodology, given that
thermographies will not have their distortions corrected if they are not taken with a calibrated camera. This
metric calibration required the design of a calibration field adequate for being detected by the camera: a
t
wooden plank with light bulbs, precisely detected when turned on.
ip
The following step is the data acquisition with both technologies: laser scanning and thermography. This
cr
procedure is applied to the data acquisition of the School of Technical Industrial Engineering in Vigo, the
us
Data processing is divided in three different parts: thermography data processing, scanning data processing,
an
and combination of both kinds of data. This combination is based on control points; marking 8 control points
which achieves high precision thanks to the metric calibration parameters of the thermographic camera. As a
result, energy efficiency can be directly quantified through the measurement of the surfaces at highest or
d
lowest temperatures. Furthermore, the knowledge of the coordinates of each point of the façade allows the
te
exact location of peculiar zones, such as moisture, thermal bridges, and defects in isolation.
p
2. ACKNOWLEDGEMENTS.
ce
Authors would like to give thanks to Consellería de Economía e Industria (Xunta de Galicia) and Ministerio
de Ciencia e Innovación (Gobierno de España) for the financial support given; human resources programs
Ac
REFERENCES.
[2] S. Martín, I. Cañas, I. González, Thermographic Survey of two rural buildings in Spain, Energy and
Page 9 of 24
[3] E. Rosina, J. Spodek, Using infrared thermography to detect moisture in historic masonry: a case study in
[4] N.P. Avdelidis, A. Moropoulou, Applications of infrared thermography for the investigation of historic
t
[5] F. Sandrolini, E. Franzoni, An operative protocol for reliable measurements of moisture in porous
ip
materials of ancient buildings, Build. Env., 41 (2006), 1372-1380.
cr
[6] T.M . Lindquist, L. Bertling, Hazard rate estimation of high-voltage contacts using infrared thermography,
us
[7] C. Balaras, A. Argirou, Infrared thermography for building diagnostics, Energy and Buildings, 34 (2002),
an
171-183.
[8] A. Chrysochoos, B. Berthel, F. Latourte, Local energy analysis of high-cycle fatigue using digital image
M
correlation and infrared thermography, J. Strain Anal. Eng. Design, 43, 6 (2008), 411-421.
[9] P. McMullan, Assessing structural components of new masonry construction utilizing infrared
d
[10] M.R. Clark, D.M. McCann, M.C. Forde, Application of Infrared Thermography to the Non-Destructive
[11] J.R. Keyserling, P.D. Ahlgren, E. Yu, N. Belliveau, M. Yassa, Functional Infrared Imaging of the Breast –
ce
Historical Perspectives, Current Applications and Future Considerations, IEEE Eng. Med. Biol. Mag., 19 (3),
33-41 (2000).
Ac
[12] D.J. Mccaferty, The value of Infrared Thermography for Research on Mammals: Applications and Future
[13] E. Grinzato, V. Vavilov, T. Kauppinen, Quantitative infrared thermography in buildings, Energy and
[14] A. Hoyano, T. Asawa, R. Yashiro, Generation of surface temperatura image in built environment space
using the 3D thermograph and ray tracing method, IEEJ Trans. Fund. Mat., 129 (11), (2009), 791-798.[15] A.
Rizzi, F. Voltolini, F. Remondino, S. Girardi, L. Gonzo, Optical measurement techniques for the digital
Page 10 of 24
preservation, documentation and analysis of cultural heritage, VIII Conference on Optical 3D Measurement
[16] B. Ergun, C. Sahin, I. Baz, T. Ustintas, A case study on the historical peninsula of Istanbul based on
three-dimensional modeling by using photogrammetry and terrestrial laser scanning, Environ. Monit.
t
ip
[17] G. Teza, A. Galgaro, F. Moro, Contactless recognition of concrete surface damage from laser scanning
cr
and curvature computation, NDT&E International, 42 (2009) 240-249.
[18] F. Al-Neshawy, J. Piironen, S. Peltola, A. Erving, N. Heiska, M. Nuikka, J. Puttonen, Measuring the
us
bowing of marble panels in building facades using terrestrial laser scanning technology, Journal of
an
[19] J. Armesto, C. Ordóñez, L. Alejano, P. Arias, Terrestrial laser scanning used to determine the geometry
of a granite boulder for stability analysis purposes. Geomorphology, 106 (2009), 271-277.
M
[20] I. Lubowiecka, J. Armesto, P. Arias, H. Lorenzo, Historic bridge modelling using laser scanning, ground
penetrating radar and finite element methods in the context of structural dynamics, Eng. Struct., 31 (2009)
d
2667-2676.
te
[21] G. Giunta, E. Di Paola, B. Castiglione, Innovative 3D information system for the restoration and the
p
preventive maintenance plan of the Milan Cathedral, Proc. SPIE, 5239 (2004), 296-305.
ce
[22] L. Bartolini, M. Ferri de Collibus, G. Fornetti, M. Guarneri, E. Paglia, C. Poggi, and R. Ricci, Amplitude-
modulated laser range-finder for 3D imaging with multi-sensor data integration capabilities, Proc. SPIE,
Ac
laser profilometry and pulsed thermography, NDT and E International, 37 (7), (2004), 571-575.
[24] T. Luhmann, S. Robson, S. Kyle, I. Harley, Close range photogrammetry. Principles, methods and
[25] D.L. Balageas, Termografía Infrarroja: una técnica multifacética para la Evaluación No Destructiva
Page 11 of 24
[26] J. Heikkila, O.Silven, A four-step camera calibration procedure with implicit image correction. CVPR97.
[27] K. Amdal, Single camera system for close range industrial photogrammetry, Int. Arch.
th
[28] Z. Zhang, A flexible technique for camera calibration, 7 Int. Conference on Computer Vision, Greece,
t
1999.
ip
[29] B. Triggs, Autocalibration from planar scenes, ECCV 98(1998), 89-105.
cr
[30] K.B. Atkinson, Close Range Photogrammetry and Machine Vision, Whittles Publishing, Caithness, UK,
us
2006.
[31] Y. Chen, A.F. Schenk, A rigorous calibration method for digital cameras, Int. Arch. Photogramm. Remote
an
Sensing, 29-BI (1992) 199-205.
[32] S. Bell, A Beginner’s Guide to Uncertainty of Measurement, UK: National Physical Laboratory, 2009.
M
[33] BIPM, IEC, IFCC, ISO, IUPAC, IUPAP, OIML, Evaluation of measurement data- Guide to the expression
[34] P. Besl, N.A. McKay, Method for registration of 3-d shapes, IEEE Trans. Pattern Anal. Machine Intell,
te
Page 12 of 24
FIGURE CAPTIONS.
Fig. 1 a&b. Visible and thermal image of the calibration field; the thermal image has a zoom on a single
t
ip
Fig. 2. Thermography after digital value scale assignment.
cr
Fig. 3. Thermography with colour palette.
us
Fig. 5. Image of the scan positions in the EUIT Industrial.
an
Fig. 6. Cleaned and segmented cloud of points.
Fig. 7 a&b. Cloud of points textured with thermographies from different points of view.
M
Fig. 8. Ortothermogram of the façade of the EUIT Industrial, in Vigo, with its graphic scale.
d
te
TABLES.
p
ce
Table 1. Results of focal length, format size and principal point from the metric calibration of the
thermographic camera.
Ac
Page 13 of 24
Table
t
4 15,326 3,058 2,223 5,988 4,492
ip
5 15,412 3,001 2,077 5,995 4,501
cr
6 15,421 2,968 2,065 6,004 4,509
us
7 15,389 3,046 2,131 6,001 4,505
9 15,370 2,856
an2,421 6,006 4,503
M
10 15,360 3,016 2,068 5,991 4,494
Page 14 of 24
Figure
i
cr
us
an
M
ed
pt
ce
Ac
Page 15 of 24
Figure
i
cr
us
an
M
ed
pt
ce
Ac
Page 16 of 24
Figure
i
cr
us
an
M
ed
pt
ce
Ac
Page 17 of 24
Figure
i
cr
us
an
M
ed
pt
ce
Ac
Page 18 of 24
Figure
i
cr
us
an
M
ed
pt
ce
Ac
Page 19 of 24
Figure
i
cr
us
an
M
ed
pt
ce
Ac
Page 20 of 24
Figure
i
cr
us
an
M
ed
pt
ce
Ac
Page 21 of 24
Figure
i
cr
us
an
M
ed
pt
ce
Ac
Page 22 of 24
Figure
i
cr
us
an
M
ed
pt
ce
Ac
Page 23 of 24
Figure
i
cr
us
an
M
ed
pt
ce
Ac
Page 24 of 24