Professional Documents
Culture Documents
Bridge Inspection and Condition Assessment Using Image-Based Technologies with UAVs
Shuhei Hiasa, Ph.D.1; Enes Karaaslan2; Wesley Shattenkirk3; Chase Mildner4; and F. Necati
Catbas, Ph.D., P.E., F.ASCE5
1
Visiting Scholar, Dept. of Civil, Environmental, and Construction Engineering, Univ. of Central
Florida, 12800 Pegasus Drive, Suite 211, Orlando, FL, USA. E-mail:
hiasa615@Knights.ucf.edu; Civil Engineer, West Nippon Expressway Company Ltd. (NEXCO-
Downloaded from ascelibrary.org by University Of British Columbia on 04/23/18. Copyright ASCE. For personal use only; all rights reserved.
West), Dojima Avanza 19F, 1-6-20 Dojima, Kita-ku, Osaka 530-0003, Japan. E-mail:
s.hiasa.aa@w-nexco.co.jp
2
Ph.D. student, Dept. of Civil, Environmental, and Construction Engineering, Univ. of Central
Florida, 12800 Pegasus Drive, Suite 211, Orlando, FL, USA. E-mail: Enes.Karaaslan@ucf.edu
3
Student, Dept. of Mechanical and Aerospace Engineering, Univ. of Central Florida, 12760
Pegasus Drive, Suite 307, Orlando, FL, USA. E-mail: WShattenkirk@Knights.ucf.edu
4
Student, Dept. of Mechanical and Aerospace Engineering, Univ. of Central Florida, 12760
Pegasus Drive, Suite 307, Orlando, FL, USA. E-mail: chasemildner@Knights.ucf.edu
5
Professor, Dept. of Civil, Environmental, and Construction Engineering, Univ. of Central
Florida, 12800 Pegasus Drive, Suite 211, Orlando, FL, USA (corresponding author). E-mail:
catbas@ucf.edu
ABSTRACT
This paper presents the capabilities and limitations of high-definition (HD) imaging and
infrared thermography (IRT) using unmanned aerial vehicles (UAVs) for bridge inspections.
Regarding HD imaging, this study shows the potential to detect the required minimum, 0.1 mm,
width of cracks using simulated cracks at a distance of 1-3 m from the bridge. As for IRT
application with UAVs, the effect of vibration caused by the drone was investigated. This paper
concludes that the hovering flight of drones was extremely stable and IRT with UAVs can
provide reliable data for bridge inspections. If IRT is used without hovering flight, the effect of
flying speed must be investigated since it might also affect the IRT results. This paper shows
great potential of image-based technologies with UAVs for bridge inspections without any traffic
disturbance as a complimentary approach to current practices.
INTRODUCTION
Aging and deterioration of road infrastructure is becoming a serious problem worldwide. In
order to prevent the impending degradation of these bridges, periodic inspection and assessment
for proper maintenance are indispensable. In the US, every bridge as defined by the National
Bridge Inspection Standards (23 CFR 650 Subpart C) is required to have a routine inspection
conducted, visual inspection at a distance to identify obvious defects, at regular intervals not to
exceed twenty-four months. In addition, in-depth inspections, to identify any deficiencies not
readily detectable using routine inspection procedures, are generally conducted over longer
intervals than routine inspections; the level and frequency are determined by the bridge
administrators. In-depth inspections consist of hands-on inspections by non-destructive
evaluation (NDE) methods to fully ascertain the existence of or the extent of any deficiencies,
and close-up visual assessment of every defective surface at a distance no further than an arm’s
length (FHWA 2012; GPO 2017).
Even though a routine inspection is conducted periodically, this type of inspection aims to
© ASCE
detect mainly severe and/or obvious defects. It may not be able to detect moderate or
insignificant defects, and cannot detect hidden defects such as delamination. In many cases, what
bridge administrators can do in response to those obvious/severe defects is corrective
maintenance, such as major repair work, rehabilitation and replacement. This requires a lot of
costs and time as well as lane closures, causing social impact on the road network for the
maintenance work. In order to reduce maintenance cost and extend the service life of bridges in
good condition, preventive maintenance is essential by detecting insignificant and/or hidden
Downloaded from ascelibrary.org by University Of British Columbia on 04/23/18. Copyright ASCE. For personal use only; all rights reserved.
defects which cannot be detected by a routine inspection. Specifically, this is important in the US
since the number of bridges has been increasing year by year while the aging has been
progressing; e.g., 26% of 588,844 bridges were over 50 years in 2000 while 39 % of 614,386
bridges were over 50 years in 2016 (FHWA 2017; FHWA and FTA 2014). Therefore, better
methods are needed to detect such defects and quantify the extent and severity of bridge
conditions early, accurately, and rapidly with minimal traffic impact, ideally without lane
closures.
Image-based bridge inspection technologies are the promising candidates to meet the demand.
Authors have been conducting research on infrared thermography (IRT) and high-definition
(HD) imaging technologies. IRT can detect subsurface defects such as delamination and voids,
and HD imaging can detect surface defects such as cracks, thus, these technologies can
supplement both hands-on and close-up visual inspections. Since image-based technologies are
non-contact methods and can be used with vehicles, such as cars and unmanned aerial vehicles
(UAVs) by attaching these cameras on them, it is feasible to scan bridges without traffic
disturbance. The data collection speed of the integrated IRT and HD systems is a great advantage
for periodic bridge inspections compared to current routine and in-depth inspections. Especially
for bridge deck inspection, image-based technologies have showed a great potential to conduct
much faster inspections than traditional practices by attaching cameras on a car and driving the
car at normal speeds without lane closures. As for other components, they can also be conducted
much faster than current practices by attaching cameras onto UAVs since they do not require
direct contact to the concrete surface, which can eliminate traffic control and lane closures for
special inspection vehicles and platforms such as snooper trucks.
This paper explores the capabilities of integrated system of image-based technologies and
UAVs for bridge inspections. Since application of UAVs for bridge inspections has been
developed very recently, exploring the capabilities, limitations and proper conditions of the
integrated system through field experiments is important for applying this system to real bridges.
As mentioned in (Omar and Nehdi 2017a), one of the limitations for applying image-based
technologies using UAVs is limited sizes of cameras can be utilized due to the small UAV
payload. Therefore, it is important to investigate the capabilities and limitations of both IR and
HD cameras which can be attached to UAVs.
High-speed scanning of bridge decks: For high-speed concrete bridge deck scanning at
highway speeds, Line Camera System (LCS) has been utilized by attaching cameras to a vehicle.
LCS can be considered as the most suitable type of HD camera to scan bridge decks since the
camera distance from the surface is fixed by mounting cameras on a car. As for the accuracy,
insignificant cracks, less than 0.3 mm (0.012 in.) width (AASHTO 2013), for reinforced concrete
can be detected from the collected images (Matsumoto et al. 2015). On the other hand, high-
speed application of IRT was not fully investigated. Actually, several different types of camera
have been used for high-speed scanning while ASTM standard recommends for data collection
speed at less than 16 km/h (10 mph) (ASTM 2014). Therefore, authors conducted comparative
© ASCE
studies to explore suitable conditions and IR camera specifications for high-speed scanning
(Hiasa et al. 2016b, 2017d).
UAVs application for bridge inspections: Recently, applications of UAVs for bridge
inspections have been increasing. For example, (Ellenberg et al. 2016a; Escobar-Wolf et al.
2017a; Omar and Nehdi 2017b) investigated the capability of the combination of UAV and IRT
for bridge deck inspections. On the other hand, (Ellenberg et al. 2014) investigated the
possibility of HD imaging application for crack detection. They tested the detectable crack width
Downloaded from ascelibrary.org by University Of British Columbia on 04/23/18. Copyright ASCE. For personal use only; all rights reserved.
using simulated cracks, and validated that HD imaging could detect the crack with 0.75 mm
thickness at distances of 3 m without postprocessing and 12 m after postprocessing. Throughout
these experiments, UAV application with image-based technologies has demonstrated high
potential to compliment current routine and in-depth inspections.
Regarding bridge deck inspections, it can be assumed that high-speed scanning using a car is
much faster, more reliable and safer than using a drone since it might require some traffic control
to collect the whole decks surface data. For example, (Escobar-Wolf et al. 2017b) missed some
areas of bridge decks due to the difficulty to check the coverage areas during the operation of the
UAV. Furthermore, it can be expected that taking whole deck images may be difficult for busy
traffic roads since most of the decks might be covered by the traffic. Moreover, using a drone
over bridges without lane closure has a potential danger such as falling on the road or hitting by
cars. Therefore, UAVs application may be better to be used for sides of bridge, substructures and
underside of decks.
Review of HD imaging and IRT technologies: As (Koch et al. 2015) reviewed on computer
vision based crack detection of concrete infrastructure, the rate of the application of computer
vision methods for civil infrastructure inspection have been exponentially increasing over the last
decade, and automation of detection and measurements of defects has been developing. As for
the accuracy, the most critical factor for accuracy is image quality, regardless if the system is
manual or automatic.
In terms of IRT, NDE Web Manual of FHWA (FHWA 2015) lists the limitations of IRT,
such as 1) it is difficult to select the optimal conditions for effective application, 2) obstacles,
such as water, stains, or debris, can cause misdetection, 3) unable to provide information about
delamination depth, and 4) difficulty of detecting defects located at deeper than 10-13 cm (4-5
in.). Authors have conducted several studies to identify the uncertainties and challenges of IRT,
such as data collection time, delamination size, camera specifications and data collection speed,
in order to enhance the usability, reliability and accuracy of IRT for concrete bridge inspections.
Furthermore, proper methods, ideal conditions, and data interpretation methods for more
effective application have been explored.
In terms of 1), ideal data collection time (nighttime) and proper camera specifications
depends on data collection speed (cooled type IR cameras for high-speed scanning) were found
in past studies (Hiasa et al. 2016b)(Hiasa 2016) (Hiasa et al. 2017d; Watase et al. 2015).
Regarding 2), those misleading thermal contrasts can be distinguished by comparing IR images
with HD images; thus, authors recommend integrated use of IRT and HD imaging for an image-
based structural health monitoring at local level (Hiasa et al. 2017d). Furthermore, it was also
found that debris generate higher thermal contrast than delamination on the concrete surface;
thus, it is proposed that temperature differences due to obstacles can be distinguished by
analyzing the data (Hiasa 2016). As for 3), delamination depth estimation method was developed
using finite element (FE) modeling (Hiasa et al. 2017b). In regard to 4), authors found the
correlation between size of delamination and detectable depth (Hiasa et al. 2017a). Actually,
© ASCE
(Kee et al. 2012) were able to detect a 15.2 cm (6 in.) depth of delamination by IRT. Therefore,
IRT can detect delamination that is deeper than 10-13 cm if the delamination size is large
enough. In addition to these limitations, authors have been developing more objective data
interpretation method than just judging the color contrast of IR images by incorporating FE
model simulations (Hiasa et al. 2016a, 2017c). Even though more data is needed to enhance the
reliability and usability of IRT for bridge inspection, significant improvements within the IRT
method have already been achieved through past studies.
Downloaded from ascelibrary.org by University Of British Columbia on 04/23/18. Copyright ASCE. For personal use only; all rights reserved.
© ASCE
in Figure 4(d) to investigate the effect of crack direction for HD imaging. Regarding Figure 4(b),
different widths of lines defined as criteria were drawn.
Downloaded from ascelibrary.org by University Of British Columbia on 04/23/18. Copyright ASCE. For personal use only; all rights reserved.
© ASCE
those images taken from 1m away. From Figure 6(a-c), even 0.1 mm cracks can be observed
from this distance by enlarging the images. However, it was difficult to see the 0.1 mm crack
from dark gray background as shown in Figure 6(d). From this image, somehow 0.3 mm width
line can be distinguished from the enlarged image, and 1.27 mm and 4.76 mm cracks can be
observed clearly.
Downloaded from ascelibrary.org by University Of British Columbia on 04/23/18. Copyright ASCE. For personal use only; all rights reserved.
© ASCE
of IRT methods, which is the effect of vibrations from the drone. (Hiasa et al. 2016b) found that
even vibration arising from idling of a car generated blurred images for uncooled type IR
cameras. In Table 2, some commercially available IR cameras for drones are summarized along
with a handheld IR camera, the T420 manufactured by FLIR Systems, Inc. Since the payload of
the UAV is limited, IR cameras with uncooled detector types are ideal for the application.
Therefore, the effect of vibration caused by drones must be further investigated before applying
it to bridge inspections. This study examined the effect by using the handheld IR camera, the
Downloaded from ascelibrary.org by University Of British Columbia on 04/23/18. Copyright ASCE. For personal use only; all rights reserved.
T420, with the same drone utilized throughout. Since the T420 is not intended for UAV
application, if the drone can fly steadily without generating blurred images from the T420, other
IR cameras meant for UAVs may be used without vibration problems regarding blurred images
caused by uncooled IR cameras. In this test, a target sheet which has two 10 x 10 cm lattice
pattern squares (1 x 1 cm and 2 x 2 cm grids) as shown in Figure 8(a) was attached on a brick
wall as shown in Figure 8(b).
© ASCE
© ASCE
© ASCE
IR images, although this depends on the camera specifications. In this case, even in the IR image
taken from 5 m, two lattice pattern squares can be distinguished clearly, indicating IRT can
detect at least a 10 x 10 cm square of delamination. Since it can be assumed that real
delamination occurred in real concrete bridges may be much larger than 10 x 10 cm, 4-5 m might
be better for this camera with bridge scanning using with UAVs.
Downloaded from ascelibrary.org by University Of British Columbia on 04/23/18. Copyright ASCE. For personal use only; all rights reserved.
DISCUSSION
Throughout the test, some challenges were found. The wind condition was not good during
the test which made it a little bit challenging to maintain a specific distance and stabilize the
drone. However, real bridges over rivers or seas can be expected stronger winds, so that more
experiments under such weather conditions are important. Furthermore, the test bridge railing
was metal and interfered the GPS/compass on the drone, thus, bridges with concrete railings
should also be tested to determine if it becomes easier to scan the bridge using a drone.
Furthermore, it was found that if two operators could control UAV, with one operator controlling
the flight path and the other controlling the gimbal/ camera position, it would be much easier to
scan bridges as opposed to everything being controlled by one operator.
Regarding the capability of image-based technique with UAVs, this test showed good
potential to use it for bridge inspection, although more tests on real bridges are needed since this
test used a target sheet for IRT test and simulated cracks printed on different colors of papers for
HD imaging. However, as (Ellenberg et al. 2016b) mentioned, bridge inspection using image-
based technologies with UAVs has a great potential to be a complimentary approach to current
routine and in-depth inspection methods as well as other NDE methods as a “rapid screening”
method. In regard to the scanning speed, 54 m long bridge was scanned within 2 minutes. This
would be much faster by accumulating more experiences to control drones for bridge inspections.
CONCLUSION
This study investigated the capabilities of integrated systems of image-based technologies
and UAVs for bridge inspections. Regarding HD imaging, simulated cracks printed on different
colors of papers were attached to a footbridge. Although some challenges were found using a
real bridge, even 0.1 mm thick of lines, minimum requirement for concrete bridges, can be
© ASCE
observed from enlarged images taken from 1-3 m distance from the bridge. However, these
simulated cracks were printed on papers, and some thin cracks on darker gray scales of
background could not be distinguished from the enlarged images. Thus, further investigation is
needed, at real bridges, to identify the capability of this method. As for IRT application with
UAVs, the effect of vibration caused by the drone was investigated. Even though the IR camera
used for this study was not meant for use with a drone, the effect of vibration cannot be observed
from this test. Therefore, this paper concluded that hovering flight of drones is very stable and
Downloaded from ascelibrary.org by University Of British Columbia on 04/23/18. Copyright ASCE. For personal use only; all rights reserved.
IRT with UAVs can provide reliable data for bridge inspections, although if IRT is used without
hovering flight, the effect of flying speed must be investigated since it might also affect the IRT
results. Through these field experiments, this paper shows a great potential of image-based
technologies with UAVs for bridge inspections without any traffic control, as a complimentary
approach to current inspection methods.
REFERENCES
AASHTO. (2013). Manual for Bridge Element Inspection, 1st Edition, with 2015 Interim
Revisions.pdf.
ASTM. (2014). Standard Test Method for Detecting Delaminations in Bridge Decks Using
Infrared Thermography. ASTM International, West Conshohocken, PA, USA.
Ellenberg, A., Kontsos, A., Moon, F., and Bartoli, I. (2016a). “Bridge deck delamination
identification from unmanned aerial vehicle infrared imagery.” Automation in Construction,
Elsevier B.V., 72, 155–165.
Ellenberg, A., Kontsos, A., Moon, F., and Bartoli, I. (2016b). “Bridge deck delamination
identification from unmanned aerial vehicle infrared imagery.” Automation in Construction,
Elsevier B.V., 72, 155–165.
Ellenberg, a., Branco, L., Krick, a., Bartoli, I., and Kontsos, a. (2014). “Use of Unmanned Aerial
Vehicle for Quantitative Infrastructure Evaluation.” Journal of Infrastructure Systems, 21(3),
4014054.
Escobar-Wolf, R., Oommen, T., Brooks, C. N., Dobson, R. J., and Ahlborn, T. M. (2017a).
“Unmanned Aerial Vehicle (UAV)-Based Assessment of Concrete Bridge Deck
Delamination Using Thermal and Visible Camera Sensors: A Preliminary Analysis.”
Research in Nondestructive Evaluation, Taylor & Francis, 0(0), 1–16.
Escobar-Wolf, R., Oommen, T., Brooks, C. N., Dobson, R. J., and Ahlborn, T. M. (2017b).
“Unmanned Aerial Vehicle (UAV)-Based Assessment of Concrete Bridge Deck
Delamination Using Thermal and Visible Camera Sensors: A Preliminary Analysis.”
Research in Nondestructive Evaluation, Taylor & Francis, 0(0), 1–16.
FDOT. (2016). Florida Department of Transportation Bridge Inspection Field Guide national
Bridge, Bridge Mnagement and Agency Defined Elements.
FHWA. (2012). Bridge Inspector’ s Reference Manual.
FHWA. (2015). “Federal Highway Administration Research and Technology: Nondestructive
Evaluation (NDE) Web Manual.”
<https://fhwaapps.fhwa.dot.gov/ndep/DisplayTechnology.aspx?tech_id=14> (Sep. 28, 2017).
FHWA. (2017). “Highway Bridges by Year Built 2016.”
<https://www.fhwa.dot.gov/bridge/nbi/no10/yrblt16.cfm> (Sep. 28, 2017).
FHWA, and FTA. (2014). 2013 Status of the Nation’s Highways, Bridges, and Transit:
Conditions & Performance.
GPO. (2017). “Electronic Code of Federal Regulations.” U.S. Government Publishing Officem,
© ASCE
© ASCE