Professional Documents
Culture Documents
588113/2021/O/o ED/BnS/RDSO
Guidelines for
4D (BrIM) based Inspection of Indian Railway Bridges
Using 3D Bridge Information Model and Unmanned Aerial
System (Drone)
May- 2021
Issued by
Guidelines for
4D (BrIM) based Inspection of Indian Railway Bridges
Using 3D Bridge Information Model and Unmanned Aerial System
(Drone)
1.0 Abbreviations
UAV : Unmanned Aerial Vehicles
UAN : Unique Authorization Number
UAS : Unmanned Aerial System
LED : Light-Emitting Diode
BrIM : Bridge Information Model (Digital Twin)
GAD : General Arrangement Drawing
GCP : Ground Control Points
DGPS : Deferential Global Positioning System
DGCA : Directorate General of Civil Aviation
NPNT : No Permission No Takeoff
CAPI : Critical Areas of Particular Interest
BMS : Bridge Management System
2.0 Introduction
2.1 There are more than 1,50,000 bridges in Indian Railways including about 700
Important & 12000 Major bridges. All these bridges need regular monitoring, periodic
inspection and maintenance to make railway operation fail safe. Monitoring strategies play a
major role in achieving the target of service life of bridges. Currently, the inspections of these
bridges are carried out by mobile inspection units, ladders, rope access etc. Regardless of
the method used to carry out the inspection, the associated costs and dangers remain a
challenge. Mobile inspection units require operation closures and blockage of routes, while
inspection by ropes/ladders require a high level of training and expertise and still have issues
related with resource availability, time needed and safety of the inspection staff.
2.2 Therefore, in most cases, these inspections are technically and logistically complex.
The inspection of critical structural components and difficult spots that are hard to reach is
mostly done by specially trained staff like industrial climbers or with large under bridge units,
elevated platforms or other specialized equipment.
2.3 Remote controlled Unmanned Aerial Vehicles (UAV) equipped with high definition
photo and video cameras can simplify these difficult inspection tasks. This method provides
an important contribution to monitoring strategies in terms of quality and efficiency.
Unmanned Aerial System (UAS) commonly known as "Drone" is considered as an efficient
tool for mapping, monitoring, inspection and planning for transportation corridors and
projects. This latest technology needs to be leveraged for better monitoring and management
in Indian Railways. The geographical intelligence captured by drone technology can help in
efficient mapping and faster decision making.
1
32
588113/2021/O/o ED/BnS/RDSO
2.4 Unmanned Aerial System (UAS) is truly a disruptive & emerging technology with
potential applications in bridge inspection & monitoring which is capable of giving access to
engineer's eyes in the hardest to reach places of a bridge, without the need of blockage of
routes and expensive access vehicles or potentially dangerous rigging (or even ladders).
UAS is an efficient way of capturing the photographs or Video of the various structures of
bridges in challenging locations which helps in efficient bridge structure inspection and
maintenance.
3.0 Digital Twin - 4D BrIM, Bridge Information Model Integrated Drone Inspection
3.1 Bridges are constructed based on the GAD (General arrangement Drawing) &
Detailed designs. These GADs are available in the form of 2D drawings printed on paper or
scanned Pdf files, with railways for most of the bridges except the bridges those are very old.
It is difficult to refer these traditional 2D paper or CAD drawing for the inspection &
maintenance purpose. Moreover, the inspections records are not being linked with the
designed elements of the Bridges and thus are hard to visualize, compare and comprehend.
Regular Monitoring, Inspection & Maintenance management is a difficult and complicated
task. The periodic inspection of the same Bridge and comparison of same is essential for
holistic bridge maintenance.
3.2 In the 4D Bridge information modelling (BrIM) based approach the 3D Model of the
Bridge is developed for managing and maintaining the inspection records. The integration of
BrIM model along with related information of bridge inspection (Data captured using Drone
etc.) shall improve the efficiency of maintenance and management work of bridge. This has
also to be integrated with existing Bridge Management System (BMS).
2
33
588113/2021/O/o ED/BnS/RDSO
6.0 Limitations
Drone survey can be used as guidance for conducting manual survey or general
survey of bridges but cannot be used in totality for complete/overall safety inspection of
bridges. It can be utilized as technological up gradation for aiding the effective inspection
of non-approachable /inaccessible locations of bridge component for future study and
analysis etc.
7.0 Objective
a) To Develop 3D model (Digital Twin / BrIM) of the Bridge using the GAD. The BrIM
shall retain Bridge information in a digital format, and facilitates easy updating and
transfer of these information in the 3D CAD environment. Drone Inspection data
shall be linked with the Bridge 3D model.
b) Visual Inspection of the bridge by recording systematically and periodically the state
of the structure by high resolution camera mounted Drones. This enables one to
know the conditions of Bridge and identify actual and potential sources of trouble at
the earliest.
c) To provide feed-back of information to custodians of the bridges on those features
which are likely to give maintenance problems and necessary attention is to be
taken.
d) To provide necessary information to aid in decision making for carrying out
maintenance repairs, strengthening or replacement of the structure.
e) Web based BMS linked BrIM environment enable railway official to obtain an
overview of the bridge geometry and drone inspection data quickly. This will allow
officials to track and access the most recent drone inspections information,
condition, and later correlate the maintenance record during the maintenance
phase.
3
34
588113/2021/O/o ED/BnS/RDSO
in different conditions and with different types of bridge. Surface damages like cracks and
spalling can only be detected from close distances. Inspectors need to work at the same
close distance right at the bridge, which is expensive and frequently risky. Often inspectors
need support of industrial climbers, scaffoldings, cranes or boats, to access remote and
critical spots. Every structural analysis is thus very time-consuming, and generates
significant financial and human costs. A solution for accurate monitoring is possible without
high financial resources or human cost. UAV can be flown over/under/side of the Bridges,
the waypoint automation flights are exact and reproducible. With an established stable and
reproducible pathway, the slightest alterations to a structural integrity can be detected with
the UAV.
8.2 High quality inspection data are essential for a reliable state estimation of
structures. Due to the high wind stability of the flight system and the fully stabilized
(horizontal and vertical compensation) camera, the high resolution photos and videos allow
detailed inspection of inaccessible areas. Furthermore, global positioning and inertial
measurement units, which are built into the flight systems, allow an advanced navigation
and semi-autonomous inspection flight. The gathered data can be geo- referenced for later
storage in dedicated databases, so that inspection results can be related to locations on
the structure. This offers the possibility of 3D-modelling of structures in relation to a direct
referenced visualization of inspection of observations.
8.3 Areas of Interest in Steel Girder Bridges (Plate Girder and Open Web Girder)
a) Abutments
b) Piers
c) Bed Blocks
d) Bearings & vicinity
e) Lateral Bracing
f) Sleeper Seats
g) Flooring arrangement and connections with bottom chords, cross griders
h) Gusset connection of top lateral bracing to top boom
i) Bridge Deck
j) Protection Works, etc.
4
35
588113/2021/O/o ED/BnS/RDSO
8.5 Critical Areas of Particular Interest (CAPI) are the specific areas based on the
historical inspection records, failure reports, repair and rehabilitation records and need
special attention while inspection.
9.2 Drones, camera and data processing technologies are evolving at rapid pace hence it
becomes further more important to have uniformity.
5
36
588113/2021/O/o ED/BnS/RDSO
18 Image Resolution 20 MP
19 Video Resolution 4K
6
37
588113/2021/O/o ED/BnS/RDSO
10.1.3 Stage 2: 3D Bridge Model Development (Only one Time for a bridge)
10.1.3.1 At this Stage the approved GAD (General arrangement drawings) available with
the railway shall be collected in the form of PDF or AutoCAD drawings. In case CAD files are
not available with railway then the scaled CAD file shall be developed using available PDF.
The As-Built Scaled 3D model shall be developed by referring the scaled CAD files. These
3D Model shall be developed in advance 3D BrIM modelling software. The Models shall be
developed so that each element which is required for the inspection can be individually
selected, rendered and can be connected with the drone inspection data. The Levels of
Detail (LOD) 200/300 shall be used including defining a general model with approximate
values for each element.
Following Part of the Bridge should be modelled:
10.1.3.2 Steel Girder Bridges (Plate Girder and Open Web Girder)
7
38
588113/2021/O/o ED/BnS/RDSO
Important Structures such as Abutments, Piers, Bed Blocks, Bearings & vicinity,
Lateral Bracing, Sleeper Seats, Flooring arrangement connections with chords, cross girders,
Gusset connection of lateral bracing to top boom, Bridge Deck, Protection Works attached to
bridge structure shall be modeled
10.1.3.3 Concrete Girder Bridges
Important Structures such as Protection Works, Abutments, Piers, Bed Block,
Bearings & vicinity, Anchorage Zone, Deck Slab, Top and bottom flange of I-girder, Bottom
slab in box girder, Webs, Diaphragms, Junction of slab and web, Junction of precast and in
situ cast elements, Segmental Joints, Expansion Joints shall be modeled
10.1.3.4 BrIM shall be developed with the lightweight techniques so that the models can be
operated in Web based Application and could adapt to different users online. The Levels of
Detail (LOD) 200/300 shall be used including defining a general model with approximate
values for each element. Information such as size, shape, orientation and location along with
other non-geometric information is to be associated with each element of the model to the
model data. 3D Model should not involve the information related to the unnoticeable \ internal
structure details,
10.1.3.5 BrIM models shall be compatible to link with inspection data for effective reporting
of condition, maintenance needs, planned maintenance and other important data reflected in
the digital twin. BrIM Modeling Software such as Revit, Tekla, Bentley, ArchiCad or similar
shall be used and model shall be in interoperable open IFC format.
8
39
588113/2021/O/o ED/BnS/RDSO
possible accidents.
10.1.5.2 To perform the Drone Pre-flight Setup - It is recommended, to conduct a
thorough inspection of the drone prior to the first flight of the day. Inspections of all the
softwares and hardwares including, but not limited to, propellers and rotors inspection, full
charging of all instruments (e.g., a remote controller, storage batteries, and a monitor),
remote controller adjustments, gimbal inspection, and firmware updates should be
conducted. A compass calibration must be performed prior to flying at a new location to
prevent GPS signal loss during a flight.
10.1.5.3 Ground Control Points (GCP): GCP’s are used to enhance the positional
accuracy of the data developed from drone images. At least 4 GCP’s shall be established
using DGPS (Differential Global Positioning system), GCP’s shall be marked on permanent
structures (Bridge Abutments or retaining walls preferably) by paint marking and nail so that it
can be referred during the data collection for each repeated bridge inspections in future
10.1.5.4 Data Acquisition: The whole length of the Bridge is to be inspected covering the
Bridge structures as mentioned in the scope of Bridge Aerial Survey work under Areas of
Interest Critical Areas of Particular Interest (CAPI) such as Foundation, Abutments, piers,
girders, chords, bearings, bottom trough, joints, rail etc. Substructure and surroundings
including buffer of 100m toward Increasing & decreasing chainage and 100m in upstream &
downstream of the river/nalas/stream/road/canal etc. crossing the bridge.
10.1.5.5 Survey grade UAS (Drone) with High resolution digital camera capable of collecting
geo-tagged video (at least 4K resolutions) & high resolution images (at least 20MP resolution)
fitted on 3-axis gimbal (Pitch, roll, yaw) to be used for stable and clear data acquisition quality.
The UAS (Drone) should be able to capture the video & imagery of the bottom of bridge. Data
acquisition shall be done in good Photographic Conditions and Ground must be free of fog,
haze, dust, "and smoke. Also Data to be collected in good light conditions to ensure the
Image & Video are Clear and sharp in detail. Drone will be flown as per the flight plan and
images acquired for the complete bridge for 3D photogrammetric model. This may require
multiple passes and may be on automatic flight mode, unless there are infringements. Pilot
shall collect the data with in possible line of sight of the drone without colliding with the bridge
structure.
10.1.5.6 High Resolution Video Data with GPS – 4K Video shall be captured along with
the GPS information for the bridge covering Top, Bottom, Left, Right side within the 5m from
the bridge structure to achieve the high level of clarity and detailing.
10.1.5.7 High Resolution Geotagged Imagery for Orthophoto- Survey grade UAS
(Drone) to be utilized to capture precisely geotagged low altitude Nadir aerial images. These
images shall be captured from flight height of about 20-60m, as per requirement.
10.1.5.8 High Resolution Nadir & Oblique Geotagged Imagery for 3D reality Model-
Oblique & Nadir photography to be done as per best practices (for best result) to meet the
objective. Very low altitude flight height of about 20-60 M, as per requirement should be used
for clear details captue.
10.1.5.9 High Resolution Geotagged Imagery for Inspection – Close up/zoomed
stable images shall be taken for each part of bridge to gather detailed information of
structural and non-structural components. Depending on clearances this is more likely to
be manual flight, but efforts should be made to standardize the flight plans for future
inspections. Some CAPIs may need flight paths that require traffic or power regulations
9
40
588113/2021/O/o ED/BnS/RDSO
10
41
588113/2021/O/o ED/BnS/RDSO
seamless video output and to make the output more informative, important annotations
should be super imposed on the output. Proper recording of actual state of affairs shall
be done where ever possible to find defects that may exist, but also should help in
anticipating problems and recognizing these areas. All the videos shall have the
Geotagging information along.
10.1.6.2 Imagery Data Photogrammetry Processing: Down looking and Oblique
looking imagery captured from UAS (drone) to be processed using stereo
photogrammetric software by the process of Aero- triangulation, developing dense point
cloud of surface, developing TIN model, developing high resolution, scale corrected,
distortion free Ortho photo.
10.1.6.3 Imagery Data 3D Reality Model Processing: Down looking and Oblique
looking imagery captured from UAS (drone) to be processed using drone
photogrammetric software by the process of Aero- triangulation (align), developing dense
point cloud of surface, developing TIN model, building texture developing high resolution,
3D Model.
10.1.6.4 High Resolution Geotagged Imagery for Inspection: Images of CAPIs shall
be collected, tagged and renamed suitably. These images shall also be linked to the 3D
model to show their location in the overall bridge structure, for better appreciation. The
images can also be processed for better clarity and contrast of the feature that is required
to be analyzed.
11
42
588113/2021/O/o ED/BnS/RDSO
(iv) Unlimited role based access from anywhere over internet browser for
Monitoring Reports alerts, Administration etc. Data storage and 24x7 tier-III
hosted data centre management shall be done. Unlimited Department Access
shall be available.
(v) Application Platform Framework (APF) shall comprise of following key
modules:
a) Server & Client
b) User Management
c) Upload Module
d) Video Data Processing Module -
• Video serving using adaptive bitrate, Transcoding & Processing of video
data to create compatibility for sync functionality
e) Database
• Project, Geo-Video, BrIM Model, Geo-Images details and geo-meta data
information, User & Inspection Annotation
f) Application Server
• User Management module
• GeoVideo Management module
• Geo Images Management Module
• BrIM / MAP Module
• Sync Module
g) HTTP Server
• SSL Implementation: - Support for HTTPS
• Encryption: - Password should be stored in encrypted HASH
• Domain Mapping
h) User Interface
(vi) Features List - Features required for the Web 4D Bridge Information Modelling
application
a) BrIM Model visualization in WebGL with Pan, Zoom in, Zoom Out, Tilt Rotate,
functions
b) BrIM Model shall be available along with MAP base layer
c) Selectable Individual components of the BrIM Model
d) Video Location synchronization with the map in the bi-directional format.
• On clicks at timeline of video / Images, Sync with relative position on the 3D
BrIM
12
43
588113/2021/O/o ED/BnS/RDSO
13
44
588113/2021/O/o ED/BnS/RDSO
and oblique looking mode at low altitude and near to the structure so as to access
defect/dislocation in critical members of bridges. Output of this recording is a Geotagged
video file which can be viewed on video analyzer. Subsequently annotation can be put on
the video in post processing. The zoom lens provides quality detail without having to
position the UAV too close to the bridge.
10.2.3 Aerial photography is used for taking high resolution still pictures of the important
parts of the bridge. These photos/videos can be zoomed for getting the closer view of the
visual inspection.
10.2.4 The UAV system should have live video/picture available at control station (FPV-
First Person Video) to capture the relevant details precisely with right context. Data
acquisition shall be done in good Photographic Conditions and location must be free of fog,
haze, dust, and smoke. Data to be collected in good light conditions to ensure that images
and videos are clear and sharp.
14
45
588113/2021/O/o ED/BnS/RDSO
10.4.3 Additionally, there are a lot of factors such the terrain profile, drone hardware
choice, image overlap, weather conditions, stability and the speed of the flight, and GPS
conditions etc. that will influence the overall quality and accuracy of your survey.
11.0 Deliverables
11.1 2D CAD Drawing of the GAD in Autocad DWG Format (if not available).
11.2 Bridge Information Model in RVT / OBJ / Open IFC format in the classes defined.
11.3 4K quality Videos with Geotagged files & Photographs.
11.3.1 Geotagging is the process of adding geographical identification metadata to
various media such as a geotagged photograph or video, websites, SMS messages, QR
Code or RSS feeds and is a form of Geospatial meta data. This data usually consists of
latitude and longitude coordinates, though they can also include altitude, bearing, distance,
accuracy data, place names, time stamp, etc.
11.3.2 Geotagging can help users find a wide variety of location-specific information from
a device. For instance, someone can find images taken near a given location by entering
latitude and longitude coordinates into a suitable image search engine. Geotagging-
enabled information services can also potentially be used to find location-based news,
websites, or other resources. Geotagging can tell users the location of the content of a
given picture or other media or the point of view, and conversely on some media platforms
show media relevant to a given location.
11.3.3 Two main options can be used to geotag photos: capturing GPS information at the
time the photo is taken or "attaching" geo coordinates to the photograph after the picture is
taken. In order to capture GPS data at the time the photograph is captured, the user must
have a camera with built in GPS or a standalone GPS along with a digital camera.
11.3.4 Forward and backward Video Capture with a perpendicular or oblique angle
suitable to capture details from below of the Bottom Boom to capture the Bottom Girders &
Cross Girders along with joints in most of the inaccessible locations in line of sight of the
drone. Videography should be focused on entire girders/bottom boom.
11.3.5 Left & Right Side Videography / Photography should be sufficiently close to
visualize any defect or crack looking approximate 90 degree to the
side face of the bridge structure including Vertical Chord, Diagonal Chord, Top Chord.
Videography/ photography should have high resolution zooming provision at intermittent
suspicious portion of the member to clearly observe the cracks and dislocation.
11.3.6 Pier Video/Stitched Photographs should be taken all around and should be
sufficiently close for inspecting the cracks. It should also have high resolution zooming
provision at intermittent suspicious portion.
11.3.7 Focus area on the Joints of the Structures for Corrosion, Loose joints, developing
cracks with high resolution zooming provision at intermittent suspicious portion.
11.3.8 The videos captured from the drone stitched together and annotation is being
done on the various structures such as pier number, bearings, bottom chord, top chord,
diagonal chord, vertical chord, joints, bottom trough, stringer, drone directions, area of
concern, etc.
15
46
588113/2021/O/o ED/BnS/RDSO
11.4 Scaled and Geo positioned Orthophoto Tiles in geotiff format of 2 cm resolution of
area 100m upstream, downstream and surrounding the bridges.
11.4.1 An orthophoto is an aerial photograph or satellite imagery geometrically
corrected (orthorectified) such that the scale is uniform: the photo or image follows a
given map projection. Unlike an uncorrected aerial photograph, an orthophoto can be used
to measure true distances, having been adjusted for topographic relief, lens distortion,
and camera tilt. Ortho photographs are commonly used in geographic information systems
(GIS) as a "map accurate" background image. A digital elevation model (DEM) is required
to create an accurate orthophoto as distortions in the image due to the varying distance
between the camera/sensor and different points on the ground need to be corrected.
11.5 Interactive 3 D model of the bridge in Obj/3mx/fbx format both in soft and hard copy
11.5.1 3D ‘reality’ models are fully interactive and allow the user to zoom, pan and fly
around the model, providing a unique perspective on the surveyed area of interest. The
models help to minimize the need for expensive site visits and reduce safety risks on site
because multiple users can view different aspects of the bridge from safe locations.
11.6 Bridge Visual Inspection Report, shall cover the physical conditions of bridge as
visually noticed in drone data from top, bottom, left and right side of bridge including
bearings, Piers, Chord, flange, Boom, rivets, Girders, abutments etc. as per nomenclature
used by Indian railways in BMS.
a) The detailed physical condition shall be element wise.
b) The report shall cover the condition of bank areas.
c) The comments shall cover the detailed physical conditions of steel/concrete
structural members, as visually noticed. The identification of members like top
boom, bottom boom, verticals, laterals and cross members to be done.
d) The reported defects shall be identifiable through indexed photographs taken from
the UAS (Drone).
e) The masonry or concrete supports from bed block downwards for piers till water
level are to be captured from all round side and reported upon. Any unusual
structural defect is to be commented.
f) The abutment protection like pitching, retaining walls are to be captured by video
and shall be commented in report.
g) The river guidance and protection works like guide bunds or spurs may be
captured at discretion of Railway.
h) The conclusions shall comment on general health of bridge and bring out important
conclusions for appreciation of senior authorities.
11.7 3D Model, drone data & linked drone inspection reports should be hosted on
working agency’s Web 4D-Bridge Information Modelling System. Secured Login Access of
the application to the railway. This should also be integrated with IR’s web enabled IT
Application- Bridge Management System (BMS).
16
47
588113/2021/O/o ED/BnS/RDSO
Annexure-I
Typical Compliance Checklist
Compliance: Apart from being in accordance with above guidelines, compliance must be
confirmed in regard to following.
COMPLIANCE CHECKLIST
Provide details
and write up on
methodology of
Comp each proposed
Reference liance item with makes /
SN Item Para of this model number Remarks
Guideline (Yes / etc. Add
No) Annexures /
brochures for
details and
proposed items
Certificate Issued
2. DGCA Issued UAN No 10.1.5.12(C) from DGCA Shall
be Submitted
Security clearance:
Organization or
individual must have the Document shall be
3. 10.1.5.12(a)
security clearance for submit
drone operations from
DGCA
9.2, Ownership
Certificate with
5. Drone LiDAR Sensor S.No. 24(e) Calibration
in table Certificate
17
48
588113/2021/O/o ED/BnS/RDSO
COMPLIANCE CHECKLIST
Provide details
and write up on
methodology of
Comp each proposed
Reference liance item with makes /
SN Item Para of this model number Remarks
Guideline (Yes / etc. Add
No) Annexures /
brochures for
details and
proposed items
Provide
Central Server
undertaking and
Integration with 10.1.6.5, detailed
9. Railways BMS in
10.1.8 methodology of
desired integration
OEMs Central
formats
Server working
18
49
588113/2021/O/o ED/BnS/RDSO
Annexure-II
Per
Bridge One
1.2 Bridge for the length beyond 100 m
Per Time
Meter
One
Bridge for the length beyond 100 m Meter
Time
19
50
588113/2021/O/o ED/BnS/RDSO
One
Bridge for the length beyond 100 m Meter
Time
20
51
588113/2021/O/o ED/BnS/RDSO
21
52
588113/2021/O/o ED/BnS/RDSO
22