Professional Documents
Culture Documents
Results in Engineering
journal homepage: www.sciencedirect.com/journal/results-in-engineering
A R T I C L E I N F O A B S T R A C T
Keywords: In recent times, requirements in urban planning and construction of buildings have dramatically increased with
Augmented reality the drastic growth of population in urban areas. Well-designed urban planning helps in the provision of excellent
Virtual reality facilities to the public. Furthermore, it transforms a city into a smart city. Urban planning simplifies the provision
Visualization
of resources, i.e. transportation, communication, water provision, garbage disposal system, etc. The existing
Building information modeling
Urban development
construction planning visualizations of 2D CAD and 3D BIM renderings work entirely in virtual digital content,
which reduces the graphical object’s real-time exposure to the construction process. This work explores some
software-driven approaches to visualize 3D layout plans for urban development using Augmented Reality (AR).
AR environment gives full-scale walkthroughs of designs to workers and designers. The article analyzes two
urban planning scenarios (a) creation of new structures, (b) recreation of existing designs. The creation of new
structures is done using Building Information Modeling (BIM) with AR to make 3D layout blueprints come alive.
Recreation of existing designs develops BIM after merging two environments together, i.e. already existing
structures and designs of new structures. Experimental results consisting of photorealistic AR digital visualiza
tions of indoor as well as outdoor scenes of 3D layouts are used to assess the validity of our approach. The article
also reports the historical growth of Augmented Reality, and explores the possible ways to architect and design
urban planning 3D layout in the AR environment. Furthermore, it discusses certain possible applications of AR in
urban planning.
1. Introduction text objects are projected on a projection surface using the projection
system. In Fig. 1, b) depicts the visualization of AR on the projection
The visualization of reality view produced by amalgamating the surface. This AR visualization is generated by merging the virtual image
virtual objects with the real scenes is an Augmented Reality (AR) tech of graphical text objects with the shadow of a human.
nology. The final AR output projects in the form of live video as digitally In Fig. 1, c), the user is typing the text by pressing the graphical
enhanced computer graphics. Virtual Reality (VR) is a computer- objects of text available on the projection surface. Fig. 1, d) depicts the
generated artificial environment that makes the users of the device drawing of virtual sketches by operating graphical objects available on
feel as if they are in a different artificial world. Reflecting Virtual Reality the projection surface.
vision and real vision on human retina gives the illusion of augmented Nowadays, AR is projected by immersing with 3D environment. This
reality. environment brings complete illusion to the user that the virtual
Prominent developments in augmented reality were done in 1974 by rendering environment is a part of its real context.
Myron Krueger. Myron Krueger invented the video place mechanism for In the olden days, people used drawings and blu eprints to design
the human-machine interface. Video place merges the virtual image building plans. Continuing this paradigm, the subsequent generation
with the shadow of a real human image. The significant steps of the implements Computer-Aided Design (CAD), which helps to visualize the
video place system’s AR visualization are shown in Fig. 1. In Fig. 1, the dimensions of design in a digital environment. Later, a 3D model design,
black color area indicates the projection surface. Fig. 1, a) depicts the Building Information Modeling (BIM) [1] was invented to get a
virtual vision of the graphical text objects on the projection surface. completely realistic environment. Using BIM with augmented reality
Users can type the text using these graphical objects. These graphical makes 3D prints and displays come alive. Using a tablet application or
* Corresponding author.
E-mail addresses: rohil@pilani.bits-pilani.ac.in (M.K. Rohil), p20190024@pilani.bits-pilani.ac.in (Y. Ashok).
https://doi.org/10.1016/j.rineng.2022.100447
Received 26 January 2022; Received in revised form 28 April 2022; Accepted 12 May 2022
Available online 18 May 2022
2590-1230/© 2022 The Author(s). Published by Elsevier B.V. This is an open access article under the CC BY-NC-ND license (http://creativecommons.org/licenses/by-
nc-nd/4.0/).
M.K. Rohil and Y. Ashok Results in Engineering 14 (2022) 100447
Table 1
Overview of related studies.
Specification Article Overview
2
M.K. Rohil and Y. Ashok Results in Engineering 14 (2022) 100447
Li≜CnjT Ct Bj (2)
3
M.K. Rohil and Y. Ashok Results in Engineering 14 (2022) 100447
transposition, that follows. Aided Design (CAD) models that help visualize the dimensions of
⎡ ⎤ design in a digital environment. Later, a 3D model design, Building In
C T C Ri
(βi11 + βoi ) nT1 C Ri C ni11 ⎡ ⎤ formation Modeling (BIM) [1], was invented to get a completely realistic
⎢ n1 ⎥
⎢
⎢C T C TC Ri
⎥
⎥[
d1 environment. In this work, we render BIM’s 3D visual designs with
⎢ n2 (βi12 + βoi ) n2 Ri C ni12 ⎥ C ] ⎢ ⎥
⎢ d2 ⎥ Augmented Reality that makes 3D prints and displays come alive. Using
⎢ ⎥ tRi
=⎢ . ⎥ (3)
⎢.
⎢ . ⎥
⎥ αi ⎢
⎣. ⎦
⎥ a tablet AR application or pair of AR glasses (HoloLens) will give
⎢ ⎥
⎢. . ⎥ full-scale walkthroughs of the design. Fig. 5 illustrates different visual
⎣C T ( )C ⎦ dM
experiences of 2D CAD, 3D BIM, and proposed 3D AR visualizations of
Ri
nM βiMNiM + βoi nTM C Ri C niMNiM
BIM for the construction environments’ analysis. Further, these steps are
From the above computations, in the presence of no error, object explained below.
distance calculation produces zero error by subtracting laser beam dis
tance to object from LIDAR produced by laser beam method and camera a. Virtual 3D BIM Model Creation
image distance to the object from LIDAR produced by camera image
method. The virtual three-dimensional BIM model is created based on a dig
Similarly, for digital maps, GPS outputs are found with architecture ital 2D layout design, or adjusted if the 3D model is needed in BIM
position longitude, latitude, and altitude then obtain the position error design software. We have mentioned information related to some of the
statistics such as standard deviation for longitude, latitude, and altitude virtual 3D model designing IDEs in Fig. 6. It explains the pipeline flow
from the covariance of GPS measurements and the values of final dis through to the BIM 3D model generation. We have created 3D virtual
tance from LIDAR to object obtained from Eq. (3). The procedure is models using Revit, which has a rich library of all Architecture, Con
recursively applied to minimize position error statistics. design. struction, and Engineering (ACE) related three-dimensional graphical
We can design the extended architecture with computer-aided soft objects such as doors, windows, walls, roofs, stairs, floors, ramps, etc.
ware according to coordinates and measurements obtained from Eq. (3) and produces an FBX file to export into Unity (AR engine). Fig. 7 depicts
with the artificial 3D environment. The virtual computer-aided archi the Revit software design environment. The toolbar menu on top of
tecture design environment coordinates are imposed with real-time Revit has buttons with all 3D graphical objects to incorporate into the 3D
coordinates. Rendering 3D environment yields the final amalgamated architecture models. The designer can use available 3D graphical objects
design of virtual computer-aided design and real existing design — on the toolbar menu, or can build from scratch using parametric
recursive application of algorithm results in producing the computer- modeling. The design imports 2D drafting, and puts the graphical ob
generated 3D augmented visualization with accurate computations. jects in specified places as per 2D digital drawing. Revit can import 2D
In the olden days, for planning, experts used drawings and blueprints digital drawings of dwg, pdf, gbXML and image file formats.
to design building plans in construction planning practice. Continuing
this paradigm, the subsequent generations implemented 2D Computer- b. Virtual 2D Drafting
4
M.K. Rohil and Y. Ashok Results in Engineering 14 (2022) 100447
c. Contextual Analysis
5
M.K. Rohil and Y. Ashok Results in Engineering 14 (2022) 100447
water, gas, power, etc. The construction site analysis helps in con ⎧[ ( )]2 H*W
struction and architecture design. The designer can put his idea of a
j
⎪ −
⎨ ω 1− e λ
⎪ j≤
design on a hand-made drawing sheet, or can start designing in digital k2
T(d, j) = [ ( )]2 (10)
⎪
2D drafting. This paradigm is continuous, like contextual analysis, vir ⎪
⎩ αd2 * ω 1 − e− λj j> 2
H*W
tual 2D drafting, virtual 3D BIM model design (for example, Fig. 8 il k
lustrates the top view of a room design of 3D BIM in Revit app, and Fig. 9 Here, the upper limit of roughness of a given plane is denoted by ω.
illustrates a 3D external view of the BIM in Revit app), and generation of As threshold dynamically varies, λ is used to determine the change in the
AR visualizations. speed of threshold and H*W indicates depth map size. Here, α and k are
The details pertaining to two important aspects are provided below. two constants.
i. Location of Interest estimation from real-time depth map ii. Conversion of LOI coordinates to BIM 3D visual coordinates
The digital graphical objects (3D layouts) are projected on different While positioning the BIM 3D graphical objects uses plane co-
structures, generally dominated by plane surfaces. To estimate the ordinates [13,21], a BIM 3D visual is generally created with a local
location of interest, we employ depth-driven plane detection [20]. The system/object coordinate system by defining a reference point that can
patch with the highest planarity is used as seed to initialize this method, be a project survey point. The real time environment defines the world
and grows the plane detection to its maximum extent until the dynamic coordinate system, i.e. LIDAR coordinate system. Hence, the next step is
threshold steers the process. In the depth map, a patch with free zero to transform (i.e. convert) the LOI coordinate system into local coordi
depth value points is considered as one initial seed patch. nate system. The geometric model for this type of transformation is
In 3D space, for a plane given in Eq. (4), where a, b, c and d are four depicted in Fig. 10, and it is calculated using Eq. (11) and Eq. (12).
numeric constants, and for any arbitrary point p given by Eq. (5) pre
MLOI,BIM = R(θ).T(Δx Δy Δz) (11)
sented on the plane, the normal of the plane ̂ n could be estimated by Eq.
(6). ⎡ ⎤
cos θ − sin θ 0
ax + by + cz + d = 0 (4) (Xbim Ybim Zbim )T = ⎣ sin θ cos θ 0 ⎦ ⋅ (x y z)T + (Δx Δy Δz)T (12)
0 0 1
p = (x, y, z) (5)
Based on the above discussion, Fig. 11 depicts the building mecha
nism for new structures.
n =̂
(a, b, c) (6)
The fitting error, error(p), between i, the fitting plane (that may be 4. Experimental results
optimal), and a point p close to or on the plane can be estimated as
follows. As mentioned in Section 3, the implementation procedure starts with
the development of Building Information Modeling. Fig. 12 depicts the
error(p) = | n̂i ⋅ p + di | (8)
3D view of a proposed building. It is an entirely virtual reality image
The given plane region could be grown by iteratively adding points without augmentation of reality.
to initial seed patches. In jth iteration, the point incorporated into the Fig. 13 depicts the augmented reality visualization of BIM. In this
plane is given by the following Eq. (9). image, the generated Augmented Reality vision from Fig. 12 was pro
/ j { } jected on the grass floor. We can also visualize this AR vision by pro
sj+1
i si = ∀p ∈ NiJ : error(p) ≤ T(d, j) (9) jecting through AR glasses available in the market. This AR vision will
Here, the threshold, T(d,j), can be dynamically changed as follows. give the same impression as in Fig. 13. For more advanced applications,
users can feel the floor-by-floor and corner-by-corner walkthroughs of
Fig. 8. Top view of internal room design of 3D BIM model drawing in Revit.
6
M.K. Rohil and Y. Ashok Results in Engineering 14 (2022) 100447
the design.
Fig. 14 is the view of the real construction environment. The building
designed (in Fig. 12) by architects, can be constructed besides the real
Fig. 12. Building information modeling of a proposed building.
building shown in Fig. 14. In the image, the construction environment is
7
M.K. Rohil and Y. Ashok Results in Engineering 14 (2022) 100447
Fig. 14. Real-time building without adding virtual images. become interactive with an increased level of the digital spatial design
environment. AR can potentially decrease the direct involvement of
designers and contractors with the working environment. AR simplifies
the process of monitoring for the contractor by doing error pruning from
the room environment before the actual building work officially starts. It
helps in improving workplace safety and removing the unpredictable
danger hazards without direct human interaction. AR helps to train new
employees without directly exposing to potentially dangerous equip
ment. AR also enables the stakeholders to customize the room and house
environment before purchase.
Augmented Reality gives new ways to visualize information and
interacting with the real world. Mapping and analysis of terrains need a
direct exposure to a potentially dangerous environment. However, using
augmented reality reduces human interaction in terrain mapping and
gives spatial realistic holographic environment. Nowadays, people are
using perspective views for terrain mapping. However, while using the
Fig. 15. Adjusting the AR vision with a real-time environment.
perspective view method, the computations of dimensions are affected
by different factors: 1) viewing azimuth, 2) viewing angle, 3) viewing
distance and 4) Z-Scale.
final Augmented Reality vision by amalgamating the coordinates of both
Generate Building Information Modeling (BIM) model using 3D
visions. The final visualization of the design is depicted in Fig. 16. We
views of the terrain accumulated from the perceptive view. As shown in
can modify, or even reinitiate the complete design layout by simply
Fig. 3, deploying these BIMs into AR glass will give an augmented reality
undergoing mandatory changes to BIM. BIM can be redesigned accord
view of terrain mapping. Contour lines, contour interval, vertical
ing to the requirements of users. After making the required modifica
profiling and Hill shading are the different methods for computing the
tions to BIM, visualize the BIM in AR by projecting through AR glasses,
terrain mapping. Contour lines, contour interval, and vertical profiling
as explained in Section 3.
calculate the elevation manually. Hill Shading is a software-driven
computer-aided 2D approach for terrain mapping and attempts to
5. Augmented reality applications to urban planning simulate the view of terrain along with the interaction between surface
and sunlight. All these methods require a lot of human resources and
Many experiments have been carried out to survey the uses and consume much time. These methods may generate enormous compu
benefits of Augmented Reality in urban development. Fig. 17 depicts a tational complexity with inaccurate results. Using AR can reduce some
HoloLens [4] urban plan image, a full-scale walkthrough of the design of these manual efforts.
projected using HoloLens. The tags labelled 1 and 2 on Fig. 17 represent Water Shed analysis [22] is another area where AR can be applied. It
the two cities whose 3D layout plans are to be augmented. statistics. includes analysis of home water tank, city centralized water tank, water
The advantages of Augmented Reality in urban planning involve levels in reservoir, wastewater drainage system, and flood management.
better attention to eye-catching presentations. Planning and designing
8
M.K. Rohil and Y. Ashok Results in Engineering 14 (2022) 100447
9
M.K. Rohil and Y. Ashok Results in Engineering 14 (2022) 100447
SLAM [25] may give the continuous detection of the location of interest, [5] T. Kösa, F. Karakuş, The effects of computer-aided design software on engineering
students’ spatial visualisation skills, Eur. J. Eng. Educ. 43 (2) (2018) 296–308.
whenever there is a sensor failure or when GPS failures occur due to
[6] X. Qiao, P. Ren, S. Dustdar, L. Liu, H. Ma, J. Chen, Web AR: a promising future for
inconsistent internet facility at the construction site. Incorporating the mobile augmented reality-state of the art, challenges, and insights, Proc. IEEE 107
LIDAR and sensor information fusion for the proposed AR visualization (4) (2019) 651–666.
of construction sites and architectures is yet to be explored. [7] L.B. Rosenberg, Virtual fixtures: perceptual tools for telerobotic manipulation, in:
1993 IEEE Annu. Virtual Real. Int. Symp, 1993, pp. 76–82.
The application of onsite visualization capabilities of Augmented [8] A.M. Clark, M.T.G. Clark, Pokémon go and research: qualitative, mixed methods
Reality could be interestingly taken to urban or city planning. However, research, and the supercomplexity of interventions, Int. J. Qual. Methods 15 (1)
the theme of integrating and exploiting the visualization of urban (2016) 1–3.
[9] S.J. Fenves, Computer-aided design in civil engineering, Proc. IEEE 69 (10) (1981)
development using AR for smart and sustainable city development needs 1240–1248.
to be further researched. [10] C.M. Eckert, P.J. Clarkson, Planning development processes for complex products,
The proposed method can further enhance the level of understanding Res. Eng. Des. 21 (3) (2010) 153–171.
[11] R. Jiang, S. Yang, S.S. Ge, X. Liu, H. Wang, T.H. Lee, GPS/odometry/map fusion for
of onsite by incorporating cloud computing services. We could reaize vehicle positioning using potential function, Aut. Robots 42 (1) (2018) 99–110.
uploading as well as synchronization of information contained in AR [12] N. Gupta, M.K. Rohil, Exploring possible applications of augmented reality in
devices sitting at the onsite locations using cloud services. Thus, the education, in: 2017 4th Int. Conf. Signal Process. Integr. Networks, SPIN 2017,
2017, pp. 437–441.
Architecture, Engineering, Construction, and Facility Management [13] F.M. Mirzaei, D.G. Kottas, S.I. Roumeliotis, Analytical Least-Squares Solution for
(AEC/FM) designs and construction site 3D visuals can be accessible, 3D Lidar-Camera Calibration, vol. 100, Springer Tracts Adv. Robot., 2017,
examinable and modifiable from any location, irrespective of the loca pp. 183–200.
[14] H. Kato, M. Billinghurst, Marker tracking and HMD calibration for a video-based
tion. Users from different locations can collaborate with each other by
augmented reality conferencing system, in: Proc. - 2nd IEEE ACM Int. Work.
accessing these cloud AR services. The incorporation of cloud AR for Augment. Reality, IWAR 1999, 1999, pp. 85–94.
BIM’s 3D visualization of construction layouts does elicit further [15] http://www.onginnovations.com/urban-planning, “Urban Planning” ([Online].
investigation. Available: http://www.onginnovations.com/urban-planning).
[16] J. Sanchez, Mathematical examination of force reconstruction and the
deconvolution problem, Results Eng 14 (100391) (2022).
Credit author statement [17] J.A. Jeličić, M. Rapaić, M. Kapetina, S. Medić, D. Ecet, Urban planning method for
fostering social sustainability: can bottom-up and top-down meet? Results Eng 12
(100284) (2021).
Mukesh Kumar Rohil: Conceptualization, Methodology, Investiga [18] K. Nakao, S. Inazumi, T. Takaue, S. Tanaka, T. Shinoi, Visual evaluation of relative
tion, Supervision, Validation, Writing – original draft, Writing- deep mixing method type of ground-improvement method, Results Eng 10
Reviewing and Editing. Yemineni Ashok: Data curation, Investigation, (100233) (2021).
[19] M.H. Mohammed, H.M. Zwain, W.H. Hassan, Modeling the impacts of climate
Visualization, Writing – original draft. change and flooding on sanitary sewage system using SWMM simulation: a case
study, Results Eng 12 (100307) (2021).
Declaration of competing interest [20] Z. Jin, T. Tillo, W. Zou, Y. Zhao, X. Li, Robust Plane Detection Using Depth
Information from a Consumer Depth Camera, IEEE Transactions on Circuits and
Systems for Video Technology, 2019.
The authors declare that they have no known competing financial [21] D. Liu, J. Chen, D. Hu, Z. Zhang, Dynamic BIM-augmented UAV safety inspection
interests or personal relationships that could have appeared to influence for water diversion project, Comput. Ind. 108 (C) (2019) 163–177.
[22] A. Tomkins, E. Lange, Interactive landscape design and flood visualisation in
the work reported in this paper.
augmented reality, Multimodal Technol. Interact. 3 (2) (2019) 43.
[23] http://www.google.com/maps/, “Google Maps” [Online]. Available: http://
References support.google.com/maps.
[24] M. Akula, S. Dong, V.R. Kamat, L. Ojeda, A. Borrell, J. Borenstein, Integration of
[1] S. Azhar, Building information modeling (BIM): trends, benefits, risks, and infrastructure based positioning systems and inertial navigation for ubiquitous
challenges for the AEC industry, Leader. Manag. Eng. 11 (3) (2011) 241–252. context-aware engineering applications, Adv. Eng. Inf. 25 (4) (2011) 640–655,
[2] W. Piekarski, B. Thomas, ARQuake: the outdoor augmented reality gaming system, https://doi.org/10.1016/j.aei.2011.07.006.
Commun. ACM 45 (1) (2002) 36–38. [25] T. Bailey, H. Durrant-Whyte, Simultaneous localization and mapping (SLAM): Part
[3] N.S. Pathkar, N.S. Joshi, Google glass : project glass, Int. J. Appl. or Innov. Eng. II, IEEE Robot. Autom. Mag. 13 (3) (2006) 108–117, https://doi.org/10.1109/
Manag. 3 (10) (2014) 31–35. MRA.2006.1678144.
[4] S.N. Leonard, R.N. Fitzgerald, Holographic learning: a mixed reality trial of
Microsoft Hololens in an Australian secondary school, Res. Learn. Technol. 26
(1063519) (2018) 1–12.
10