Automation in Construction 140 (2022) 104320

Contents lists available at ScienceDirect

Automation in Construction
journal homepage: www.elsevier.com/locate/autcon

Artificial intelligence-based voice assistant for BIM data management

Faris Elghaish a, Jatin Kumar Chauhan a, Sandra Matarneh b, Farzad Pour Rahimian c, *,
M. Reza Hosseini d
a
School of Natural and Built Environment, Queen’s University Belfast, Belfast, UK
b
Faculty of Engineering, Al Ahliyya Amman University, Jordan
c
School of Computing, Engineering & Digital Technologies, Teesside University, Middlesbrough, UK
d
School of Architecture and Building, Deakin University, Geelong, Victoria, Australia

A R T I C L E I N F O A B S T R A C T

Keywords: Existing systems that employ Automatic Speech Recognition (ASR) technology to retrieve information from the
Artificial intelligence BIM model fail to provide remote interaction, retrieve a wide range of data, and automate the entire process. This
Voice assistant for BIM is particularly a problem for users with disabilities. The paper offers a two-way, automated, and agnostic solution
Remotely data retrieval
to this theoretical and methodological gap. A ‘Proof of Concept’ prototype was developed using Amazon Alexa –
Amazon Alexa for BIM
Generative design-based AI voice assistant
as the AI voice assistant platform – to test the applicability. The outcome shows that the created and the retrieved
information is valid. Furthermore, there is a high level of interoperability among the components of the proposed
solution, including the AI voice assistant interface and mediation environment to convert verbal requests and
retrieve information to CSV files. Future research will extend the created solution to retrieve and access infor­
mation from a BIM cloud model.

1. Introduction
Building Information Modelling (BIM) provides geometric and se­
mantic data representations for building components as a single point of
truth for all system users [1,2]. The BIM’s unique selling point is pre­
mised upon its inherent capability to create new collaborative work
practices [3]. In BIM-enabled projects, stakeholders (designers, con­
tractors, clients and end-users) gain access to up-to-date digital building
data via a common data environment (CDE) [4]. This collaborative
platform is supposed to streamline data flow throughout the life cycle of
projects in the Architecture, Engineering, Construction and Operation
(AECO) industry [5]. It stands to reason that data exchange, information
retrieval (IR) and the capability of retrieving precise data are widely
deemed essential elements of BIM platforms [6,7].
BIM models are highly structured instances of a well-defined data
schema. Therefore, retrieving information from BIM models requires
using query languages to process structured data using non-proprietary
schema like the Industry Foundation Classes (IFC) [1]. However,
searching on BIM platforms based on the IFC schema faces many limi­
tations, where IFC-based data do not include all the data available in
building information models [8]. In addition, this type of search requires
experts to deal with IFC-based data and manipulate and process BIM
data [9]. Therefore, there is a need for more resilient solutions to lay the
foundation for changing the BIM environment from an expert-to-
customer-oriented approach by facilitating usability and accessibility
in the AECO industry. Furthermore, BIM is considered the digital in­
formation source for all construction phases and processes [10,11].
Therefore, managing data interactions in BIM platforms and efficient
data exchange beyond BIM platforms are essential for successfully
delivering BIM-enabled projects [12,13].
Many researchers have attempted to integrate data from emerging
digital technologies into BIM with the above in mind. These include:
coupling BIM and the Internet of Things (IoT) to enhance health and
safety in projects [14,15]; integrating blockchain into BIM to automate
sharing risk/reward for Integrated Project Delivery (IPD) projects [16];
and using immersive technologies with BIM to efficiently involve end-
users in design and development stages [17–19].
Similarly, Artificial Intelligence (AI) has been integrated into BIM for
several reasons: automated decision making [20,21]; design optimisa­
tion [22–25]; and detection of defects in infrastructure systems [26].
There is a significant level of attention to employing emerging tech­
nologies to leverage BIM processes. Despite the growing interest in

* Corresponding author.
E-mail addresses: F.elghaish@qub.ac.uk (F. Elghaish), jchauhan01@qub.ac.uk (J.K. Chauhan), s.matarneh@ammanu.edu.jo (S. Matarneh), f.rahimian@tees.ac.uk
(F. Pour Rahimian), reza.hosseini@deakin.edu.au (M.R. Hosseini).

https://doi.org/10.1016/j.autcon.2022.104320
Received 14 January 2022; Received in revised form 27 April 2022; Accepted 30 April 2022
Available online 13 May 2022
0926-5805/© 2022 The Authors. Published by Elsevier B.V. This is an open access article under the CC BY license (http://creativecommons.org/licenses/by/4.0/).
F. Elghaish et al.
integrating various technological innovations with BIM, as the way
forward, the human side of interaction – of users – with BIM platforms
has received scant attention [5].
Alotto et al. [27] asserted that the future of digital construction ne­
cessitates collaboration between human intelligence and Artificial In­
telligence. This is recommended to enable interoperability among
different devices, such as using mobile to interact with BIM models in a
server through designated rooms for interaction. This will allow users to
manage information automatically and remotely [28]. The growth of
Automatic Speech Recognition (ASR) technology for virtual assistants
provided a wide range of solutions to retrieve information using users’
voices [29,30]. Search engines have recently been developed to detect
and understand natural human language in addition to accepting
keyword-based requests from the human voice [31]. ASR technology
started to improve job efficiencies in retrieving data [32].
Regarding developing an automated data retrieving approach for
BIM, Motawa [9] proposed a spoken dialogue BIM system approach to
capture building operation information like maintenance data. Howev­
er, this approach relies on extracting information from the IFC protocol
and storing it in the knowledge base to be provided upon the verbal
request, limiting the capabilities of using this system for different types
of information. Alotto et al. [27] integrated AI voice assistants into BIM
for training purposes to enable BIM novice users to develop parametric
models. However, the proposed solution falls short of providing a voice
interaction solution in both directions; Shin et al. [31] developed an AI
voice assistant application to retrieve information from BIM-based SQL
queries. This was limited too in enabling interactions remotely, given it
is a server-based solution.
Though voice can be the most convenient way of interacting with
BIM platforms [33], a lack of a workable system that makes possible the
interaction between users and BIM platform through voice represent a
gap in the body of knowledge. Accordingly, a research question is
formulated as ‘what would be the details of a workable AI voice assistant
platform to enable communications between users and BIM platforms?’
This research question provides a background for addressing a gap
identified in BIM-related studies. The human side of interactions be­
tween users and BIM technology is largely overlooked [5], and now the
available system suffers from various deficiencies. In scientific terms, an
improvement is needed to improve the method of interaction between
BIM platforms and users – by applying technological innovation. This is
in close alignment with design science research (DSR) activities that aim
to design and investigate the application of an artefact – as a treatment
for improving a service – in a context; design scientists suggest and
develop an artefact to interact with a problem context, to improve
something in that context [34].
According to the DSR approach, there is a need for a technological
innovation that provides a voice-enabled platform as an alternative to
the traditional methods of interactions between users and BIM models,
where geometric and semantic data are communicated. This is char­
acterised as a system for: (1) enabling remote interaction, (2) supporting
retrieving different types of BIM data, (3) allowing novice BIM users to
develop parametric designs by uttering specific keywords, (4) providing
retrieved information verbally to enable disabled users to interact with
BIM models. Apart from designing the system, the accuracy of the
retrieved data from the BIM model-based AI voice assistant is appraised.
The proposed integrated solution is tested to ensure all processes are
smoothly linked to overcoming the limitations of existing solutions.
The paper is structured as follows. Following the introductory Sec­
tion 1, Section 2 represent the conceptual background, followed by the
research methods in Section 3. Section 4 presents the solution devel­
opment, and Section 5 includes the implementation investigation of the
proposed solution. The discussion, significance and limitation are pre­
sented in Section 6. Finally, Section 7 is the research conclusion.
2
Automation in Construction 140 (2022) 104320
2. Contextual background
2.1. The necessity of interactions
The construction industry is evolving toward integrating people and
processes with information across the asset life cycle [35]. Developing
and operating assets require data and information to be accessible to key
actors, including clients/developers, architects, engineers, contractors,
suppliers and facility/asset managers [36]. Getting the right data and
information to the right actor at the right time while ensuring future
actors’ needs and processes are met is the crux of good information
management is the promise and the selling point of BIM [37–39]. The
capability of access and interaction with information and data underpins
effectiveness, utility, productivity and efficiency in BIM-enabled pro­
jects [5]. As a result, a new stream of research focused on improving user
interactions and BIM platforms has emerged, as discussed next.
2.2. Interactions beyond models
A huge amount of multiscale information is contained in a BIM
model (component-level, attribute-level, etc.), which BIM users retrieve
based on their work requirements. For example, a BIM manager re­
trieves components and attributes information about a building to verify
conformity with requirements and standards [40]. On the other hand, a
facility manager is more interested in retrieving semantic data on
various building elements [41].
Existing retrieval approaches target extracting information from
various sources other than objects embedded in a BIM model. For
example, Gao et al. [42] developed a semantic search engine based on
BIM-oriented ontology; the system focused on the contextual meaning of
terms and the local context analysis technique (LCA) for retrieving on­
line BIM documents. Liu et al. [43] presented an enhanced explicit se­
mantic analysis method for product model retrieval that enables an
automated generation of semantic information from domain-specific
knowledge repositories. And Gao et al. [44] focused on constructing a
lightweight IFC ontology for their proposed system to retrieve online
BIM product documents. Shi et al. [45] developed a file comparison tool
IFCdiff to search online BIM documents quickly and accurately. Wu et al.
[1] developed a semantic search engine for intelligent retrieval in a BIM
object database to understand real meaning from a natural query sen­
tence of users, using domain ontology and natural language processing
(NLP). To focus on the information collaboration issue of real-world
facilities and BIM models, Xie et al. [46] proposed a solution that
matches real-world facilities to BIM data using NLP. However, the
proposed system supports only simple sentences. Complex sentences
containing verbs and operators are not supported yet.
Preidel et al. [2] examined and assessed two common query lan­
guages for processing BIM model information. They concluded that
textual query languages are too complex to be employed by typical end-
users in the construction industry, such as architects and engineers. On
the other hand, existing information retrieval methods generate irrele­
vant results in many cases that require time and effort to search for
useful and professional information that meets a user’s specific needs
[1,44,46].
2.3. Interactions with models
BIM models are increasingly becoming more developed and more
complex. Therefore, architects and engineers need more interaction
with relevant information from models [33]. Retrieving information
from a BIM model has been addressed in several studies. For example,
Matarneh et al. [47] proposed a plan that extracts specific non-
geometric attributes relevant to facilities systems and equipment from
BIMs model using IFC schema to manipulate information and generate a
spreadsheet that contains all facilities management systems re­
quirements. A cloud BIM intelligent information retrieval and
F. Elghaish et al. Automation in Construction 140 (2022) 104320

representation method were proposed by Lin et al. [28] using Natural using their voice to perform searches and manipulate things directly on
Language Processing (NLP). However, the information retrieval process BIM platforms. The case studies did not target all BIM model data but
was difficult to retrieve multiscale information due to the lack of cor­ rather the walls within the architecture (see Table 1 for details about the
relation between different documents. A BIM model retrieval method focus of studies, employed methods, data input types and limitations).
using airborne LiDAR point clouds was proposed by Chen et al. [48]. Apart from the above drawback of existing methods, most of the
The capabilities offered by AI can revolutionise the way users can current research on BIM information retrieval focuses on using IFC
interact with BIM models [49], yet, little emphasis has been placed on schema for data manipulation and information retrieval from BIM
applying voice recognition, and few studies have attempted to use it in models or using keywords for searching. Both methods require experi­
BIM software [9,50]. This presents a gap in the body of knowledge, as ence in BIM commands and coding [9,44,45,47,53]. In addition, a ma­
discussed next. jority of existing studies have used the NLP based approach for
information retrieval. Dynamo is one of the most common VP tools in
the AECO industry and is associated with Autodesk Revit software [54].
2.4. Voice for interacting with models: A gap in the literature
Several researchers have adopted Dynamo as a visual programming tool
in their studies. For example, an dynamic workflow was established in
Table 1 tabulates a summary of noteworthy publications that provide
Dynamo to combine the linked sensors’ maintenance-related informa­
solutions for interacting with models through voice.
tion with a cloud-based tool to facilitate efficient communications be­
Apart from the scarcity of research in the field (see Table 1), many of
tween the facility management team and IoT companies for intelligent
these attempts face challenges in retrieving BIM data with speech
sensor management [55]. Bespoke queries have been generated using
recognition systems. One of the main pitfalls is keyword-based search
Dynamo to allow searching, isolating, and visualising the resulting ele­
engines. An example is the Voice 360 plugin provided by Autodesk to
ments¸ to present the efficient use of BIM information [56]. A sensor
execute Forge Viewer commands. Using voice recognition, the user can
integration method was developed by O’Shea and Murphy [57] using
give commands instead of inputs from the mouse and keyboard. How­
Revit and Dynamo to monitor the structural health of existing structures.
ever, the Voice 360 plugin requires using command-based keywords and
A procedural model for the road infrastructure design was presented by
is limited to a list of acceptable items [51]. The limited number of
Biancardo et al. [58] using Dynamo to adjust the values of the input
keywords is a major limitation in keyword-based search engines.
parameters. However, almost all existing attempts were not linked with
Furthermore, it is difficult to find accurate results when the precision
any AI voice assistant to read CSV files and return information as CSV
and recall values used for the search are low [52]. Words with multiple
files to enable visionary disabled BIM users to use BIM automation-based
meanings or phrases with the same purpose lead to irrelevant searching
visual programming to automate tasks.
results [52]. Another retrieval system for searching BIM data was
With the above in mind, there is a need to develop a workable in­
developed by Motawa [9], which used the IFC database and created an
formation retrieval system capable of retrieving multiscale information
NLP-based retrieval system for searching BIM data. This method is also
in BIM models by different users with different experience levels in BIM
limited since the IFC schema focuses on the relationship between ob­
application tools, reinforcing the aims and objectives of this paper.
jects. It means that all the detailed data of an element are not converted
to IFC format [8]. To overcome the limitations of these studies, Shin
3. Research methods
et al. [50] developed the BIM automatic speech recognition (BIMASR)
framework to enable users to ask questions based on natural language
3.1. Design of the artefact

Table 1
The AI voice assistant proposed in this paper can interact with BIM
Previous studies on automatic speech recognition in BIM.
models to retrieve all types of information exchanged between users and
Author Focus of Study Method Input Type Limitations BIM models in traditional interaction models. The ability of the assistant
Shin Develop a Introducing SQL Query Relies on to retrieve information for specific purposes relies on the availability of
et al. framework for BIM to RDBMS Oracle the visual programming script (i.e., Dynamo) to receive the order as CSV
[7] ASR-based module database, not
file, retrieve the information, and return the results as a CSV file. For
building Semantic- on a cloud-
information based BIM based example, a ‘Proof of Concept’ will be tested to retrieve ‘room schedule’
retrieval from database from a complex 3D BIM model in this study. Other users like quantity
BIM software surveyors will need other dynamo scripts to retrieve information based
Alotto Building Developed a Natural Focused on on their tasks and needs.
et al. modelling with prototype for Language parametric
[27] artificial automated understanding modelling
Snyder [59] stated that literature review methodology plays an
intelligence modelling in using a voice important role in developing a conceptual background, creating guide­
and BIM using a assistant lines, and evaluating existing practices. Therefore, the literature review
Speech voice assistant was employed to assess existing solutions for AI voice assistants to
recognition for
interact with BIM models and highlight deficiencies and gaps in these
learning
purposes solutions. Furthermore, a high-level architecture model should be
Motawa Develop a Integrating Natural Only IFC developed to understand the interoperability among different tools in
[9] Spoken cloud-based Language protocol- the software architecture [60,61].
Dialogue BIM spoken queries based Fig. 1 shows the processes of developing the AI-voice assistant so­
system to dialogue knowledge
capture system and information
lutions. This includes data collection tasks and solution development
building case-based retrieval from processes to enable users: (1) to retrieve information automatically and
operation reasoning BIM the BIM remotely from BIM models using any device (mobile or tab); (2) to
knowledge system. model request the BIM platform to develop information/design elements
Kim Information Using the Keyword- User requires
automatically. Amazon Alexa was selected to develop the AI-voice as­
et al. retrieval from conventional based knowledge of
[51] BIM and artificial commands customised sistant skill because it is a user-friendly platform with a high interop­
modification intelligence commands erability level with many platforms [62]. Besides, it has high accuracy
for BIM data in technology and and usability in recognising voices [63]. Dynamo was employed to
Revit the Algorithm- convert CSV files and ask 3D BIM platform to perform the verbally
based BIM
requested task [7,64].

3
F. Elghaish et al.
Fig. 1. Research methods and design
3.2. Investigate implementation: The validation
A high-level architecture of the proposed automated AI-voice assis­
tant interaction model was developed to check the implementation as­
pects of the designed solution – the AI voice assistant. A computerised
simulation of an existing real-life problem has been seen as the best
approach to check the validity of a proposed conceptual model. In
addition, valid and reliable data using a single case study should test the
created platforms’ implementation to support the design of the proposed
solution [65].
To test the accuracy and the usability of the proposed solution, a
‘single case mechanism experiment’ was conducted to check the inter­
operability of the solution, accuracy of retrieved data and usability for
most of the tasks following the procedure recommended by Wieringa
[66] and Kuechler and Vaishnavi [67]. This is an accepted method for
investigating the implementation of proposed solutions in information
systems [66]. To this end, researchers apply stimuli to a case and explain
the responses in terms of mechanisms internal to the case [66]. The
‘single case mechanism experiment’ was used to investigate imple­
mentation, as it gives researchers the chance to intervene in a case,
unlike observational case studies. So too, it provides insight into the
behaviours of the proposed solution and highlights any problematic
aspects of it in a context that simulates the real world [66].
4
Automation in Construction 140 (2022) 104320
4. Solution development
To develop a BIM-based AI voice assistant, three enablers are needed:
building AI-voice assistant skill; the mediator – environment – to link AI-
voice assistant skill and BIM models; and the tool to read BIM infor­
mation. Fig. 2 shows the process, components and interrelationships of
each environment, as adopted in this paper.
To build the AI-voice assistant environment, the developer should
build an interaction model that includes the logic for the skill, defines
the user interface, and develops the functions required by the AI-vice
assistant (see Fig. 2). The built AI-voice assistant skill requires a medi­
ator environment to: (1) link between the cloud skill and server, (2) send
and read information from BIM models. Visual programming platform is
then needed to interact with a 3D BIM model (i.e., Revit). Finally, this
visual programming platform (i.e., Dynamo) is used to (1) read the CSV
file issued by the AI-voice assistant skill, (2) convert this to order to the
3D BIM platform to perform tasks (see Fig. 1). All these processes should
be performed automatically; they should follow the concept of ‘Machine
to Machine’ to minimise human involvement. A description of proced­
ures and activities is presented next.
4.1. The mechanism of using the proposed system
This proposed system can enable project managers to interact with
F. Elghaish et al.
Fig. 2. Components of AI-voice assistant-based BIM environment.
BIM models remotely. The process begins by launching the skill on the
cloud via a device such as a mobile/tablet. Then, the AI-voice assistant
skill will convert the request into a CSV file using a Python script.
Subsequently, a generative design platform (Dynamo) will read the CSV
file and ask the 3D BIM platform to perform the requested task. Finally,
to enable BIM disabled users to interact with BIM data, the same
generative design platform will convert the retrieved data to CSV format
to be verbally returned to the user device (see Fig. 3).
4.2. Building the AI-Voice assistant skill
The Alexa Skills Kit (ASK) is selected to develop the AI-voice assistant
environment. That was because ASK is a flexible App that provides a
platform to customise skills within Alexa cloud-based API, skills com­
ponents, and other tools to develop and maintain skills throughout their
lifecycle [68]. In addition, ASK’s interactive voice interface allows users
5
Automation in Construction 140 (2022) 104320
to communicate with other platforms in simple steps [69]. As such,
Amazon Alexa was selected to accomplish a task or information retrieval
from the BIM model.
The Amazon developer account is required to create an Alexa skill.
However, a user can allow others to access their custom skills developed
by using account linking and permissions options for a particular skill.
For instance, a project lead or manager can permit to access these skills
to team members working on the same project in a BIM environment. As
discussed next, it would be useful to utilise customised skills for a project
or team.
4.2.1. Developing a custom skills-based Amazon Alexa
A developer first defines an interaction model according to the
desired skill set to build a custom skill. Then, the user’s spoken input
translates to the requests, or intents, that one’s skill can handle, ac­
cording to one’s particular interaction model. Finally, Alexa determines
F. Elghaish et al.
Fig. 3. Mechanism of adopting the AI-Voice assistant for BIM data management
the interaction model’s underlying intent when a user talks to skill and
passes it to the skill application logic.
Amazon provides many ways to start creating a skill. These are
custom models or existing built models. Pre-built models are the
developed packages of intents and utterances that one can select to
create a new skill in Amazon’s developer console. According to special
cases, the custom model is the most appropriate model for fabrication.
The first step is to develop the interaction model, which refers to
intents, sample utterances, slots, and dialogue models. Intents represent
user requests by which the skill can be invoked. The user should define
the intents for the skill’s specific features and use built-in intents for
basic actions like stopping, cancelling, and asking for assistance.
As part of Skill Alexa development, slots are optional parameters or
variables that can be added to intents. Each slot in the interaction model
gets a name and a slot type. The slot type comprises a list of represen­
tative values for the slot to improve recognition accuracy. For widely
used arguments like dates and numbers, the user can use a developed
slot type or create a bespoke slot for the case.
Fig. 4 depicts a voice command with relevant items of the interaction
model. For example, if a user wants to create a room schedule using
Alexa, the user can utter commands like “Alexa, ask project 101 to create
a room schedule”. Here, the word “Alexa” is the wake word to enable the
Alexa service, “ask” is the launch or action word, “project 123” is the
invocation name, and “to create a room schedule” is a complete utter­
ance consisting of a slot “room”. Here slot can be “door” or “window”,
which can be a variable for a request for the schedule.
For example, it can be “name of floor finish on 3rd level” if a user
wants to inquire about floor materials. Within these utterances, you can
provide slots that are variables to define a specific request. For example,
in the utterances “name of floor finish on 3rd level”, the 3rd floor can be
put as slots with the option provided in the interface. It can be 2nd or 4th
floor. There is no need for a developer to create different intents for
these variables.
Fig. 5 shows the development of the AI-Voice assistant platform to
interact with BIM using the Amazon Alexa platform. The first figure
shows the development steps that have been adopted to develop the
skill, including customising the skill’s intent and slot, building the
Fig. 4. Sample voice command.
6
Automation in Construction 140 (2022) 104320
interaction model and subsequently, the endpoint for the skill was
selected as “HTTPS” to deploy codes on a public IP address. When a port
connector provides the webserver port (public IP address), insert it in
this section.
Fig. 6 shows the created ‘intents’ to test the proposed solution. The
intent is named ‘CreateSchedule’, and three utterances were added to
ask Alexa to run the request, namely, ‘to create a room schedule’, ‘to
make a room schedule’, ‘please create room schedule’. These utterances
are coded in a JSON file, as presented in Fig. 5. Subsequently, codes
should be deployed, and the BIM user should request the AI voice as­
sistant skill to perform the task by calling the coded utterances.
To connect the local server that contains the BIM model to a public IP
address – which would connect to Alexa Cloud Services – a port for­
warding application Ngrok is employed. Fig. 7 shows how the ‘HTTPS’
links were copied from Ngrok in the endpoint. Ngrok received JSON
data, processed it, and responded with JSON data from the Python script
used for this demonstration. After inserting the endpoints provided by
the Ngrok application, it saves the endpoint in the Alexa skill builder.
4.2.2. Building mediator environment
The Python script in Fig. 8 is developed to link four primary data
platforms, including the port connector, the Flask-ask extension, the
Alexa input from AWS, and the CSV file, to connect all tasks in an in­
tegrated solution. The Python script was developed to deal with re­
quests, responses, and modifications to a CSV file. In addition, the script
allowed data to be redirected to an HTTPS server, which was read by
Alexa voice.
Fig. 8 shows the developed Python code to retrieve information of
‘room schedule’ from a 3D BIM model, which is structured to (1) import
CSV, as well as flask-ask initialisation, (2) switch function to read a CSV
file, (3) a function to create a schedule via manipulating CSV and
generate a response message using Alexa’s intent, (4) Port for Ngrok, to
connect local server to a public server.
To perform the received order from the AI voice assistant platform as
CSV file, a “Switchboard_Test” CSV file was created (see Fig. 8), enabling
reflection on changes made by the Python script in case of receiving an
affirmative signal from the intent created in the AI voice assistant
builder. For example, this solution can automatically change the state
0 to 1 in ‘Switch00’. This enables a Dynamo node to understand that the
output of the process will be a dataset rather than an empty list.
4.2.3. AI-voice assistant to BIM
Data can be retrieved from a BIM model as a CSV file. However, there
F. Elghaish et al. Automation in Construction 140 (2022) 104320

Fig. 5. Developed Alexa skill interface.

Fig. 6. JSON structure for intent and deploying the created skill.

is a need for a mediator to link the AI-voice assistant created skill
(Amazon Alexa) and a 3D BIM model (Revit). Visual programming
software like Dynamo can be used in the Revit environment to manage
data in a BIM model through CSV files. It can also manipulate data in the
model file after the changes are reflected in the CSV file. A Dynamo
script consists of nodes designed to read data from a CSV file and ask the
3D BIM model platform to perform the task. As an example of the type of
task, a room schedule in a Revit model is automatically created using a
Dynamo script linked to a CSV file. Fig. 9 shows the structure of the
created Dynamo script to read the CSV file from Amazon Alexa and ask
the 3D BIM platform (Revit) to perform the task. The system subse­
quently returns the results to the Alexa skill to enable the user to get
results remotely. The created script will be performed automatically.
The Dynamo script is structured as follows:

7
F. Elghaish et al. Automation in Construction 140 (2022) 104320

Fig. 7. Using Ngrok as a port connector.

Fig. 8. Python codes to interact between AI-voice assistant skills and a BIM model

• Import CSV file – The CSV file created as “Switchboard_Test” is • Create Schedule – Script designed for the automated creation of room
linked with this script. schedule in the Revit model if a Python script activates the switch.
• Switch – This custom node acted as a switch function to trigger the
“create schedule” node.

8
 F. Elghaish et al.
9

Automation in Construction 140 (2022) 104320

Fig. 9. Extracting BIM information using Dynamo visual programming
F. Elghaish et al.
5. Single case mechanism experiment
To test the applicability and usability of the proposed solution, a
‘Proof of Concept’ to validate the artefact through a ‘single case mech­
anism experiment’. The experiment extracts ‘Room schedule’ from a
complex BIM model. Given that the process requires integration among
different platforms, there is a need for an interoperability and workflow
flowchart, as presented in Fig. 10, to enable users/evaluators to un­
derstand the developed compound application.
The main aim of the single case mechanism experiment process is to
ensure that the ‘Proof of Concept’ has been developed to achieve its
purpose and is ready to be validated by practitioners as evaluators.
Researchers intervene in the experiment and identify problems and
behaviours as the first validation step through running workability and
usability tests.
5.1. Workability
Fig. 11 shows the steps that have been conducted to develop a
‘schedule for a room’. The process begins by uttering Amazon Alexa to
‘create rooms schedule’. Then, the developed Python script will convert
the request to a CSV file readable by Dynamo. The created Dynamo
script includes a node that works as a switch function to trigger creating
a ‘room schedule’. Finally, a 3D BIM model, as presented in Fig. 11, is
used to check the ‘Proof of Concept’ validity, scalability and workability.
The results show that a ‘room schedule is developed properly, including
all parameters mentioned in the Dynamo script and nodes —around 43
parameters were included according to the nature of the extracted in­
formation such as area, volume, number, level, etc. The same process
has been repetitively conducted after changing the design to ensure that
the ‘PoC’ can detect various alterations and scenarios. The outcome
‘Room schedule’ was compared with traditional developed ones from
the same 3D BIM model using the same parameters. The created script
turned out to be capable of dealing with all BIM model sizes, given that
no error was observed in the 43 parameters listed in the Dynamo script.
This reflects the reliability of the proposed solution to utilise the AI voice
assistant tool in integration with BIM to retrieve data verbally. Table 2
shows the criteria considered to test the workability of the created ‘Proof
of the Concept’ to check the validity of integrating the AI voice assistant
into the BIM process.
Fig. 10. Model interoperability and workflow
10
Automation in Construction 140 (2022) 104320
The proposed solution is mainly designed to facilitate extracting
information remotely and enable those who cannot read to interact with
the BIM model through sending and receiving information verbally.
Therefore, the created system-based AI voice assistance enables con­
verting the produced information into a CSV file. Then users can hear
information ‘row by row’, regardless of the location.
Different users can interact with the created system, as well as in­
formation can be then sent to all stakeholders. As such, this tool can
facilitate decision-making on-site in case users cannot access the 3D BIM
platform or are not familiar with extracting data from BIM models.
Furthermore, all project team will be able to get benefits from BIM data,
regardless of their capabilities and knowledge in using the BIM platform,
particularly the management team, since project management tasks
requires retrieving data from design repetitively.
5.2. Usability test
A usability test aims to assess how specific users can use a system to
achieve specific goals with effectiveness, efficiency, and satisfaction in a
specific context of use (BS EN ISO 9241-11:2018). To evaluate the us­
ability of the proposed system, ten evaluators working on BIM projects
are asked to participate in this experiment. Evaluators were encouraged
to provide their feedback using the questionnaire distributed to them
earlier. The questionnaire was designed to collate participants’ feedback
on the system’s usability. The questionnaire questions were designed to
assess the usability following the BS EN ISO 9241-11:2018 standards.
In this study, evaluators were five novices in BIM. They were ar­
chitects working in the construction industry. In addition, six evaluators
were experts in BIM since they had experience in BIM for more than ten
years and worked as BIM managers, coordinators, and specialists.
Table 3 provides demographic information about evaluators.
An introduction of the theoretical aspects of the systems was pre­
sented. After this, the evaluators were asked to use Alexa voice assistant
to retrieve data from the BIM model. Next, each participant was asked to
use Alexa to retrieve a different dataset to compare results. Then,
evaluators were asked to answer related questions such as how useful it
would be to implement this solution in the AEC industry for data man­
agement and information retrieval from the BIM model.
After analysing the feedback data received from the evaluators, the
results generally indicated that they had positive opinions about the
 F. Elghaish et al.
11

Automation in Construction 140 (2022) 104320

Fig. 11. Demonstration of creating ‘room schedule-based AI-voice assistant.’
F. Elghaish et al. Automation in Construction 140 (2022) 104320

Table 2 experience – EV6 – recommended that ‘It could be better to use the
Workability test results. solution on a cloud server to access file 24/7′′ .
No. Criteria Result

1 Testing the accuracy of data retrieval Achieved

6. Discussion on findings
2 The system was tested to verify if it would retrieve BIM data Achieved
using a voice assistant This study came to respond to an intensive demand by researchers to
3 Retrieved data was checked to ensure the accuracy Achieved enable the real-time retrieval of data from BIM models remotely, such as
4 This process was repeated several times to ensure the accuracy of Achieved
[70–72]. In response to a demand in the context, the proposed AI voice
retrieved data
5 The system was tested to verify the consistency of data retrieval. Achieved assistant-Based BIM system is developed to enable users to interact with
The module was checked to see if it would give well-structured BIM models (3D, 4D and 5D) remotely and verbally. This can save time
data output whenever we use the voice assistant to retrieve data while working on-site and enables non-BIM users to retrieve information
from the BIM model from models without a need for BIM knowledge and competency.
Moreover, users with a reading disability will be able to interact with the
BIM model without following complex and compound steps, and infor­
Table 3 mation will also be provided verbally. The proposed system provides
Evaluators demographic information. data in different formats to re-use it for multiple purposes. For example,
Code Position Experience (yrs) the data is initially retrieved as a CSV file, a flexible format that can be
EV1 Architect 18
converted to excel format. Therefore, this can facilitate integrating the
EV 2 Architect 10 retrieved data into other platforms for further process (i.e., cost
EV 3 Architect 15 estimation).
EV 4 Architect 14 Even though a few attempts to use AI voice assistant technology to
EV 5 Architect 20
interact with BIM data, such as systems developed by Motawa [9], the
EV 6 BIM Manager & software developer 11
EV 7 BIM Coordinator 16 BIM model was not linked with the AI voice assistant platform to enable
EV 8 BIM Manager 11 users to interact verbally. Shin et al. [7] developed a framework based
EV 9 BIM Specialist 15 on integrating SQL and Dynamo to retrieve BIM data verbally. However,
EV 10 BIM Manager 16 their system stopped short in conducting the process in an integrated
EV 11 BIM Manager 18
environment. And there was no proposed interface for the AI voice as­
sistant skill to enable users to send queries easily. As such, the proposed
developed system prototype. For example, Fig. 12 clearly shows that the platform stands out among previous studies in dealing with limitations
11 evaluators agreed that the proposed solution is applicable, given six in 3 ways:
evaluators chose 4/5 and the other five evaluators chose 5/5. (1) using Amazon Alexa to develop a user-friendly interface to
The evaluators were asked to evaluate the usefulness of the proposed interact with the BIM model, (2) developing an automated mediator
solution in the AEC industry for data management and information environment to read CSV data from AI voice assistant skill and request
retrieval from the BIM model. They agreed that the proposed solution is the 3D BIM model to perform the task, and (3) proposing a solution
useful, EV8 stated: capable of providing verbal data enables users with a disability to deal
“This could save effort and time, especially for owner and construction with exchanging data.
management team who are usually not BIM experts.” The proposed methodology of remotely performing tasks can be
another evaluator went on to say (EV9); considered a point of departure for an automated generative design-
“non-BIM users might find such a tool very convenient, especially since based AI voice assistant to develop a complete design using common
navigating a BIM model might not be a straightforward thing to do.” utterances. This can be a comprehensive solution for blindness and
Other evaluators agreed, where EV10 argued that: vision problems of users to develop design and management documents
“The system is user friendly and easy to navigate and use, and anyone can using BIM platforms. Users will be able to send requests to develop tasks,
use it easily”; similarly, EV11 agreed that: receive either a verbal message that the task is performed successfully or
“the solution is efficient and easy and can be used by any user.” retrieve the information verbally.
Given that evaluators were selected from different backgrounds to From an efficiency perspective, there have been several attempts to
check the validity of all users, therefore, evaluators from BIM back­ reduce the consumed time to perform repetitive tasks while developing
grounds proposed some recommendations to enable retrieving data BIM models [73]. However, most attempts rely on Dynamo to develop
from a BIM model in a cloud, not a server. For example, EV11 mentioned scripts to interact with Autodesk Revit to automatically develop com­
that “It would be useful to develop further the system to be a cloud plex/repetitive tasks for specific design elements, and the user should
system than can be accessed anywhere” and another architect with BIM manually perform the task. The proposed system uses an AI voice as­
sistant, which enables the full automation of the process, significantly

Fig. 12. Usability and validity of the proposed solution.

12
F. Elghaish et al.
increasing efficacy and productivity.
The simplicity of performing automation tasks is essential to ensure
the solution’s scalability. Therefore, the design of such a solution con­
siders this properly by developing a user-friendly AI-voice assistant skill
using the Amazon Alexa platform. Furthermore, it also considers auto­
mating all further tasks, including switching node from CSV file to visual
script in Dynamo and extracting data and converting it as CSV files to
automatically resend it to the Amazon Alexa platform.
The proposed system interacts with the BIM model through sensing
queries as CSV files to the user device that holds the BIM model. How­
ever, this system can be extended in future research to enable BIM users
to interact with the BIM data in a cloud such as BIM 360 to enable
multiple users to retrieve information from BIM models without needing
a centralised server containing the 3D BIM model. Moreover, the pro­
posed solution is tested to develop a project schedule and retrieve the
created schedule verbally. Although the methodology and the solution
can interact with BIM models to retrieve different types of information
(i.e., parametric, geometric), nevertheless, to globalise the benefits of
using this solution, multiple dynamo scripts should be developed to
perform and retrieve a wide range of tasks/data according to each
project’s needs.
7. Novelty and originality
Given that voice, assistant tools are proven tools to interact with
many devices to help disables and automate conducting tasks in
different industries such as the health sector [74,75] and facilitate
disabled people to manage their daily tasks in smart houses [76,77].
There is, however, a conspicuous gap of knowledge in the con­
struction industry for this. Research on the topic is scary. There are few
attempts to employ AI voice assistants to interact with BIM models.
Researchers like Shin et al. [7] developed a building information
modelling automatic speech recognition (BIMASR) framework to enable
BIM users to interact with the BIM model using natural language (NL)-
based questions. However, the developed solution is complex and in­
cludes multiple tasks. The solution was developed based on Google
cloud API to recognise the speech and then Oracle database with Eclipse
platform to interact with Dynamo. This process requires heavy language
programming (Java and Python), which compromises the opportunity
for real applications, as well as, the solution was developed to interact
with the design rather than retrieving information. The proposed solu­
tion further creates a user-friendly system based on an AI voice assistant
to interact with BIM models. The system removed the necessity of
engaging in several activities for the user, increasing efficiency and
making the interaction simple and intuitive for users with a disability,
where no specific skill is required. In essence, the proposed solution
developed a new mode of interaction with BIM platforms which sim­
plifies the use of BIM and can convince non-adopters to join the trend of
BIM and digitalisation. The study also provides a blueprint for other
platforms using the same methods and techniques to simplify data ex­
change interactions between users and the platform.
The paper addresses the human side of BIM implementation from a
broader theoretical perspective, which has been overlooked in the BIM
literature. The technical aspects of BIM implementation are intertwined
with people’s demands and user requirements. This has been a missing
component of BIM literature [5], addressed in this paper.
Moreover, the contribution of a study in the construction manage­
ment discipline lies within its originality in the development of knowl­
edge and its impacts on practice [78–80]. With this in mind, the present
study provides an original insight into the phenomenon of using voice as
a new method for interaction with the BIM platform through the use of
“contingency approaches”. Contingency approaches provide original
understanding on a topic where they bring to light “what processes and
practices apply in which contexts, what relationships hold or do not hold
in which contexts, and where do methods work and do not work or how
do they vary in different contexts.” [81]. This applies to this paper, in
13
Automation in Construction 140 (2022) 104320
light of designing a solution and running an experiment to test the
applicability and implementation aspects of the solution, as another
evidence of the contribution of the present study.
8. Conclusions
The proposed ‘Proof of Concept’ prototype is the first of its kind to
use an AI-voice assistant platform such as Amazon Alexa in conjunction
with a generative design tool—Dynamo. The system helps users interact
with a 3D BIM model to retrieve information from an existing model or
perform tasks to develop a design. If the user utilises the system to
retrieve information, the AI voice assistant skill can read the CSV data
from the Dynamo platform. This solution is a step toward construction
4.0, given IoT devices and concepts are integrated into BIM to automate
the entire process and minimise human interference to reduce errors and
waste.
The developed prototype is validated using a single case mechanism
experiment to retrieve information from a 3D BIM model (Developing a
room schedule) to check its validity, workability and scalability. The
results proved that the entire process is robust, including the AI-Voice
assistant interface-based Amazon Alexa. Furthermore, this mediator
environment converts the verbal request to a CSV file to be readable by
the generative design platform (Dynamo) retrieved information is cor­
rect and reliable.
Despite the study’s contributions, some limitations need to be
acknowledged that point to fertile grounds for defining future research
in the field. Even though the proposed solution works automatically
without a need for a human to link its processes, the Dynamo script
performs the specific tasks. It also helps retrieve specific types of data
required for each case. This calls for developing a wide range of scripts
to enable the scalability of the proposed solution. In addition, the
created solution could be extended to link the Amazon Alexa skill and
the BIM model in a cloud such as BIM 360 to enable multiple users to
interact with the BIM model without connecting the device to the AI-
voice assistant skill. Besides, this paper focuses on presenting a theory
of design for a solution to a problem for the industry. A broadscale
validation of the system’s proposed design and testing the applicability
of various commands and different types of interactions for various roles
in construction projects remains an area for further investigation.
Moreover, the readiness of the industry and the enablers in the context
to support the application of the proposed design are not considered in
the present study as another area for future researchers.
Moreover, the solution was tested in an experiment under idealised
conditions, where researchers intervened and controlled the experi­
ment. The solution should be exposed to varied scenarios under practice
conditions; hence, future research should focus on the scaling-up
approach to extend the study’s findings. Future research, therefore, is
needed to replicate the findings from samples to populations.
Declaration of Competing Interest
No.
References
[1] S. Wu, Q. Shen, Y. Deng, J. Cheng, Natural-language-based intelligent retrieval
engine for BIM object database, Comput. Ind. 108 (2019) 73–88, https://doi.org/
10.1016/j.compind.2019.02.016.
[2] C. Preidel, S. Daum, A. Borrmann, Data retrieval from building information models
based on visual programming, Visual. Eng. 5 (1) (2017) 18, https://doi.org/
10.1186/s40327-017-0055-0.
[3] M. Oraee, M.R. Hosseini, D. Edwards, E. Papadonikolaki, Collaboration in BIM-
based construction networks: a qualitative model of influential factors, Eng. Constr.
Archit. Manag. 29 (3) (2021), https://doi.org/10.1108/ECAM-10-2020-0865.
[4] M.U. Hossain, S.T. Ng, Critical consideration of buildings’ environmental impact
assessment towards adoption of circular economy: an analytical review, J. Clean.
Prod. 205 (2018) 763–780, https://doi.org/10.1016/j.jclepro.2018.09.120.
[5] M.R. Hosseini, M. Maghrebi, A. Akbarnezhad, I. Martek, M. Arashpour, Analysis of
citation networks in building information modeling research, J. Constr. Eng.
F. Elghaish et al.
Manag. 144 (8) (2018) 04018064, https://doi.org/10.1061/(ASCE)CO.1943-
7862.0001492.
[6] J. Wang, X. Gao, X. Zhou, Q. Xie, Multiscale information retrieval for BIM using
hierarchical structure modelling and natural language processing, J. Inform.
Techno. Const. 26 (2021) 409–426, https://doi.org/10.36680/j.itcon.2021.022.
[7] S. Shin, C. Lee, R.R. Issa, Framework for Automatic Speech Recognition-Based
Building Information Retrieval from BIM Software, Construction Research
Congress 2020: Computer Applications, American Society of Civil Engineers
Reston, VA, 2020, pp. 992–1000, https://doi.org/10.1061/9780784482865.105.
[8] H. Lange, A. Johansen, M.B. Kjærgaard, Evaluation of the opportunities and
limitations of using IFC models as source of building metadata, Proceedings of the
5th Conference on Systems for Built Environments, Association for Computing
Machinery, Shenzen, China, 2018 of Conference, pp. 21–24. doi:https://doi.org/1
0.1145/3276774.3276790.
[9] I. Motawa, Spoken dialogue BIM systems – an application of big data in
construction, Facilities 35 (13–14) (2017) 787–800, https://doi.org/10.1108/F-01-
2016-0001.
[10] Y. Pan, L. Zhang, A BIM-data mining integrated digital twin framework for
advanced project management, Autom. Constr. 124 (2021), 103564, https://doi.
org/10.1016/j.autcon.2021.103564.
[11] S. Alizadehsalehi, A. Hadavi, J.C. Huang, From BIM to extended reality in AEC
industry, Autom. Constr. 116 (2020), 103254, https://doi.org/10.1016/j.
autcon.2020.103254.
[12] T. Beach, I. Petri, Y. Rezgui, O. Rana, Management of collaborative BIM data by
federating distributed BIM models, J. Comput. Civ. Eng. 31 (4) (2017) 04017009,
https://doi.org/10.1061/(ASCE)CP.1943-5487.0000657.
[13] H. Abdirad, Managing digital integration routines in engineering firms: cases of
disruptive BIM cloud collaboration protocols, J. Manag. Eng. 38 (1) (2021)
05021012, https://doi.org/10.1061/(ASCE)ME.1943-5479.0000988.
[14] M. Honic, I. Kovacic, P. Aschenbrenner, A. Ragossnig, Material passports for the
end-of-life stage of buildings: challenges and potentials, J. Clean. Prod. 319 (2021),
https://doi.org/10.1016/j.jclepro.2021.128702.
[15] P. Liu, Mountain rainfall estimation and BIM technology site safety management
based on internet of things, Mob. Inf. Syst. 2021 (2021), https://doi.org/10.1155/
2021/1017200.
[16] F. Elghaish, S. Abrishami, M.R. Hosseini, Integrated project delivery with
blockchain: an automated financial system, Autom. Constr. 114 (2020), 103182,
https://doi.org/10.1016/j.autcon.2020.103182.
[17] A. Khalili, An XML-based approach for geo-semantic data exchange from BIM to VR
applications, Autom. Constr. 121 (2021), 103425, https://doi.org/10.1016/j.
autcon.2020.103425.
[18] F. Pour Rahimian, V. Chavdarova, S. Oliver, F. Chamo, L. Potseluyko Amobi,
OpenBIM-tango integrated virtual showroom for offsite manufactured production
of self-build housing, Autom. Constr. 102 (2019) 1–16, https://doi.org/10.1016/j.
autcon.2019.02.009.
[19] F. Pour Rahimian, S. Seyedzadeh, S. Oliver, S. Rodriguez, N. Dawood, On-demand
monitoring of construction projects through a game-like hybrid application of BIM
and machine learning, Autom. Constr. 110 (2020), 103012, https://doi.org/
10.1016/j.autcon.2019.103012.
[20] B. Plaß, C. Prudhomme, J. Ponciano, Bim on artificial intelligence for decision
support in E-health, the international archives of photogrammetry, remote sensing
and spatial, Inf. Sci. 43 (2021) 207–214, https://doi.org/10.5194/isprs-archives-
XLIII-B2-2021-207-2021.
[21] S. Bakhshi, M.R. Chenaghlou, F. Pour Rahimian, D.J. Edwards, N. Dawood,
Integrated BIM and DfMA parametric and algorithmic design based collaboration
for supporting client engagement within offsite construction, Autom. Constr. 133
(2022), 104015, https://doi.org/10.1016/j.autcon.2021.104015.
[22] K. Xue, M. Uzzal Hossain, M. Liu, M. Ma, Y. Zhang, M. Hu, X. Chen, G. Cao, Bim
integrated lca for promoting circular economy towards sustainable construction:
an analytical review, Sustainability 13 (3) (2021) 1310, https://doi.org/10.3390/
su13031310.
[23] R. He, M. Li, V.J. Gan, J. Ma, BIM-enabled computerised design and digital
fabrication of industrialised buildings: a case study, J. Clean. Prod. 278 (2021)
123505, https://doi.org/10.1016/j.jclepro.2020.123505.
[24] V. Getuli, P. Capone, A. Bruttini, F. Pour Rahimian, On-demand generation of as-
built infrastructure information models for mechanised Tunnelling from TBM data:
a computational design approach, Autom. Constr. 121 (2021) 103434, https://doi.
org/10.1016/j.autcon.2020.103434.
[25] S. Abrishami, J. Goulding, F. Rahimian, Generative BIM workspace for AEC
conceptual design automation: prototype development, Eng. Constr. Archit.
Manag. 28 (2) (2021) 482–509, https://doi.org/10.1108/ECAM-04-2020-0256.
[26] J. Sresakoolchai, S. Kaewunruen, Integration of building information modeling
(BIM) and artificial intelligence (AI) to detect combined defects of infrastructure in
the railway system, in: Resilient Infrastructure, Springer, 2022, pp. 377–386,
https://doi.org/10.1007/978-981-16-6978-1_30.
[27] F. Alotto, I. Scidà, A. Osello, Building modeling with artificial intelligence and
speech recognition for learning purpose, in: Proceedings of EDULEARN20
Conference Vol. 6, 2020, pp. 5866–5875, https://doi.org/10.21125/
edulearn.2020.1529.
[28] J.R. Lin, Z.Z. Hu, J.P. Zhang, F.Q. Yu, A natural-language-based approach to
intelligent data retrieval and representation for cloud BIM, Comp. Aided Civil
Infrastruct. Eng. 31 (1) (2016) 18–33, https://doi.org/10.1111/mice.12151.
[29] W.B. Croft, The Importance of Interaction for Information Retrieval Vol. 19, SIGIR,
2019, pp. 1–2, https://dl.acm.org/doi/10.1145/3331184.3331185 Last Access: 29
March 2022.
14
Automation in Construction 140 (2022) 104320
[30] S. Wu, L. Hou, G.K. Zhang, Integrated application of BIM and eXtended reality
technology: a review, classification and outlook, in: International Conference on
Computing in Civil and Building Engineering, Springer, 2020, pp. 1227–1236,
https://doi.org/10.1007/978-3-030-51295-8_86.
[31] S. Shin, C. Lee, R.R. Issa, Advanced BIM Platform Based on the Spoken Dialogue for
End-User, International Conference on Computing in Civil and Building
Engineering, Springer, 2020, pp. 123–132. https://doi.org/10.1007/978-3-030-5
1295-8_11.
[32] R. Ivanov, An approach for developing indoor navigation systems for visually
impaired people using building information modeling, J. Ambient Intell. Smart
Environ. 9 (4) (2017) 449–467, https://doi.org/10.3233/AIS-170441.
[33] S. Shin, R.R.A. Issa, BIMASR: framework for voice-based BIM information retrieval,
J. Constr. Eng. Manag. 147 (10) (2021) 04021124, https://doi.org/10.1061/
(ASCE)CO.1943-7862.0002138.
[34] R.J. Wieringa, What Is Design Science?, Design Science Methodology for
Information Systems and Software Engineering, Springer, Berlin Heidelberg,
Berlin, Heidelberg, 2014, pp. 3–11, https://doi.org/10.1007/978-3-662-43839-8_
1.
[35] Allen Consulting Group, Productivity in The Buildings Network: Assessing the
Impacts of Building Information Models, 2019 (Issue), Retrieved from: https://buil
dingsmart.org.au/wp-content/uploads/2014/03/BIM_Economic_Study_Final-Rep
ort_29Oct2010.pdf, 2010. Last Access: 29 March 2021.
[36] M.R. Hosseini, Integrating BIM into facility management, Int. J. Build. Pathol.
Adapt. 36 (1) (2018) 2–14, https://doi.org/10.1108/IJBPA-08-2017-0034.
[37] J.R. Jupp, V. Singh, A PLM perspective of BIM research initiatives, Int. J. Product
Lifecycle Manage 9 (2016) 180–197. https://www.mdpi.com/2412-3811/5/4/37.
Last Access: 29 March 2022.
[38] R. Woodhead, P. Stephenson, D. Morrey, Digital construction: from point solutions
to IoT ecosystem, Autom. Constr. 93 (2018) 35–46, https://doi.org/10.1016/j.
autcon.2018.05.004.
[39] B. Succar, E. Poirier, Lifecycle information transformation and exchange for
delivering and managing digital and physical assets, Autom. Constr. 112 (2020),
103090, https://doi.org/10.1016/j.autcon.2020.103090.
[40] J. Zhang, N.M. El-Gohary, Automated information transformation for automated
regulatory compliance checking in construction, J. Comput. Civ. Eng. 29 (4) (2015)
B4015001, https://doi.org/10.1061/(ASCE)CP.1943-5487.0000427.
[41] S.T. Matarneh, M. Danso-Amoako, S. Al-Bizri, M. Gaterell, R.T. Matarneh, BIM for
FM: developing information requirements to support facilities management
systems, Facilities 38 (5–6) (2020) 378–394, https://doi.org/10.1108/F-07-2018-
0084.
[42] G. Gao, Y.-S. Liu, M. Wang, M. Gu, J.-H. Yong, A query expansion method for
retrieving online BIM resources based on industry foundation classes, Autom.
Constr. 56 (2015) 14–25, https://doi.org/10.1016/j.autcon.2015.04.006.
[43] H. Liu, Y.S. Liu, P. Pauwels, H. Guo, M. Gu, Enhanced explicit semantic analysis for
product model retrieval in construction industry, IEEE Trans. Indust. Inform. 13 (6)
(2017) 3361–3369, https://doi.org/10.1109/TII.2017.2708727.
[44] G. Gao, Y.S. Liu, P. Lin, M. Wang, M. Gu, J.H. Yong, BIMTag: concept-based
automatic semantic annotation of online BIM product resources, Adv. Eng. Inform.
31 (6) (2017) 48–61, https://doi.org/10.1016/j.aei.2015.10.003.
[45] X. Shi, Y.-S. Liu, G. Gao, M. Gu, H. Li, IFCdiff: a content-based automatic
comparison approach for IFC files, Autom. Constr. 86 (2018) 53–68, https://doi.
org/10.1016/j.autcon.2017.10.013.
[46] Q. Xie, X. Zhou, J. Wang, X. Gao, X. Chen, L. Chun, Matching real-world facilities to
building information modeling data using natural language processing, IEEE
Access 7 (2019) 119465–119475, https://doi.org/10.1109/
ACCESS.2019.2937219.
[47] S. Matarneh, M. Danso-Amoako, S. Al-Bizri, M. Gaterell, R. Matarneh, BIM-based
facilities information: streamlining the information exchange process, J. Eng.
Design Technol. 17 (6) (2019) 1304–1322, https://doi.org/10.1108/JEDT-02-
2019-0048.
[48] Y.C. Chen, B.Y. Lin, C.H. Lin, Consistent roof geometry encoding for 3D building
model retrieval using airborne LiDAR point clouds 6 (9) (2017), https://doi.org/
10.3390/ijgi6090269.
[49] A. Darko, A.P. Chan, M.A. Adabre, D.J. Edwards, M.R. Hosseini, E.E. Ameyaw,
Artificial intelligence in the AEC industry: Scientometric analysis and visualisation
of research activities, Autom. Constr. 112 (2020), 103081, https://doi.org/
10.1016/j.autcon.2020.103081.
[50] S. Shin, C. Lee, R.R.A. Issa, Advanced BIM Platform Based on the Spoken Dialogue
for End-User 98, 2021, pp. 123–132, https://doi.org/10.1007/978-3-030-51295-8_
11.
[51] K. Kim, Y. Cho, K. Kim, BIM-driven automated decision support system for safety
planning of temporary structures, J. Constr. Eng. Manag. 144 (8) (2018)
04018072, https://doi.org/10.1061/(ASCE)CO.1943-7862.0001519.
[52] A. Malve, P. Chawan, A comparative study of keyword and semantic based search
engine, Int. J. Innovat. Res. Sci. Eng. Technol.y 4 (11) (2015) 11156–11161.
http://www.ijirset.com/upload/2015/november/39_A_Comparative.pdf. Last
Access: 29 March 2022.
[53] N. Gui, C. Wang, Z. Qiu, W. Gui, G. Deconinck, IFC-based partial data model
retrieval for distributed collaborative design, J. Comput. Civ. Eng. 33 (3) (2019),
https://doi.org/10.1061/(ASCE)CP.1943-5487.0000829.
[54] K. Kensek, Y. Ding, T. Longcore, Green building and biodiversity: facilitating bird
friendly design with building information models, J. Green Build. 11 (2) (2016)
116–130, https://doi.org/10.3992/jgb.11.2.116.1.
[55] M. Valinejadshoubi, O. Moselhi, A. Bagchi, Integrating BIM into sensor-based
facilities management operations, J. Facil. Manag. (2021), https://doi.org/
10.1108/JFM-08-2020-0055 2021/11/27 ahead-of-print (ahead-of-print).
F. Elghaish et al.
[56] A. Santoni, R. Martín-Talaverano, R. Quattrini, J.I. Murillo-Fragero, HBIM
approach to implement the historical and constructive knowledge, The Case of the
Real Colegiata of San Isidoro (León, Spain) 2021 12 (24) (2021) 17, https://doi.
org/10.4995/var.2021.13661.
[57] M. O’Shea, J. Murphy, Design of a BIM integrated structural health monitoring
system for a historic offshore lighthouse, Buildings 10 (7) (2020) 131, https://doi.
org/10.3390/buildings10070131.
[58] S.A. Biancardo, A. Capano, S.G. de Oliveira, A. Tibaut, Integration of BIM and
procedural modeling tools for road design, Infrastructures 5 (4) (2020) 37, https://
doi.org/10.5281/zenodo.3757120.
[59] H. Snyder, Literature review as a research methodology: an overview and
guidelines, J. Bus. Res. 104 (2019) 333–339, https://doi.org/10.1016/j.
jbusres.2019.07.039.
[60] M. Jaiswal, Software architecture and software design, Int. Res. J. Eng. Technol. 6
(11) (2019), 2395–0056, https://www.irjet.net/archives/V6/i11/IRJET-V6I11
303.pdf. Last Access: 29 March 2022.
[61] G. Shen, N. Arnold, S. Benes, D. Jarosz, A. Johnson, D. Stasic, I. Usmani, S. Veseli,
High-level application architecture design for the APS upgrade, in: 17th Int Conf on
Acc and Large Exp Physics Control Systems, 2019, pp. 1436–1440, https://doi.org/
10.18429/JACoW-ICALEPCS2019-WEPHA143.
[62] T. Kita, C. Nagaoka, N. Hiraoka, M. Dougiamas, Implementation of voice user
interfaces to enhance users’ activities on Moodle, in: 2019 4th International
Conference on Information Technology (InCIT), IEEE, 2019, pp. 104–107, https://
doi.org/10.1109/INCIT.2019.8912086.
[63] D.S. Zwakman, D. Pal, C. Arpnikanondt, Usability evaluation of artificial
intelligence-based voice assistants: the case of Amazon Alexa, SN Comp. Sci. 2 (1)
(2021) 1–16, https://doi.org/10.1007/s42979-020-00424-4.
[64] C. Cavalliere, G.R. Dell’osso, M.A. Leogrande, Automatic workflow for 4D-BIM
based modelling, in: Progress (es), Theories and Practices: Proceedings of the 3rd
International Multidisciplinary Congress on Proportion Harmonies Identities (PHI
2017), October 4–7, 2017, Bari, Italy, CRC Press, 2017, p. 405. https://www.taylor
francis.com/chapters/edit/10.1201/9781351242691-68/automatic-workflow-4d-
bim-based-modelling-carmine-cavalliere-guido-raffaele-dell-osso-maria-angela-leo
grande. Last Access: 29 March 2022.
[65] A. Dasso, Verification, validation and testing in software engineering, IGI Global
ISBN (2006) 1591408539.
[66] R.J. Wieringa, The Design Cycle, Design Science Methodology for Information
Systems and Software Engineering, Springer, Berlin Heidelberg, Berlin, Heidelberg,
2014, pp. 27–34, https://doi.org/10.1007/978-3-662-43839-8_3.
[67] B. Kuechler, V. Vaishnavi, On theory development in design science research:
anatomy of a research project, Eur. J. Inf. Syst. 17 (5) (2008) 489–504, https://doi.
org/10.1057/ejis.2008.40.
[68] I. Lopatovska, K. Rink, I. Knight, K. Raines, K. Cosenza, H. Williams, P. Sorsche,
D. Hirsch, Q. Li, A. Martinez, Talk to me: exploring user interactions with the
Amazon Alexa, J. Librariansh. Inf. Sci. 51 (4) (2019) 984–997, https://doi.org/
10.1177/0961000618759414.
[69] V. Kepuska, G. Bohouta, Next-generation of virtual personal assistants (microsoft
cortana, apple siri, amazon alexa and google home), in: 2018 IEEE 8th Annual
15
Automation in Construction 140 (2022) 104320
Computing and Communication Workshop and Conference (CCWC), IEEE, 2018,
pp. 99–103, https://doi.org/10.1109/CCWC.2018.8301638.
[70] F. Svalestuen, V. Knotten, O. Lædre, F. Drevland, J. Lohne, Using building
information model (BIM) devices to improve information flow and collaboration
on construction sites, J. Inform. Techno. Const. 22 (2017) 204–219. https://www.
itcon.org/paper/2017/11 (Last Access: 29 March 2022).
[71] V. Singh, N. Gu, X. Wang, A theoretical framework of a BIM-based multi-
disciplinary collaboration platform, Autom. Constr. 20 (2) (2011) 134–144,
https://doi.org/10.1016/j.autcon.2010.09.011.
[72] K. El Ammari, A. Hammad, Remote interactive collaboration in facilities
management using BIM-based mixed reality, Autom. Constr. 107 (2019), 102940,
https://doi.org/10.1016/j.autcon.2019.102940.
[73] M. Sheikhkhoshkar, F.P. Rahimian, M.H. Kaveh, M.R. Hosseini, D.J. Edwards,
Automated planning of concrete joint layouts with 4D-BIM, Autom. Constr. 107
(2019) 102943, https://doi.org/10.1016/j.autcon.2019.102943.
[74] G. Hong, A. Folcarelli, J. Less, C. Wang, N. Erbasi, S. Lin, Voice assistants and
Cancer screening: a comparison of Alexa, Siri, Google assistant, and Cortana, the,
Ann. Fam. Med. 19 (5) (2021) 447–449, https://doi.org/10.1370/afm.2713.
[75] A. Palanica, Y. Fossat, Medication name comprehension of intelligent virtual
assistants: a comparison of Amazon Alexa, Google assistant, and apple Siri between
2019 and 2021, Front. Digital Health 3 (2021) 48, https://doi.org/10.3389/
fdgth.2021.669971.
[76] H. Isyanto, A.S. Arifin, M. Suryanegara, Design and implementation of IoT-based
smart home voice commands for disabled people using Google Assistant, in: 2020
International conference on smart technology and applications (ICoSTA), IEEE,
2020, pp. 1–6, https://doi.org/10.1109/ICoSTA48221.2020.1570613925.
[77] P. Mtshali, F. Khubisa, A smart home appliance control system for physically
disabled people, in: 2019 Conference on Information Communications Technology
and Society (ICTAS), IEEE, 2019, pp. 1–5, https://doi.org/10.1109/
ICTAS.2019.8703637.
[78] N. Chileshe, PhD in construction management research: what is original
contribution to knowledge? The case of TQM, in: F. Khosrowshahi (Ed.), The 21st
Annual ARCOM Conference, Association of Researchers in Construction
Management, London, UK, 2005, pp. 1267–1278. . chrome-extension://
efaidnbmnnnibpcajpcglclefindmkaj/viewer.html?pdfurl=https%3A%2F%2Fwww.
arcom.ac.uk%2F-docs%2Fproceedings%2Far2005–1267-1278_Chileshe.
pdf&clen=126045&chunk=true Last Access: 29 March 2022.
[79] S. Azhar, I. Ahmad, M.K. Sein, Action research as a proactive research method for
construction engineering and management, J. Constr. Eng. Manag. 136 (1) (2009)
87–98, https://doi.org/10.1061/(ASCE)CO.1943-7862.0000081.
[80] S.D. Green, C.-C. Kao, G.D. Larsen, Contextualist research: iterating between
methods while following an empirically grounded approach, J. Constr. Eng.
Manag. 136 (1) (2009) 117–126, https://doi.org/10.1061/(ASCE)CO.1943-
7862.0000027.
[81] H. Boer, M. Holweg, M. Kilduff, M. Pagell, R. Schmenner, C. Voss, Making a
meaningful contribution to theory, Int. J. Oper. Prod. Manag. 35 (9) (2015)
1231–1252, https://doi.org/10.1108/IJOPM-03-2015-0119.