You are on page 1of 14

Case Study

Longitudinal Study of BIM Adoption by


Public Construction Clients
Ury Gurevich 1 and Rafael Sacks 2

Abstract: Building information modeling (BIM) adoption is driven in part by the government and other large public procurement agencies
mandating its use. A longitudinal study of BIM adoption in three major public agencies (two in the United Kingdom and one in Israel) tracked
Downloaded from ascelibrary.org by Heriot-Watt University on 11/07/22. Copyright ASCE. For personal use only; all rights reserved.

their BIM adoption actions and outcomes over a 3-year period, using a formal BIM adoption impact map (BIM-AIM) to structure the
observations and to record and measure the outcomes. Detailed case studies of these organizations and 17 of their individual projects reveal
the actions taken and their effects. The agencies’ project managers varied greatly in their perceptions of the purpose and the value of BIM
implementation. Nevertheless, two of the organizations have made significant progress in compiling the information backbone necessary to
integrate as-designed and as-made BIM models in digital twin information systems that can enhance their operations and achieve long-term
organizational goals. The results emphasize that public agencies stand to reap significant value from system-wide asset information models in
addition to the benefits of BIM application in isolated projects. An updated (BIM-AIM), which can guide agencies in their BIM adoption
efforts, is a central contribution of the research. DOI: 10.1061/(ASCE)ME.1943-5479.0000797. © 2020 American Society of Civil Engineers.
Author keywords: Asset management; Building information modeling (BIM); BIM adoption; Occupant value; Public construction
clients.

Introduction of small firms (Dainty et al. 2017; Lee et al. 2013; Tulubas
Gokuc and Arditi 2017); or
With the realization that building information modeling (BIM) re- 4. Construction industry sector or nation-wide reviews of BIM
quires deep changes to processes and organizations, the topic of policy and standardization efforts mostly conducted by govern-
BIM adoption has become a central subject of research in the field ments (Aksenova et al. 2019; Cheng and Lu 2015; Kassem and
of engineering management. Indeed, a formal unified taxonomy of Succar 2017; Sacks et al. 2016).
the drivers of BIM adoption and the factors that affect it have been In contrast, scant attention has been paid to BIM adoption by
proposed to facilitate such research (Ahmed and Kassem 2018). construction clients, neither public nor private. Public construction
The extant research can be broadly categorized as focusing on the clients are of special interest because given their role as decision-
following four levels, with increasing degree of resolution: makers, the very large scales of their projects and their portfolios,
1. Individual adoption and proficiency with BIM tools and meth- and their exposure to public scrutiny, they strongly influence their
ods (e.g., Jin et al. 2017; Ma et al. 2020), exploring issues such design and construction service provider supply chains. As such,
as skills training, proficiency, extrinsic and intrinsic motivation, they are drivers of BIM adoption across construction markets.
and the social and organizational aspects of the transformation Public construction procurement agencies began demanding
from the perspective of the people involved (Liao and Ai Lin BIM over a decade ago (Sacks et al. 2018), primarily to improve
Teo 2018); project-level outcomes. Most, if not all, seek to improve construc-
2. Adoption at the level of construction projects (e.g., Cao et al. tion processes and achieve better buildings. More sophisticated
2018; Davies and Harty 2013; Papadonikolaki 2018). The owners seek better control over the assets and systems they operate
project-level benefits of BIM are now fairly well understood (Al Sayed et al. 2015; Bew et al. 2015). Creating the right condi-
(Chan et al. 2019), and the potential cost savings in the construc- tions for effective adoption requires motivation, resources, and
tion process have been documented (Azhar 2011; Bryde et al. coordinated action across a range of interdependent organizations
2013; Giel and Issa 2013); and disciplines (among them owners, project managers, designers,
3. Adoption within companies, both design firms (architects and builders, permit agencies, suppliers, and occupants) and public con-
engineers) and construction companies. This work highlights struction procurement agencies have established a variety of BIM
both successes and difficulties, such as the disenfranchisement adoption strategies. Among the early adopters, agencies such as
the General Services Administration (Matta et al. 2007) and the
1 Department of Veterans Affairs (Tiejten 2010) prepared BIM guides
Ph.D. Graduate, Virtual Construction Lab, Faculty of Civil and Envir-
onmental Engineering, Technion–Israel Institute of Technology, Haifa for their service providers (Sacks et al. 2016). As time passed and
3200003, Israel (corresponding author). ORCID: https://orcid.org/0000 more organizations mandated the use of BIM for their projects, fo-
-0003-1559-4676. Email: Ury.gurevich@gmail.com cus moved from project-level implementation issues to questions
2
Professor, Virtual Construction Lab, Faculty of Civil and Environmen- regarding the information itself: What are public clients’ goals and
tal Engineering, Technion–Israel Institute of Technology, Haifa 3200003,
priorities regarding the information? How should it be delivered?
Israel. Email: Cvsacks@technion.ac.il
Note. This manuscript was submitted on November 13, 2019; approved
What skills do suppliers need to meet public clients’ information
on January 29, 2020; published online on May 7, 2020. Discussion period needs? How can public clients support their supply chains to better
open until October 7, 2020; separate discussions must be submitted for fulfill their needs?
individual papers. This paper is part of the Journal of Management in In general, public clients operate in one of two modes: through
Engineering, © ASCE, ISSN 0742-597X. in-house construction procurement departments or using outsourced

© ASCE 05020008-1 J. Manage. Eng.

J. Manage. Eng., 2020, 36(4): 05020008


construction management services that act as client representatives. (2) pilot or pathfinder projects, (3) national BIM guidelines,
In this research, we focus on the former. For all of the case studies (4) funding, (5) national training programs, and (6) international
involved clients of this type, and in the remainder of the paper, the Standards. Using information about BIM adoption in construction
term construction procurement agency refers to this client type. projects from a Shanghai municipality database, Cao et al. (2018)
Despite the wealth of research on BIM adoption, including that conducted a longitudinal study from 2007 to 2015 to explore the
cited presented, none was found that elucidated the relationships relationship between the project-based networks in which the firms
between specific BIM adoption actions on project outcomes or function to their long-term competitiveness. However, none of
long-term asset management. This lack of evidence for the long- these shed light on the effects of owner or client organizations on
term impacts of BIM adoption on the value achieved by public pro- BIM adoption, and by extension, none offer recommendations for
curement agencies motivated the pursuit of the longitudinal study specific adoption actions and their implications for construction
presented in this paper. By studying agencies’ adoption processes agencies.
in detail, following them for 3 years, and subsequently revisiting Organizations frequently limit their aspirations for BIM adop-
them for a detailed review of their development and outcomes, the tion to the short-term goals of project delivery—i.e., optimization
authors learned about the successes, failures, and mechanisms at of time, budget, quality, safety, and sustainability within the scope
Downloaded from ascelibrary.org by Heriot-Watt University on 11/07/22. Copyright ASCE. For personal use only; all rights reserved.

work. Case studies of three major public agencies in Israel and the of specific design and construction projects. McAuley et al. (2017)
United Kingdom—Israel Ministry of Defence (IMOD), Transport studied public organizations and found that 80% of the 100 sur-
for London (TfL), and Environment Agency (EA)—provided the veyed reported increased demand for BIM from their clients,
bulk of the data. The goal was to codify the experience gained by representing individual projects. Lam et al. (2017) developed a
the case study agencies in a form useful to similar public clients in framework for assessing the rewards and the risks associated with
formulating their future BIM adoption paths. This knowledge is BIM adoption from the point of view of small- and medium-sized
formalized in a BIM adoption impact map (BIM-AIM). The first enterprises, suggesting inter alia that such firms respond to client
version of the BIM-AIM (Gurevich et al. 2017) served both as demands rather than initiating BIM adoption themselves. The focus
a research tool and as the foundation for the development of the on project goals is also reflected in the BIM guides of many public
BIM-AIM 2.0, which is the practically applicable contribution procurement agencies. All of the ten guides reviewed by Sacks et al.
of the research. (2016) primarily listed project-level goals; the only long-term goals
The following section reviews the background of research on that appeared dealt with maintenance, albeit solely on a project
BIM adoption, the long- and short-term goals of BIM adoption, and level rather than system wide.
the BIM-AIM (which facilitates mapping of adoption processes However, project goals are short-term in the context of the
within and between organizations). Section Aims and Methods de- broader purposes of public procurement agencies. Issues such as
scribes the research methodology, tool development, measurement client end occupant satisfaction, system-wide operational and main-
parameters, and case study methods. Section Case Study Results tenance efficiency for an agency’s assets, better control over the sys-
summarizes the case studies, and they are discussed in Section tem and facility life-cycle cost (LCC), personnel development, and
Discussion. Sub-section BIM-AIM 2.0 presents the new BIM- environmental concerns are all long-term goals (MOD 2016). TfL,
AIM-2.0, and Section Conclusions provides conclusions and rec- for example, includes “Define, manage and continually improve the
ommendations for procurement agencies that plan to adopt BIM. information that supports decisions, ensuring it is controlled, acces-
sible and of the required quality” as one of 13 strategic asset man-
agement objectives (TfL 2018). Some researchers have identified
BIM Adoption Research the potential for BIM to support the long-term management of an
agency’s asset information and thus to achieve far-reaching benefits
BIM adoption is a subject of interest for researchers primarily due not only for the organization but also for its clients—the end users
to its potential impacts on construction organizations and construc- of facilities (Enache-Pommer et al. 2010; Gerrish et al. 2017;
tion projects. The scope of interest in IT adoption in the construc- Shoolestani et al. 2015). Dakhil et al. (2016) emphasized the value
tion industry extends beyond the technology to cover business, of information among the long-term benefits of BIM adoption.
engineering process, human resources, and information aspects Of their list of 16 drivers that motivate clients of all kinds to adopt
(Amor et al. 2002). The first port of call for most researchers is BIM, 13 relate primarily to the project phase, while three relate to
to examine the project level benefits of BIM, and examples abound, the value of information—its availability, accessibility, accuracy,
which some are listed in the introduction. However, from the per- control, and validity. All of these authors suggest that the use of the
spective of large public construction clients, patterns of adoption at information models provide end users with more suitable, healthier,
the organizational level must be considered as well as those at the and higher-quality facilities and infrastructure systems. Yet, in prac-
project level, and long-term benefits that extend beyond the project tice, there are limited examples of public procurement agencies that
level are also of central interest. have made such long-term goals explicit within their BIM adoption
Gu and London (2010) explored the product, process, and peo- policies.
ple aspects at the organizational level using a holistic approach,
but the conclusions of this work do not offer any specific recom-
mendations nor explanations regarding the BIM adoption process. Aims and Methods
Arayici et al. (2011) focused on the impacts of BIM adoption on
architects, specifically on the use of common design team BIM au- The aim of the research is to elucidate BIM adoption as it occurs
thoring tools (e.g., Revit, Archicad, and Allplan). Other research within public construction clients. Questions included: What ac-
efforts regarding strategies for BIM implementation have also con- tions were taken to promote BIM adoption? Were there any causal
centrated on a single type of design organization (Arayici et al. relationships between the agencies’ actions and the project and
2011; Eadie et al. 2013; Liao and Ai Lin Teo 2018; Smith 2014; organizational level outcomes? What was achieved, and what ac-
Wong et al. 2011). McAuley et al. (2017), in contrast, took a tions failed to deliver expected results?
broader view and studied the global BIM effort. They concluded The basic research method was longitudinal case-study re-
that the most important issues were: (1) contracts and procurement, search. The method required continuous access over a long period

© ASCE 05020008-2 J. Manage. Eng.

J. Manage. Eng., 2020, 36(4): 05020008


of time, and as a result, the number of case studies was limited. companies, designers, regulatory authorities, contractors, operators,
Initially, six agencies were selected, and their adoption patterns and end-users.
were assessed in a series of interviews with senior management. The BIM-AIM was used as a research tool through longitudinal
Five of these six were public construction agencies adopting BIM case studies. Interviewees at all levels (project and organization)
within the framework of the UK government BIM mandate, and were periodically asked to evaluate its actions and relationships to
the sixth was the engineering and construction division of the clarify which actions were and were not performed, what their im-
Israel Ministry of Defense. The five UK agencies were Highways pact was, and what if anything was lacking. This supplemented the
England (HE), Defence Infrastructure Organization (DIO), EA, other research tools, enabling rigorous data collection. It informed
Ministry of Justice (MoJ), and Transport for London/London all aspects of the study and eventually provided the evidence for
Underground (TfL). These five were selected for study due to their substantial revision of the BIM-AIM once the longitudinal studies
participation in the UK government BIM task force effort. They are were completed.
large government construction agencies, active in planning, design,
execution, development, and maintenance of building and infra- Measuring Agency Level Actions
Downloaded from ascelibrary.org by Heriot-Watt University on 11/07/22. Copyright ASCE. For personal use only; all rights reserved.

structure projects. The agencies’ portfolios represent a diverse cross


section of public project types, providing a broad perspective on The data collected to measure the agencies’ adoption actions were
BIM implementation. measures of the eight organizational actions defined in the BIM-
Given the limited research resources available for long term fol- AIM and are listed in Table 1. The measurements were made using
low up after the initial round of interviews (conducted in January a standard form in interviews with the leaders of BIM adoption
2016), the number of subjects was narrowed to the four whose within each of the three agencies. The interviewees were asked to
agency-level efforts were most advanced: IMOD, TfL, the UK EA, assess the degree to which each of the adoption actions listed in
and the UK Ministry of Justice (MoJ). Over the course of the study, Table 1 had been implemented using a four-point scale: none (0),
personnel changes at MoJ prevented continued access to study the partial (1), thorough (2), and full implementation (3). A composite
agency, thus leaving three: IMOD, TfL, and EA. They were fol- numeric score was calculated, giving equal weight to the score of
each aspect, and the scores were normalized to 100%. These data
lowed over a period of 2¾ years (33 months), with a review com-
collected refer to different points in time throughout the longitudi-
prising: (1) the adoption actions implemented, and (2) a set of
nal study so that the status of each agency could be traced.
17 project case studies. Nine detailed case studies were collected
from IMOD, and four were collected from both EA and TfL. The
projects were followed through a series of semi-structured inter- Assessing BIM Adoption
views with project managers, designers, and contractors. Finally, in
The agencies studied operate on two levels: that of the administra-
November 2018, concluding interviews were held with the BIM tion, including their head-office departments; and that of the projects
adoption leaders of each agency. through which they deliver services to their clients and the end-users
of the facilities they build, operate, and maintain. The projects them-
BIM Adoption Impact Map (BIM-AIM) selves have distinct identities and organizations, often setting their
own policies and practices. As such, one cannot simply refer to a
In the first stage of this work, the authors developed and published a level of BIM adoption achieved within an agency as each of its proj-
BIM-AIM (Gurevich et al. 2017) based on the interviews with the ects may achieve a level different from that of the others. Therefore,
initial six case study agencies. The BIM-AIM presents a set of pos- BIM adoption outcomes were assessed using two measures:
sible relationships between the actions taken by public construction 1. The maturity of each agency’s BIM adoption progress was mea-
agencies to promote BIM adoption, the immediate and intermediate sured using a composite questionnaire based on the BIM-AIM.
consequences of their actions, and the eventual achievement of This questionnaire was administered with the project-level inter-
value for the occupants of the facilities they build. The BIM-AIM viewees in all 17 projects. This resulted in a composite normal-
was designed to support public agencies to consciously design their ized score that reflected the project teams’ perceptions of the
routes to BIM adoption based on the collective experience of the support the agency provided to their project.
agencies studied in the research. The resulting first version of the 2. The maturity of BIM use in each project based on project
BIM-AIM included 118 diverse activities performed by seven actor managers’ evaluation of the project’s use of BIM tools and
types: owners (public procurement agencies), project management processes.

Table 1. Agency adoption actions


Name Description
Fund training Provide funding for in-house training, creating data resources, outsourcing, and other components.
Fund hardware and software Software and hardware purchase, software operation training programs.
Provide senior management leadership Senior managers of the agency direct themselves and their employees to invest time in training and developing
personal BIM abilities.
Prepare BIM object libraries Create organizational BIM object libraries to be used by the supply chain.
Provide BIM management training Outsourced training of project managers for BIM specific organizational needs.
Prepare a BIM guide Preparation of BIM guides that define the agency’s processes and information requirements.
Motivate project managers Enhance the perception of the potential benefits and the BIM actions needed to achieve project goals: preparation
of contracts, Owners’ Information Requirements documents, and other components.
Prepare a BIM execution plan (BEP) Define the desired modes of collaboration and information sharing, covering the roles and responsibilities of
template project partners, software and level of development (LOD) of the different aspects of the model, the management of
the model itself, quality control procedures, object composition, naming conventions, and other components.
Financial incentives Align remuneration of design teams with project design requirements.

© ASCE 05020008-3 J. Manage. Eng.

J. Manage. Eng., 2020, 36(4): 05020008


The BIM Handbook lists many models for measuring BIM with values for performance ranging from nonexistent (0) to initial
maturity (Sacks et al. 2018, Ch. 8). Among the better-known mod- (1), managed (2), defined (3), measured (4), and optimized (5).
els are the BIM maturity matrix (BIm) and competency sets (Succar
et al. 2013), TNO’s BIM QuickScan (van Berlo et al. 2012), own-
er’s BIMCAT (Giel and Issa 2013), BIM Scorecard (Kam et al. Case Study Results
2013), and Penn State’s Organizational BIM Assessment Profile
(CIC 2013). The ARUP BIM Maturity Measure (Arup 2014; In this chapter, we summarize the background, agency level mea-
Azzouz et al. 2016), selected for this research, is based on the Penn surements, and results of case studies of three public construction
State model. agencies (IMOD, TfL, and EA) and 17 of their projects (nine for
The measurement methods are defined in the following IMOD, four for TfL, and four for EA). The projects are listed in
subsections. Table 2. The documents collected, together with the interview and
questionnaire results, are unique records of the developments in
Project Perception of Agency BIM Maturity the agencies over the 33-month research period. All three agencies
Agency BIM maturity was evaluated using a set of 21 questions began their adoption with pilot projects. In parallel to the pilot
Downloaded from ascelibrary.org by Heriot-Watt University on 11/07/22. Copyright ASCE. For personal use only; all rights reserved.

that probed the project personnel’s perception of the support pro- projects, actions were taken at the organizational level to promote
vided to their project by the agency. The answer to each question and support project-level BIM adoption, and despite uniform be-
was scored on a scale from 1 to 5 according to a predetermined set ginnings, the adoption process occurred quite differently in each
of five possible responses for each question. The scores for each agency.
question were normalized on a scale set by the highest value en-
countered across all of the projects, and they were weighted to re-
The Engineering and Construction Division of the
flect the extent to which the agency had succeeded in each of the
Israel Ministry of Defense
actions defined in the BIM-AIM and listed in Table 1. The ques-
tions and the weighting scheme are provided in Appendix A. IMOD is the public agency responsible for the development,
design, construction, and maintenance of facilities including defense
Project BIM Maturity system structures and infrastructure. It plays a key role in the na-
Project-level BIM implementation was measured using a tool de- tional construction industry, with a very large annual budget for
veloped for ARUP by researchers at Penn State University (Arup new construction. IMOD is a large agency with many departments:
2014; Azzouz et al. 2016). Using this tool, ARUP assesses the so- project management, maintenance, budgets, information technol-
phistication of BIM use and the depth of its spread across the com- ogy, engineering and engineering control, infrastructure and deploy-
pany’s regional offices. Unlike other BIM project measurement ment, and training. IMOD published a BIM mandate in 2016,
tools that concentrate on aspects of project cost, quality, timing, calling for all projects to adopt BIM by the end of 2019. IMOD
and safety, the performance categories measured in the ARUP tool management defined the goal as follows: “to improve product
make it suitable for measuring project results in this context. The quality for end users in terms of asset erection and operation, while
areas covered include the storage of and access to information, 3D continuously improving design, operation, maintenance, and asset
coordination, collaboration, BIM execution plan (BEP), team ex- management outcomes.” Thus, information from the models was
perience, procurement and contracts, design reviews, information expected to improve the agency’s management of its assets.
deliverables, level of development (LOD), visualization, and 4D In March 2015, the division’s head appointed nine internal and
simulation. The tool covers all professional disciplines, and scores external BIM adoption teams—control, engineering, computeriza-
for each area and for each domain are assessed on a six-point scale tion, pilot projects, supervision, maintenance, training, steering,

Table 2. Agency and project list


Project name Description Duration (years) Scope
IMOD
Project A Civil infrastructure works (sewage, water, power, communications, roads, and sidewalks) 3 160,000 m2
Project B 10 buildings (office buildings, logistic building, dormitories, kitchen and dining room, and auditorium) 2.5 17,000 m2
Project C Seven three-story buildings 3 23,000 m2
Project D Clinic building 2 2,000 m2
Project E Design of three separate buildings in a head office ‘Big Room’–office building, clinic and warehouse 2 3,000 m2
Project F Civil infrastructure works (sewage, water, power, communications, roads, and sidewalks) 3 100,000 m2
Project G A two-story housing building and civil infrastructure 3 4,500 m2
Project H Industrial buildings 3 40,000 m2
Project I Clinic building 1 600 m2
TfL
Project J Underground Station upgrade project to handle 40% more passengers 5 £563 m
(previous capacity was 98 million passengers/year).
Project K Underground Station project for transportation upgrades 4 £200 m
Project L Underground Station project for transportation upgrades 3 £24 m
Project M Underground Station project for upgrade of the Grade II listed station and ticket hall 3 £65 m
EA
Project N Procurement of a barrier to reduce the risk of tidal flooding 3 £100 m
Project O Procurement of a barrier—prevent back-up of floodwater from the Foss 2 £17 m
when it meets the surge water of the Ouse.
Project P Procurement of a barrier project 3 £25 m
Project Q Environmental project in the city of London N/A N/A
Note: N/A = not applicable.

© ASCE 05020008-4 J. Manage. Eng.

J. Manage. Eng., 2020, 36(4): 05020008


aspects. This finding surprised the agency’s managers who invested
significant resources in actions to support BIM adoption and who
expected that the project teams would naturally adopt and imple-
ment the practices they inculcated in the earlier projects.
In retrospect, the project level interviews showed that the agency
emphasized value in the design and procurement phases and on
presentation to project clients, whereas the value of BIM use in the
construction and the operation and maintenance phases was ne-
glected. For instance, the contractors used a BIM model extensively
in a designated pilot project but not in the other projects studied.
The implicit understanding that the model was only useful in
design-determined behavior and of the lack of agency-level control
and lack of BIM competent staff on site led, project managers to
gloss over construction contractors’ failure to comply with contrac-
Downloaded from ascelibrary.org by Heriot-Watt University on 11/07/22. Copyright ASCE. For personal use only; all rights reserved.

Fig. 1. IMOD BIM maturity: Project BIM maturity versus agency


tual requirements to use the model once pressures built to get the
actions. project built on budget and on time.
In the concluding interviews, senior management revealed that
the level of organizational effort was reduced at the start of 2017
based on the premise that project managers follow the BIM proc-
esses defined in the agency’s procedures (BIM guide, BEP, and
contracts). Project managers felt that the management failed to ex-
plain the long-term benefits to the construction clients who found it
difficult to understand why they were required to budget more for
design. In addition, the process training was insufficient, and man-
agers lacked the tools to view models at the sites. The lack of con-
trols prevented agency managers from identifying the growing gaps
between formal procedures and actual practice. In mid-2018, man-
agement realized that the BIM potential was not being realized and
strengthened the agency’s BIM leadership role.

Transport for London


TfL is a local government agency responsible for the transportation
Fig. 2. IMOD BIM maturity: Project team perceptions of agency BIM system in the Greater London area, including the London Under-
maturity versus agency actions. ground. At the outset of BIM adoption, a department was established
with four employees to lead the adoption process. Management
chose people familiar with the organization who would learn and
and professional—that were entrusted with establishing suitable in- develop in the area of BIM rather than hire new employees with
frastructure and procedures in the various departments. Each team proven BIM capabilities but with no prior familiarity with the organi-
appreciated the advantages of BIM for its own area, but not for the zation. While recognizing the value of knowledge accumulated in
entire organization. BIM was perceived to be very beneficial to the the private sector, management was concerned that external entities
design process, but its use at the procurement and maintenance would fail to understand the unique character of the organization and
stages was not well understood. therefore preferred to empower people within.
Nine IMOD projects were investigated. Figs. 1 and 2 present The organization began the adoption process with no BIM
the results of the three measures defined in the Aims and Methods manual, information specifications for designers, or ordered a BIM
Section over time. Fig. 1 shows the agency actions measure and the adoption plan: the adoption team had to prepare all of these from
project teams’ perceptions of the BIM maturity of their projects, while scratch. Thus, in addition to accompanying the pilot projects and
Fig. 2 shows the same agency actions measure and the project teams’ training personnel, the team prepared a strategic adoption plan that
perceptions of the agency’s BIM maturity. While the scope of agency outlined the steps to be taken and the outcomes the organization
actions increased consistently over time, the project teams perceived expected to achieve (Brett 2016). This mapping was strategic and
an increase in maturity through the first 25 months and then a de- represented the organization’s needs and goals with respect to BIM
crease. After the first year of the adoption process, the agency ceased (the “what” and “when” rather than the “how”).
investing new resources in BIM adoption actions, expecting that the The team worked with and relied on the support of the UK BIM
mandate for BIM would force suppliers to adapt. In practice, agency Task Group. As in other agencies, the process began with trial and
managers, design firms, and project managers underestimated the error, pilot projects, and compilation of BIM manuals to establish
extent of the organizational preparations required. both internal procedures and guidelines for subcontracted suppliers.
Figs. 1 and 2 show that the organization began the adoption pro- A raft of practices and documents, such as the Employer’s Informa-
cess well. BIM coaches were provided to project teams, project tion Requirements (EIR), were stipulated for suppliers in the TfL
managers received training, hardware and software were provided, Supplier Handbook (Supplier Handbook 2018). These were de-
an agency BIM guide and accompanying BIM library were com- signed to reflect the organization’s needs and operational principles
piled, and templates for a BEP and contract documents were pro- in its demand for BIM but not the specific actions designed to enable
vided. Over time, however, the level of BIM maturity reported by the realization of BIM in projects or in the organization.
projects dropped, and project managers began reporting numerous At the time of the final review in January 2018, maintenance
problems that led them to abandon the use of BIM for some project works and permitting procedures still used 2D drawings rather than

© ASCE 05020008-5 J. Manage. Eng.

J. Manage. Eng., 2020, 36(4): 05020008


Downloaded from ascelibrary.org by Heriot-Watt University on 11/07/22. Copyright ASCE. For personal use only; all rights reserved.

Fig. 4. EA actions, project BIM maturity measures, and project team


Fig. 3. TfL agency actions, project BIM maturity measures, and project
perceptions of agency BIM maturity.
team perceptions of agency BIM maturity.

structures rather than on infrastructure. To overcome this obstacle,


BIM models. The agency did not restrict designers and contractors
EA managers decided to reinterpret BIM as a form of informa-
to use standardized model objects, but the requirements for infor-
tion management, helping the entire agency understand the overall
mation to be managed using models were very well defined. One of
objectives of BIM implementation. Specifically, they defined re-
the key objectives was to gather data on the city that would enable
quirements for delivery of as-built asset information including struc-
better transportation planning. The organization had implemented
ture geometry, topographic data, and as-built point clouds.
actions that were not considered in the original BIM-AIM:
Following the entry of the UK Government’s BIM mandate
• Pre-qualify designers (controlling the level of designers prior to
into force in April 2016, it became apparent that many suppliers
onset of the design process).
still lacked the knowledge and capability to provide information
• Integration of as-built model data into geographic information
in the required formats. Their lack of knowledge was shared by
systems (GISs).
Fig. 3 shows steady progress over time in the maturity of BIM project managers, who focused on immediate project values
use in the agency, although unsurprisingly, the level of maturity in (budget, time, quality, and safety) and could not be relied upon
individual projects lags the level measured for the organization. to enforce the information requirements. Management instituted a
BIM adoption actions have been pursued consistently, although policy that required design teams to submit their BIM deliverables
in December 2017, numerous possible actions remain for potential to centralized control. At the same time, the agency undertook to
implementation. The standard object libraries and the use of BIM better inform its suppliers concerning the entire process and its
models for permitting and approvals were considered. Despite the ultimate goal.
organization’s relatively advanced state, it continued to invest re- During the research period, we reviewed four projects to deter-
sources in BIM training and education at all levels from junior man- mine BIM maturity on the organizational and project levels. The
agers to senior executives. results are shown in Fig. 4. The charts reveal uniform perceptions
of progress in BIM maturity from the project and the organizational
perspectives, and progress follows the pace of actions taken by the
UK Environment Agency agency.
The EA is responsible for environmental regulation and the oper- The charts show a positive and consistent trend overall but
ation and maintenance of some 30,000 assets. At any given time, do not reveal the problems encountered. The understanding that
the organization has approximately 500 active projects and 1,000 many suppliers were unable to adopt the BIM requirement within
employees, and of whom, some 160 are project managers. The UK a short period of time led the organization to rearrange the organi-
government mandate was the main driver for BIM adoption. At the zational BIM requirements and prioritize them. To support project
start of adoption, the agency had no relevant standards and empha- managers, the agency established a uniform standard Informaion
sis was placed on 3D design and production of 2D construction Delivery Plan document for all projects, thus avoiding rework.
drawings. From January 2016, BIM was required by contract in Although the agency was unwilling to increase fees for BIM de-
all new projects of £250,000 or more, and a designated BIM man- sign, it recognized the shift in work and now budgets the BIM pro-
ager was employed to manage the initiative. Responsibility for the cess at an earlier stage in the tender process.
training of junior employees was entrusted to project managers who Another problem was that designers often withheld models from
had gained experience. contractors. This meant rework and human error as contractors cre-
Over time, EA management began identifying the added value ated their own models and, in some cases, forced project engineer-
for the organization and established a core goal of controlling in- ing teams to coordinate among 2D drawings, design models, and
formation about its assets, with a strong emphasis on improving construction models. Contractors, in contrast, understood the poten-
operations and maintenance. They struggled with the definition tial of BIM for all project types and were willing to share informa-
of BIM in that the term refers to buildings: unlike other government tion with project managers. Thus, in Design Build projects, better
construction agencies, EA builds conduits, dams, water ways, and collaboration was achieved.
other such elements, but not many buildings. Through their work As experience accumulated, management identified model-
processes, the teams manage some 10,000 documents a month based analyses and simulations that added significant value and
throughout the organization. Available BIM standards did not began requiring their use in projects. Construction teams used
suit the nature of most EA projects mainly because they focus on laser scanning and other tools to document quality and as-built

© ASCE 05020008-6 J. Manage. Eng.

J. Manage. Eng., 2020, 36(4): 05020008


information, which could then be repackaged for operation, main- organizational leadership encouraged suppliers to produce digital
tenance, and future design tasks. These actions gave the organiza- information of value to the agencies. The suppliers understood
tion a significant performance benefit. the value of the information and the implications for the ways they
As of January 2018, the EA still had gaps with respect to per- work.
mitting, standard object libraries and training. Despite these gaps, This mixed evidence underlines that agency adoption actions do
the organization had begun collecting thorough as-built informa- not necessarily ensure better project and/or agency BIM perfor-
tion in a common asset information platform that supports organi- mance. Rather, some actions are critical, enabling and/or amplify-
zational decision making. ing the effect of others, codependent, or of less or no significance
and may in fact squander an organization’s resources. For example,
careful and thorough preparation of a set of asset information re-
Discussion quirements and proactive management leadership resonate and am-
plify the impact of other agency actions, such as training; creation
Interaction of BIM Adoption Actions of a BIM object library by an agency requires the investment of
Downloaded from ascelibrary.org by Heriot-Watt University on 11/07/22. Copyright ASCE. For personal use only; all rights reserved.

considerable resources and appears to be of marginal value.


The original BIM-AIM model embodied the implicit assumption Specifically, in reviewing the evidence from all three agencies
that actions that an organization undertakes to promote BIM adop- mapped onto the BIM-AIM, five of the adoption actions contem-
tion result both in better information at the organizational level and plated in the BIM-AIM were not standard practice in any of the case
greater BIM maturity in the organization’s projects. Indeed, the TfL study agencies, and seven others were found to amplify BIM adop-
and EA case study results show trends that suggest incremental im- tion. The five actions not performed by any of the agencies were
provement in project BIM maturity in parallel with proactive steps • agency control and measurement of BIM performance across
taken by the agencies. However, any assumption of direct causation projects,
is undermined by the richer evidence from IMOD and by the so- • review of actual post-occupancy performance to determine ac-
phistication of the first project in the TfL set. curacy of asset/building performance predicted by BIM analy-
During the first half of the period examined, the process in sis tools,
IMOD showed the same trend as that observed for the other two • monitoring design efficiency by measuring cost and duration,
organizations. However, during the second half, despite continued • training of permitting bodies, and
action at the organization level, results are mixed: some project man- • distribution of BIM object libraries and enforcement of their
agers perceived a significant decline in agency BIM maturity. The use.
first TfL project was exceptional, with BIM maturity significantly Actions found to amplify BIM adoption were
higher than the norm for the organization at the time, suggesting that • Leadership and control influences employees’ behavior signifi-
individual projects can perform well with little dependence on the cantly. A clearly stated, well-motivated and consistent require-
agency’s actions. ment to use BIM is essential, reinforcing for project managers
Despite the efforts that IMOD management made to implement and service providers that BIM-related demands will not change
most of the agency actions represented in the BIM-AIM, the con- from one project to the next. This result aligns with the findings
tinuity of BIM maturity among its projects was not assured. Some of Wang and Song (2017), albeit in the context of design firms,
examples of the dissonance are as follows: who found that top management support was positively and sig-
• The agency invested significant resources to establish a Big nificantly associated with BIM user satisfaction, which in turn
Room for Project E, including agency employees’ time, furnish- drove adoption and implementation.
ing of work areas, software, and hardware. The architects and • Early inclusion of suppliers in BIM adoption proved highly
engineers employed in the project created libraries of standard effective in the EA, whose needs definition was complex. In
BIM objects, but the agency failed to adopt the libraries as stan- some IMOD projects, the BIM requirements were not shared
dard practice. Thus, potential benefits pertaining to standardiza- with suppliers, and interpretations of the required BIM products
tion and definition of information requirements were squandered. changed from project to project.
• Despite contract clauses requiring work with BIM, a lack of ef- • BIM management training for project managers is important and
fective information quality assurance procedures, coupled with critical. An introduction to the potential functionality of BIM
ineffective definition of the information goals for the agency tools when used correctly indeed proves essential in motivating
beyond the level of individual projects, led to project managers them and maintaining discipline and commitment. Such training
acquiescing to the immediate pressures applied by design of- programs may be frontal, like at the IMOD, or integrative, like at
fices and contractors in their projects to complete parts of their the EA. There is no guarantee that project managers will realize
projects using traditional computer-aided design (CAD) meth- the vision of working with BIM because project-level BIM ob-
ods. In IMOD’s Project D, the architect said that “Only half of jectives are not necessarily aligned with project objectives; train-
the project team worked with BIM. The model manager failed to ing must, therefore, focus on the connections between achieving
close the gap and it caused us to work half of the time with BIM both organizational and project goals when realizing design and
and half of the time without. In fact, the project manager gave up construction using BIM.
on BIM when we fell behind schedule”. • Direct support for project managers derives from training and
• Model managers were required to prepare a BEP together with complements it. The training process at TfL was most effective
the project team. The plans were prepared in most of the proj- since project managers learned tools through the direct support
ects, but the teams did not fully implement them. of projects. Project managers remained motivated and future
At the EA, in contrast, significant efforts were invested in lead- value for the agency was ensured.
ership, internal education and guidance, inclusion of supply chain • Preparation of an owner’s information model (OIR). Without a
partners in defining processes and detailed asset information re- contractual document that sets out requirements and objectives,
quirements, and screening of designers and contractors accord- teams often misinterpret BIM requirements. The OIR sets the
ing to their capability and capacity for work with BIM. Interviews standard across an agency’s projects for the delivery of uniform
with suppliers of TfL and EA revealed that collaboration and and thus valuable, information.

© ASCE 05020008-7 J. Manage. Eng.

J. Manage. Eng., 2020, 36(4): 05020008


• Payment for using BIM. All three organizations began adop- requirements where project managers were lax. Many projects
tion with the assumption that the transition requires no addi- lapsed into shadow BIM modeling of designs done in 2D CAD,
tional payment to design firms. As adoption progressed and resulting in meeting formal contract requirements to provide mod-
expectations for the information required formed, agencies els, but without any of the process benefits. This reflects a product-
learned that the provision of digital information rather than oriented (IMOD) versus a process-oriented (EA and TfL) cultural
drawings requires professional resources that imply increased preference. Where BIM is concerned, the different outcomes under-
cost for design and information management. These processes line that focus on process is essential.
must be budgeted for early on in the BIM adoption process.
• Coordination of expectations and information sharing. The re-
luctance to share domain models limits the ability to connect the Long-Term Value Versus Short-Term Value
pieces to form a complete, comprehensive picture of a project. Many studies on BIM address the benefits of streamlined design and
Fears of professional liability for error restrict the provision of control processes (Azhar et al. 2011; Miettinen and Paavola 2014;
discipline design models to contractors. All three agencies cre- Sacks et al. 2018; CURT 2010) in projects. Others focus on the added
ated model-delivery and sharing mechanisms that helped allay
Downloaded from ascelibrary.org by Heriot-Watt University on 11/07/22. Copyright ASCE. For personal use only; all rights reserved.

value of the modeling process, such as reduced project durations,


fears and encourage the sharing of detailed information. more accurate cost estimates, and less production waste. Very few,
however, discuss long-term information benefits for the organization.
Evidence of achievement of these short-term benefits was found
Sources of Motivation in all of the three agencies’ projects. IMOD’s actions focused ex-
The EA and TfL participated in the UK BIM Task Group (Blackwell clusively on improving project outcomes. Aksenova et al. (2019)
2012; CIC 2019) and derived significant advantages from it. When found a similar effect in the Finnish AEC industry, concluding that
the case studies began, both agencies already had BIM standards and BIM adoption had achieved local improvements in project produc-
a BIM mandate for their designers. The IMOD, in contrast, began its tivity but had no systemic effect on the industry at large, nor had it
journey as the lone public agency in its local industry seeking to provided valuable data assets for client agencies.
adopt BIM. The EA and TfL aspired to achieve BIM Level 2 in all However, it can also be otherwise. Data stored over time enable
of their projects. Both were strongly motivated by the UK gov- the creation of new information and knowledge (Cooper 2017). For
ernment BIM mandate, which required the implementation of BIM example, an agency can be expected to generate experiential knowl-
in all government projects by April 2016. Unlike EA and TfL, edge from information on the actual energy consumption modes of a
IMOD faced no government mandate or indeed any other demand building, which then guides the agency’s future design and opera-
to implement BIM. The primary motivation derived from the head tion policies. The deeper value for the organization comes from the
of the organization, who decided to adopt BIM using all available knowledge derived from the information that has been created and
means to optimize the organization’s function. With consistent stored, enabling it to act in the future in a better educated manner.
leadership, he overcame project managers’ fears and objections re- Knowledge from information on the failures and/or successes of past
garding increased costs and extended schedules. The head invested designs, comparing actual with predicted performance, is applied
personal time and appointed an agency BIMM director to adopt stan- in the design of future facilities. The knowledge is also applied to
dard BIM requirements within the first year of adoption. Only when efficient operation and maintenance of buildings and their systems.
information requirements and specifications were complete, and A clear manifestation of this was found in the EA case study. The
project managers had undergone training, did pilot projects begin EA has a digital network control system that enables project man-
bearing fruit. However, in the second half of the study period, lead- agers to report project progress in real time. In the EA’s flood pro-
ership attention turned elsewhere and the director’s position became tection project, management systematically monitored the progress
vacant. Although project managers continued to require BIM from of each subproject and data gathered during execution enabled later
the design and construction teams, they failed to properly control the analysis. For example, as-built LIDAR scans are routinely compared
deliverables and the level of BIM maturity regressed. with follow-up scans to map deficiencies and locate gaps over time.
Although the UK mandate was the primary driver for EA’s TfL preserved information acquired during construction using sim-
adoption of BIM, as time passed, management motivation drew in- ilar means: integration of information from BIM models, photo-
creasingly more from the positive perception of the value for the graphic images, and LIDAR scans into its GIS systems. TfL’s GIS
preservation of asset information and organizational knowledge system, supplemented with this information, supports decision-
and less from the fear of budget cuts. BIM leaders at TfL stood making for the development of the city’s transportation system.
out, compared with the other agencies, in their structured approach The focus on the agency as a whole and its information needs,
to mapping the agency’s processes and needs. BIM leaders at EA rather than on specific projects, enables the organization to outline
acted with no ordered adoption plan but undertook all of the steps broad information management processes. This aligns with Dakhil
taken by the other agencies. BIM leaders at IMOD executed an et al.’s list of BIM benefits in which the three benefits that apply
ordered adoption plan during the first half of the adoption 3-year beyond the project lifetime all relate to the value of information
adoption period, but they lost momentum and the agency regressed (Dakhil et al. 2016). Data enable organizations to monitor the
during the latter half. depreciation rate of structures, asset quality, and even suitability
EA BIM leaders emphasized communication with entities out- of facilities to user needs. This fundamental value can only be real-
side the organization, directing their actions toward their suppliers ized by driving processes of data storage, data analysis to generate
and collaborating with them to compile guidelines. TfL and IMOD, information, and, later on, knowledge derivation.
in contrast, developed requirements internally. All three incorpo-
rated procedural and information requirements (OIR) in their con-
BIM-AIM 2.0
tract documents, expecting that this would be the prime motivating
factor for their design and construction supply chains. However, As a result of these insights, a new version—BIM AIM 2.0—was
cultural differences led to different outcomes. In contrast with compiled. Fig. 5 shows that BIM AIM 2.0 is defined using IDEF0
the discipline of EA and TfL suppliers in conforming to process notation (NIST 1993), representing not only the inputs and outputs
requirements, IMOD suppliers often sought to evade fulfilling of each action, but also the controls that govern their execution and

© ASCE 05020008-8 J. Manage. Eng.

J. Manage. Eng., 2020, 36(4): 05020008


Downloaded from ascelibrary.org by Heriot-Watt University on 11/07/22. Copyright ASCE. For personal use only; all rights reserved.

© ASCE
05020008-9

J. Manage. Eng., 2020, 36(4): 05020008


Fig. 5. First level of the BIM-AIM 2.0 defined in IDEF0.

J. Manage. Eng.
the resources required for them. It identifies actions that generate The accumulated value takes the form of information, and not
long-term value, high-impact or amplifying actions, less important only project-level outcomes—the organizational assets that did not
actions, and it classifies actions according to context (actions refer- exist previously. The need for digital assets is not obvious and re-
ring to people, technology, process, and/or information). quires organizational maturity, in turn requiring sufficient invest-
The following actions were added in BIM-AIM 2.0: ment in the creation of such assets.
• Preparing OIR: A document specifying objectives and BIM re- Long-term value of information value. Although this study was
quirements at the agency level (this was previously present only originally framed to study the impact of an agency-initiated and
as a project-level action). agency-led BIM adoption process on the local project outcomes
• Prequalification of design and construction firms for BIM cap- for end users of the built assets it procured, the results highlight
ability and capacity. the long-term value that public agencies can derive from the infor-
• Agency level monitoring and control of BIM processes within mation defining their assets that can be collected during project
projects through inspection of agency project managers’ com- BIM implementations. This value is manifested in the accumula-
pliance with processes. tion of data in a comprehensive information system describing an
• Agency level inspection and control of inputs into the agency’s agency’s facilities and their operation, and it extends well beyond
Downloaded from ascelibrary.org by Heriot-Watt University on 11/07/22. Copyright ASCE. For personal use only; all rights reserved.

information systems from project information. This includes, the more familiar values of BIM for construction projects, which
for example, inspection and review of point clouds, images, manifest in the budget, time schedule, quality, and safety of indi-
model geometry, and alphanumeric data. vidual projects. Such information systems enable agencies to ana-
The BIM-AIM 2.0 can be used by organizations that lack the lyze the data, run predictive simulations, and generate information
time, resources, or knowledge for an extended period of self-study. to support decision-making with far-reaching consequences. Find-
Such organizations will find the map to be valuable, particularly ings from the EA and TfL case studies underline the value inherent
early on when defining their goals at the beginning of the adoption in a comprehensive, in-depth, and detailed data base of an agency’s
process from an understanding of the potential end effects. Using assets. In contrast, the IMOD was not ready to benefit from that
the map will also support organizations in planning what actions to value, and it was not realized.
implement to achieve their goals. Motivation. The value of an agency’s decision to transition to
BIM is not enough to ensure implementation or lasting effect. All
adoption actions must be backed-up by a concerted, continuous, and
Conclusions sustained leadership effort by an agency’s head and senior manag-
ers. A national or governmental BIM mandate is of great value, as
In this 33-month longitudinal study, case study data were collected can be seen in the significant advantages that the TfL and the EA
from 17 projects of three large public construction agencies, using derived from the UK government BIM mandate in terms of both
in-depth interviews and structured questionnaires framed by the motivation and practical support through the UK BIM task force.
BIM-AIM. At the time of the study, the IMOD was the single largest In this context, a mature perception of the value of agency-level in-
construction client in the country. The EA and TfL, like the IMOD, formation needs is a strong motivating factor at the project level.
are also significant public clients in the construction industries in Need for agency-level information requirements. The experi-
which they operate. All three have in-house construction procure- ence of all three agencies supports the argument in favor of the
ment departments, and the conclusions address this client type. preparation of a detailed set of owner’s information requirements
Nevertheless, it is likely that public clients using out-sourced client (OIR) at the agency level rather than delegating this to the project
representatives will also find the conclusions relevant and applicable. level BEP (as is common practice in many agencies). The uniform-
This work is the first to provide a theoretical basis and practical ity of requirements is necessary to ensure compatibility of the in-
tools for BIM adoption by public construction agencies. Prior to this formation delivered at project handover for incorporation into an
research, the cause and effect relationships between agencies’ pro- agency’s digital twin database representing its assets and their op-
active BIM adoption efforts and the resulting impacts on the proj- eration. An agency OIR also avoids possible negative consequen-
ects in their portfolios could only be surmised (Khosrowshahi and ces of leaving the information demands to the discretion of project
Arayici 2012; Lindblad 2019; Silva et al. 2016). Some agencies in- managers. A corollary of creating and maintaining an agency-level
deed fail to appreciate, or are unaware of, the value they can gain as OIR is that the agency must retain a professional BIM manager
facility operators from the mere requirement to use BIM in the proj- who understands the work processes within and outside the agency.
ects they procure beyond the short-term benefits at the individual Similarly, it provides the foundation for agency level monitoring of
project level (such as high-quality design information, shortening of information deliverables in projects, and this is essential in business
design and execution durations, and prevention of waste due to re- cultures that do not prioritize standardized procedures.
work in construction—Bryde et al. 2013; Lehtinen 2012; Sacks et al. The revised, comprehensive BIM-AIM 2.0 model is a practical
2018). The following paragraphs highlight the study’s key findings. outcome of the study. Exposure of the first version of the BIM-AIM
Impact of adoption promotion actions. The case study results to scrutiny in all case studies showed that BIM managers through
showed in a qualitative and quantitative manner that there is a pos- its use as a research tool provided the opportunity to fine tune the
itive correlation between the investment in BIM at the organizational model, making it representative of the full gamut of BIM adoption
level and the maturity of BIM implementation achieved at the project actions evidenced in the case studies. Public construction owners
and organization received. However, it is equally clear that this is not can use the BIM-AIM 2.0 as a tool for planning their BIM adoption
a linear relationship and that individual actions are codependent and processes and for reviewing the ongoing performance of BIM
vary greatly in their impact. The whole is greater than the sum of its adoption programs.
parts, and the EA did not execute all of the possible actions, but EA In conclusion, this work has revealed the value that engineering
achieved successful adoption. The IMOD acted in all areas mapped managers in all organizations engaged in public construction can
by the original BIM-AIM, but over time, various concessions by in- derive from effective management of BIM adoption: short-term
sufficiently prepared and trained project managers led to degradation economic and schedule benefits in projects and long-term benefits
of the quality of the outcomes in its projects. It is evident some from knowledge and information retained in the organization and
actions have significantly more effect than others. across the supply chain.

© ASCE 05020008-10 J. Manage. Eng.

J. Manage. Eng., 2020, 36(4): 05020008


Downloaded from ascelibrary.org by Heriot-Watt University on 11/07/22. Copyright ASCE. For personal use only; all rights reserved.

Appendix. Project Level Perception of Agency and Project BIM Maturity

© ASCE
Client action areas
Design BIM use
Managers’ control in the
Organizational Level of Standardization & Leadership understanding & Organizational (review & Client construction End user Total
Project level interview questions BIM Guide training BIM libraries encouragement commitment funding feedback) satisfaction stage satisfaction (%)
Agency BIM maturity questions
What proportion of your agency’s employees — — — 1.25% — — — — — — 1.25
were exposed to BIM?
What proportion of your agency’s project — — — — 0.63% — 1.11% — — — 1.74
managers are able to run a BIM project?
What BIM training has the project manager — 1.67% — — — — — — — — 1.67
had?
Do you use BIM in any project? — — — — 0.63% — — — — — 0.63
What do you use BIM tools for? — — 1.00% — 0.63% — 1.11% — — — 2.74
What proportion of the agency’s projects — — — 1.25% — — — — — — 1.25
require BIM (a percentage)?
How long ago was the decision taken to adopt — — — 1.25% 0.63% 1.67% — — — — 3.54
BIM?
Who decided to adopt BIM in the agency? — — — 1.25% — 1.67% — — — 2.00% 4.92
Has an adoption goal been defined? — — — 1.25% — — — — — — 1.25
Do junior management require the use of BIM — — — 1.25% — — — — — — 1.25
in projects?
Is there a contractual requirement for the 2.50% — — — 0.63% — 1.11% — — — 4.24
design team to use BIM?
Does the agency have a BIM guide? 2.50% 1.67% 1.00% — — — — — — — 5.17

05020008-11
How familiar are you with the guide? Have — 1.67% 1.00% — 0.63% — — — — — 3.29
you implemented it?
Does the agency have a standard BEP? 2.50% — 1.00% — — — — — — — 3.50
Is the BEP dictated by the agency or prepared — — 1.00% — 0.63% — — — — — 1.63

J. Manage. Eng., 2020, 36(4): 05020008


by the project partners?
Has the organization purchased BIM software — — — — — 1.67% — — — — 1.67
and equipment for projects?
Has the agency provided one or more Big — — — — — 1.67% — — — — 1.67
Rooms for collaborative design?
Does the agency have modelling standards? — — 1.00% — — — 1.11% — — — 2.11
Does the agency pay more for projects using — — — — — 1.67% — — — — 1.67
BIM?
Has the agency supported its suppliers in — 1.67% — 1.25% — 1.67% — — 1.67% — 6.25
upgrading to BIM?
Does the agency require contractors to use — — — — 0.63% — — — 1.67% — 2.29
BIM?
Project BIM maturity questions
Is BIM used in your project? — — — 1.25% 0.63% — — — — 2.00% 3.88
Who decided to adopt BIM in the project? — — — — 0.63% — — 2.50% 1.67% 2.00% 6.79
Does the client participate in the design — — — — — — 1.11% 2.50% — 2.00% 5.61
process?
Is the model shared with the client? — — — — — — 1.11% 2.50% — 2.00% 5.61
Do the design consultants who don’t model — 1.67% 1.00% — — — 1.11% — — — 3.78
themselves, use the model?

J. Manage. Eng.
construction End user Total

1.74

3.40

2.29

3.29
3.29

3.50
3.13
satisfaction (%)
Data Availability Statement

100
All data, models, and code generated or used during the study
appear in the published article.



10%
Acknowledgments
BIM use

1.67%

1.67%
1.67%
in the

stage
— The authors gratefully acknowledge the contributions of the man-


10%
agement, project managers, and agency BIM leaders of the EA, TfL
and the Israel Ministry of Defense in providing extensive access to
their projects and participating in interviews over the full course of
feedback) satisfaction

2.50%
Client

the research.


10%
Downloaded from ascelibrary.org by Heriot-Watt University on 11/07/22. Copyright ASCE. For personal use only; all rights reserved.

References
understanding & Organizational (review &
Design
control

1.11%

1.11%




Ahmed, A. L., and M. Kassem. 2018. “A unified BIM adoption taxonomy:

10%
Conceptual development, empirical validation and application.” Autom.
Constr. 96 (Dec): 103–127. https://doi.org/10.1016/j.autcon.2018.08
.017.
Aksenova, G., A. Kiviniemi, T. Kocaturk, and A. Lejeune. 2019. “From
funding



Finnish AEC knowledge ecosystem to business ecosystem: Lessons


10%
Client action areas

learned from the national deployment of BIM.” Constr. Manage. Econ.


37 (6): 317–335. https://doi.org/10.1080/01446193.2018.1481985.
Al Sayed, K., M. Bew, A. Penn, D. Palmer, and T. Broyd. 2015. “Modelling
dependency networks to inform data structures in BIM and smart
commitment
Managers’

cities.” In Proc., 10th Space Syntax Symp. (SSS10), edited by K. Karimi,


0.63%

0.63%

0.63%

0.63%
0.63%

0.63%

L. Vaughan, K. Sailer, G. Palaiologou, and T. Bolton, 90:1–90:15.


10%

London: Space Syntax Laboratory, The Bartlett School of Architecture,


Univ. College London.
Amor, R., M. Betts, G. Coetzee, and M. Sexton. 2002. “Information tech-
encouragement

nology for construction: Recent work and future directions.” J. Inf.


Leadership

Technol. Constr. 7 (16): 245–258.




Arayici, Y., P. Coates, L. Koskela, M. Kagioglou, C. Usher, and


10%

K. O’Reilly. 2011. “BIM adoption and implementation for architec-


tural practices.” Struct. Surv. 29 (1): 7–25. https://doi.org/10.1108
/02630801111118377.
Organizational Level of Standardization &

Arup. 2014. “BIM maturity measure v1.00.” Accessed October 1, 2019.


BIM libraries

https://www.arup.com/-/media/arup/files/publications/b/copy-of-123456
1.00%
1.00%

1.00%

-bim-maturity-measure-ver-100by-arup.xlsm.

10%

Azhar, S. 2011. “Building information modeling (BIM): Trends, bene-


fits, risks, and challenges for the AEC industry.” Leadersh. Manage.
Eng. 11 (3): 241–252. https://doi.org/10.1061/(ASCE)LM.1943-5630
.0000127.
training

Azzouz, A., A. Copping, P. Shepherd, and A. Duncan. 2016. “Using the


1.67%



10%

ARUP BIM maturity measure to demonstrate BIM implementation in


practice.” In Proc., 32nd Annual ARCOM Conf., edited by P. W. Chan
and C. J. Nielson, 25–34. Manchester, UK: Association of Researchers
BIM Guide

in Construction Management.
2.50%

Bew, M., T. Broyd, H. Shayesteh, and K. Al-Sayed. 2015. Digital built



10%

Britain Level 3 building information modelling—Strategic plan.


London, UK: HM Government.
Blackwell, B. 2012. Building information modelling—Industrial strategy:
What is the source for construction documents

Government and industry in partnership. Dept. for Business, Innova-


Do model access permissions differ across

tion and Skills, HM Government, London, UK.


Do you feel that design productivity was
As a project manager, have you received

Is the model shared with the contractor?

Brett, M. 2016. TfL building information modelling (BIM) strategy.


London, UK: Transport for London (TfL).
Does the contractor have modeling

Bryde, D., M. Broquetas, and J. M. Volm. 2013. “The project benefits of


Project level interview questions

responsibilities? What are they?

building information modelling (BIM).” Int. J. Project Manage. 31 (7):


971–980. https://doi.org/10.1016/j.ijproman.2012.12.001.
Appendix. (Continued.)

Cao, D., H. Li, G. Wang, X. Luo, and D. Tan. 2018. “Relationship network
Is there a project BEP?

structure and organizational competitiveness: Evidence from BIM


implementation practices in the construction industry.” J. Manage.
training in BIM?

Eng. 34 (3): 04018005. https://doi.org/10.1061/(ASCE)ME.1943-5479


and drawings?

.0000600.
Total scores

Chan, D. W. M., T. O. Olawumi, and A. M. L. Ho. 2019. “Perceived


improved?
designers?

benefits of and barriers to building information modelling (BIM) im-


plementation in construction: The case of Hong Kong.” J. Build. Eng.
25 (Sep): 100764. https://doi.org/10.1016/j.jobe.2019.100764.

© ASCE 05020008-12 J. Manage. Eng.

J. Manage. Eng., 2020, 36(4): 05020008


Cheng, J. C., and Q. Lu. 2015. “A review of the efforts and roles of the in architecture, engineering and construction, edited by G. Gudnason
public sector for BIM adoption worldwide.” J. Inf. Technol. Constr. and R. Scherer, 439–446. Reykjavik, Iceland: CRC Press.
20: 442–478. Liao, L., and E. Ai Lin Teo. 2018. “Organizational change perspective
CIC (Construction Industry Council). 2013. BIM planning guide for facility on people management in BIM implementation in building projects.”
owners. State College, PA: Pennsylvania State Univ. J. Manage. Eng. 34 (3): 04018008. https://doi.org/10.1061/(ASCE)ME
CIC (Construction Industry Council). 2019. “Building information model- .1943-5479.0000604.
ling (BIM) task group.” Accessed October 25, 2019. http://cic.org.uk Lindblad, H. 2019. “Black boxing BIM: The public client’s strategy in BIM
/projects/project.php?s=building-information-modelling-bim-task-group. implementation.” Constr. Manage. Econ. 37 (1): 1–12. https://doi.org
Cooper, P. 2017. “Data, information, knowledge and wisdom.” Anaesth. /10.1080/01446193.2018.1472385.
Intensive Care Med. 18 (1): 55–56. https://doi.org/10.1016/j.mpaic Ma, P., S. Zhang, Y. Hua, and J. Zhang. 2020. “Behavioral perspective
.2016.10.006. on BIM postadoption in construction organizations.” J. Manage.
CURT (The Construction Users Roundtable). 2010. “BIM implementation: Eng. 36 (1): 04019036. https://doi.org/10.1061/(ASCE)ME.1943-5479
An owner’s guide to getting started.” Accessed April 1, 2019. https:// .0000729.
www.yumpu.com/en/document/read/19432985/bim-implementation-an Matta, C., K. Kam, and T. Graves. 2007. GSA BIM guide series 01 – The
-owners-guide-to-getting-started. national 3D-4D-BIM program. Office of the Chief Architect, Public
Downloaded from ascelibrary.org by Heriot-Watt University on 11/07/22. Copyright ASCE. For personal use only; all rights reserved.

Dainty, A., R. Leiringer, S. Fernie, and C. Harty. 2017. “BIM and the Buildings Service, US General Services Administration, Washington,
small construction firm: A critical perspective.” Build. Res. Inf. 45 (6): DC.
696–709. https://doi.org/10.1080/09613218.2017.1293940. McAuley, B., A. Hore, and R. West. 2017. BICP global BIM study-lessons
Dakhil, A., J. Underwood, and M. Al Shawi. 2016. “BIM benefits-maturity for Ireland’s BIM programme. School of Surveying and Construction
relationship awareness among UK construction clients.” In Proc., Management, Dublin Institute of Technology, Dublin, Ireland.
First Int. Conf. of the BIM Academic Forum, 14. Glasgow, Scotland: Miettinen, R., and S. Paavola. 2014. “Beyond the BIM utopia: Approaches
Glasgow Caledonian Univ. to the development and implementation of building information mod-
Davies, R., and C. Harty. 2013. “Implementing ‘Site BIM’: A case study of eling.” Autom. Constr. 43: 84–91.
ICT innovation on a large hospital project.” Autom. Constr. 30 (Mar): MOD (Ministry of Defence). 2016. “A better defence estate.” Accessed
15–24. https://doi.org/10.1016/j.autcon.2012.11.024. June 9, 2019. https://assets.publishing.service.gov.uk/government
Eadie, R., H. Odeyinka, M. Browne, C. McKeown, and M. Yohanis. 2013. /uploads/system/uploads/attachment_data/file/576401/Better_Defence
“An analysis of the drivers for adopting building information model- _Estate_Dec16_Amends_Web.pdf.
ling.” J. Inf. Technol. Constr. 18: 338–352. NIST. 1993. Integration definition for function modeling (IDEF0).
Gaithersburg, MD: NIST.
Enache-Pommer, E., M. J. Horman, J. I. Messner, and D. Riley. 2010.
Papadonikolaki, E. 2018. “Loosely coupled systems of innovation: Align-
“A unified process approach to healthcare project delivery: Synergies
ing BIM adoption with implementation in Dutch construction.” J. Man-
between greening strategies, lean principles, and BIM.” In Proc., Con-
age. Eng. 34 (6): 05018009. https://doi.org/10.1061/(ASCE)ME.1943
struction Research Congress 2010: Innovation for Reshaping Con-
-5479.0000644.
struction Practice, 1376–1405. Reston, VA: ASCE.
Sacks, R., C. M. Eastman, G. Lee, and P. Teicholz. 2018. BIM handbook:
Gerrish, T., K. Ruikar, M. Cook, M. Johnson, M. Phillip, and C. Lowry.
A guide to building information modeling for owners, designers, engi-
2017. “BIM application to building energy performance visualisation
neers, contractors and facility managers. Hoboken, NJ: Wiley.
and management: Challenges and potential.” Energy Build. 144 (Jun):
Sacks, R., U. Gurevich, and P. Shrestha. 2016. “A review of building in-
218–228. https://doi.org/10.1016/j.enbuild.2017.03.032.
formation modeling protocols, guides and standards for large construc-
Giel, B. K., and R. R. A. Issa. 2013. “Return on investment analysis
tion clients.” J. Inf. Technol. Constr. (ITCon) 21: 479–503.
of using building information modeling in construction.” J. Comput.
Shoolestani, A., B. Shoolestani, T. Froese, and D. J. Vanier. 2015. “Socio-
Civ. Eng. 27 (5): 511–521. https://doi.org/10.1061/(ASCE)CP.1943
BIM: BIM-to-end user interaction for sustainable building operations
-5487.0000164.
and facility asset management.” In Proc., 5th Int./11th Construction
Gu, N., and K. London. 2010. “Understanding and facilitating BIM adop- Specialty Conf. on Canadian Society for Civil Engineering. Montreal,
tion in the AEC industry.” Autom. Constr. 19 (8): 988–999. https://doi Canada: Canadian Society for Civil Engineering.
.org/10.1016/j.autcon.2010.09.002. Silva, M. J. F., F. Salvado, P. Couto, and Á. V. e Azevedo. 2016. “Roadmap
Gurevich, U., R. Sacks, and P. Shrestha. 2017. “BIM adoption by public proposal for implementing building information modelling (BIM) in
facility agencies: Impacts on occupant value.” Build. Res. Inf. 45 (6): Portugal.” Open J. Civ. Eng. 6 (3): 475. https://doi.org/10.4236/ojce
610–630. https://doi.org/10.1080/09613218.2017.1289029. .2016.63040.
Jin, R., C. Hancock, L. Tang, C. Chen, D. Wanatowski, and L. Yang. 2017. Smith, W. K. 2014. “Dynamic decision making: A model of senior leaders
“Empirical study of BIM implementation–based perceptions among managing strategic paradoxes.” Acad. Manage. J. 57 (6): 1592–1623.
Chinese practitioners.” J. Manage. Eng. 33 (5): 04017025. https://doi https://doi.org/10.5465/amj.2011.0932.
.org/10.1061/(ASCE)ME.1943-5479.0000538. Succar, B., W. Sher, and A. Williams. 2013. “An integrated approach to BIM
Kam, C., D. Senaratna, B. McKinney, Y. Xiao, and M. Song. 2013. The competency assessment, acquisition and application.” Autom. Constr.
VDC scorecard: Formulation and validation. Center for Integrated 35 (Nov): 174–189. https://doi.org/10.1016/j.autcon.2013.05.016.
Facility Engineering, Stanford Univ. Supplier Handbook. 2018. “Document No.: H-054 Issue No.: A5.” Ac-
Kassem, M., and B. Succar. 2017. “Macro BIM adoption: Comparative cessed October 10, 2019. http://content.tfl.gov.uk/suppliers-handbook
market analysis.” Autom. Constr. 81 (Sep): 286–299. https://doi.org/10 -updated.pdf.
.1016/j.autcon.2017.04.005. TfL (Transport for London). 2018. “Transport for London P020 A3 asset
Khosrowshahi, F., and Y. Arayici. 2012. “Roadmap for implementation of management policy.” Accessed June 9, 2019. http://content.tfl.gov.uk
BIM in the UK construction industry.” Eng. Constr. Archit. Manage. /tfl-asset-management-policy.pdf.
19 (6): 610–635. https://doi.org/10.1108/09699981211277531. Tiejten, R. 2010. “The veterans administration BIM guide, Department of
Lam, T. T., L. Mahdjoubi, and J. Mason. 2017. “A framework to assist Veterans Affairs.” Accessed March 1, 2019. http://www.cfm.va.gov/til
in the analysis of risks and rewards of adopting BIM for SMEs in /bim/BIMguide/downloads/VA-BIM-Guide.pdf.
the UK.” J. Civ. Eng. Manage. 23 (6): 740–752. https://doi.org/10 Tulubas Gokuc, Y., and D. Arditi. 2017. “Adoption of BIM in architectural
.3846/13923730.2017.1281840. design firms.” Archit. Sci. Rev. 60 (6): 483–492. https://doi.org/10.1080
Lee, S., J. Yu, and D. Jeong. 2013. “BIM acceptance model in construction /00038628.2017.1383228.
organizations.” J. Manage. Eng. 31 (3): 04014048. https://doi.org/10 Van Berlo, L. A. H. M., T. Dijkmans, H. Hendriks, D. Spekkink, and W.
.1061/(ASCE)ME.1943-5479.0000252. Pel. 2012. “BIM Quickscan: Benchmark of BIM performance in the
Lehtinen, T. 2012. “Increasing integration in construction projects: A case Netherlands.” In Proc. of the CIB W78 2012: 29th Int. Conf. Beirut,
study on a PPP project adopting BIM.” In Proc., eWork and eBusiness Lebanon.

© ASCE 05020008-13 J. Manage. Eng.

J. Manage. Eng., 2020, 36(4): 05020008


Wang, G., and J. Song. 2017. “The relation of perceived benefits and Wong, A. K. D., F. K. Wong, and A. Nadeem. 2011. “Government roles in
organizational supports to user satisfaction with building information implementing building information modelling systems: Comparison be-
model (BIM).” Comput. Hum. Behav. 68 (Mar): 493–500. https://doi tween Hong Kong and the United States.” Constr. Innovation 11 (1):
.org/10.1016/j.chb.2016.12.002. 61–76. https://doi.org/10.1108/14714171111104637.
Downloaded from ascelibrary.org by Heriot-Watt University on 11/07/22. Copyright ASCE. For personal use only; all rights reserved.

© ASCE 05020008-14 J. Manage. Eng.

J. Manage. Eng., 2020, 36(4): 05020008

You might also like