Professional Documents
Culture Documents
net/publication/324571401
CITATIONS READS
4 418
3 authors:
Ian Strydom
7 PUBLICATIONS 19 CITATIONS
SEE PROFILE
Some of the authors of this publication are also working on these related projects:
All content following this page was uploaded by Jan H Kroeze on 17 July 2018.
1
School of Computing, University of South Africa (UNISA), Florida, Johannesburg, South Africa
sunet.eybers@yahoo.com
2
School of Computing, University of South Africa (UNISA), Florida, Johannesburg, South Africa
kroezjh@unisa.ac.za
3
School of Computing, University of South Africa (UNISA), Florida, Johannesburg, South Africa
istrydom45@mail.com
Abstract. Business Intelligence and Analytics (BI&A) and the topic of ‘big data’ have sparked renewed interest in the
discipline of Business Intelligence (BI) and the challenges associated with the implementation thereof. Although the
benefits of the powerful analytical capability of BI&A are obvious, not all organisations have reached the maturity of dealing
with big data. For some organisations, the focus remains on implementing ‘traditional’ BI capabilities based on structured
data (also known as BI&A 1.0) such as data warehousing. For this reason, the value of such implementations remains a
burning issue, especially in tough economic times. As a result, the authors embarked on a journey of investigating the current
published academic material focusing on the value added by BI projects to organisations. Various focus areas have been
identified and presented in a conceptual classification framework. This provisional framework makes an important academic
contribution as it provides the reader with various approaches to identify, evaluate and justify the value of such projects either
prior to, during or after projects; monitor the potential value in the course of the project; identify gaps in current research and
identify future research opportunities.
Keywords. Business intelligence, business value, success, maturity.
1 Introduction
The interest in Business Intelligence and BI related projects seemed to have increased substantially, both under practitioners
and academic scholars. Despite challenging financial times, BI implementations remain one of the highest priorities for
organisations [14]. Also the number of BI related papers published in peer reviewed journals has steadily increased over the
past decade [23]. The latest trend towards the growing analytical capability required by huge datasets, labelled as ‘big data’,
contributed to renewed interest in the application and capability of Business Intelligence and Analytics (also known as
BI&A) [7]. However, whilst the benefits reaped by organisations implementing BI&A 2.0 and BI&A 3.0 are obvious, not all
organisations are currently implementing this type of capability, and some are still stuck in BI&A 1.0. For this reason, the
benefits of BI&A 1.0 cannot be discarded and stakeholders demand feedback in terms of the value of such implementations.
Also, even when BI&A 2.0 and 3.0 are implemented, benefits are often lagging. For this reason, it is sometimes imperative
to establish business benefits ex-ante (before), during or post-ante (after) implementations. It therefore seems surprising that
a literature review by [23] found that research pertaining to the benefits offered by BI implementations seems to have been
neglected when compared to other focus areas. However, it remains an important topic of interest for various reasons.
Firstly, it is important to identify and understand BI competencies in decision environments contributing to successful BI
implementations [22]. Secondly, the need has arisen to develop tools necessary for analysing, predicting and managing
success in BI organisations due to huge capital investments [1]. Thirdly, it remains challenging to justify BI investments due
to indirect, intangible benefits across organisations [15]. Fourthly, the research pertaining to BI value measurement seems
insufficient [20], [34]. Fifthly, various authors recognize the need for the development of accurate and reliable measurement
methods for measuring the business value of BI implementations [2], [28]. Lastly, there is a need to investigate the
relationship between costs and benefits of BI solutions [11].
The objective of this paper is to consolidate current BI value research contributions and subsequently propose a provisional
classification framework for BI value research. The primary research question can therefore be articulated as: What
academic research has been conducted and published over the last decade focusing on the business value achieved in
organisations as a result of a business intelligence implementation?
The proposed framework will make numerous contributions. Firstly, the framework will present the reader with a summary
of existing academic research focusing on the topic of BI value. Secondly, gaps in the current research are identified for
future research opportunities. Lastly, the extent is exposed to which BI value research is investigated. Future research efforts
can therefore build on the current structure.
2 Research Methodology
A literature review approach was used to investigate the extent to which BI value has been researched (this is similar to an
approach followed by [5]). An extensive literature search was performed targeting various peer-reviewed academic resources
including (a) the current Association for Information Systems (AIS) senior scholars’ basket of top IS journals available on the
AIS website; as well as (b) proceedings from academic conferences on the topic of Information Systems (IS) (as part of the
AIS accredited conferences). The senior scholars’ basket was selected due to the focus on the top IS journals in the field.
This selection approach is similar to the approach followed by renowned authors such as [7] and [23]. Also, conference
proceedings comprise the latest research information pertaining to the field of BI.
Table 1. AIS senior scholars' basket of top IS journals (top 8)
European Journal of Information Systems
Information Systems Journal
Information Systems Research
Journal of the AIS
Journal of Information Technology
Journal of Management Information Systems (MIS)
Journal of Strategic Information Systems
MIS Quarterly
The following search criteria were used in the search process against all fields (including abstract, keywords and title):
“business intelligence” AND “value”; “business intelligence” and “evaluation”; “business intelligence” and “success”;
“business intelligence” AND “worth”; “business intelligence” AND “performance management”; “business intelligence”
AND “impact”. All aspects of the BI concept was considered, including BI as technology (such as data warehousing, OLAP,
decision support systems), product (data, information, knowledge, decisions) as well as process (extract, transform and load
processes) [43]. No further demarcation of BI was considered, despite the BI evolution classification into BI&A 1.0 (data
warehousing), BI&A 2.0 (analytical web applications) and BI&A 3.0 (mobile technology) of Chen et al. [7].
The search was further restricted to include results from the past decade, from 2000 to 2013. Although BI is perceived as a
young discipline (less than 25 years old) [32] the search was not expanded to include the entire period. The main reason for
the decision is the fact that BI, prior to 2000, was often referred to using encapsulating terminology such as decision support
systems (DSS) and management information systems (MIS) [3], [16]. Although introduced in 1989 by Howard Dressner
[52] BI, as a discipline, did not receive sufficient academic focus prior to the turn of the century. This is evident when a
general search is conducted for the keyword “business intelligence” when using any renowned academic search engine. For
example, the PROQUEST (ABI/INFORM Global) search engine was used to perform a complete search (with no date
restrictions). The search returned 41 records for the period 1990 to 1999; 522 records for the period 2000 to 2009 and a total
of 491 records for 2010 to 2013 (search conducted on 1 September 2013). The results set returned using a restriction for the
period 1990 to 1999 was therefore excluded because of the majority of the articles published in the latter periods. Even if the
period prior to 1990 was included, it would probably not have impacted much on the literature results set.
The initial literature search resulted in a temporary set of 449 journal articles and 1524 conference papers and proceedings.
The articles were further evaluated for relevancy using the article abstract. The preliminary literature pool was compiled. A
backward literature search was conducted to identify additional possible resources after which the final literature pool was
finalized. A backward literature search entails the evaluation of the reference list contained in the articles returned as part of
the literature pool to identify possible related articles on the topic. A list of the final literature pool utilized for the
construction of the framework is displayed in Table 2.
A meta-synthesis approach was used to integrate, evaluate and interpret the content of the final qualitative literature pool.
This approach was used to identify the main unit of investigation within the studies and identify common key elements as
well as the academic contribution made. For example, studies investigating success factors of BI implementations using
critical success factors were classified accordingly.
5 Conclusion
The objective of the paper was to investigate the extent to which BI value has been researched in order to present a
summarized consolidated view in a framework. Although similar work has been done by [39] focusing on IT value research,
little evidence could be found of a similar framework focusing on BI. Furthermore, the framework classified, categorized
and synthesized BI value academic literature for the last decade. This was similar to an approach used by [5] on the topic of
telework.
The framework presented identifies the extent to which BI value has been researched as well as gaps with a view to future
research. Firstly, there seems to be a need to investigate mobile BI (also known as BI&A 3.0) as well as BI applicable to
social media which is currently in its infancy. Secondly, the investigation highlights the lack of published academic material
focusing on the evaluation of the organisational level of analysis, followed by the process level of analysis and the
interrelationships between these two levels. It seems as if the focus is on investigations of pre-conditions of success, such as
maturity models, readiness assessments and success models.
A possible explanation for the lack of organisational level focus might be attributed to the assessment of the net value of both
tangible and intangible benefits of BI implementations without considering lower level (process level) characteristics.
The research focus areas identified in the framework are in line with the level of the measurement research field as described
by [39] in his taxonomy of IS business value research. This refers to both the organisational or process level unit of analysis.
The importance of considering the level of analysis is stressed by [10] postulating that the distinction between the levels
contributes to the explanation of the productivity paradox. The separation of the different levels is useful to structure research
and to resolve conflicting results. This is similar to the approach used by Sidahmed [45]. It is also argued that, beyond the
distinction between the levels, the interrelationship between the levels can provide useful insights into how Information
Systems (IS) generates value [9], [25].
The framework contributes to the existing pool of academic literature as it provides the reader with a high level classification
framework for current BI value literature; identifies gaps in the current research (as discussed above); identifies future
research areas; and contains a bibliography of academically published research according to the identified focus areas.
References
1. Adamala, S., Cidrin, L.: Key Success Factors in Business Intelligence. J. Intell. Stud. Bus. 1, 107-127 (2011)
2. Arnott, D., Gibson, M.: The Evaluation of Business Intelligence: A Case Study in a Major Financial Institution. ACIS
2005 Proceedings, Paper 97 (2005)
3. Arnott, D., Pervan, G.: Eight Key Issues for the Decision Support Systems Discipline. Decis. Sup. Syst. 44, 657–672
(2008)
4. Byrd, T.A., Davidson, N.W.: An Empirical Examination of a Process-oriented IT Business Success Model. Inf.
Technol. Manage. 7, 55-69 (2006)
5. Boell, S.K., Campbell, J., Cecez-Kecmanovic, Cheng, J.E.: Advantages, Challenges and Contradictions of the
Transformative Nature of Telework: A Review of the Literature. Proceedings of the Nineteenth Americas Conference
on Information Systems, Chicago, Illinois, August 15-17 (2013)
6. Chasalow, L.C.: A Model of Organizational Competencies for Business Intelligence Success, Doctor of Philosophy in
Business, Department of Information Systems, Virginia Commonwealth University (2009)
7. Chen, H., Chiang, R.H.L. and Storey, V.C.: Business Intelligence and Analytics: From Big Data to Big Impact. MIS Q.
36, 4:1165-228 (2012)
8. Davern, M., Kauffman, R.: Discovering Value and Realizing Potential from IT investments. J. Manage. Inf. Syst. 16, 4,
121-144 (2000)
9. DeLone, W.H., McLean, E.R.: The DeLone and McLean Model of Information Systems Success: A Yen-Year Update.
J. Manage. Inf. Syst. Spring, 19, 4, 9-30 (2003)
10. Dehning, B., Richardson V.J: Returns on Investments in Information Technology: a Research Synthesis. J. Inf. Syst.
16, 1, 7–30 (2002)
11. Dinter, B.: The Maturing of a Business Intelligence Maturity Model. AMCIS 2012 proceedings. Paper 37 (2012)
12. Eckerson, W.: Performance Dashboards: Measuring, Monitoring and Managing your Business. Wiley-Interscience,
NYC (2007)
13. Elbashir, M.Z., Collier, P.A., Davern, M.J.: Measuring the Effects of Business Intelligence Systems: The Relationship
Between Business Process and Organizational Performance. Int. J. of Acc. Inf. Syst. 9, 135–153 (2008)
14. Farrokhi, V., Pokorádi, L.: The Necessities for Building a Model to Evaluate Business Intelligence Projects – Literature
Review. Int. J. Comput. Sci. Eng. Surv. (IJCSES), 3,2, April (2012)
15. Gartz, U.: Enterprise Information Management. In: Business Intelligence in the Digital Economy: Opportunities,
Limitations and Risks, Raisinghani, M. (eds.). Hershey: Idea Group Publishing (2004)
16. Gray, P.: Business Intelligence: A New Name or the Future of DSS?. In: DSS in the Uncertainty of the Internet Age.
Bui T., Sroka H., Stanek S., Goluchowski J., (eds.). Publisher of the Karol Adamiecki, University of Economics,
Katowice (2003)
17. Gustafsson, P., Franke, U., Hook, D., Pontus, J.: Quantifying IT Impacts on Organizational Structure and Business
Value with Extended Influence Diagrams. In: Stirna, J., Persson, A. (Eds.). IFIP Int. Fed. Inf. Process. 138-152 (2008)
18. Grublješič, T., Jaklič, J.: Conceptualization of BIS Embeddedness Determinants. Proceedings of the Nineteenth
Americas Conference on Information Systems, Chicago, Illinois, August 15-17 (2013)
19. Hawking, P.: Business Intelligence Excellence: A Company’s Journey to Business Intelligence Maturity. AMCIS
proceedings, Paper 63 (2011)
20. Hawking, P., Sellitto, C.: Business Intelligence (BI) Critical Success Factors. ACIS 2010 proceedings, Paper 4 (2010)
21. Hwang, M., Xu, H.: A Structural Model of Data Warehousing Success. J. Comput. Inf. Syst, 48-56 (2008)
22. Isik, O.: Business Intelligence Success: An Empirical Evaluation of the Role of BI Capabilities and Organization's
Decision Environment. AMCIS 2009 Doctoral Consortium, Paper 13 (2009)
23. Jourdan, Z., Rainer, R.K., Marshall, T.E.: Business Intelligence: An Analysis of the Literature. Inf. Syst. Manage. 25,
121-131 (2008)
24. Kimball, R., Ross, M., Thornthwaite, W., Mondy, J., Becker, B.: The Data Warehouse Lifecycle Toolkit, 2nd ed.
Indianapolis, Wiley Publishing (2008)
25. Kohli R., Grover V.: Business Value of IT: An Essay on Expanding Research Directions to Keep Up with the Times. J.
Assoc. Inf. Syst. 9,1, 23-39 (2008)
26. Kulkarni, U.R., Robles-Flores, J.A.: Development and Validation of a BI Success Model. Proceedings of the
Nineteenth Americas Conference on Information Systems, Chicago, Illinois, August 15-17 (2013)
27. Lahrmann, G., Marx, F., Winter, R., Wortmann, F.: Business Intelligence Maturity Models: An Overview. Proceedings
of the VII Conference of the Italian Chapter of AIS (itAIS 2010), Naples, Italy (2010)
28. Marshall, P., McKay, J., Prananto, A.: A Process Model of Business Value Creation from IT Investments. Proceedings
of the Fifteenth Australasian Conference on Information Systems, December 1-3, Hobrt, Tasmania (2004)
29. Melville, N., Kraemer, K.,, Gurbaxani, V.: Information Technology and Organizational Performance: An Integrative
Model of IT Business Value, MIS Q., 28, 2, 283-322 (2004)
30. Miller, D.: Improving Business Intelligence: The Six Sigma Way. Holt, Thompson and Associates, United States of
America (2010)
31. Mungree, D., Rudra, A., Morien, D.: A Framework for Understanding the Critical Success Factors of Enterprise
Business Intelligence Implementation. Proceedings of the Nineteenth Americas Conference on Information Systems,
Chicago, Illinois, August 15-17 (2013)
32. Negash, S., Gray, P.: Business Intelligence. AMCIS 2003 Proceedings, Paper 423 (2003)
33. Olbrich S., Poeppelbuss J., Niehaves B: BI Systems Managers’ Perception of Critical Contextual Success Factors: A
Delphi Study. ICIS 2011 Proceedings, Paper 12 (2011)
34. Olszak, C.M.: The Business Intelligence-based Organization – New Chances and Possibilities. Proceedings of the
International Conference on Management, Leadership and Governance (2012)
35. Pirttimǎki, V., Lönnqvist, A., Karjaluoto, A.: Measurement of Business Intelligence in a Finnish Telecommunications
Company. Electron. J. Knowl. Manage., 4, 1, 83-90 ( 2006)
36. Raber, D., Wortmann, F., Winter, R.: Towards the Measurement of Business Intelligence Maturity. ECIS 2013
Proceedings, Paper 109 (2013)
37. Sangar, A.B., Iahad, N.B.: Critical Factors that Affect the Success of Business Intelligence Systems (BIS)
Implementation in an Organization. Int. J. Sci. Technol. Res., 2, 2, 176 (2013)
38. Schieder, C., Gluchowski, P.: Towards a Consolidated Research Model for Understanding Business Intelligence
Success. ECIS 2011 proceedings, Paper 205 (2011)
39. Schryen, G.: Preserving Knowledge on IS Business Value - What Literature Reviews Have Done. Bus.Inf. Syst. Eng. 2,
4, 233-244 (2010)
40. Seddon, P., Constantinidis, D., Dod, H.: How Does Business Analytics Contribute to Business Value? Thirty Third
International Conference on Information Systems, Orlando (2012)
41. Sen, A., Sinha, A.P., Ramamurthy, K.: Data Warehousing Process Maturity: An Exploratory Study of Factors
Influencing User Perceptions, IEEE Trans. Eng. Manage. 53, 3, 440-455 (2006)
42. Shaban, E., Helmy, Y., Khedr, A., Nasr, M.: Business Intelligence Maturity Models: Toward New Integrated Model,
ACIT 2011 proceedings (2011)
43. Shin, B.: An Exploratory Investigation of System Success Factors in Data Warehousing, J. Assoc. Inf. Syst. 4, 1 (2003)
44. Shollo, A., Kautz, K.: Towards an Understanding of Business Intelligence, ACIS 2010 Proceedings, Paper 86 (2010)
45. Sidahmed, M.: Business Intelligence Impact Assessment. AMCIS 2007 Proceedings, Paper 205 (2007)
46. Silvius A.J.G.: Does ROI Matter? Insights into the True Business Value of IT, The Electron. J. Inf. Syst. Eval., 9, 2, 93-
104 (2006)
47. Simmons, C.: A Stakeholder Model of Business Intelligence, in Anandarajan, M., Anandarajan, A., Srinivisan, C. (Eds.)
Business Intelligence Techniques: A Perspective from Accounting and Finance, Berlin, Springer (2004)
48. Smith, D. and Crossland, M.: Realizing the Value of Business Intelligence. In: Advances in Information Systems
Research, Education and Practice, 274, 163-174, Springer, Boston (2008)
49. Soh, C., Markus, M.: How IT Creates Business Value: A Process Theory Synthesis, Proceedings of the Sixteenth
International Conference on Information Systems, 29-41 (1995)
50. Symons, V.: A Review of Information Systems Evaluation: Content, Context and Process, Eur. J. Inf. Syst. 1, 3, 205-212
(1991)
51. Tona, O., Carlsson, S., Eom, S.: An Empirical Test of DeLone and McLean’s Information System Success Model in a
Public Organization. AMCIS 2012 Proceedings, Paper 10 (2012)
52. Watson, H.: Tutorial: Business Intelligence – Past, Present and Future. Commun. Assoc. Inf. Syst. 25. Article 39
(2009)
53. Watson, H., Ariyachandra, T., Matyska, R.J.: Data Warehousing Stages of Growth. Inf. Syst. Manage. 18, 3, 41-50.
(2011)
54. Williams, S., Williams, N.: The Profit Impact of Business Intelligence, Elsevier, United States of America (2007)
55. Wixom, B.H., Watson, H.J. An Empirical Investigation of the Factors Affecting Data Warehousing Success. MIS Q.
25, 1, 17-41 (2001)
56. Yeoh, W., Koronios, A.: Critical Success Factors for Business Intelligence Systems. J. Comput. Inf. Syst. 50, 3, 23-32
(2010)
57. Yogev, N., Fink, L., Even, A.: How Business Intelligence Creates Value. ECIS 2012 Proceedings, Paper 84 (2012)