Professional Documents
Culture Documents
net/publication/270453543
CITATIONS READS
10 1,065
3 authors:
Norin Arshed
University of Dundee
45 PUBLICATIONS 197 CITATIONS
SEE PROFILE
Some of the authors of this publication are also working on these related projects:
Systematic Literature Review of Lean Six Sigma in the Public Sector View project
Critical assessment on the Six Sigma Black Belt roles/responsibilities, skills and View project
All content following this page was uploaded by Saja Albliwi on 23 November 2015.
CMMI 2000 - To develop an integrated framework that - It suits large and bureaucratic organisations
includes current and future models which solves - Exclusive focus on the process
the problem of using many CMM and - Specific training and experience are essential
overlapping - Much more applicable to large software organisations than any
- To address project management and process other organisations
issues in developing products and services - Misses consideration of human factors, cultural factors and
organisational factors
- Successful use of the model depends on the lead-assessor
- Requires a solid theoretical base to be recognised as a trustworthy
model
OMG 2002 -To improving business process related to - The role of IT support is missing in the model
products and services in an organisation -There are lack of studies that tasted the validity and accuracy of this
-To work as a road map that managers can use model. Hence, more studies are needed to test theses two points.
for benchmarking and monitoring business
process
TABLE 1: Summary of Maturity Models
Subsequently, other maturity models have been developed drive for improvement, most maturity models rely on
for different purposes and activities such as innovation, levels leading towards a predefined “end state” [6].
research and development (R&D), supplier relationship, Furthermore, there is a multitude of similar maturity
knowledge management and so on [17]. models, unsatisfactory documentation, unthinking
However, software development and software engineering adoption of the Capability Maturity Model (CMM)
have dominated most of the maturity models, although blueprint, and lack of an economic foundation. The major
there are differences in their structures [8]. criticism relates to most of the models providing limited
Reference [3] conducted a systematic literature review to guidance on specific steps that should be taken in order to
present the development of maturity models. They state improve maturity levels [6]. There is also a requirement
that maturity models differ in their purpose; first, some for criteria that will help users determine the current stage
models aim to determine the current situation of the of maturity and acknowledge the methodical progression
organisation (descriptive); second, models are able to to the next stage [7]. Reference [7] argue that on one hand,
draw a path for improvement (prescriptive); and the third the available maturity models are very complicated,
type of model allows benchmarking through and between needing great effort to implement, while on the other
industries by comparing organisations in term of hand, models are very simple hands-on methods for
similarities of practices (comparative). assessing maturity levels.
Interestingly, even popular maturity models like Crosby’s
III. RESULTS AND DISCUSSION Quality Management Maturity Grid (QMMG) have been
subject to criticism by other scholars. Although this model
Although a number of maturity models have appeared in was created for assessing maturity of quality management,
the literature since 1979, there are major voids in terms of the argument here is that this model is not absolutely
missing significant elements in each model (see table 2). applicable to business process improvement and it is
Moreover, the most common aim for many researches was based on the author’s practical experience. Reference [8]
to develop maturity models based on practice. Despite the argued that QMMG is not described as a lifecycle. Rather,
wide popularity of maturity models, these have always it describes the potential of a higher maturity level, and
been vulnerable to criticism. One criticism is that maturity leaves it to the discretion of the user to decide whether to
models are “step-by-step recipes” lacking empirical proceed to the next stage. In addition, a limited number of
foundation and reality [6 p.330]. Hence, there is dearth of available maturity models have QMMG as the foundation.
theoretical reflective publications [3,8]. Instead of It seems to be unknown to many researchers and
focusing on the factors that influence the evolution and developers of maturity models.
Crosby’s Bessant’s
Criteria CMM CMMI OMG
Grid Model
Quality Continuous Software Different Business
Target
Management Improvement Industry Industries Process
User-friendliness Yes Yes No No No
Training No No Yes Yes Yes
Prior knowledge and experience Yes Yes Yes Yes Yes
Clarity of determining the current level of maturity Yes Yes Yes Yes Yes
Empirical evidence No Yes No Yes No
Theoretical based No No No No No
Researcher experience based Yes Yes No No No
Quality standards/previous models based No No Yes Yes Yes
Complexity No No Yes Yes Yes
Performance based scoring system No No No No No
Accuracy No No Yes Yes NA
Availability of criteria to determine the current stage of maturity,
No No No No Yes
when the stage is completed and when to move to the next stage
Validity/reliability/generalization No No No No NA
TABLE 2: Maturity Models evaluation criteria
The model developed by John Bessant for Continuous Interestingly enough, reviewing the available models and
Improvement (CI) maturity has also faced some criticism literature shows that CMMI is obviously the most
from other researchers. Reference [18] has published a commonly used and the only standard for the majority of
paper to revise Bessant’s model. the current maturity models, and it is the best one
They argued that there are important elements and critical according to academics [8].
success factors such as communication have not been The last model reviewed in this paper was OMG-BPMM.
covered in the model. In addition, although this model was Reviewing the literature shows that this model is rarely
developed from empirical research in private and public addressed in research in particularly in comparison to
sectors, the model has not been tested either in the public CMM and CMMI.
sector or large organisations. To date, the model has only This model was criticised by reference [6] that it did not
been used by SMEs (Small and Medium Sized cover the important role of IT support. Although this
Enterprises) in the manufacturing sector. model claims that is applicable across many organisations,
CMM has also been criticised by a number of scholars. industries and locations [6], the authors call for further
Reference [19] has argued that the model necessitates a research in understanding the accuracy and validity of the
team to assess the process by conducting a full-scale audit model. In general, most of the available maturity models
which is costly on time and effort. This model is very have been developed using quality standards such as ISO,
confusing for the user in terms of measuring maturity as it IEC 15504, CMMI-DEV, Malcolm Baldrige National
has different structures, terms, formats, etc. Moreover, Quality Award (MBQNA) and others [20]. Other models
there are different CMM formats available that overlap are based on the adaption or improvement of previous
and are contradictory [14]. maturity models such as CMMI, CMM, Bessant’s CI
CMMI is always criticised for the specific focus on the model etc., and a very small number of models are based
process and ignorance of the very important factors of on Crosby’s maturity Grid. The authors also observed that
people, culture and organisation, which are critical to a limited number of maturity models used scientific
project success. It is also criticised by many practitioners, guidelines as a foundation for development of maturity
as it requires a specific type of training and experience models. Therefore, the majority of the available models
[14]. Moreover, this model focuses on large organisations were developed on the practical experience of the
rich in bureaucracy. However, it can still be deployed in researchers. Hence the theoretical basis is missing in most
small organisations. It is also criticized for the major role of the models. We also observed that the validity and
the lead assessor plays in the successful deployment of the generalization of the models is limited in scope.
model – in reality, there should be no difference between Therefore, there is a research gap around developing a
the lead assessor and the other members of the team in the maturity model that is based on theory for subsequent
successful determination of maturity [14]. testing in the real world. In fact, maturity models have
always been criticised for lack of consideration for
There are multiple CMMI models available, as generated results/performance. That means it is possible to move to
by the CMMI Framework. Consequently, the user needs the next stage of maturity without any improvement in the
to be well-prepared, choosing the best CMMI model business process [24].
commensurate with the process improvement needs of the Furthermore, the authors argue that it is important to
organisation [12, 13]. In addition, both CMM and CMMI differentiate between process maturity and organisational
were developed to serve large governmental software maturity. There are some models that were created for
organisations, therefore their application in other assessing process maturity (the condition of the process in
organisations is not as successful. general) such as OMG and other models for assessing
organisational maturity (business process management [9] Crosby P.B (1979) “Quality is Free: The Art of Making
capability of the organisation) e.g. CMMI and the model Quality Certain”, McGraw-Hill, New York.
developed by reference [21, 22]. However, there are few [10] Bessant, J. and Caffyn, S. (1997). “High – involvement
models that integrate the features of both types of models. innovation through continuous improvement”, International
Journal of Technology Management, Vol.14 No. 1, pp. 14-
22.
[11] Bessant, J., Caffyn, S., and Gallagher, M. (2001) “An
IV. CONCLUSION AND FUTURE RESEARCH evolutionary model of continuous improvement behaviour”,
Technovation. Vol.21 No.2, pp.67 – 77.
This paper has critically reviewed the most common [12] CMMISM for Systems Engineering/Software Engineering,
maturity models for Business Process excellence. The Version 1.02, Continuous Representation, CMU/SEI-2000-
results clearly reveal that there is a need for developing a TR-019, ESC-TR-2000- 019, Software Engineering Institute,
maturity model for Business Process excellence. Future Carnegie Mellon University, Pittsburgh, PA, 2000.
work will focus on developing a maturity model for Lean [13] CMMISM for Systems Engineering/Software Engineering,
Version 1.02, Staged Representation, PA CMU/SEI-2000-
Six Sigma. The development of this model will be an TR-018, ESC-TR-2000-018, Software Engineering Institute,
attempt to bridge the research gap which is the absence of Carnegie Mellon University, Pittsburgh, PA, 2000.
a Lean Six Sigma maturity model. Without using a [14] Höggerl, M. and Sehorz, B. (2006) “An Introduction to
maturity model, organisations deploying Lean Six Sigma CMMI and its Assessment Procedure”, Seminar for
cannot assess their current maturity level. The model will Computer Science, Department of Computer Science
be developed after an in-depth analysis of the available University of Salzburg.
maturity models. The Lean Six Sigma Maturity Model [15] The CMMI Overview by SEI. Available at
(LSS-MM) will comprise a number of levels of maturity, http://www.sei.cmu.edu/cmmi/general/general.html.
behaviours/characteristics and scores. The model will be [16] Kishore, R., Swinarski, M.E., Jackson, E. and Rao, H.R.
(2012) “A Quality-Distinction Model of IT Capabilities:
supported by a matrix aiming to assess the maturity of Conceptualization and Two-Stage Empirical Validation
critical success factors in organisations. Using CMMi Processes”, IEEE TRANSACTIONS ON
ENGINEERING MANAGEMENT, Vol. 59 No. 3, pp. 457-
ACKNOWLEDGMENT 469.
[17] Boughzala, I. and de Vreede, G-J. (2012) “A Collaboration
This study was sponsored by a grant from King Abdulaziz Maturity Model: Development and Exploratory
University, Jeddah, Saudi Arabia. The first author is a Application”, 45th Hawaii International Conference on
recipient of PhD studentship award from King Abdulaziz System Sciences.
University. The funding body has no role in the study [18] Fryer, K., Ogden, S. and Anthony, J. (2013) "Bessant's
continuous improvement model: revisiting and revising",
design, data collection and analysis, decision to publish, or International Journal of Public Sector Management, Vol. 26
preparation of the manuscript. No. 6, pp.481 – 494.
[19] Paulk, M.C., Curtis, B., Chrissis, M.B., & Weber, C.V.
REFERENCES (1993) “Capability maturity model”, version 1.1. IEEE
Software, Vol.10 No. 4, pp.18–27.
[1] Pigosso, D.C.A., Rozenfeld, H. and McAloone, T.C., (2013) [20] Xiaofen, T. (2013) "Investigation on quality management
“Ecodesign maturity model: a management framework to maturity of Shanghai enterprises", The TQM Journal, Vol.
support ecodesign implementation into manufacturing 25 No. 4, pp.417 – 430.
companies”, Journal of Cleaner Production, No.59 pp.160-173. [21] McCormack, K. (2007) “Business process maturity”.
[2] Pullen, W. (2007). “A public sector HPT maturity model”, Raleigh, NC: DRK Research.
Perform Improvement, Vol. 46 No.4, pp. 9–15. [22] Van looy, A., De Backer, M., Poels, G. (2011) “Defining
[3] García-Mireles, G.A., Moraga, M.A. and García, F. (2012) business process maturity. A journey towards excellence”,
“Development of Maturity Models: A Systematic Literature Total Quality Management & Business Excellence, Vol. 22
Review”, Proceedings of the EASE 2012 - Published by the IET, No.11 DOI:10.1080/14783363.2011.624779.
ISBN 978-1-84919-541-6. [23] R.L. Raschke, L.R. Ingraham, Business Process Maturity’s
[4] Van looy, A., De Backer, M., Poels, G. and Snoeck, M. (2013) Effect on Performance, in: AMCIS 2010 Proceedings, 2010,
“Choosing the right business process maturity model”, Paper 402.
Information and Management, Vol. 50, pp. 466-488. [24] The OMG Business Process Maturity Model. Available at
[5] Bergman, B., & Klefsjo¨, B. (2010) “Quality from customer http://www.omg.org/spec/BPMM/1.0/
needs to customer satisfaction (3rd ed.)” Lund: Studentlitteratur. [25] Snee, R.D. (2010), “Lean Six Sigma – getting better all the
[6] Röglinger, M., Pöppelbuß, J. and Becker, J. (2012) "Maturity time”, International Journal of Lean Six Sigma, Vol.1 No.1,
models in business process management", Business Process pp.9-29
Management Journal, Vol. 18 No. 2, pp.328 – 346.
[7] Cronemyr, P. and Danielsson, M. (2013) “Process Management
1-2-3 – a maturity model and diagnostics tool”, Total Quality
Management & Business Excellence, Vol. 24 No. 7-8, pp. 933-
944, DOI: 10.1080/14783363.2013.791114.
[8] Wendler, R. (2012) “The maturity of maturity model research: A
systematic mapping study”, Information and Software
Technology journal, Vol.54 No.12, pp.1317–1339.