CMMI® for

SCAMPISM Class A Appraisal Results

2011 End-Year Update

Software Engineering Institute

Carnegie Mellon University
Pittsburgh, PA 15213

March 2012

CMMI-SCAMPI v1.2/v1.3 Class A

Appraisal Results © 2012 Carnegie Mellon University
1
March 2012
© 2012 Carnegie Mellon University
Outline

Introduction
Current Status
Community Trends
Organizational Trends
Summary and Terms Used in this Briefing

This briefing is based solely on the appraisals reported to the SEI. It cannot be used as a source for an exact indicator of all
organizations in the world using CMMI models or appraisal methods nor can it be used for certification or verification
purposes.
The SEI does not certify appraisal results or organizations. The SEI licenses SEI Partners, authorizes/certifies lead
appraisers, team leaders and high maturity lead appraisers to conduct appraisals. Neither the SEI nor any other organization
is a “certifying authority” of the results from a SCAMPI appraisal. Therefore requests to the SEI to provide information to be
used for this purpose can not be fulfilled. Information provided by the SEI, such as this briefing, is to demonstrate reported
results of the use of CMMI products and services only.

CMMI-SCAMPI v1.2/v1.3 Class A

Appraisal Results
2
March 2012
© 2012 Carnegie Mellon University
Introduction - Purpose

Characterize the adoption of CMMI

Describe results from Standard CMMI Appraisal Method for Process

Improvement (SCAMPISM) v1.2/v1.3 Class A appraisals using Capability
Maturity Model® Integration (CMMI v1.2/ v1.3)*

* Organizations previously appraised against CMMI v1.0 /v1.1 and which have not reappraised against v1.2 or v1.3
are not included in this report.

* SVC,ACQ appraisals are included in this report, P-CMM appraisals are not included in this report,

CMMI-SCAMPI v1.2/v1.3 Class A

Appraisal Results
3
March 2012
© 2012 Carnegie Mellon University
Introduction - Briefing Contents

This briefing includes three primary sections:

1. Current Status
• Snapshot of the reporting organizations based on the most recent appraisals,
since the release of SCAMPI V1.2
2. Community Trends
• Changes in the global distribution of appraisals
• Growth in the number of appraisals performed
• Shifts in the maturity profile over time

3. Organizational Trends
• Time to move up in maturity based on change in maturity level and time
between appraisals

CMMI-SCAMPI v1.2/v1.3 Class A

Appraisal Results
4
March 2012
© 2012 Carnegie Mellon University
 Process Maturity Profile
by All Reporting Organizations
3600
3400
3200 65.8%
3000
2800
Number of Organizations

2600
2400
2200
2000
1800
1600
1400
1200 22.9%
1000
800
600
400
3.6% 5.4%
200 0.7% 1.7%
0
Not Given Initial Managed Defined Quantitatively Optimizing
Managed

Based on most recent appraisal of 4731 organizations

CMMI-SCAMPI v1.2/v1.3 Class A
Appraisal Results
5
March 2012
© 2012 Carnegie Mellon University
 Process Maturity Profile (SVC Only)
by All Reporting Organizations
80

70
Number of Organizations

60

55.2%
50

40 39.6%

30

20

10
3.1%
1.0% 1.0%
0
Not Given Initial Managed Defined Optimizing

Based on most recent appraisal of 96 organizations

CMMI-SCAMPI v1.2/v1.3 Class A
Appraisal Results
6
March 2012
© 2012 Carnegie Mellon University
Reporting Organization Categories

Commercial/In-house 80.4%

Contractor for
Military/Government
15.9%

Military/Government Agency 3.7%

0 1000 2000 3000 4000 5000

Number of Organizations
Based on most recent appraisal of 4657 organizations reporting an organization category
CMMI-SCAMPI v1.2/v1.3 Class A
Appraisal Results
7
March 2012
© 2012 Carnegie Mellon University
 Process Maturity Profile
by Reporting Organization Categories
100%

90% Commercial/In-house = 3746

% of Organizations Within Category

Contractor for Military/Government = 740

80%
Military/Government Agency = 171

70% 67.8%

61.9%
60%

50%
44.4%

40%
35.1%

30% 28.2%

21.0%
20%
13.5%

10%
5.4% 6.4%
3.2% 3.0% 2.9% 2.3%
1.9% 1.8%
0.6% 0.1% 0.4%
0%
Not Given Initial Managed Defined Quantitatively Optimizing
Managed

Based on most recent appraisal of 4657 organizations reporting an organization category

CMMI-SCAMPI v1.2/v1.3 Class A
Appraisal Results
8
March 2012
© 2012 Carnegie Mellon University
Organization Size
Based on the total number of employees within the area of the organization that was appraised

1001 to 2000
501 to 1000 1.8%
2000+
3.8% 1.6%

301 to 500
5.3% 25 or fewer
20.6%

201 to 300
5.7% 201 to 2000+
18.2%

101 to 200
14.5%
1 to 100
67.3%

76 to 100 26 to 50
7.5% 26.5%

51 to 75
12.8%
Based on 4703 organizations reporting size data
CMMI-SCAMPI v1.2/v1.3 Class A
Appraisal Results
9
March 2012
© 2012 Carnegie Mellon University
Organization Size (SVC Only)
Based on the total number of employees within the area of the organization that was appraised

1001 to 2000 2000+

4.2% 5.3%

501 to 1000
7.4%

25 or fewer
38.9%
201 to 2000+
301 to 500 29.5%
5.3%

201 to 300
7.4%
1 to 100
61.1%

101 to 200
9.5%

76 to 100 26 to 50
4.2% 9.5%
51 to 75
8.4%

Based on 95 organizations reporting size data

CMMI-SCAMPI v1.2/v1.3 Class A
Appraisal Results
10
March 2012
© 2012 Carnegie Mellon University
 Maturity Profile by Organization Size
Based on the total number of employees within the area of the organization that was appraised

100%

90%

74.3%
% of Organizations by Size

80%

70.6%
69.7%

67.4%

63.5%
70%

59.3%

57.9%

57.1%
55.2%

54.1%
60%

50%
39.3%

39.2%
40%

27.4%
30%
22.5%

20.8%
20.5%

19.5%

18.1%
17.5%

14.9%

14.1%

13.5%
20%

10.7%

9.5%
7.0%
6.5%

6.0%
5.6%
5.4%

4.8%
10%
4.4%
4.0%
3.8%

3.5%

2.7%

2.7%
2.7%

2.5%
2.5%
2.5%

2.2%

2.0%
1.7%

1.7%
1.4%

1.2%
0.8%

0.8%
0.7%
0.6%

0.6%
0.5%

0.5%

0.4%
0.3%

0.3%

1.4%
0%
25 or fewer 26 to 50 51 to 75 76 to 100 101 to 200 201 to 300 301 to 500 501 to 1000 1001 to 2000 2000+
Not Given Initial Managed Defined Quantitatively Managed Optimizing

Based on 4703 organizations reporting size data

CMMI-SCAMPI v1.2/v1.3 Class A
Appraisal Results
11
March 2012
© 2012 Carnegie Mellon University
USA and Non-USA
Reporting Organization Categories

333
Commercial/In-
house 3413

Contractor for 522

Military/Government
218

USA: 100% = 939

Non-USA: 100% = 3718

84
Military/Government
Agency 87

0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%

% of Organizations

CMMI-SCAMPI v1.2/v1.3 Class A

Appraisal Results
12
March 2012
© 2012 Carnegie Mellon University
 Maturity Profile by All Reporting
Organizations in the USA
100%

90%

80%
% of Organizations

70%

60%
496
50%

40% 341

30%

20%

10% 55
45
6
4
0%
Not Given Initial Managed Defined Quantitatively Optimizing
Managed

Based on 947 organizations in the USA

CMMI-SCAMPI v1.2/v1.3 Class A
Appraisal Results
13
March 2012
© 2012 Carnegie Mellon University
 Maturity Profile by All Reporting
Organizations based outside the USA
100%

90%

80%
% of Organizations

2618
70%

60%

50%

40%

30%

743
20%

10% 210
113
75
25
0%
Not Given Initial Managed Defined Quantitatively Optimizing
Managed
Based on 3784 organizations outside the USA

CMMI-SCAMPI v1.2/v1.3 Class A

Appraisal Results
14
March 2012
© 2012 Carnegie Mellon University
Section 2—Community Trends

Appraisals are conducted through December 2011 and reported to the

SEI by January 2012

• 76 countries reporting appraisals

– Most of the appraisals are from Asia and North America.

• 5378 Appraisals posted on PARS

– Expired appraisals are removed from PARS and replaced with the newest
reappraisal result.

CMMI-SCAMPI v1.2/v1.3 Class A

Appraisal Results
15
March 2012
© 2012 Carnegie Mellon University
Countries Where Appraisals Have Been
Performed and Reported to the SEI

Argentina Australia Austria Bahrain Bangladesh Belgium Brazil Brunei Darussalam

Bulgaria Canada Chile China Colombia Costa Rica Cuba Cyprus
Czech Republic Denmark Egypt Finland France Germany Greece Guatemala
Hong Kong Hungary India Indonesia Ireland Israel Italy Japan
Jordan Korea, Republic Of Latvia Lebanon Lithuania Luxembourg Macedonia Malaysia
Mauritius Mexico Morocco Nepal Netherlands New Zealand Norway Pakistan
Panama Paraguay Peru Philippines Poland Portugal Qatar Romania
Russia Saudi Arabia Singapore Slovakia South Africa Spain Sri Lanka Sweden
Switzerland Syrian Arab Republic Taiwan Thailand Tunisia Turkey Ukraine United Arab Emirates
United Kingdom United States Uruguay Viet Nam

Red country name: New additions with this reporting since September 2011
CMMI-SCAMPI v1.2/v1.3 Class A
Appraisal Results
16
March 2012
© 2012 Carnegie Mellon University
 Number of Appraisals Reported to the SEI
by Continent
5000

4500

4000
Number of Appraisals

3500
3130

3000

2500

2000

1424
1500

1000
672

500 326

59 17
0
Africa Asia Australia Europe North America South America

Based on 5628 appraisals

North America includes Canada, the USA, and Mexico; South America includes Central America and the
Caribbean ; Australia includes New Zealand
CMMI-SCAMPI v1.2/v1.3 Class A
Appraisal Results
17
March 2012
© 2012 Carnegie Mellon University
 Number of Appraisals Reported to the SEI
by Continent (SVC Only)
100

80
Number of Appraisals

60 56

40

28

20
12

2 2
0
Africa Asia Europe North America South America

Based on 100 appraisals

North America includes Canada, the USA, and Mexico; South America includes Central America and the
Caribbean ; Australia includes New Zealand
CMMI-SCAMPI v1.2/v1.3 Class A
Appraisal Results
18
March 2012
© 2012 Carnegie Mellon University
Number of Appraisals and Maturity Levels
Reported to the SEI by Country
Maturity Maturity Ma turity Maturity Maturity Maturity Maturity Maturity Ma turity Maturity
Number of Le vel 1 Le vel 2 Leve l 3 Level 4 Level 5 Numbe r of Le vel 1 Level 2 Level 3 Leve l 4 Level 5
Country Appraisals Reported Reported Reported Re porte d Reported Country Appra isa ls Reported Reported Re porte d Reported Re porte d
Argentina 70 40 23 3 Macedonia 10 or fewer
Australia 15 3 6 1 Malaysia 48 8 38 2
Austria 10 or fewer Mauritius 10 or fewer
Bahrain 10 or fewer Mexico 116 56 52 1 5
Bangladesh 10 or fewer Morocco 10 or fewer
Belgium 10 or fewer Nepal 10 or fewer
Brazil 143 1 76 56 8 Netherlands 12 1 4 6
Brunei Darussalam 10 or fewer New Zealand 10 or fewer
Bulgaria 10 or fewer Norway 10 or fewer
Canada 30 1 9 12 3 Pakistan 24 1 21 1 1
Chile 37 2 22 12 1 Panama 10 or fewer
China 1866 71 1686 56 45 Paraguay 10 or fewer
Colombia 43 1 16 10 3 5 Peru 18 10 7
Costa Rica 10 or fewer Philippines 12 2 4 1 4
Cuba 10 or fewer Poland 10 or fewer
Cyprus 10 or fewer Portugal 20 8 10 2
Czech Republic 10 or fewer Qatar 10 or fewer
Denmark 10 or fewer Romania 11 1 4 6
Egypt 44 1 25 14 1 Russia 10 or fewer
Finland 10 or fewer Saudi Arabia 12 2 6 1 2
France 124 3 71 39 1 Singapore 17 5 10 1
Germany 65 6 24 19 Slovakia 10 or fewer
Greece 10 or fewer South Africa 10 or fewer
Guatemala 10 or fewer Spain 222 1 125 74 2 8
Hong Kong 11 3 3 4 Sri Lanka 16 2 14
Hungary 10 or fewer Sweden 10 or fewer
India 518 1 15 366 4 123 Switzerland 10 or fewer
Indonesia 10 or fewer Syrian Arab Republic 10 or fewer
Ireland 10 or fewer Taiwan 113 1 48 58 4 1
Israel 14 8 4 Thailand 51 16 33 2
Italy 55 27 24 Tunisia 10 or fewer
Japan 187 7 43 97 8 9 Turkey 24 21 3
Jordan 10 or fewer Ukraine 10 or fewer
Korea, Republic Of 158 56 74 12 9 United Arab Emirates 10 or fewer
Latvia 10 or fewer United Kingdom 83 2 25 29 5
Lebanon 10 or fewer United States 1278 10 470 636 5 68
Lithuania 10 or fewer Uruguay 10 or fewer
Luxembourg 10 or fewer Viet Nam 22 18 1 3

CMMI-SCAMPI v1.2/v1.3 Class A

Appraisal Results
19
March 2012
© 2012 Carnegie Mellon University
Most Reported Appraisals per Year by Country

Country 2006 2007 2008 2009 2010 2011 Total

China 1 103 273 482 499 508 1866
United States 3 149 238 311 307 270 1278
India 5 81 80 117 110 125 518
Spain 15 30 75 43 59 222
Japan 16 47 40 40 44 187
Korea, Republic Of 21 30 28 35 44 158
Brazil 16 27 38 37 25 143
France 13 29 31 28 23 124
Mexico 4 18 30 35 29 116
Taiwan 18 29 19 24 23 113
CMMI-SCAMPI v1.2/v1.3 Class A
Appraisal Results
20
March 2012
© 2012 Carnegie Mellon University
 Number of SCAMPI A Appraisals Reported to
SEI by Year
1600

TOTAL
1375
1400 1349 1333
POSTED ON PARs
1311 1299 1307
Number of Appraisals

1200

1004
1000

941

800

600 556

509
400

200

11
0
2006 2007 2008 2009 2010 2011

Based on 5628 appraisals

CMMI-SCAMPI v1.2/v1.3 Class A
Appraisal Results
21
March 2012
© 2012 Carnegie Mellon University
 Trends in the Community Maturity Profile
100%

90%

2006 11
80%
2007 564

65.9%
2008
% of Organizations

1516

64.6%
70%

63.6%

62.9%
2009 2770

58.2%
2010 3,845
60%
2011 4,731

47.9%
50%

40%
31.4%
28.2%

27.3%
30% 25.1%

22.9%
23.8%

20%

9.4%
9.1%
9.0%

5.4%
6.1%

5.7%
10%

5.2%
5.1%
4.9%

3.6%
4.4%

1.7%
1.6%
0.7%

1.3%
1.2%

1.1%
1.0%
0.8%
0.5%
0.4%

0%
Not Given Initial Managed Defined Quantitatively ManagedOptimizing
Based on a cumulative view of the most recent appraisals of organizations up through the year indicated
CMMI-SCAMPI v1.2/v1.3 Class A
Appraisal Results
22
March 2012
© 2012 Carnegie Mellon University
 Time to Move Up

40

Number of months 75th Percentile

to move to
next maturity 30
level 26
25 Median

20
20
25th Percentile

10
5

Time Period of Initial

Appraisal 2006 to Present

Level 1 to 2 2 to 3 3 to 4 3 to 5

Orgs 7 189 47 57

CMMI-SCAMPI v1.2/v1.3 Class A

Appraisal Results
23
March 2012
© 2012 Carnegie Mellon University
Summary -1
Since 2006, 5628 SCAMPI v1.2/1.3 appraisals have been reported to
the SEI.
Despite global economic conditions, demand appears to be consistent.
Only 42 fewer SCAMPI appraisals were performed in 2011 vs. 2009.

Appraisals reported from China, Spain, Korea, India and Japan are
increasing at a rapid rate.

More than 67% of appraised organizational units have 100 or fewer

employees. The percentage is increasing steadily.

The majority of reported appraisals are maturity level 2 and 3

organizations.
The number of appraisals in the USA and China represent more than
55% of the total number of appraisals.

CMMI-SCAMPI v1.2/v1.3 Class A

Appraisal Results
24
March 2012
© 2012 Carnegie Mellon University
Summary -2

China is now reporting more appraisals than USA

For organizations that began their CMMI-based SCAMPI effort with V1.2
or later, the median time to move from
• maturity level 2 to 3 is 20 months

• maturity level 3 to 4 is 25 months

• maturity level 3 to 5 is 26 months

Note:
Since the September 2011 report, the median time to move from maturity level 2 to 3 increased from 19
months to 20 months. The median time to move from maturity level 3 to 4 increased from 21 months to
25 months. The median time to move from maturity level 3 to 5 increased from 25.5 months to 26
months.

CMMI-SCAMPI v1.2/v1.3 Class A

Appraisal Results
25
March 2012
© 2012 Carnegie Mellon University
Terms Used in this Report

Company - Parent of the appraised entity. A company can be a commercial or non-

commercial firm, for-profit or not for-profit business, a research and
development unit, a higher education unit, a government agency, or
branch of service, etc.

Organization - a.k.a. Appraised entity. The organization unit to which the appraisal
results apply. An appraised entity can be the entire company, a selected
business unit, units supporting a particular product line or service, etc.

Non-USA - Appraised entity whose geographic location is not within the United States.
The parent of the appraised entity may or may not be based within the
United States.

PARS - the Published Appraisal Results webpage contains CMMI® appraisals

published at the request of the appraisal sponsor. The URL is:
http://sas.sei.cmu.edu/pars/

CMMI-SCAMPI v1.2/v1.3 Class A

Appraisal Results
26
March 2012
© 2012 Carnegie Mellon University
Contact Information

SEI Customer Relations (412) 268-5800

SEI FAX number (412) 268-5758

Internet Address customer-relations@sei.cmu.edu

Mailing Address Customer Relations

Software Engineering Institute
Carnegie Mellon University
Pittsburgh, PA 15213-3890

CMMI-SCAMPI v1.2/v1.3 Class A

Appraisal Results
27
March 2012
© 2012 Carnegie Mellon University
NO WARRANTY
THIS CARNEGIE MELLON UNIVERSITY AND SOFTWARE ENGINEERING INSTITUTE
MATERIAL IS FURNISHED ON AN “AS-IS" BASIS. CARNEGIE MELLON UNIVERSITY
MAKES NO WARRANTIES OF ANY KIND, EITHER EXPRESSED OR IMPLIED, AS TO
ANY MATTER INCLUDING, BUT NOT LIMITED TO, WARRANTY OF FITNESS FOR
PURPOSE OR MERCHANTABILITY, EXCLUSIVITY, OR RESULTS OBTAINED FROM
USE OF THE MATERIAL. CARNEGIE MELLON UNIVERSITY DOES NOT MAKE ANY
WARRANTY OF ANY KIND WITH RESPECT TO FREEDOM FROM PATENT,
TRADEMARK, OR COPYRIGHT INFRINGEMENT.
Use of any trademarks in this presentation is not intended in any way to infringe on the
rights of the trademark holder.
This Presentation may be reproduced in its entirety, without modification, and freely
distributed in written or electronic form without requesting formal permission. Permission
is required for any other use. Requests for permission should be directed to the Software
Engineering Institute at permission@sei.cmu.edu.
This work was created in the performance of Federal Government Contract Number
FA8721-05-C-0003 with Carnegie Mellon University for the operation of the Software
Engineering Institute, a federally funded research and development center. The
Government of the United States has a royalty-free government-purpose license to use,
duplicate, or disclose the work, in whole or in part and in any manner, and to have or
permit others to do so, for government purposes pursuant to the copyright license under
the clause at 252.227-7013.

CMMI-SCAMPI v1.2/v1.3 Class A

Appraisal Results
28
March 2012
© 2012 Carnegie Mellon University