2011 Sep CMMI Process Maturity Report

CMMI® for SCAMPISM Cl A A i l R ltSCAMPISM Class A Appraisal Results 2011 Mid-Year Update

Software Engineering InstituteCarnegie Mellon UniversityCarnegie Mellon UniversityPittsburgh, PA 15213

September 2011September 2011

1

CMMI-SCAMPI v1.2/v1.3 Class A Appraisal ResultsSeptember 2011© 2011 Carnegie Mellon University

© 2011 Carnegie Mellon University

Outline

IntroductionCurrent StatusCommunity TrendsOrganizational TrendsSummary and Terms Used in this BriefingSummary and Terms Used in this Briefing

This briefing is based solely on the appraisals reported to the SEI. It cannot be used as a source for an exact indicator of all organizations in the world using CMMI models or appraisal methods nor can it be used for certification or verification purposes.

The SEI does not certify appraisal results or organizations. The SEI licenses SEI Partners, authorizes/certifies lead appraisers, team leaders and high maturity lead appraisers to conduct appraisals. Neither the SEI nor any other organization is a “certifying authority” of the results from a SCAMPI appraisal. Therefore requests to the SEI to provide information to be used for this purpose can not be fulfilled. Information provided by the SEI, such as this briefing, is to demonstrate reported results of the use of CMMI products and services only.

2


Introduction - Purpose

Characterize the adoption of CMMI

Describe results from Standard CMMI Appraisal Method for ProcessDescribe results from Standard CMMI Appraisal Method for Process Improvement (SCAMPISM) v1.2/v1.3 Class A appraisals using Capability Maturity Model® Integration (CMMI v1.2/ v1.3)*

* Organizations previously appraised against CMMI v1.0 /v1.1 and which have not reappraised against v1.2 or v1.3 are not included in this report.

* SVC,ACQ appraisals are included in this report, P-CMM appraisals are not included in this report,

3


Introduction - Briefing Contents

This briefing includes three primary sections:

1 Current Status1. Current Status• Snapshot of the development community based on the most recent

appraisals, since SCAMPI V 1.2 release, of reporting organizations

2. Community Trends • Global distribution of appraisals

G th i th b f i l f d• Growth in the number of appraisals performed

• Shifts in the maturity profile over time

3 Organizational Trends3. Organizational Trends• Time to move up in maturity based on change in maturity level and time

between appraisals

4


Process Maturity Profile by All Reporting Organizationsby All Reporting Organizations

3200

3400

3600

2400

2600

2800

3000

atio

ns

65.4%

1400

1600

1800

2000

2200

r of O

rgan

iza

600

800

1000

1200

1400

Num

ber

23.4%

0

200

400

Not Given Initial Managed Defined Quantitatively Managed

Optimizing

4.0%0.5% 1.6%

5.1%

5


Based on most recent appraisal of organizations4220

Process Maturity Profile (SVC Only)by All Reporting Organizationsby All Reporting Organizations

50

40

niza

tions

20

30

ber o

f Org

an

42.9%

51.0%

10

20

Num

b

0Not Given Managed Defined

6.1%

6


Based on most recent appraisal of organizations49

Reporting Organization Categories

Commercial/In-house 80.5%

Contractor for Military/Government 15.8%

Military/Government Agency 3.7%

0 1000 2000 3000 4000 5000

Number of Organizations

7


gBased on organizations reporting an organization category4220

Process Maturity Profile by Reporting Organization Categoriesby Reporting Organization Categories

90%

100%

C i l/I h 3356

70%

80%

90% Commercial/In-house = 3356

Contractor for Military/Government = 659

Military/Government Agency = 153

n C

ateg

ory

61.7%58.3%

43.1%39.9%

40%

50%

60%

atio

ns W

ithi

20.4%

27.6%

15.7%20%

30%

40%

% o

f Org

aniz

a

3.5%0.4% 1.9%

4.6%2.9%

0.2% 0.3%

5.8%

0.7% 1.3% 2.6%

0%

10%


Optimizing

%

8


Based on most recent appraisal of organizations reporting an organization category4168

Organization SizeBased on the total number of employees within the area of the organization that was appraisedBased on the total number of employees within the area of the organization that was appraised

501 to 10004 0%

1001 to 20001.9%

2000+1 6%

25 or fewer20.3%

301 to 5005.4%

4.0% 1.6%

101 to 20015 1%

201 to 3005.8%

1 to 10066 3%

201 to 2000+18.6%

26 0

15.1% 66.3%

26 to 5025.9%

51 to 7512 6%

76 to 1007.6%

9


12.6%Based on organizations reporting size data4197

Organization Size (SVC Only)Based on the total number of employees within the area of the organization that was appraisedBased on the total number of employees within the area of the organization that was appraised

501 to 100012 2%

1001 to 20002.0% 2000+

4.1%

25 f

12.2%

201 to 2000+32.7% 25 or fewer

49.0%301 to 5006.1%

32.7%

101 to 2002.0%

201 to 3008.2%

1 to 10065.3%

26 to 5010.2%

51 to 754.1%

76 to 1002.0%

10


Based on organizations reporting size data49

Maturity Profile by Organization SizeBased on the total number of employees within the area of the organization that was appraisedBased on the total number of employees within the area of the organization that was appraised

90%

100%

72.4

%

69.8

%

68.5

%

68.3

%

0.2%

68.1

%

% 61.5

%70%

80%

s by

Siz

e

40.7

%53

.8%

60

57.2 6

54.5

%

39.4

%

40%

50%

60%

Org

aniz

atio

ns

3%

22.5

%

23.1

%

20.2

%

17.2

%

18.0

%

.1% 13.9

%

% 12.8

%

22.3

%

23.1

%

20%

30%

%

% o

f O

4.0%

2.6% 3.2%

2.5% 4.

7% 7.4%

5.3% 6.0%

10.

3.0%

0.6%

0.5%

0.4% 0.9%

0.4%

0.4%

11

5.1%

1.5%

0.4% 1.0% 1.5% 3.

5%

3.0% 4.1%

2.2%

0.6%

1.5%0.6% 1.1% 2.1% 5.

4% 5.8%

9.8% 1

0%

10%

25 or fewer 26 to 50 51 to 75 76 to 100 101 to 200 201 to 300 301 to 500 501 to 1000 1001 to 2000 2000+Not Given Initial Managed Defined Quantitatively Managed Optimizing

11


Based on organizations reporting size data4197

USA and Non-USAReporting Organization CategoriesReporting Organization Categories

Commercial/In-316

Commercial/Inhouse 3040

Contractor for Military/Government 191

468

Military/Government Agency

USA: 100% = 864

Non-USA: 100% = 3304

73

80

0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%

% of Organizations

12


Maturity Profile by All Reporting Organizations in the USAOrganizations in the USA

90%

100%

70%

80%

ons

40%

50%

60%

f Org

aniz

ati

317

453

20%

30%

40%

% o 317

0%

10%


Optimizing

561 2

41

13


g

Based on organizations in the USA 870

Maturity Profile by All Reporting Organizations based outside the USAOrganizations based outside the USA

90%

100%

70%

80%

atio

ns 2305

40%

50%

60%

of O

rgan

iza

20%

30%

40%

%

672

0%

10%


Optimizing

11119 67

176

14


Based on organizations outside the USA3350

Section 2—Community Trends

Appraisals are conducted through June 2011 and reported to the SEI by July 2011

• 73 countries reporting appraisals– Most of the appraisals are from Asia and North America.

• 4612 Appraisals posted on PARS– Expired appraisals are removed from PARS and replaced with the newest

reappraisal result.

15


Countries Where Appraisals Have Been Performed and Reported to the SEIPerformed and Reported to the SEI

Argentina Australia Austria Bahrain Bangladesh Belgium Brazil Brunei DarussalamBulgaria Canada Chile China Colombia Costa Rica Czech Republic DenmarkEgypt Finland France Germany Greece Guatemala Hong Kong HungaryIndia Indonesia Ireland Israel Italy Japan Jordan Korea Republic OfIndia Indonesia Ireland Israel Italy Japan Jordan Korea, Republic OfLatvia Lebanon Lithuania Luxembourg Macedonia Malaysia Mauritius MexicoMorocco Nepal NetherlandsNew Zealand Norway Pakistan Panama ParaguayPeru Philippines Poland Portugal Qatar Romania Russia Saudi ArabiaSingapore Slovakia South AfricaSpain Sri Lanka Sweden Switzerland TaiwanThailand Tunisia Turkey Ukraine United Arab E United Kingdom United States UruguayViet Nam

16


Viet NamRed country name: New additions with this reporting since March 2011

Number of Appraisals Reported to the SEI by Continentby Continent

3500

4000

2660

2500

3000

3500

ppra

isal

s

1500

2000

500

umbe

r of A

p

580

1244

295500

1000

Nu

54 13

295

0Africa Asia Australia Europe North America South America

Based on appraisals North America includes Canada the USA and Mexico; South America includes Central America and the

4846

17


North America includes Canada, the USA, and Mexico; South America includes Central America and the Caribbean ; Australia includes New Zealand

Number of Appraisals and Maturity LevelsReported to the SEI by CountryReported to the SEI by Country

CountryNumber of Appraisals

Maturity Level 1

Reported

Maturity Level 2

Reported

Maturity Level 3

Reported

Maturity Level 4

Reported

Maturity Level 5

Reported CountryNumber of Appraisals

Maturity Level 1

Reported

Maturity Level 2

Reported

Maturity Level 3

Reported

Maturity Level 4

Reported

Maturity Level 5

ReportedArgentina 66 37 23 2 Malaysia 45 8 35 2Australia 11 3 3 Mauritius 10 or fewerAustria 10 or fewer Mexico 95 43 45 1 5Austria 10 or fewer Mexico 95 43 45 1 5Bahrain 10 or fewer Morocco 10 or fewerBangladesh 10 or fewer Nepal 10 or fewerBelgium 10 or fewer Netherlands 11 1 3 6Brazil 125 1 67 48 7 New Zealand 10 or fewerBrunei Darussalam 10 or fewer Norway 10 or fewerBulgaria 10 or fewer Pakistan 24 1 21 1 1Canada 30 1 9 12 3 Panama 10 or fewerChile 33 1 21 10 1 Paraguay 10 or fewerg yChina 1557 63 1409 43 35 Peru 18 10 7Colombia 40 1 15 8 3 5 Philippines 11 1 4 1 4Costa Rica 10 or fewer Poland 10 or fewerCzech Republic 10 or fewer Portugal 16 6 9 1Denmark 10 or fewer Qatar 10 or fewerEgypt 40 1 24 11 1 Romania 10 or fewerFinland 10 or fewer Russia 10 or fewerFrance 111 66 34 1 Saudi Arabia 11 2 6 1 1Germany 55 6 19 16 Singapore 14 4 8 1Greece 10 or fewer Slovakia 10 or fewerGuatemala 10 or fewer South Africa 10 or fewerHong Kong 10 or fewer Spain 186 1 106 62 2 4Hungary 10 or fewer Sri Lanka 15 2 13India 462 12 330 3 108 Sweden 10 or fewer

Indonesia 10 or fewer Switzerland 10 or fewerIreland 10 or fewer Taiwan 98 1 42 50 4Israel 13 7 4 Thailand 38 12 25 1Italy 45 18 23 Tunisia 10 or fewer

Japan 165 7 39 85 6 7 Turkey 22 19 3Jordan 10 or fewer Ukraine 10 or fewerKorea, Republic Of 128 49 59 10 4 United Arab Emirates 10 or fewerLatvia 10 or fewer United Kingdom 74 1 21 26 5Lebanon 10 or fewer United States 1119 5 417 550 3 60Lithuania 10 or fewer Uruguay 10 or fewer

18


g yLuxembourg 10 or fewer Viet Nam 17 14 1 2Macedonia 10 or fewer

Number of SCAMPI A Appraisals Reported to SEI by YearSEI by Year

1600

TOTAL 1375

1310 12991200

1400POSTED ON PARs

rais

als

1004

13751349

941

800

1000

mbe

r of A

ppr 1004

509542

400

600

Num 556 551

0

200

2006 2007 2008 2009 2010 2011

11

19


Based on appraisals4846

Trends in the Community Maturity Profile

11

90%

100%

2006 11564

151627703,846

63.6

%

8.2%

62.9

%64

.6%

65.4

%

60%

70%

80%20062007200820092010za

tions

4,220

47.9

%58

40%

50%

60% 2011

% o

f Org

aniz

27.3

%31.4

%28

.2%

25.1

%23

.8%

23.4

%

20%

30%

%

9.1%

9.0%

1.2%

1.1%

9.4%

6.1%

0.8% 1.0%

5.7%

4.9%

0.5% 1.3%

5.2%

4.4%

0.4% 1.

6%

5.1%

4.0%

0.5% 1.6% 5.

1%

0%

10%

Not Given Initial Managed Defined Quantitatively ManagedOptimizing

20


Based on a cumulative view of the most recent appraisals of organizations up through the year indicated

Time to Move Up

40

3025.5

Number of months to move tonext maturity level

75th Percentile

Median

2120 19

25th Percentile

10

Time Period of Initial

5

2006 to Present

1 to 2 2 to 3 3 to 4 3 to 5

7 146 31 40

Time Period of InitialAppraisal

Level

Orgs

21


Summary -1

Since 2006, 4846 SCAMPI v1.2/1.3 appraisals have been reported to the SEI.

Appraisals report from China, Spain, Brazil, Argentina, and India are increasing at a rapid rate.

More than 66% of appraised organizational units have 100 or fewer employees. The percentage is increasing steadily.

The majority of reported appraisals are maturity level 2 and 3The majority of reported appraisals are maturity level 2 and 3 organizations.

The number of appraisals in the USA and China represent more than 55% f th t t l b f i l55% of the total number of appraisals.

China is now reporting more appraisals than USA

22


Summary -2

For organizations that began their CMMI-based SCAMPI effort with V1.2 or later, the median time to move from

• maturity level 2 to 3 is 19 months

• maturity level 3 to 4 is 21 months

• maturity level 3 to 5 is 25.5 months

23


Terms Used in this Report

Company - Parent of the appraised entityA company can be a commercial or non-commercial firm, for-profit or notfor-profit business a research and development unit a higher educationfor-profit business, a research and development unit, a higher educationunit, a government agency, or branch of service, etc.

Organization - a.k.a. Appraised entity The organization unit to which the appraisal results apply. An appraisedentity can be the entire company, a selected business unit, unitssupporting a particular product line or service, etc.

Non-USA - Appraised entity whose geographic location is not within the United States.The parent of the appraised entity may or may not be based within theUnited States.

PARS - Published Appraisal Results webpage contains CMMI® appraisalspublished at the request of the appraisal sponsor.

The link is: http://sas.sei.cmu.edu/pars/

24


Contact Information

SEI Customer Relations (412) 268-5800SEI Customer Relations (412) 268 5800

SEI FAX number (412) 268-5758

Internet Address [email protected]@

Mailing Address Customer RelationsSoftware Engineering InstituteCarnegie Mellon UniversityCarnegie Mellon UniversityPittsburgh, PA 15213-3890

25


NO WARRANTY

THIS CARNEGIE MELLON UNIVERSITY AND SOFTWARE ENGINEERING INSTITUTE MATERIAL IS FURNISHED ON AN “AS-IS" BASIS CARNEGIE MELLON UNIVERSITYMATERIAL IS FURNISHED ON AN AS IS BASIS. CARNEGIE MELLON UNIVERSITY MAKES NO WARRANTIES OF ANY KIND, EITHER EXPRESSED OR IMPLIED, AS TO ANY MATTER INCLUDING, BUT NOT LIMITED TO, WARRANTY OF FITNESS FOR PURPOSE OR MERCHANTABILITY, EXCLUSIVITY, OR RESULTS OBTAINED FROM USE OF THE MATERIAL. CARNEGIE MELLON UNIVERSITY DOES NOT MAKE ANY WARRANTY OF ANY KIND WITH RESPECT TO FREEDOM FROM PATENT, TRADEMARK, OR COPYRIGHT INFRINGEMENT.

Use of any trademarks in this presentation is not intended in any way to infringe on the rights of the trademark holderrights of the trademark holder.

This Presentation may be reproduced in its entirety, without modification, and freely distributed in written or electronic form without requesting formal permission. Permission is required for any other use. Requests for permission should be directed to the Software Engineering Institute at [email protected].

This work was created in the performance of Federal Government Contract Number FA8721-05-C-0003 with Carnegie Mellon University for the operation of the Software Engineering Institute, a federally funded research and development center. TheEngineering Institute, a federally funded research and development center. The Government of the United States has a royalty-free government-purpose license to use, duplicate, or disclose the work, in whole or in part and in any manner, and to have or permit others to do so, for government purposes pursuant to the copyright license under the clause at 252.227-7013.

26


2011 Sep CMMI Process Maturity Report

Documents

Transcript of 2011 Sep CMMI Process Maturity Report