• Embed Doc
  • Copy Link
  • Readcast
  • Collections
  • CommentGo Back
Download
 
 
Use and Organizational Effects of Measurementand Analysis in High Maturity Organizations:Results from the 2008 SEI State of Measurementand Analysis Practice Surveys
Dennis R. GoldensonJames McCurleyRobert W. Stoddard II
February 2009TECHNICAL REPORT
CMU/SEI-2008-TR-024ESC-TR-2008-024
Software Engineering Process Management
Unlimited distribution subject to the copyright.http://www.sei.cmu.edu
 
 
This report was prepared for theSEI Administrative AgentESC/XPK5 Eglin StreetHanscom AFB, MA 01731-2100The ideas and findings in this report should not be construed as an official DoD position. It is published in theinterest of scientific and technical information exchange.This work is sponsored by the U.S. Department of Defense. The Software Engineering Institute is a federallyfunded research and development center sponsored by the U.S. Department of Defense.Copyright 200
8
Carnegie Mellon University.NO WARRANTYTHIS CARNEGIE MELLON UNIVERSITY AND SOFTWARE ENGINEERING INSTITUTE MATERIAL ISFURNISHED ON AN “AS-IS” BASIS. CARNEGIE MELLON UNIVERSITY MAKES NO WARRANTIES OFANY KIND, EITHER EXPRESSED OR IMPLIED, AS TO ANY MATTER INCLUDING, BUT NOT LIMITEDTO, WARRANTY OF FITNESS FOR PURPOSE OR MERCHANTABILITY, EXCLUSIVITY, OR RESULTSOBTAINED FROM USE OF THE MATERIAL. CARNEGIE MELLON UNIVERSITY DOES NOT MAKEANY WARRANTY OF ANY KIND WITH RESPECT TO FREEDOM FROM PATENT, TRADEMARK, ORCOPYRIGHT INFRINGEMENT.Use of any trademarks in this report is not intended in any way to infringe on the rights of the trademark holder.Internal use. Permission to reproduce this document and to prepare derivative works from this document forinternal use is granted, provided the copyright and “No Warranty” statements are included with all reproductionsand derivative works.External use. This document may be reproduced in its entirety, without modification, and freely distributed inwritten or electronic form without requesting formal permission. Permission is required for any other externaland/or commercial use. Requests for permission should be directed to the Software Engineering Institute atpermission@sei.cmu.edu.This work was created in the performance of Federal Government Contract Number FA8721-05-C-0003 withCarnegie Mellon University for the operation of the Software Engineering Institute, a federally funded researchand development center. The Government of the United States has a royalty-free government-purpose license touse, duplicate, or disclose the work, in whole or in part and in any manner, and to have or permit others to do so,for government purposes pursuant to the copyright license under the clause at 252.227-7013.For information about SEI reports, please visit the publications section of our website(http://www.sei.cmu.edu/publications).
 
 
i
| CMU/SEI-2008-TR-024
Table of Contents
Acknowledgments vii
 
Abstract ix
 
1
 
Introduction 1
 
2
 
The Respondents and Their Organizations 3
 
3
 
Baselining Variability in Process Outcomes: Value Added by ProcessPerformance Modeling 9
 
4
 
Baselining Variability in Process Implementation 11
 
4.1
 
Stakeholder Involvement in Setting Measurement and Analysis Goals and Objectives 11
 
4.2
 
Measurement-Related Training 12
 
4.3
 
Process Performance Modeling 14
 
4.4
 
Analytic Methods 21
 
5
 
Baselining High Maturity Organizational Context 27
 
5.1
 
Management Support, Staffing, and Resources 27
 
5.2
 
Technical Challenge 31
 
5.3
 
Barriers and Facilitators 32
 
6
 
Explaining Variability in Organizational Effects of Process Performance Modeling 35
 
6.1
 
Analysis Methods Used in this Report 35
 
6.2
 
Process Performance Modeling and Analytic Methods 38
 
6.3
 
Management Support 45
 
6.4
 
Stakeholder Involvement in Setting Measurement and Analysis Goals and Objectives 48
 
6.5
 
Measurement-Related Training 51
 
6.6
 
Technical Challenge 56
 
6.7
 
In Summary: A Multivariable Model 61
 
7
 
Performance Outcomes of Measurement and Analysis Across Maturity Levels 63
 
8
 
Summary and Conclusions 69
 
Appendix A:
 
Questionnaire for the Survey of High Maturity Organizations 71
 
Appendix B:
 
Questionnaire for the General Population Survey 116
 
Appendix C:
 
Open-Ended Replies: Qualitative Perspectives on the Quantitative Results 137
 
References 169
 
of 00

Leave a Comment

You must be to leave a comment.
Submit
Characters: ...
You must be to leave a comment.
Submit
Characters: ...