SCAMPI V1.

3 Appraisal Team Training Course: Pretest

Distribution limited to SCAMPI Appraisal Team Members in preparation for SCAMPI

Appraisal Team Training. No other reproduction or distribution is permitted without
written permission of the Software Engineering Institute (SEISM).
®
Capability Maturity Model and CMMI are registered in the U.S. Patent and Trademark Office by Carnegie
Mellon University.

SM
IDEAL, SCAMPI, SCAMPI Lead Appraiser, and SEI are service marks of Carnegie Mellon University.

Version February 2011

Copyright 2011 by Carnegie Mellon University. Page 2 of 9
1 About This Pretest
1.1 Audience
This pretest is for attendees of the Standard CMMI® Appraisal Method for Process Improvement
(SCAMPISM) Appraisal Team Training course.

1.2 Objective
The objective of the pretest is to ensure that all SCAMPI Appraisal Team Training course
attendees begin with a basic understanding of SCAMPI concepts and terminology.

The pretest does not address everything you will need to know to be effective as a SCAMPI team
member; however, it does attempt to clarify some of the essential aspects. Doing well on the
pretest does not ensure your success as a SCAMPI team member. On the other hand, if you have
difficulty completing the pretest, it will be an indication that you need to spend more time
understanding the basic concepts and language of the method.

The pretest does not directly address CMMI model knowledge. As a past attendee of the
Introduction to the CMMI course, you should be familiar with the V1.3 CMMI models.

1.3 Instructions
The pretest must be completed individually, as it is intended to reflect your understanding of the
material. Reference aids–the materials provided to you in the pre-course package–can be freely
consulted in the formulation of your responses.

Please complete your pretest by hand with a ball-point pen or felt-tip marker. Do not use pencil
or erasable ink. “Completing” the pretest consists of (1) providing responses to each of the
questions, (2) providing the requested information in Section 5 (Examinee Affirmation), and (3)
signing the pretest.

Preparation for completing the pretest consists of reading and understanding the provided
background document:

1. SCAMPI Version 1.3: Method Definition Document (SMDD), Part I: SCAMPI A

Method Overview.

Copyright 2011 by Carnegie Mellon University. Page 3 of 9

1.4 Scoring

The pretest will be scored according to the following rules:

1. True-False questions: 1 point for each question answered correctly.

2. Multiple-choice questions: 2 points for each question answered correctly.
3. Fill-in-the-blank(s) questions: 1 point for each correct response (a multiple-word
response or phrase is considered one response).
4. Hybrid questions containing a fill-in-the-blank component as well as a multiple choice
component: 3 points for answering the question correctly, partial credit for either
component will be provided in accordance with rules 2 and 3 above.

Unless otherwise indicated, multiple-choice questions are intended to have a single correct
response. Please answer these questions by circling the response which you think represents the
most correct answer, unless the question specifically says you may select more than one correct
response.

Fill-in-the-blank(s) questions provide space wide enough for handwritten responses; in general,
the width of the space is not necessarily indicative of the length of the word to be written.
Conversely, the number of spaces is indicative of the number of words in the correct response.

Students scoring below 80% may be dropped from the appraisal team, or they may be required to
build their knowledge and understanding of the topics for which incorrect responses were
provided, at the discretion of the Lead Appraiser.

Feedback regarding your performance on the pretest will be provided prior to the start of the on-
site period.

Copyright 2011 by Carnegie Mellon University. Page 4 of 9

 Page Sub-total__________ (For SEI Use Only)

2 SCAMPI Version 1.3: Method Definition Document

The answers to most of the questions in this part of the test can be found verbatim in the
SCAMPI MDD (SMDD). In fact, most of the questions are text extracted from the SMDD. In
choosing your answers, keep in mind that there are almost always particular words we are
looking for that can be found in the SMDD in text similar to or the same as that in the questions.

2.1 Part I: Overview

2.1.1 About This Document

2.1.1.1 How to Use This Document

1. Required (SCAMPI) practices are found in the ________________

table _________________
activity
elements of the SMDD.

2. Acceptable limits for things that are allowed to vary, and acceptable limits for things
parameters
under the discretion of the appraisal team leader, are found in the ________________
limits
and _________________ elements of the SMDD.

2.1.1.2 Feedback Information

1. If I have a suggested improvement for the SMDD I should

a. go to http://www.sei.cmu.edu/cmmi/models/change-requests.html for information

on how to provide feedback.
b. call SEI Customer Relations.
c. send an email to cmmi-comments@sei.cmu.edu.
d. Any of the above.
e. None of the above.

2. If I have a question about the SMDD, I should

a. go to http://www.sei.cmu.edu/cmmi/models/change-requests.html for information

on how to provide feedback.
b. call SEI Customer Relations.
c. send an email to cmmi-comments@sei.cmu.edu.
d. Any of the above.
e. None of the above.

Copyright 2011 by Carnegie Mellon University. Page 5 of 9

 Page Sub-total__________ (For SEI Use Only)

2.1.2 Executive Summary

1. Circle all that apply. The SCAMPI method:

a. is designed to provide benchmark quality ratings relative to Capability Maturity
Model® Integration (CMMI) models.
b. is applicable to a wide range of appraisal usage modes, including both internal
process improvement and external capability determinations.
c. None of the above.

3
2. SCAMPI consists of _________ 13
phases and __________ essential processes.

3. (True / False) Successful application of SCAMPI V1.3 relies upon adjusting the
parameters of the method to the needs of the organization and to the objectives and
constraints of the sponsor’s organization.

4. Circle all that apply. Which of the following statements regarding tailoring the SCAMPI
method are true?

a. The sponsor’s objectives largely influence tailoring decisions.

b. All tailoring decisions must be documented in the appraisal plan.
c. The more tailoring done, the more expensive the appraisal.
d. Tailoring should not exceed the acceptable limits allowed by the appraisal
method.
e. The SCAMPI Lead Appraiser is responsible for ensuring that the requirements of
the method are satisfied. Tailoring the method too severely could result in the
failure to satisfy method requirements, the inability to obtain sufficient data for
generation of appraisal findings or ratings, or the failure to meet the criteria
necessary for recognition as a SCAMPI (ARC Class A) appraisal.

5. A nominal time frame for conducting a SCAMPI appraisal is three months, including

a. planning
b. preparation
c. execution
d. A and B
e. B and C
f. A, B and C

Copyright 2011 by Carnegie Mellon University. Page 6 of 9

 Page Sub-total__________ (For SEI Use Only)

2.1.3 SCAMPI Method Overview

1. Goal ratings are a function of the extent to which the corresponding ______________
reference model practice are

present in the planned and implemented processes of the organization.

2. (True / False) Sufficiency at the practice level for an instantiation is determined when
artifacts covering the intent of the practice have been verified for the practice and
corroborated by artifacts or affirmations.

3. Circle all that apply. Based upon the objective evidence for practice implementation, the
appraisal team (or typically a mini-team) assigns values to characterize the extent to
which the CMMI model practice is implemented. Each practice is characterized
according to a scale that includes which of the following?

a. Satisfied
b. Not Satisfied
c. Fully Implemented
d. Largely Implemented
e. Partially Implemented
f. Almost Implemented
g. Not Implemented
h. Not Yet
i. Hardly Implemented
j. Not Ever
k. None of the above

4. (True / False) Strengths and weaknesses identified across instantiations are synthesized
and aggregated to statements of preliminary findings, expressed at the organizational unit
level.

5. Maturity level ratings and/or capability level ratings are based on the definitions of
capability levels and maturity levels in the

a. ARC.
b. CMMI models.
c. SCAMPI MDD.
d. SCAMPI Lead Appraiser “Kit” CD.
e. None of the above.

Copyright 2011 by Carnegie Mellon University. Page 7 of 9

 Page Sub-total__________ (For SEI Use Only)

6. Circle all that apply. The SCAMPI method is defined in terms of the following
architectural elements:

a. segments
b. activities
c. processes
d. pages
e. words
f. frames
g. phases
h. steps
i. practices

Copyright 2011 by Carnegie Mellon University. Page 8 of 9

 Page Sub-total__________ (For SEI Use Only)

3 Examinee Affirmation
By my signature below I do affirm that I have completed this pretest in good faith and that the
responses contained herein reflect my understanding of the SCAMPI V1.3 method.

Name (printed): ________________________________

Signature: ______________________________________

Date Completed (mm/dd/yy): _________________________

Please provide your contact information, as you would like it to appear in our records.

________________________________ (name)

________________________________ (organization)

________________________________ (address 1)

________________________________ (address 2)

________________________________ (City, State/Province, Postal code)

________________________________ (Country)

Copyright 2011 by Carnegie Mellon University. Page 9 of 9