Goal Question Metric Tutorial

Jackie Morman
Quality & Mission Success Manager Lockheed Martin Missiles & Fire Control

02/05/2008

Goal Question Metric Tutorial

Topics
Basic Constructs Goal Question Metric Example

02/05/2008

Goal Question Metric Tutorial

Basic Constructs
Conceptual Level (Goal)
A goal is defined for an object, for a variety of reasons, with respect to various models of quality, from various points of view, relative to a particular environment.

Operational Level (Question)

A set of questions is used to characterize the way the assessment/achievement of a specific goal is going to be performed based on some characterizing model.

Quantitative Level (Metric)

A set of data is associated with every question in order to answer it in a quantitative way.
02/05/2008 Goal Question Metric Tutorial 3

Goal
Goals are composed of
Purpose Three basic sources of information
Issue Object (process) Viewpoint Example: Improve (purpose) the timeliness (issue) of engineering change processing (object) from the project managers viewpoint (viewpoint)
02/05/2008 Goal Question Metric Tutorial 4

Question
Derive meaningful questions that characterize the goal in a quantifiable way using the following 3 groups of questions:
Group 1: How can we characterize the object (product, process, or resource) with respect to the overall goal of the specific GQM model?
Examples What is the current engineering change processing speed? Is the (documented) engineering change process actually performed?

Group 2: How can we characterize the attributes of the object that are relevant with respect to the issue of the specific GQM model?
Examples What is the deviation of the actual engineering change processing time from the estimated? Is the performance of the engineering change process improving?

Group 3: How do we evaluate the characteristics of the object that are relevant with respect to the issue of the specific GQM model?
Examples Is the current performance satisfactory from the viewpoint of the project manager? Is the performance visibly improving?

02/05/2008

Goal Question Metric Tutorial

Metric
Identify metrics that will answer the questions
Maximize existing data source May be as good as the maturity of the process/procedure
Subjective metric vs. objective metric

02/05/2008

Goal Question Metric Tutorial

Example
Goal Purpose Issue Object (process) Viewpoint Question Q1 Metrics M1 M2 M3 Question Q2 Metrics M4 M5 Question Q3 Metrics M6 Improve The timeliness of Engineering change processing From the project managers viewpoint What is the current engineering change processing speed? Average cycle time Standard deviation % cases outside of the upper limit Is the (documented) engineering change process actually performed? Subjective rating by the project manager % of exceptions identified during reviews What is the deviation of the actual engineering change processing time from the estimated? Current avrage cycle time - Estimated average cycle time * 100 Current avrage cycle time Subjective evaluation by the project manager Is the performance of the engineering change process improving? Current average cycle time * 100 Baseline average cycle time Is the current performance satisfactory from the viewpoint of the project manager? Subjective evaluation by the project manager Is the performance visibly improving? Current average cycle time * 100 Baseline average cycle time
Goal Question Metric Tutorial 7

M7 Question Q4 Metrics M8 Question Q5 Metrics M7 Question Q6 Metrics M8

02/05/2008

Bibliography
Basili, Caldiera, Rombach, Goal Question Metric Approach," http://www.cs.umd.edu/users/mvz/handout s/gqm.pdf, Feb 2008,.

02/05/2008

Goal Question Metric Tutorial

Return To Presentation Summary

02/05/2008

Goal Question Metric Tutorial