Professional Documents
Culture Documents
EXCEPTION REPORTING
Downloaded from ascelibrary.org by UNIVERSITY OF NEW SOUTH WALES on 05/11/15. Copyright ASCE. For personal use only; all rights reserved.
ABSTRACT; Exception reporting, hardly a new concept, is too often still largely
that--a concept. Modern project-control information systems should generate an
assortment of useful exception reports. As decision support systems, they must
provide all levels of management with current information about various aspects
of project performance in a timely and meaningful manner. Exception reports can
enhance management's productivity by focusing on the most critical subset of per-
formance information. This paper presents a systematic approach to exception
reporting for construction labor cost and related performance aspects. Several
exception reports are used, individually and in combination, to provide structured
and guided exception-reporting and variance-analysis capabilities. These reports,
and their underlying concepts, are demonstrated using a computerized prototype.
The purpose of such exception-reporting capability is to enable managers to identify
critical control points, prioritize their limited time and improve their effectiveness.
Flexibility,versatility, user-defined criteria, and multiple reporting perspectives are
emphasized.
INTRODUCTION
LSr. Engr., Automation Integration Methods Group, Bechtel Corp., San Fran-
cisco, CA; formerly PhD candidate, Univ. of California, Berkeley, CA 94720.
"Assoc. Prof., Dept. of Civ. Engrg., Univ. of California, Berkeley, CA.
Note. Discussion open until August 1, 1993. To extend the closing date one month,
a written request must be filed with the ASCE Manager of Journals. The manuscript
for this paper was submitted for review and possible publication on December 31,
1991. This paper is part of the Journal of Construction Engineering and Management,
Vol. 119, No. 1, March, 1993. 9 ISSN 0733-9364/93/0001-0087/$1.00 + $.15
per page. Paper No. 3191.
87
VARIANCETHRESHOLDS
Thresholds are central to management by exception. They define toler-
able performance levels by demarcating an envelope above and below the
planned performance level. This envelope allows actual performance to
deviate slightly without triggering alarms.
A big noise factor in tracking labor performance is the accuracy of work
quantity measurements (Langworthy, 1988, private communication; Hart,
1990, private communication; Kerby, 1990, private communication; Herrell,
1988, private communication). Work quantities are used to compute physical
percent completion and unit productivity, crucial performance metrics. Un-
certainty in man-hour allocations to specific accounts is also a source of
noise. Man-hour allocation deviations are affected by the size of the time
unit chunks used to report progress, too.
Threshold Variability
A variance threshold must also allow for the inevitable variability of actual
performance about the estimated average. Actual period costs routinely
vary from the estimate. What matters is that actual costs eventually converge
toward the at-completion budget. Another important practical point is the
amount of budget deviation that can be tolerated at completion. Because
no two jobs are identical, actual production levels will differ. Thresholds
should be set judiciously and in accordance with the specific characteristics
of the individual project.
This also means that a constant, cumulative threshold throughout an
account's progress fails to provide for the relatively turbulent performance
data of early progress stages. Thresholds should have different variances at
the various progress stages. At the project's beginning, operations do not
achieve a smooth production mode; there are account setup and other front-
end fixed-cost activities that an intelligent system would recognize.
As a consequence most cost engineers are cautious about performance
data trends until approximately 15%-20% completion is achieved (Eang-
worthy, 1988, private communication; Kerby, 1990, private communication;
Hart, 1990, private communication; Herrell, 1988, private communication).
The dilemma is that a cost engineer cannot wait too long before acting on
observed trends. The opportunity window for effective remedial steps be-
comes smaller as time passes.
Early progress performance assessments are most susceptible to perfor-
mance data noise. Quantity measurement and man-hour allocation noise is
increasingly diluted as the project progresses. The dilution is caused by
offsetting period measurement and allocation errors, and by a declining
incremental impact of period data on the cumulative results. As work pro-
gresses the expected reduction in data noise should therefore be translated
into diminished tolerance of observed performance variance. Our system
allows the user to define variable threshold levels based on an important
concept called the window of opportunity.
88
80%); and (3) the late stage (e.g., 80%-100%). These points are approx-
imate points of delimitation and are not the same for every account or
project. The significance of the first stage has already been explained. The
last stage marks the point beyond which management cannot meaningfully
affect performance (Hart, 1990, private communication). By then most
budgeted resources are expended and overruns are not correctable. Prob-
lems usually display early warning signs (Hart, 1990, private communication;
Langworthy, 1988, private communication). EarIy detection within the 0 % -
80% completion window of opportunity improves chances for the success
of corrective efforts.
Threshold Values
Threshold level tightness must be commensurate with the degree of con-
trol management plans to exercise. Industry professionals are reluctant to
define even extreme threshold values without a specific project scenario
(Langworthy, 1988, private communication; Pancham, 1990, private com-
munication; Hart, 1990, private communication). In theory, a project man-
ager will refuse to accept any overrun. The consensus of this study's industry
advisors is, however, that at least 3 % - 5 % variance must be allowed for
data noise, especially in quantity measurements. One project manager com-
mented that a 10% period or cumulative variance is almost always a prob-
lem, except for small accounts. Our prototypical system allows the user to
specify the three different project ranges and the threshold for each on both
a relative and absolute basis. It can do it for a number of perspectives,
which are described in the next section.
EXCEPTION REPORTING
To support decision making at various management and supervision lev-
els, multiple labor performance data views must be supported. The basic
premise is that users should be provided a perspective that best serves their
level of responsibility. Thus, from the overall company's viewpoint, a variety
of reporting perspectives is needed.
9 Work elements
9 Work packages
9 Discipline/work category
9 Subarea/subfacility
9 Area/facility
9 Superintendents or foremen
9 Performing organizational units
4. Schedule activities
89
A SYSTEMATICAPPROACH
Each of SAMER's exception reports is useful by itself because it allows
the user to focus on a specific aspect of labor-related performance. The full
decision support potential of these reports is best realized, however, when
they are used together synergistically.
A road-map approach guides the overall variance-analysis approach. This
approach helps management ask the right questions. Fig. 1 presents this
road map, which we call the variance-analysis path diagram (VAPD). The
user follows this road map when using the system to identify exceptions and
analyze variances. The following relationship conceptually defines cost var-
iance in terms of its major components:
CV = CW/v I -~ C V L -~ C V E --~ . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . (1)
This equation implies that residual sources of cost variance remain and are
not only accounted for by material, labor, or equipment. They may also
include subcontract, indirects, and other cost types. The components ex-
plicitly identified in the equation, however, are typically the major ones.
The labor component of cost variance (CVL) is the focus of the VAPD
and starts at the top with labor cost in bubble 1. Because only labor cost
and hours are analyzed from this point on, the subscript L will be dropped
from the notation.
Most of the shaded bubbles in Fig. 1 are associated with one of the
90
1110.1210A703 27 Ions 376,22 245.69 1.53 -7832 100 -7518 .207 -10 *Over~nlzhtrgdyduetolowrthaaest. produ~
(100%) (96%) 43%) (1%) .Ge~tcUni4ProductivityEll for furtherins~hl
1110.1120.1403 65 tons r~9.04 504.0 lo29 -4727 60 -3402 -1152 -173 *ny.~un~largelyd~tolowertbau~t.prodm.
(100% (72%) (24%) (4%) .Ge~rateUrdtProdectivRyEaf~furtborinsiglo
* Ove~enis sobstanfialiydue to higherthat1Mr.
laborunitprice:
I - Ge~ate LaborUnitPriceER for i'urth~ insist
i
[110.1120.1443 50 :y 49.17 46.24 1.06 -I173 15 -2127 856 !98 *Ov~nt~enttr~ly d~to;ewer thanest,prod~
(I00%) O81%) (-73%3 (-S%) .Ge~at*UnitProductivttyEa f~fnrtherinstl~
9 A largeoff~ttingunder~n dee to lowerOt~ ~t.
10 labor emltpriceexist&
- ~ # t e LaborUnitPrice]~1~for furth~ titbit
110,2110.2305 !f 30.69 27.71 L14 -649 8 -302 - 3 3 0 1-17 *Overr~issubstanttallyd~loIower t h a n ~
4100%) (47%) 451%) (3%) prudu~
. GenerateUnitProductivRyER for fartherinslghl
9 o ~ u n is largelyd e to higherth~ ~t~labor
unit p ~ :
9Ge~att Lal~r UnitPriceER for furtherinslgnt
Pe~od ~ I A~o~t~
the window of opportunity is set between 20% and 70% for this account.
A LCER is shown in Fig. 3. Generally to-date results will be shown in this
paper, though the three buttons at the bottom of the output screen allow
the user to switch between current, to-date, and forecast at-completion
report periods.
Item code identifies exceptions by account or classification code, The PC
column reports percent completion. Next is the budgeted labor cost of work
performed (labor earned value) in the BCWP column. ACWP is the actual
labor cost of work performed. The labor cost variance (BCWP - ACWP)
in the CV column is reported in dollars or man-hours, as well as a percentage
of the corresponding earned value (BCWP) in parentheses. (In this case,
the cost variance percentage change is negative.) Next is the relative rank
index of the overrun exception in the rank index column sorted in descending
order. The rank index normalizes each exception on a scale of 100. Con-
ventional practice is to report only the overruns. Though this figure does
not show it, we feel that information systems should highlight successes,
too, so we include both in one report to stress them equally. It is possible
though to switch this feature off.
The next three columns provide an analysis of the reported labor cost
variance (CV). Labor cost (C) for an account can be computed as follows:
C = O x UC .............................................. (2)
where Q = work quantity in units of measure (uom), bubble 9 in Fig. 1;
and UC = unit labor cost (labor $/uom), bubble 2 in Fig. 1.
Any labor-cost variance results from problems with work quantity, unit
labor cost, or combined deviations. SAMER's breakdown of labor-cost
variance for each exception item enables the user to quickly trace the sig-
nificant next-level source(s) of the reported variance.
The quantity column reports the portion of the account's CV due solely
to actual work quantity deviation from the account's total budgeted work
quantity, CVo, for the selected reporting period. Budget unit labor cost is
used to compute the contribution to labor-cost variance. For the current
period a work quantity deviation occurs only if all or part of the quantity
installed during the period exceeds the total work quantity account budget.
Therefore:
For the to-date period, a work quantity deviation occurs if and only if
the cumulative quantity installed to date is larger than the total work quantity
budgeted for the account. Therefore:
The unit cost column identifies the portion of CV solely due to deviation
of the account's actual unit labor cost for the reporting period from the
account's budget unit labor cost. This definition of labor-cost variance due
to unit labor-cost variance (CVuc) is consistent for all three reporting pe-
riods. Thus for the reporting, to-date, and at-completion periods, a unit
labor-cost deviation occurs if the actual unit labor cost for the reporting
period is different from the account's budget unit labor cost. Therefore:
The portion of CV due to joint work quantity and unit labor-cost devia-
tions (CVonuc) is reported in the joint column. Joint work quantity and
unit labor-cost deviation occurs when both work-quantity and unit labor-
cost deviations exist for the selected reporting period according to the afore-
mentioned definitions. It is computed by multiplying the quantity deviation
by the unit labor-cost deviation. The variance breakdown is reported in
dollars or equivalent budget man-hours, and as a percentage of the labor-
cost variance in parenthesis.
The L C E R breaks labor-cost variance into three components
CV = CV o + CVuc + CVonuc .............................. (3)
This variance analysis is useful because it points the user toward the next
step(s) in the variance-analysis path. The user can then interactively generate
the recommended reports and display them on the screen alongside the
LCER. More detail is obtained from each additional recommended report.
The remarks column is an innovative feature of most of SAMER's ex-
ception reports. It provides a narrative interpretation of the variance-anal-
ysis results. Numbers are sometimes misleading, especially when changes
of sign are involved. The remarks eliminate such confusions and recommend
certain action for further insight. They are constructed by a set of if-then
rules that reason about variance-analysis results.
If variance analysis points to work quantity as a sizable contributor to
labor-cost variance, a general statement to that effect is provided. Note that
work quantity deviations do not in themselves necessarily impact labor
production.
If unit labor cost is a major contributor to CV, the user will be advised
to generate a unit labor-cost exception report, as discussed in the next
section. By examining the different exceptions in the LCER, the user may
be able to recognize commonalities across accounts that explain some var-
94
1110.1210.1703 25 14742 22574 -7832 I 100 0 -7832 0 * Overrun Is entirely due to higher than ~t. unit
(-~%) ! (0%) (1oo%) (o%) labor cost:
Generate Unit Labor Cost ER for further insight
1110.1120.1403 75 2268~ 27467 -4727 I 60 0 -4727 0 * Overrun is entirely due to higher than est. unit
(.21%) [ (0%) (100%) (0%) labor cost:
i Generate Unit Labor Cost ER for further Iltstght
1110.1120.1443 50 18496 19669 -1173 15 0 -1173 0 *Overronisentirelyduetohigherthanest. unit
(-6%/ (0%) (10o%) (0%) labor cost:
Generate Unit L~bor Cmt ER for farther insight
1110.2110.2305 10 6048 6697 -649 8 0 -649 0 * Overrun is entirely d~e ~ohigher than est. unit
(-11%) (0%) O00%) (0%) labor cost:
Generate Unit Labor Cost ER for further insight
95
the account budget unit productivity and the actual unit productivity
for the reporting period. Budget quantity and labor unit price are
used to compute the contribution to labor-cost variance.
The unit price column contains CVtje. Labor-cost variance due to labor
unit price deviation occurs when the account's actual labor unit price for
the selected reporting period differs from the budget labor unit price. This
definition is consistent for all three reporting periods. Thus for the current,
to-date, and at-completion periods, a labor unit price deviation occurs if
the actual labor unit price differs from the account's budget labor unit price
CVpnup appears in the joint column. A joint unit productivity and labor
unit price deviation occurs when both productivity and labor unit price
deviations exist for the reporting period according to the aforementioned
definitions. It is computed by multiplying the productivity deviation by the
labor unit price deviation and the budget quantity. It can also be computed
from (5); e.g., -4,727 = (-3,042) + ( - 1,152) + CVenup, or CVpnup =
- 173.
Each variance component is also reported as a percentage of the labor-
cost variance due to unit labor-cost deviation (CV column). The quantity
and unit labor-cost joint variance (CVqnue) from the LCER may also be
subdivided. This produces two additional joint variances: a quantity and
labor unit price joint variance, and a quantity and unit productivity joint
variance. For clarity, joint variances are not carried down to the next analysis
level because numerous two- and three-way joint variances would have to
be computed. The remarks provide textual interpretation of variance anal-
ysis results and direct the user to the next report level(s) to generate if
additional information is desired.
The user can get the next-level breakdown of the labor-cost variance for
a particular account by generating the ULCER. Furthermore, this report
enables the user to examine the account's relative unit cost deviation. Some
common denominator may be recognized by stepping back from individual
exceptions and examining accounts collectively. Exceptions will hopefully
fall into a number of meaningful groupings. Examples of such groupings
may include:
The next section discusses how managers can use SAMER when a unit
price deviation is reported.
97
The crew-mix column gives the variance portion due to crew mix or
configuration changes (CVcM). Crew mix addresses types and ratios of crafts
as well as journeymen-apprentices mix. As before, the entries in the remarks
column interpret the variance-analysis results. Remarks, however, do not
include direction to more reports or point further down the variance-analysis
path because craft rate and crew mix are the lowest level in the VAPD at
this time. These are parameters that the user may or may not be able to
control. Management must determine this on a case-by-case basis. Knowing
the share of each component helps a manager decide the utility of corrective
measure. This report allows the user to examine a specific labor unit price
exception relative to other cost elements excepted in the same category. Its
placement relative to other exceptions may be useful information. Insight
may also be gained by comparing the different accounts experiencing similar
problems.
SAMER identifies where escalation in craft rates results in significant
labor-cost variance. If normal overtime usage for an account can be defined,
98
1110.1120.1403 75 torat 23.0 20.0 6.87 1,15 0.29 -3402 ;5 * Overrun is due to poor productivity
(72%) * Signllicant productivity improvement
is required to control overrun
* Absenteeism Pall = 6%
1110,1120,1443 $0 cy 2.23 2,0 1.77 1.11 0.79 -2127 28 * Overrun is due to poor productivity
(181%) * Slgrdflcant productivity improvement
is required to control overrun
* Absenteeism Rate = 0%
* Actual crew mix is different from that
planned
1110,1120,1423 90 ;f 0.19 0.2 --- 0.97 - - - 413 $ * Overrun is due to fair productivity
(100%) * Absenteeism Rate = 0%
99
Schedule Exceptions
Construction schedule performance is directly influenced by labor pro-
ductivity (bubbles 8 and 3 in Fig. 1). Recognizing that, this study sought
ways to relate the two performance aspects to one another. The results are
the schedule exception report, (SER), Fig. 7, and the schedule activity
exception report (SAER), not shown.
For the SER, a BCWS column contains the budgeted labor cost of work
scheduled. The schedule variance (SV = BCWP - BCWS) is reported in
the first SV column. BCWP, BCWS, and SV are reported in dollars or man-
hours depending on user selection during report initialization. SV is also
reported as a percentage in a second SV column. Exceptions are sorted in
order of decreasing relative schedule variance.
SER's remarks column suggests interpretations of the reported schedule
variances. It also reports any productivity-related variance relevant to the
schedule variance. The implication is that a productivity variance may be
translating into a schedule variance. There may also be an indication of
unreliable trends or bad data. For example, a work package may be reported
as possibly ahead of schedule while suffering from productivity overruns.
Such conflicting indications help management identify situations where an
audit may be in order.
100
111~2110 10 6048 12096 -6048 -100 100 * Very si~Jficant schedule delay may be necuring. Check network.
9 Check activity A600.
9 Element has a protiuctivity overrun of $302 (5 %)
1110.1120 67 56048 29561 26486 47 47 * Very significant schedule saving may be occuring. Check network.
9 Check activity A200, A300, A400
9 Element has a productivity overrun of $5116 (9%)
1110.1210 25 14742 18428 .3686 -25 25 * Significant schedule delay may be occuring. Check network.
9 Check activity AS00,
9 Element has a productivity overrun of $7518 (51%)
A remark may also appear that points to one or more network activities
that should be checked for possible schedule variance. To check activities
highlighted by the SER, the SAER is generated. This report examines all
activities that are underway at the time the report is prepared as well as
any activity whose early start falls within the next two weekly periods. The
activity number column identifies all activities that have been excepted. The
current early start column defines each activity's early start date as of the
last schedule update. The deviation between the original and current early
start dates is reported in the early start variance column. The total float of
an excepted activity is found in the total float column. The total float var-
iance column lists the deviations that the current total float values have
experienced. The same applies to the duration and duration variance col-
umns.
The excepted activities in this report are sorted according to early start.
The remarks column interprets the early start, total float, and duration
variances. A remark will sometimes caution the user that the excepted
activity seems to have been impacted by other activities along its path.
INTERSECTING EXCEPTIONS
Every report described so far has a specific and distinct focus and scru-
tinizes one subset of performance data. All relate the performance of labor
resources, or provide information about factors that can impact labor per-
formance. They also analyze ripple effects.
Additional insight can sometimes be gained by intersecting two or more
exception reports. Three types of intersection reports are discussed here.
The idea is to explore the interrelationships that are known to exist between
different project data. That has been accomplished to some extent with the
individual reports via the variance breakdown and remarking features. Yet
there is still value to intersecting pairs of reports because it focuses attention
at the joint events rather than leave it to the user to recognize them.
101
directly intersecting the to-date portions of the LCER and SER. The joint
section of the report contains elements that have been excepted based on
both counts; i.e., threshold-penetrating cost and schedule variances. The
CV and SV for any one exception need not necessarily be consistent. That
is, they need not be both overruns or underruns. In fact, examining the
different combinations can be interesting. In the joint portion of the report,
there may be elements that are doubly troublesome. Accounts significantly
exceeding their budgets and schedules should get management's attention.
Other accounts in the joint portion of the report may be doing better than
planned in one area but failing miserably in the other. It is not uncommon
that one of the performance aspects is doing well at the expense of the
other; for example, work undergoing acceleration using overtime labor.
The disjoint section of the report identifies accounts experiencing exces-
sive deviation in one or the other performance aspect, but not both. That
in itself may be useful information. For example, why is schedule on track
despite a depressed production level that is resulting in substantial overruns?
Another account may experience the exact opposite. It may very well be
that the information is incomplete, or erroneous. Such knowledge is in itself
helpful. If the reporting system can stimulate management to ask the right
questions, then the system will be effective.
SUMMARY
This paper describes a new approach to project control. It relies upon a
variety of highly customizable exception reports that provide different win-
dows onto labor performance data. A systematic approach to labor excep-
tion reporting and variance analysis was explained and illustrated. Decision
support system concepts underlie much of SAMER, a prototype developed
for this purpose. Example reports demonstrated some of the enhancement
proposed by this study. The prototype's capability to graphically display
exception results is currently rudimentary (mostly bar charts). A more robust
graphic capability will be a major part of our future version.
This paper also emphasizes the importance of looking beyond the im-
103
ACKNOWLEDGMENTS
We wish to thank John Herrell of Guy F. Atkinson Construction Co.,
Hugh Langworthy of Bechtel, Inc., and Dr. Paul Teicholz of Stanford Uni-
versity for suggestions to this research. We also thank the reviewers of this
paper for their comments that improved the first draft of this manuscript.
This research was supported by the U.S. National Science Foundation under
Grant MSM-8451561, Presidential Young Investigator's Award.
APPENDIX. REFERENCE
Abu-Hijleh, S. F. (1991). "A model for variance-based exception reporting with
user-defined criteria," PhD thesis, Univ. of California, Berkeley, Calif.
104