Professional Documents
Culture Documents
Communicating The Forecast From Issue 54 of Foresight
Communicating The Forecast From Issue 54 of Foresight
PREVIEW Forecasts are necessary, but not in themselves sufficient for effective decision
making. Here, Alec Finney describes his takeaways from asking decision makers to reveal
what’s missing from the numerical outputs they receive from forecasters. Key themes
that emerge are the need to agree on assumptions, manage risk, and sell “a story—not a
spreadsheet.” His analysis led to the development of a new sharing platform to improve
communication and decision making.
ASKING DECISION MAKERS •
Use a “storyboard” approach to the
WHAT THEY NEED structure and evolution of the forecast.
From these discussions we needed to
I remember a senior VP in the pharma-
ceutical industry telling me that “fore-
casting is more than just the numbers—
develop the storyboard structure, risk man-
agement, and functional plans requested.
much more.” He is, of course, absolutely
STORYBOARD STRUCTURE
correct. But how so? In what ways?
Over the last three years I’ve been lis- “Make the way the forecast is commu-
tening to many development/portfolio nicated more like a story rather than a
directors in pharma to find out just what spreadsheet.”
“much more” is. I did this by taking a deep “A spreadsheet model is lost on me—tell me
dive into interviews with creators, users, the story of the forecast as it evolves.”
and approvers of forecasts in the field. Purpose and Scope
My questions were designed to cut to the • First, what is the business process
core of the forecasting experience, such the forecast supports? Is it a decision
as “What are the attributes of a quality emerging from the result of clinical tri-
forecast?” and “If you had a magic wand, als, a budgeting/target-setting exercise,
what aspect of forecasting would you fix?” or a collection of information to support
Several themes emerged about communi- long-term strategy?
cating the forecast. Decision makers need • What are the contributing markets, the
outputs that time horizon, granularity, and units of
• Measure uncertainty and manage the measure of the forecast?
associated risk; • Are the Forecast Owner and Forecast
• Make the assumptions more visible; Creator for the specific forecast in-
• Differentiate between a forecast that cluded? The Owner is accountable for
describes the most likely future and the forecast—“the buck stops here.” The
one that serves the needs of functional Creator is responsible for the forecast—
planners; creating and populating the model.
• Are delivered by an “alive and kicking” Assumptions
support system that keeps the numbers What are the challenges and opportuni-
and the assumptions up to date; and ties presented by the competitive, regula-
tory, and market-access environments?
Figure 1. Composition of the Storyboard What resources will be invested to sup-
port the launch of a new product and its
subsequent growth? What is the assumed
size of the potential market, and what
market share will our asset achieve? What
future events will significantly impact
product performance?
https://foresight.forecasters.org FORESIGHT 45
RISK MANAGEMENT courage, especially if the margin for error
is wide. But it has to be done.
“In more direct terms, all forecasts have risk
associated with them—just tell me when A good way to illustrate the uncertainty
I’m leaning out of the window too far.” around a forecast is to draw a band de-
noting, say, 80% of all possible outcomes
“Are there any other possible futures of
around the MLF, as shown in Figure 3.
which I should be aware?”
Presenting a forecast model, even with This prediction interval can be based on
a strong link to the assumptions and a Monte Carlo simulation (MCS). Here,
transparent description of the model log- we specify the amount of uncertainty
ic, will not satisfy all the contextual needs around each assumption from “the worst
of the decision makers. We also need to nightmare” on one extreme to “the best
measure uncertainty and manage the as- dream” on the other. MCS then allows us
sociated risk. Doing so requires answers to create an uncertainty profile covering
to these three questions: all assumptions behind the forecasting
• What is the Most Likely Future (MLF)? model.
• How confident am I in the forecast? Other approaches to depicting uncertain-
• Are there other futures of which I need ty are nicely presented by Paul Goodwin
to be aware? (2014), including fan charts and probabil-
ity density charts.
The Most Likely Future (MLF) Are There Other Futures of Which I
This MLF forecast is based upon the Need to Be Aware?
agreed assumptions across the business Some of these assumptions may be bi-
as well as on evidence-based models/ nary—either “on” or “off.” These should
algorithms. It is the 50/50 forecast right be represented as specific scenarios.
in the middle of the range of expectations
(Finney and Joseph, 2009). Scenario 1—An upside. The brand is
launched into market first-in-class rather
How Confident Are We than second.
in These Forecasts? Scenario 2—A downside. A competitor’s
Describing clearly and openly how much new indication is approved and will hurt
uncertainty surrounds the forecasts our market share. The total picture is
will require honesty and, very possibly, shown in Figure 3.
Figure 3. MLF with 80% Confidence Limits including Two Scenarios
In MCS, one can select a particular shape Figure
4. Planning End Points Chosen by Each Function
distribution of possible outcomes, such X
as a Normal distribution, which we’ll now
use as an illustration.
Developing Functional Plans
We can now ask each functional stake-
Probability
holder what operational plan they will Marketing Plan
need to manage expectations and risk.
(Setting targets)
The responses could be as follows: Financial Plan Manufacturing Plan
Supply Chain: I want to manage the (Managing expectations) (Managing risk)
uncertainty in the forecast to make sure
that we meet 90% of our customer- X X
service levels and minimize inventory
(Manufacturing Plan). This is depicted
in Figure 4 at the right end of the distri-
medium risk and a low level of outcome. Figure 5. Impact of Changes in Assumptions on Peak Year Sales
https://foresight.forecasters.org FORESIGHT 47
Figure 6. Early 2015 Added
CONCLUSION