You are on page 1of 14

PROBLEM STRUCTURING FOR limited literature on how to structure MCDA

MULTICRITERIA DECISION models, and this will be reviewed here. Fur-


ANALYSIS INTERVENTIONS thermore, while there is a large body of
literature on problem structuring and on
LUIS A. FRANCO problem-structuring methods, most of it is
Warwick Business School, disconnected from the mainstream MCDA
University of Warwick, literature. We will build on this body of work
Coventry, UK to give a coherent perspective on problem
GILBERTO MONTIBELLER structuring for MCDA, which we hope will
Department of Management, be useful for both MCDA researchers and
London School of Economics, practitioners.
London, UK The chapter is structured as follows:
we start by discussing two key problem-
structuring tasks concerning the earlier
stages of an MCDA intervention. The sub-
INTRODUCTION sequent section reviews general guidelines
for structuring MCDA evaluation models. In
Multicriteria decision analysis (MCDA), a the final section, we build on the preceding
methodology for supporting decision making sections to propose a general framework for
when multiple objectives have to be pursued conducting MCDA interventions, in which
[1–3], has been extensively used to support problem structuring plays a significant role.
a wide variety of complex decision problems The chapter ends with concluding remarks
[4,5]. While the literature on axiomatic and some directions for further research in
aspects of multicriteria decision analysis the field.
models is extensive, much less attention
has been devoted to the process of struc-
turing these models, with few exceptions STRUCTURING THE PROBLEM SITUATION
[6–8].
The task of structuring MCDA models in There are two main problem-structuring
real-world interventions is far from trivial. tasks faced by decision analysts when con-
This is mainly due to the intrinsic com- ducting MCDA interventions: defining the
plexity of the models, where several objec- problem, and scoping participation. Below
tives have to be articulated, defined, and we discuss each of these tasks and comment
measured by attributes. Furthermore, the on the challenges the decision analyst may
definition of a set of alternatives to be eval- encounter when carrying them out, together
uated is not always straightforward, as deci- with a set of tools/techniques that could
sion makers may struggle to think creatively be used to facilitate their achievement.
about the problem and consider innovative Although, in the discussion that follows, we
alternatives. present each problem-structuring task sepa-
At a broader level, much of the MCDA rately, it is worth noting that in practice these
literature neglects the role of problem struc- tasks are not necessarily undertaken in a lin-
turing as a prelude to the structuring of an ear fashion. Rather, there are two ‘‘modes’’ of
MCDA model, a phase of the intervention problem structuring between which the deci-
whose proper management is absolutely cru- sion analyst is continually ‘‘cycling’’ during
cial if both the decision analysts and the the early stages of an MCDA intervention.
decision analysis are to have some effect on
the organization. Defining the Problem
In this article, we discuss problem struc-
turing for MCDA interventions. There is a Given the significance ofproblem formulation

Wiley Encyclopedia of Operations Research and Management Science, edited by James J. Cochran
Copyright © 2010 John Wiley & Sons, Inc.
1
2 PROBLEM STRUCTURING FOR MULTICRITERIA DECISION ANALYSIS INTERVENTIONS

in organizational decision making [9–12], it Second, the problem which will eventu-
is surprising that the literature on MCDA ally be presented to the analyst is the result
has devoted relatively minor attention to of a process of ‘problem framing’ within the
the processes of articulating and defining organization, most typically within a team of
a multicriteria problem. It seems that the managers. As Eden and Sims aptly illustrate,
underlying assumption is that arriving at a a manager who wishes to get others in the
well-structured multicriteria decision prob- team to take on a problem she/he has identi-
lem is somehow a relatively trivial task. fied as being the team’s, ‘‘. . .will present the
There is also a widespread belief among problem in such a way as to make it appar-
many practitioners that structuring a deci- ent that there are gains to be had or losses
sion problem is more ‘‘art than science’’ and to be averted for other members of the team
that it can best be learned through expe- by solving this problem. He (sic) may seek
rience. This view suggests that experienced to show some member of the team that a
analysts are able to recognize familiar pat- solution to his (the initial problem’s definer)
terns or structures of problems, and use them problem would also solve some different prob-
as templates to build their decision models lem, which he believes this member to be
[13]. Our experience as researchers and con- experiencing. . ..he may define his problem to
sultants, however, suggests that the use of be in line with other problems which seem
decision analytic structures are well suited to to be being experienced at that time. . ..(or)
problem situations that are clearly defined, express concern and commitment about some
but less so when they are ill-structured or problem being stated by another member in
‘messy’ [14]. In such situations, attempts to the hope of getting some concern and com-
impose a structure too early in the interven- mitment about his problem in return’’ (16, p.
tion can lead to focusing on and solving the 121).
‘wrong problem’ and thus incurring in what Thus, we might expect that when the
is known as the Type III error [15]. analyst starts an MCDA intervention with
Indeed empirical research has shown that a given problem situation presented by the
the definition of problems, particularly those client, the reality is that other versions of
of the ill-structured type, is not given but con- the same situation are likely to exist. These
tinually negotiated among members of the other versions will become apparent as the
organization before and during an interven- analyst listens to others in the organization.
tion [16]. This process of negotiation can be One challenge for the analyst at this stage is
conceptualized as follows. First, managers then not so much to model what will become
are constantly striving to make sense of their the actual multicriteria decision problem to
internal and external environments in order be solved, but to identify and model the dif-
to manage and control their organizations ferent perceptions of the problem situation
[17]. This sense-making process is aided with held by different managers. Several problem-
the help of a unique mental framework that structuring tools are available to support
is developed through experience, and which this task. These include, for example, cog-
includes systems of beliefs and values. A nitive mapping [18,19]; soft systems method-
‘problem’ emerges when the use of such a ology [20,21]; dialog mapping [22]; strategic
mental framework, to make sense of a partic- choice approach [23], and group model build-
ular situation, leaves the manager uneasy or ing [24,25]. (For an overview of these tools
dissatisfied because she/he does not know see Ref. 10.)
how to deal with that situation. Because Most of these tools have been developed to
different managers will experience different capture multiple aspects of a problem situa-
problems by applying their own unique men- tion, including objective and subjective ones.
tal frameworks to what might be thought This is important because when managers
of as the same situation, the decision ana- define a problem situation, it will be defined
lyst will not be able to think and talk about in their own language and based on their own
the ‘problem’ without ascribing an owner or interpretations of the situation, their own
owners to it. experience or expertise and their own value
PROBLEM STRUCTURING FOR MULTICRITERIA DECISION ANALYSIS INTERVENTIONS 3

Inclusion of
Regeneration attitudinal
of profiling element
instrument
Improve
CEO needs to Need to remove Partners need customer
communicate with fear of global exit strategy interface
partners directly hidden agenda Increase
Partners need validity
sucession plan
CEO upset by Need to
minimize gap in Web based
partners’ recent
– perceptions of Difference in
messages
future direction contractual Sign license Need to be move to
arrangements – agreements selling learning

– solutions
Company owners
ending different Global pricing
messages strategy need
to be agreed Develop global
strategy Grow company
Need to manage –
tension between
entrepreneurial Need consisent Need additional
spirit and central capabilities rsources
control

Figure 1. An example of a cognitive map, representing strategies for growth of an organization.

systems. A problem situation defined in this the statements denote means–end chains of
way will thus include factors that may not arguments. For example, the ‘‘regeneration of
be typically regarded as legitimate variables profiling instrument’’ (top right in the map)
in a standard MCDA modeling project, but is seen by this client as a way to get partners
that are nevertheless important if the analyst to ‘‘sign license agreements’’ (center right in
wishes to understand the needs and concerns the map).
of any particular client or client group. The The recognition that problem definition in
challenge for the decision analyst is, there- organizations involves negotiation between
fore to be able to formally map aspects of the managers with multiple world-views [20]
problem situation in terms of the concepts about the problem has some practical impli-
used by the client. For if there is a doubt in cations for the analyst. First, if the MCDA
the client’s mind about whether correct con- intervention is intended to have some effect
cepts have been taken into account, she/he on the organization, the decision analyst may
is unlikely to believe in the solution to the need to discuss a redefinition of the problem
problem, let alone act upon it [16]. with the client before trying to help. The
For example, Fig. 1 illustrates a way to structuring tools cited above can all assist
capture a client’s understanding of a problem in this process [10]. Secondly, when working
using the client’s own concepts. The figure with members of a client group that have dif-
shows the beginning of a cognitive map that ferent views or interpretations of the problem
contains different aspects of a problem faced situation of interest, the analyst must choose
by an organization operating in the learning whose interpretation to pay attention to. The
and professional development sector. Here choice does not necessarily imply favoring
the client is concerned about the growth of the one particular interpretation over another.
organization, which eventually led to a mul- Rather, it is about focusing on some combina-
ticriteria evaluation of strategic priorities at tion of interpretations which for reasons that
a later stage in the intervention. Nodes in the are explained later in the chapter, will often
map contain statements describing different be a reflection of the analyst’s understanding
aspects of the problem. The links between of the key stakeholders of the organization.
4 PROBLEM STRUCTURING FOR MULTICRITERIA DECISION ANALYSIS INTERVENTIONS

High
‘Subjects’ ‘Players’
North American Company
North European
partners founders
partners

Competitors
Interest

‘Crowd’ ‘Context
setters’
Regulatory
agents

Low Figure 2. An example of a power–interest


Low High grid of stakeholders when considering
Power strategies for growth of an organization.

Once the problem situation has been by the decision. This broad definition thus
defined and agreed with the client or client considers the internal as well as the external
group, the decision analyst should be in stakeholders of the organization.
a good position to identify a particular Within the context of an MCDA inter-
decisional element of the situation upon vention, attention to stakeholders is needed
which a relevant a multicriteria evaluation to assess and enhance political feasibility
model can be built. A quite useful tool at this of decision implementation. Attention to
stage is Keeney’s concept of decision framing stakeholders is also important to satisfy
[6], which connects the strategic objectives those involved in, or affected by, the decision
of the organization with the fundamental that the intervention has followed rational,
objectives for the particular decision and the fair, and legitimate procedures. This does
alternatives to be considered [as illustrated not imply that all possible stakeholders
by Barcus and Montibeller [26]]. However, should be satisfied by or involved in the
before proceeding, the decision analyst must intervention; only that the key stakeholders
scope the required levels of participation must be. As in the case of defining the
needed for the subsequent stages of the problem, the choice of which stakeholders
intervention. This aspect is discussed next. are ‘‘key’’ should be the result of a discussion
between the client and the analyst.
Scoping Participation In the literature, there are several tools
Nutt conducted a careful analysis of 400 available for stakeholder analysis [28,29].
decisions in a variety of organizations and The most widely used techniques include
found that almost half of them ‘failed’ in the power–interest grid, star diagram,
terms of implementation (e.g., not imple- and stakeholder influence map [17]; and
mented or only partially implemented) or stakeholder–issue interrelation diagram and
the achieved results (e.g., poor results rather problem-frame stakeholder maps [28]. For
than good results) [27]. He discovered that example, Fig. 2 shows a power–interest grid
the overriding reason for these failures was for the problem situation discussed earlier.
due, in large part, to the failure of decision The grid arrays stakeholders on a two-by-
makers to attend to the interests and infor- two matrix, where the dimensions are the
mation held by the key stakeholders of the stakeholder’s interest or stake in the decision
organization. Although several definitions at hand (i.e., they care about the decision
of stakeholders are possible [28], we con- or are affected by it), and the stakeholder’s
ceptualize them here as those individuals, power to affect its implementation or impact.
or groups, who have the power to affect the Four broad categories of stakeholders are
decision under consideration; or those groups shown in Fig. 2: ‘players’ who have both, an
that are affected, or perceived to be affected, interest and significant power (e.g., Northern
PROBLEM STRUCTURING FOR MULTICRITERIA DECISION ANALYSIS INTERVENTIONS 5

European partners); ‘subjects,’ who have The above process should be designed by
an interest but little power (e.g., North the decision analyst to gain needed informa-
American partners); ‘context setters,’ who tion, build political acceptance, and address
have power but little direct interest (e.g., some important questions about legitimacy,
regulatory agencies); and the ‘crowd,’ which representation, and credibility [28]. However,
consists of stakeholders with little interest or the analyst should encourage the client to
power. The grid allows the decision analyst include stakeholders only when there are
to determine which players’ interests and good and prudent reasons to do so. They
power bases must be taken into account in should not be included when their involve-
order to address the decision at hand. ment is not needed, impractical, or inappro-
Whichever stakeholder identification tech- priate.
nique is used, the actual process of choosing Once the required participation is scoped,
which stakeholders to involve in the interven- the next stage in the intervention process
tion is often the result of several iterations is to structure the MCDA evaluation model,
along the following generic stages [28]: which we present next.

• The analyst and client initiate the pro- STRUCTURING MCDA EVALUATION
cess by doing a preliminary stakeholder MODELS
analysis, using any of the analysis tech-
There are three main tasks in structuring
niques cited above. This step is useful
MCDA evaluation models: the representation
in helping the client to think strategi-
of objectives in a value tree, the definition
cally about how to create the conditions
of attributes to measure the achievement of
needed for the intervention to reach a
objectives, and the identification of decision
successful outcome.
alternatives. Below, we discuss each of these
• After reviewing the results of this anal- tasks and discuss the challenges that an ana-
ysis, a larger group of stakeholders can lyst may encounter when undertaking them,
be assembled if judged appropriate. The as well as the tools/techniques that may be
assembled group should be asked to used to support their accomplishment.
brainstorm the list of stakeholders, who
might need to be involved in the inter- Structuring Value Trees
vention. Again, many of the techniques
The first step in building an MCDA eval-
cited above might be used as a starting
uation model is always to represent the
point. After this analysis has been com-
objectives that decision makers want to
pleted, the analyst should encourage
achieve (e.g., increase profitability, increase
the group to think carefully about who
flexibility, reduce damage to the environ-
is not at the meeting but that should
ment, and so on). In many multicriteria
be at subsequent meetings during the
models, but particularly so in multi-attribute
intervention. The analyst should ask
utility/value models [2], these objectives are
the group to carefully think through the
organized as a value tree [1,30]. A value
positive and negative consequences of
tree decomposes the overall objective of an
involving—or not—other stakeholders
evaluation into operational objectives, which
or their representatives, and in what
can be more easily employed to assess the
ways to do so.
performances of decision alternatives. For
• Last, both analyst and client finalize example, Fig. 3 presents a value tree for
the various groups, who will have some evaluating different sites for building an
role to play in the intervention. These industrial plant in Brazil. The client was
will typically include the sponsors and concerned with the logistic costs associated
champions, a coordinating group, a core with each site but also wanted to take into
decision analysis team, and various consideration the potential benefits from
advisory or support groups [23]. each site, such as accessibility to logistic
6 PROBLEM STRUCTURING FOR MULTICRITERIA DECISION ANALYSIS INTERVENTIONS

Best plant
location

Logistic Benefits of
costs the site

Maintenance Granting of planning Accessibility to Availability of


efficiency permission logistic services skilled labour

Figure 3. A value tree for selecting an industrial plant location.

systems (e.g., warehouses) and availability prompts from the analyst to reflect about the
of skilled labor required for operating the objectives prior to their explicit articulation.
plant. Behavioral research has also discovered that
Two approaches have classically been sug- these two approaches (top-down and bottom-
gested for structuring a value tree [31,32]: up) may generate value trees with different
top-down and bottom-up. The top-down shapes [34], as values are ‘‘constructed’’
approach is driven by the overall objective, instead of merely extracted from decision
which is then decomposed into objectives and makers’ minds [35]. Therefore, the choice of
the latter ones into sub-objectives, and so approach is clearly an important modeling
on. For example, if an analyst is structuring decision that the analyst has to make.
a value tree for the plant location problem Other possible tools for structuring a value
described above, using a top-down approach, tree involve the use of probes and grouping of
he/she would start with the overall objective ideas, such as Belton and Stewart’s CAUSE
(best location for the plant) and decompose probes [1] and Parnell’s affinity diagrams
it into logistic costs and benefits of the site. [36]. Another set of tools for such purpose
Each of these objectives could be decomposed involves qualitative models that represent
even further, if required. The bottom-up causality/influence between variables. Along
approach is driven by the alternatives. In these lines, Keeney [6] suggests the use of
this case, the analyst would try to identify networks of means–ends objectives, where
which attributes distinguish the alternatives arrows represent the influence between a
and they would be included in the value means and an end objective. Cognitive maps
tree. These attributes would then be grouped (illustrated in Fig. 1), a network of ideas
by their nature (e.g., in the plant location connected by perceived influence and hav-
problem, all the attributes related to the ing a means–ends structure, have also being
potential benefits from a given site) and these employed for structuring value trees [37–39]
groups could be further grouped upwards, as discussed in Montibeller and Belton [40].
composing the value tree. In a similar way, Merkhofer [41] suggests
There are compelling arguments that the use of qualitative influence diagrams to
MCDA should employ a value-focused help the structuring of value trees. The main
thinking approach for supporting decision advantage of using these causality/influence
making [6], as alternatives should be seen tools is that they permit laddering-up toward
as mere means for organizations to achieve the decision makers’ values, and laddering-
their fundamental and strategic objectives. down toward the attributes and decision alte-
This calls for a more top-down approach for rnatives, in a systematic and integrated way.
structuring value trees. On the other hand, Objectives in a value tree must follow a set
behavioral decision research has shown that of properties that need to be checked when
individuals may struggle to think about their structuring it [1,2,6]. These properties are
fundamental objectives [33], and may need the following:
PROBLEM STRUCTURING FOR MULTICRITERIA DECISION ANALYSIS INTERVENTIONS 7

• Essential. They should consider all with the objective being pursued [6,36,42].
the essential organizational objectives We describe these two dimensions below.
involved in the decision.
• Understandable. They should have a The way the objective is measured: Direct
clear meaning for all the members of the or Indirect
group involved in making the decision. • A direct attribute measures directly the
• Operational. It should be possible to degree of attaining the objective. For
measure the performance of decision example, in Fig. 3, logistic costs have a
alternatives against each of the funda- direct attribute: the total logistic cost in
mental objectives. US dollars.
• Nonredundant. They should not mea- • A proxy attribute measures indirectly
sure the same concern twice. the concern expressed by the objective,
• Concise. It should be the smallest by assessing the degree of achievement
number of objectives required for the of its associated objective. For instance,
analysis. in the value tree shown in Fig. 3, the
concern about having the planning per-
• Preferentially independent. If it is pos-
mission granted is assessed by the num-
sible to measure the performance of
ber of months required for the process-
decision alternatives on one objective
ing of such permission.
disregarding their performance on all
other objectives, then a simpler aggre-
The type of attribute: Natural or
gation function can be used to aggregate
Constructed
partial performances.
• Natural attributes measure directly the
Checking that these properties are concern expressed by the objective, are
observed in practice will usually, impact on of general use and have a common inter-
the structure of a value tree. For example, pretation. An example, in the value tree
a new objective may be included if the shown in Fig. 3, is to measure the logis-
initial set does not cover all the essential tic costs in US dollars.
issues in the evaluation. An objective may • Constructed attributes measure
be removed, if it is not operational (e.g., if directly, using indicators created
the information is considered as important specifically by the analyst, the concern
but is unobtainable) or if it is redundant. expressed by the objective. In the plant
Concerns about conciseness also can reduce location example, the availability of
the size of a value tree. Finally, if there are skilled labor (Fig. 3) is measured by
objectives that are preferentially dependent, a set of labels ranging from the best
the analyst may choose to restructure level (‘‘wide availability of skilled labor
them to avoid using a complex aggregation from similar production plants in the
function (for a detailed discussion on how region’’) to the worst one (‘‘the plant
to deal with preferential dependences, see will need to provide training to all its
Ref. 6). new employees’’).

Defining Attributes
Attributes can then be classified using
For each objective placed at the bottom level these two dimensions; for example, a direct-
of the value tree, an associated attribute or natural attribute or a direct-constructed one.
criterion should be specified. This attribute In terms of the way the objective is mea-
is a performance indicator employed to mea- sured, whenever possible, it is usually bet-
sure the impact of adopting each decision ter to use a direct attribute instead of a
alternative on the organizational objective proxy one. If a direct attribute is not avail-
being pursued. There are two dimensions able, many times it is feasible to decom-
for classifying attributes in terms of: 1) the pose an objective into subobjectives—with
way it is measured; and 2) its alignment these subobjectives being assessed via direct
8 PROBLEM STRUCTURING FOR MULTICRITERIA DECISION ANALYSIS INTERVENTIONS

attributes— but avoiding excessive decompo- which decision alternatives will be assessed
sition. In the same way, regarding the type of by the model. Traditionally, MCDA has taken
the attribute, a natural attribute is typically an alternative-focused thinking perspective,
better than a constructed one, if the former where the set of options was assumed as given
is available and provides a clear way for deci- and stable [3]. However, the identification
sion makers to assess the alternatives. (See and creation of new alternatives is certainly
Refs 36, 42, and 43 for a comprehensive dis- one of the most important aspects of any
cussion on defining attributes and guidelines MCDA intervention. No matter how careful
on how to develop suitable ones.) and sophisticated the evaluation model is; if
Independently of its type, each attribute the decision alternatives under consideration
should possess five properties [42] if it were are weak, it will lead to a poor choice [46].
to be employed in a MCDA evaluation model: An important aspect in structuring an
MCDA model is that the decision alterna-
• Unambiguous. The attribute should tives should have the same nature (in the
present a clear relationship between plant location example, for instance, all the
the impact of adopting a decision alternatives are potential sites). If the ana-
alternative and the description of such lyst is careless about this aspect, it may be
impact. difficult to create a coherent value tree. There
• Comprehensive. The attribute should are several tools that may be employed in the
cover the full range of possible con- creation/definition of decision alternatives,
sequences, if the decision alternatives such as brainstorming techniques [47], cog-
were implemented. nitive mapping [18], dialog maps [22] among
• Direct. The attribute levels should others.
describe as directly as possible the con- Particularly useful tools are the ones,
sequences of implementing a decision where decision alternatives are created from
alternative. considering the decision makers’ objectives
• Operational. The information required [6] or stakeholders’ values [48]. For example,
by the attribute can be obtained in prac- the analyst can ask the decision makers to
tice and it is possible to make value imagine options that could perform really
trade-offs between objectives [1,2]. well on a single objective. This process can
• Understandable. Consequences and be repeated for each of the fundamental
value trade-offs using the attribute can objectives present in the value tree. Once
be clearly understood by the decision the list of objectives is exhausted, the same
making group and communicated to procedure can be done for two objectives at
other stakeholders. once. Another way of creating a new option
is by combining the existing alternatives,
Quantitative attributes tend to be less trying to maintain the best features of
ambiguous than qualitative ones. A key point each alternative. Recently we have used
about comprehensiveness is that the upper a value-focused brainstorming using a
and lower limits of the attribute are well- cognitive map—which allowed eliciting,
specified (maximum feasible and minimum organizing, and displaying a large set of
acceptable, respectively) otherwise it would ideas from a client group—these ideas were
distort value trade-offs. Finally, it is critical then grouped as decision alternatives [39].
that attributes are understandable, partic- [For an extensive review of tools for creating
ularly if the analysis involves a group of alternatives see Keeney [6], Keller and Ho
decision makers and the modeling is con- [49] and Parnell et al. [29].]
ducted in a facilitated mode [44], such as in Although there is a natural tendency by
a decision conference [45]. decision makers to discard decision alterna-
tives or options that may appear to gener-
Identifying Decision Alternatives
ate some negative outcomes, any attempt at
The other major task in structuring an option evaluation should be contained at this
MCDA evaluation model is the definition of stage. The assessment of alternatives should
PROBLEM STRUCTURING FOR MULTICRITERIA DECISION ANALYSIS INTERVENTIONS 9

SCOPE LEVEL

Regional
Operational

None

DISTRIBUTION

Keep

Price

Wait option 1
Availability
Now plan A
Wait option 2
Now plan B
Never Incompatible
Doubtful Figure 4. An example of areas
TIME LAUNCH compatibility of interconnected options.

be left for the evaluation phase of the process specific options represent incompatible com-
and not intermingled with their generation. binations.
Another aspect concerning the identifica-
tion of decision alternatives is that there are
instances where the alternatives are com- AN INTERVENTION FRAMEWORK
prised by a large set of sub-options. There are
some methods that can be used to structure The techniques for multicriteria evaluations
complex decision alternatives. The strategy are already well-established in the litera-
generation table proposed by Howard [50] is ture. However, there has been much less
investment in the development of techniques
a simple way of creating decision strategies
to support the structuring stages of MCDA
from the combination of options under sev-
interventions. We have reviewed both the
eral dimensions. Another tool is the analysis
mainstream problem structuring and MCDA
of interconnected decision areas (AIDA) tech-
literatures, and identified a number of mod-
nique that is a part of the strategic choice
eling tools, which can be used to support
approach [23]. In this technique, the links
problem structuring in MCDA interventions.
between several ‘‘decision areas’’ are repre- Perhaps, more importantly, our foregoing dis-
sented, each one with several options, with cussion should have made clear to the reader
their compatibility explored, in order to gen- of the important role that problem structur-
erate a list of possible option portfolios. For ing plays in MCDA interventions.
example, in an intervention with a major In Fig. 5, we suggest a framework for con-
international hotel company, we used AIDA ducting MCDA interventions, in which the
to initially shape a strategic decision concern- role of problem structuring is made explicit.
ing how to tackle ‘‘cost of sale,’’ and produced In Phase 1, the analyst structures the prob-
a list of candidate interconnected strategic lem situation, helping the client to arrive at
options, grouped in three areas (distribu- an agreed problem definition, and designs a
tion, timing launch, and scope level). This decision process with the appropriate level
is shown in Fig. 4, where the links between of participation. Once this phase is finished,
10 PROBLEM STRUCTURING FOR MULTICRITERIA DECISION ANALYSIS INTERVENTIONS

Phase 1: Structuring the


problem situation
• Agree on a shared definition of
the problem with the client group
• Scope participation by identifying
key stakeholders that should be
Structuring of the
included in the intervention
evaluation model Assessment
process
changes the changes the
definition of the definition of the
problem or scope problem or scope
of participation of participation

Phase 3: Modelling Preferences


Phase 2: Structuring the and Evaluating the decision
MCDA evaluation model alternatives
• Elicit and distinguish means
• Elicit value/utility functions
and fundamental objectives
• Elicit trade-offs
• Structure the value tree Assessment • Assess performances of
• Develop attributes for bottom changes t he alternatives
level objectives structure • Aggregate partial performances
• Identify/create decision of the evaluation • Obtain overall performances
alternatives model • Conduct sensitivity analysis

Figure 5. A framework for structuring MCDA models.

the analyst then can start Phase 2, the struc- CONCLUSIONS AND DIRECTIONS
turing of an MCDA model, which consists FOR RESEARCH
of eliciting and distinguishing means and
fundamental objectives, structuring a value While decision analysts have recognized for
tree, developing attributes and identifying a long time the importance of problem struc-
decision alternatives. With this second phase turing for successful MCDA interventions,
completed, the analyst can finally proceed most of them have relied on ad hoc practices
to undertake Phase 3, modelling preferences for structuring the decision problem. The
and the evaluation of decision alternatives. main aim of this chapter has been to provide
The natural flow of phases is indicated with a review of tools that can help this pre-
black arrows in Fig. 5, but notice that the MCDA evaluation phase of problem structur-
process is not linear and can cycle back ing. Furthermore, we have also reviewed the
to earlier phases (grey arrows): back from main tasks involved in building an MCDA
Phase 2 to 1, if the structuring of the MCDA evaluation model per se, while attempting
model changes the definition of the problem to provide a more integrated view by relat-
or the scope of stakeholders’ participation; ing these tasks with the problem-structuring
back from Phase 3 to 2, if modelling of literature.
preferences or the assessment of alternatives As discussed in this chapter, there are a
changes the structure of the MCDA model; number of problem-structuring tools avail-
and back from Phase 3 to 1, if modelling of able to help decision analysts deploy effective
preferences or the assessment of alternatives MCDA interventions. However, our discus-
changes either the definition of the prob- sion should have also made clear that when
lem or the participation required. Table 1 the client comprises a group of managers,
contains a list of useful tools for supporting mastering the tools will not be sufficient.
the different activities within each of the The analyst will also need skills for facili-
structuring phases of an MCDA intervention. tating the group processes associated with
PROBLEM STRUCTURING FOR MULTICRITERIA DECISION ANALYSIS INTERVENTIONS 11

Table 1. Tasks and Tools for Structuring MCDA Models


Phase 1: Problem Structuring
Activity Task Supporting Tools and Useful References
Defining the Capture the different • Cognitive mapping [18,19]
Problem understandings about the • Dialog mapping [22]
multicriteria problem and • Soft systems methodology [20,21]
facilitate a definition of the
problem that is shared by the • Strategic choice approach [23]
client (or client group). • Group model building [24]
• Decision framing [6]

Scoping Determine the type and level of • Power-interest grid; star diagrams and stakeholder
Participation participation of different influence diagrams [17]
stakeholders required for the • Stakeholder-issue interrelation diagram and
intervention. problem-frame stakeholder maps [28]

Phase 2: Structuring the MCDA Evaluation Model


Activity Task Supporting Tools and Useful References
Structuring Organize the objectives to be • Top-down or bottom-up approaches [31]
Value Trees considered in the evaluation • Checklist and grouping of ideas [1,36]
as a hierarchy. • Means-ends objective networks [6]
• Cognitive maps [37–39]
• Qualitative influence diagrams [41]
• Checklist of properties for a value tree [1,6]

Defining Specify, for each bottom level • Keeney’s and Gregory’s [42] decision model for
Attributes objective in the value tree, an selecting attributes and Parnell’s [36] preference
associated attribute. ranking for selecting attributes
• Kirkwood’s [43] classification of attributes and
guidelines for their development
• Checklist of properties for an attribute [6]

Identifying Define/identify/create decision • Brainstorming [47]


Decision alternatives to be assessed by • Laddering-down in a cognitive map [18,19]
Alternatives the MCDA model. • Dialog maps [22]
• Focus on the objectives to be achieved [6,49]
• Ideation techniques [29]
• Strategy tables [50]
• Analysis of interconnected decision areas [23]

defining the problem, which are significantly decision making under uncertainty are
influenced by the power and interests of the influence diagrams [51] and decision trees
managers in that group [16,44]. [52]. A good introduction to this type of
It worth noting that the chapter has modeling is provided by Clemen and Reilly
focused on modeling decision making with [53] and Kirkwood [54].
multiple objectives. Frequently, however, We believe that problem structuring for
key uncertainties are present and should also MCDA is a rich field of research, where the
be represented. Useful tools for modeling focus can be not about developing and testing
12 PROBLEM STRUCTURING FOR MULTICRITERIA DECISION ANALYSIS INTERVENTIONS

suitable problem structuring tools, as well and may also serve as a useful resource for
as about the study of facilitated modeling in researchers interested in this field.
this intervention context. We thus suggest
some directions for further research: Acknowledgment

• Development of Problem-Structur- We are thankful for the insightful comments


ing Methods. While the field of provided by an anonymous referee; this
problem-structuring methods (PSMs) helped us to improve the draft.
is already well-established in manage-
ment science, more research could be REFERENCES
conducted on tools that could be tailored
specifically for MCDA interventions. 1. Belton V, Stewart TJ. Multiple criteria deci-
sion analysis: an integrated approach. Dor-
• Integrated Use of PSMs. The use of
drecht: Kluwer; 2002.
standard PSMs with MCDA requires
2. Keeney RL, Raiffa H. Decisions with multiple
transitions from a problem-structuring
objectives: preferences and value trade-offs.
model to a multicriteria decision anal- 2nd ed. Cambridge (MA): Cambridge Univer-
ysis model, which may prove challeng- sity Press; 1993.
ing [40]. Consequently, a direction of 3. Roy B. Multi-criteria methodology for decision
research is the development of methods aiding. Dordrecht: Kluwer; 1996.
that could provide a seamless transi- 4. Figueira J, Greco S, Ehrgott M, editors. Mul-
tion. The reasoning maps method, sug- tiple criteria decision analysis: state of the art
gested by Montibeller et al. [55], and surveys. New York: Springer; 2005.
the use of means objectives to assess 5. Keefer DL, Kirkwood CW, Corner JL. Per-
the performance of decision alternatives spective on decision analysis applications,
on fundamental objectives, suggested 1990–2001. Decis Anal 2004;1(1):5–24.
by Butler et al. [56] are examples of 6. Keeney RL. Value-focused thinking: a path
research in this direction. to creative decision-making. Cambridge (MA):
• Tools for Supporting Structuring Harvard University Press; 1992.
MCDA Tasks. The paper reviewed some 7. von Winterfeldt D, Fasolo B. Structuring
tools that could be employed for struc- decision problems: a case study and reflec-
turing value trees, defining attributes tions for practitioners. Eur J Oper Res
and identifying decision alternatives. 2009;199(3):857–866.
The development of new tools is, 8. Belton V, Stewart TJ. Problem structuring
however, still a potentially area of and MCDA. In: Ehrgott M, Figueira J, Greco
S, editors. Trends in multiple criteria decision
research—particularly if it were based
analysis. Boston (MA): Springer; In press.
more on psychological aspects [e.g., how
9. Nutt PC. Formulation tactics and the success
to spark off creativity when creating
of organizational decision making. Decis Sci
alternatives; how to identify/display
1992;23(3):519–540.
complex options to a group of decision
10. Rosenhead J, Mingers J, editors. Rational
makers, such as the approach proposed
analysis for a problematic world revisited:
by Montibeller et al. [39]]. problem structuring methods for complexity,
uncertainty and conflict. Chichester: Wiley;
To summarize, this chapter provided an 2001.
overview of the phases and tasks involved 11. Smith GF. Classifying managerial problems:
in structuring an MCDA evaluatoin model an empirical study of definitional content. J
within an intervention, from defining the Manage Stud 1994;32:679–706.
problem and identifying key stakeholders to 12. Lyles MA, Mitroff II. Organizational problem
building the MCDA model itself. Problem formulation: an empirical study. Adm Sci Q
structuring is a fundamental and challeng- 1980;25:109–119.
ing task for any MCDA intervention; thus, 13. von Winterfeldt D, Edwards W. Defin-
we hope this chapter may be of help to deci- ing a decision analytical structure. In:
sion analysts involved in such interventions Edwards W, Miles RF, von Winterfeldt D,
PROBLEM STRUCTURING FOR MULTICRITERIA DECISION ANALYSIS INTERVENTIONS 13

editors. Advances in decision analysis: from Engineering, Sage AP, editor. Hoboke (NJ):
foundations to applications. Cambridge: John Wiley & Sons, Inc.; 2008.
Cambridge University Press; 2007. 30. Goodwin P, Wright G. Decision analysis for
pp. 81–103. management judgment. 4th ed. Chichester:
14. Ackoff R. Redesigning the future: a systems Wiley; 2009.
approach to societal problems. New York: 31. Buede DM. Structuring value attributes.
Wiley; 1974. Interfaces 1986;16(2):52–62.
15. Mitroff IL, Ernshoff JR. On systemic problem 32. von Winterfeldt D, Edwards W. Decision
solving and the error of the third kind. Behav analysis and behavioral research. Cambridge
Sci 1974;19:383–393. (MA): Cambridge University Press; 1986.
16. Eden C, Sims D. On the nature of problems in 33. Bond SD, Carlson KA, Keeney RL. Gen-
consulting practice. Omega Int J Manage Sci erating objectives: can decision makers
1979;7(2):119–127. articulate what they want? Manage Sci
17. Eden C, Ackermann F. Strategy Making: the 2008;54(1):56–70.
journey of strategic management. London: 34. Morton A, Fasolo B. Behavioural deci-
Sage; 1998. sion theory for multi-criteria decision anal-
18. Eden C. Cognitive mapping: a review. Eur J ysis: a guided tour. J Oper Res Soc
Oper Res 1988;36(1):1–13. 2009;60(2):268–275.
19. Eden C. Analyzing cognitive maps to help 35. Slovic P. The construction of preference. Am
structure issues or problems. Eur J Oper Res Psychol 1995;50:364–371.
2004;159(3):673–686. 36. Parnell GS. Value-focused thinking. In:
20. Checkland P. Systems thinking, systems prac- Rainey L, Loerch A, editors. Methods for con-
tice. Chichester: Wiley; 1981. ducting military operational analysis. Alexan-
21. Checkland P, Scholes J. Soft systems dria (VA): Military Operations Research
methodology in action. Chichester: Wiley; Society; 2007. pp. 619–656.
1990. 37. Bana e Costa CA, Ensslin L, Correa EC, et al.
22. Conklin J. Dialog mapping: building shared Decision support systems in action: integrated
understanding of wicked problems. Chich- application in a multi-criteria aid process. Eur
ester: Wiley; 2006. J Oper Res 1999;113:315–335.
23. Friend J, Hickling A. Planning under pres- 38. Belton V, Ackermann F, Shepherd I. Inte-
sure: the strategic choice approach. 3rd ed. grated support from problem structuring
Oxford: Elsevier; 2005. through to alternative evaluation using COPE
24. Vennix J. Group model building: facilitating and VISA. J Multi Criteria Decis Anal
team learning using system dynamics. Chich- 1997;6:115–130.
ester: Wiley; 1996. 39. Montibeller G, Franco LA, Lord E, et al.
25. Richardson G, Andersen D. Teamwork in Structuring resource allocation decisions: a
group model building. Syst Dyn Rev framework for building multi-criteria portfo-
1995;11(2):113–137. lio models with area-grouped projects. Eur J
26. Barcus A, Montibeller G. Supporting Oper Res 2009;199(3):846–856.
the allocation of software development 40. Montibeller G, Belton V. Causal maps and
work in distributed teams with multi- the evaluation of decision options: a review.
criteria decision analysis. Omega (Westport) J Oper Res Soc 2006;57(7):779–791.
2008;36(3):464–475. 41. Merkhofer MW. Using influence diagrams
27. Nutt PC. Why decisions fail? Avoiding the in multi-attribute utility analysis: improving
blunders and traps that lead to debacles. San effectiveness through improving communica-
Francisco (CA): Berrett-Koehler Publishers; tion. In: Olivier RM, Smith JQ, editors. Influ-
2002. ence diagrams, belief nets and decision analy-
28. Bryson JM. What to do when stakehold- sis. Chichester: Wiley; 1990. pp. 297–317.
ers matter: stakeholder identification and 42. Keeney RL, Gregory RS. Selecting attributes
analysis techniques. Public Manage Rev to measure the achievement of objectives.
2004;6(1):21–53. Oper Res 2005;53(1):1–11.
29. Parnell GS, Driscoll PJ, Henderson DL, edi- 43. Kirkwood CW. Strategic decision making:
tors. Decision making for systems engineering multiobjective decision analysis with spread-
and management. Wiley Series in Systems sheets. Belmont (CA): Duxbury Press; 1997.
14 PROBLEM STRUCTURING FOR MULTICRITERIA DECISION ANALYSIS INTERVENTIONS

44. Franco LA, Montibeller G. Facilitated mod- 51. Howard RA, Matheson JE. Influence dia-
elling in operational research (invited review). grams. In: Howard RA, Matheson JE, editors.
Eur J Oper Res. 2010;205(3):489–500. The principles and applications of decision
45. Phillips L. Decision conferencing. In: Edwards analysis, Vol 2. Menlo Park (CA): Strategic
W, Miles R Jr, von Winterfeldt D, editors. Decisions Group; 1981.
Advances in decision analysis: from founda- 52. Raiffa H. Decision analysis: introductory lec-
tions to applications. New York: Cambridge tures on choices under uncertainty. Oxford:
University Press; 2007. pp. 375–399. Addison-Wesley; 1968.
46. Brown R. Rational choice and judgment: deci- 53. Clemen R, Reilly T. Making hard decision with
sion analysis for the decider. New York: Wiley; decision tools. Pacific Grove (CA): Duxbury;
2005. 2001.
47. Osborn AF. Applied imagination: principles 54. Kirkwood CW. An overview of methods
and procedures of creative problem-solving. for applied decision analysis. Interfaces
New York: Charles Scribner’s Sons; 1957. 1992;22(6):28–39.
48. Gregory R, Keeney RL. Creating policy alter- 55. Montibeller G, Belton V, Ackermann F, et al.
natives using stakeholder values. Manage Sci Reasoning maps for decision aid: an inte-
1994;40(8):1035–1048. grated approach for problem-structuring and
49. Keller LR, Ho J. Decision problem structur- multi-criteria evaluation. J Oper Res Soc
ing: generating options. IEEE Trans Syst Man 2008;59(5):575–589.
Cybern 1988;18(5):715–728. 56. Butler JC, Dyer JS, Jia JU. Using attributes to
50. Howard RA. Decision analysis: practice and predict objectives in preference models. Decis
promise. Manage Sci 1988;34(6):679–695. Anal 2006;3(2):100–116.

You might also like