Professional Documents
Culture Documents
net/publication/238345488
CITATIONS READS
302 1,643
2 authors:
Some of the authors of this publication are also working on these related projects:
All content following this page was uploaded by Wil Thissen on 10 January 2014.
Decision-making
Lone Kørnøv is in the Department of Development and Planning, Much of the work in impact assessment is based on the
Aalborg University, Fibigerstraede 13, 9220 Aalborg, Denmark. belief or assumption that the provision of better, sci-
Wil A H Thissen is in the School of Systems Engineering, Policy entifically valid information or knowledge regarding
Analysis and Management, Delft University of Technology, PO a decision issue will contribute to a better, more
Box 5015, 2600 GA Delft, Netherlands.
Impact Assessment and Project Appraisal September 2000 1461-5517/00/030191-10 US$08.00 © IAIA 2000 191
Rationality in decision- and policy-making
rational decision, which may be defined as “… one resulting in (partial) agreement or commitment to a
that pursues a logic of consequences” (March, 1994). jointly chosen course of action. There is a wide varia-
That is, a decision is considered more rational if the tion of situations at the collective level, for example,
process leading to it is based on insight into the conse- team or group decision-making, decision-making
quences of alternatives, and the selection follows the within an organisation, and decision-making between
logic of choosing the alternative that is expected to independent parties.
best achieve one’s goals or objectives. Associated For the sake of simplicity, we will adopt the simple
with this notion is a model of the decision process as a conceptual dichotomy of individual versus collective
sequence of logical steps, starting with the establish- or multi-actor decision-making. Note that collective
ment of objectives or goals in a given decision con- decisions are always based on a set of decisions of in-
text, followed by identification or design of dividuals, and that in many real-world processes both
alternatives, assessment of the impacts of alternatives, types of decision-making are intertwined.
and choice of the ‘best ‘ alternative in view of the We will start with an exploration of models of deci-
goals. sion-making at the individual level, proceed to the
First, we note that this view of rationality in deci- multi-actor situation, then discuss some insights and
sion-making requires a distinction between the ratio- developments in the field of decision support, and
nality of the process (meaning that rational finally return to the implications for SEA.
procedures are followed) and the rationality of the
outcome of the process (meaning that, in the end, the
best approach is chosen to achieve given aims). A ra- Limits to individual rationality
tional procedure will not automatically lead to a ratio-
nal choice — considering imperfect information, Individuals make decisions all the time — both simple
multiple objectives the preferences of which are often (such as deciding which paper the environmental
not clearly established, and the fact that people do statement has to be printed on, or which train to take to
not always behave as assumed in rational models for work) and complex with far reaching consequences
decision-making. (such as buying an expensive house, migrating to an-
Second, implicitly or explicitly, a separation is other part of the world, changing a national strategic
made between objective, science-based knowledge decision towards recycling of paper, glass, metal, gar-
on the one hand, and subjective, decision-maker spe- bage and so on to decrease landfill).
cific norms and values that come into play in making The process of problem solving at the individual
the trade-offs between alternatives, assuming their level is often described as consisting of three overall
impacts are known. types of activity, frequently referred to as stages
Third, this model of decision-making is a norma- (Simon, 1957):
tive one, that is, its proponents believe that it should be
applied as it will lead to improvement in real-world · finding or identifying occasions calling for a
decision-making over present practice. However, vir- decision;
tually all empirical research shows that decision- · inventing, developing and analysing possible alter-
making processes in practice often do not follow such native courses of action; and
a rational procedure, even in cases where significant · selecting a particular alternative from those
efforts are made to improve rationality (Brewer, available.
1973; March, 1987; 1988; 1994; Katz and Kahn,
1966; Simon and March, 1958; Lindblom, 1959; These activities are, at the individual level, affected
Scott, 1987; Breheny and Hooper, 1985). by several limitations to rationality, which we will
The fact that real-world decision processes do not divide into two categories: cognitive and resource
appear to follow rational principles does not automati- limitations; and behavioural variations and biases.
cally mean that attempts at increasing rationality are
undesirable. Nevertheless, insight into the reasons Cognitive and resource limitations
why attempts in the past have often not been success-
ful may increase our understanding of the limits of the Traditional economic theory assumes complete ratio-
rational model, and of the merits of other models that nality: the ‘economic decision-maker’ maximises
may provide additional guidance for our efforts to af- profit by systematic search for the best solution to a
fect decision-making. problem. It assumes complete and perfect information
In addition to the distinctions between process and for the decision-maker, and demands consideration of
substantive or outcome characteristics, between sci- all alternatives and consequences to make the optimal
entific knowledge and values, and between normative decision.
and descriptive views of decision-making, it is helpful It is self-evident that the theory of rational–
to distinguish conceptually different levels of deci- economic behaviour is hardly applicable to individual
sion processes: the individual level, where an individ- reality. The decision-maker does not and cannot know
ual actor or decision-maker develops insight and all alternatives, consequences and preferences. Alter-
comes to a choice of a strategy or action, and the natives have to be searched, consequences have to be
collective level, where individuals interact, possibly researched and finally preferences have to be found
The rules do not have to be expressed explicitly. It can developed in fields such as game theory and conflict
be a collection of attitudes and understandings of how analysis assume rational behaviour of individual ac-
the world functions, who you are and how to act. tors, including clarity of objectives and full informa-
Rule-based action will therefore mean that the ratio- tion availability.
nal decision model is not followed. Because experi- As in the individual case, empirical research dem-
ence and thereby learning is incorporated in rules, onstrates the invalidity of these idealised assump-
exploration of rules and changes in rules are an im- tions. Decision-making depends on individual
portant source for understanding decision-making in preferences and interests, which can contradict, most
organisations. likely change over time, and can develop based on ex-
perience with the issues at hand (March, 1981; 1994;
March and Olsen, 1989). In multi-actor situations,
Multi-actor decision-making there is often a high level of confusion and complex-
ity. Views and preferences diverge and change just
When several persons or organisations are involved in like the alliances between participants in the process.
decision-making, mutual dependencies and the distri- Participants often do not really know what the prob-
bution of power or authority among the participants lem is, what to aim for, how to achieve it, even less
become important dimensions that characterise the what the best way is to achieve it. Decision-makers
process. At the organisational and policy level, the na- have to consider uncertain outcomes, act in a political
ture of decision-making can vary widely. At one end system, face many new and interlinked situations and
of the spectrum are situations of centralised control problems and thereby continuously have to search for
where essentially one powerful individual makes de- new ways to handle them.
cisions regarding matters that concern the whole Various models have been developed to character-
organisation or even society. At the other end, we see ise these multi-actor policy processes. Examples in-
policy processes in which, sometimes, large numbers clude terms such as ‘policy soups’, ‘garbage cans’ or
of essentially independent actors debate and negotiate ‘policy arenas’ (Cohen et al, 1972; Kingdon, 1995) all
(for instance, the international process on reduction of of which express the idea of multi-actor situations in
greenhouse gas emissions and prevention of long- which a plethora of objectives, problems and solu-
term climatic change). tions are present, and out of which decisions emerge
In between are many variations, in which individ- in unpredictable ways. The process of policy-making
ual policy-makers (for instance, a minister) formally has been described as consisting of independent
make a decision that has been prepared in negotia- streams of actors with goals or objectives, solutions,
tion-like processes, or in which a group or body of ac- and problems. Occasionally, specific views on prob-
tors or representatives (such as a senate) take formal lems, available solutions, and objectives happen to
decisions. For SEA, oriented to policy and planning match, resulting in a so-called “policy window”
processes, the situations in which power or influence (Kingdon, 1995).
is distributed over several actors are most relevant, Another model, the so-called ‘rounds model’, con-
and our focus will be on these. centrates on the time dimension (Teisman, 1992): De-
Not unlike the situation at the individual level, two cision-making often does not happen at one specific
kinds of views on policy-making in multi-actor situa- point in time, but is a far more gradual and continuous
tions can be found in the literature. Normative or process of interaction, negotiation and learning,
‘ideal’ views are often characterised by: in which rounds can be distinguished in which
agreement on a certain aspect or part is reached
· The notion of a single decision-making group and accepted as a basis for the next round.
or entity (unicentric), such as an agency or a gov- Taking actor configurations as a central perspec-
ernment, capable of controlling developments in tive, decision-making may be described as interac-
society; often also referred to as the notion of tions in a ‘policy network, which is defined as a more
centralistic governance; or less stable pattern of social relations between inde-
· A recognisable key decision point in time; pendent actors, which takes shape around specific
· Process and substantive rationality as an explicit or policy problems or programmes (Kickert et al, 1997).
implicit norm. “Policy formation and policy implementation are
inevitably the result of interactions among a plurality
These idealised views are not only coherent with the of separate actors with separate interests, goals, and
rational view of individual decision-making, they also strategies” (Scharpf et al, 1978).
model multi-actor decision-making as if it were indi- Actors participate in the network, as they are mutu-
vidual (except for the processes taking place within ally dependent on each other to achieve their goals. At
the unitary group). the same time, each actor tries to steer towards his/ her
Other views or models do take the multi-actor na- own preferences. Individual actor’s views, strategies
ture more explicitly into account, and conceptualise and influences are not very predictable, and, thus nei-
decision-making as a process of negotiation between ther are the policy outcomes. In addition, interactions
different actors with different interests. However, not between actors may change relation patterns, which in
unlike the economic model, ideal models like those turn will influence the interaction patterns.
Table 2. Key differences between the rational, unicentric and the network or policy-centric views on multi-actor policy-making
Research in the policy sciences also points out that a wide enough range of alternatives (Miser and
political power play and compromise-making are of- Quade, 1985; 1988; Patton and Sawicki, 1993; Dunn,
ten more important than scientific evidence in deter- 1994; Keeney, 1994). As a result of practical experi-
mining the outcome. The ideal of separation of ence with this approach showing limited success, and
objective knowledge from subjective values is con- under the influence of empirical research in the policy
sidered unrealistic since all perceptions, information sciences, a number of new ideas and approaches to the
selections and inferences are affected by one’s inevi- support of decision and policy processes have
table bias (Fisher and Forester, 1993; Schön and Rein, emerged over the last decades.
1994). Policy-making is not a cognitive activity start-
ing with fixed objectives resulting in the best way to Participative or interactive modes
achieve these, but rather an open interactive process in
which problems, solutions and preferences, along First, participative or interactive modes of policy de-
with problem and solution perceptions, develop. velopment and associated policy support have been
Objectives and targets are then an output rather than developed. An important trigger was the frustration
an input to the process. with decisions that were made from a centralistic
Table 2 summarises a number of key differences governance point of view, but which appeared to be
between the unicentric or rational view, and the em- ineffective because of lack of support among those
pirical network view on policy-making. We point out who were involved in the implementation. Similarly,
that in reality elements of both models often co-exist policy studies performed by experts in their study
or compete. The distinction however clarifies the con- offices often had no impact, ending up on a shelf col-
ceptual discussion. lecting dust.
The key notion in participation is to involve rele-
vant actors in the policy preparation process. Rele-
Supporting decision processes vance of parties may be determined by their formal
position (for instance, a government authority), their
As in SEA, a significant part of the traditional litera- control of relevant resources (for instance, money,
ture on knowledge-based support of decision pro- expertise), their power to hinder or block implementa-
cesses is based on the (often implicit) assumption of tion (lobby groups, implementers) or by the stakes in
rationality, a unicentric process, and a stepwise the issue (for instance, proponents of some policy).
approach. Guidelines and methods are focused on the
collection, analysis and presentation of objective
information on the basis of which the decision-maker
can improve his or her judgement. Initially focus was on assessing the
While initially most of the attention was given to impacts of alternatives with known
assessing the impacts of alternatives and choosing outcomes: later significantly more
among a given set of alternatives with known out-
comes (such as in cost–benefit analysis or decision attention was paid to formulating the
analysis, see for instance, Stokey and Zeckhauser, problem, identifying the values of
1978; Keeney and Raiffa, 1976), later publications in interest and identifying a wide enough
this thread of thinking broaden the approach to paying
significantly more attention to formulating the prob- range of alternatives
lem, identifying the values of interest and identifying
The idea is that participation will improve the process among the participating actors concentrates on the full
in four different ways (Guba and Lincoln, 1989; lines of arguments followed to support or reject cer-
Mayer, 1997): tain positions, including the underlying differences in
perceptions and values (Fisher and Forester, 1993)
· Increased richness of information and creativity, as The objective of the approach is to increase the mutual
the points of view and knowledge of a variety of ac- understanding of participant’s differences of view,
tors are taken into account. and to attempt a “frame-reflective discourse” (Schön
· Increased acceptance of the result of the assess- and Rein, 1994) in which frames are adjusted and new
ment and/or decision process, as participation may joint views are constructed as a basis for action.
lead to shared visions and a sense of ownership of Accordingly, methods and techniques for identify-
the results. ing and portraying actor perceptions are being devel-
· Incorporation instead of exclusion of the dynamics oped (for instance, Durning, 1999). Critics have
and learning so characteristic of many such pro- pointed out, however, that such an approach can only
cesses. Rather than a study process in which objec- be productive in situations in which all participants
tives and problems are fixed at the start, a adopt an open and constructive attitude towards each
participative process allows for emergent insights other. This is often not the case, particularly if strong
and shifts in problem perspectives and objectives differences in norms or interests exist, the stakes are
over time, with the consent of all those involved. high, and the situation is perceived in terms of winners
· Contribution to the democratic character of the and losers. In such situations, we see more of a
process, depending on how the participants are court-room type of discourse, in which each of the
selected, how the process is managed, and how participants attempts to improve and add to their argu-
‘democratic’ is defined. mentation in an attempt to win the case, rather than to
search for openings and a more open, joint solution.
Participation can be realised in a wide variety of forms Therefore, the style and culture of the policy envi-
and degrees of intensity. Expert participation is pri- ronment seem to be important contextual conditions
marily beneficial to knowledge provision and integra- that determine the potential for success of discourse
tion; stakeholder participation may contribute to both approaches.
knowledge enrichment and the building of a support
base; and public participation may be more oriented to Process design
enhancing the democratic nature of the process. Par-
ticipation may take the form of hearings or more ac- A third line of innovation emphasises the process de-
tive involvement, and it may take place at one or more sign rather than the content of the interaction process.
specific points in the process, or on a more continuous The assumption is that an adequate set of agreed-upon
basis. A wide variety of techniques may be used to rules for interaction and decision-making is a neces-
structure participative processes, including gaming, sary condition for effective and efficient substantive
scenario workshops and the like (Mayer, 1997). deliberations between the participants. Guidelines for
process design emphasise things such as openness of
Normative debates the process, transparency of procedures, a certain de-
gree of freedom and protection for participants, the
Second, it has been argued that concentration on sub- provision of opportunities for parties to enter or leave
stantive, scientific and ‘objective’ aspects of a policy the process, and so on (Kickert et al, 1997; de Bruijn
issue, such as the range of alternatives and their im- and ten Heuvelhof, 1999).
pacts, does not address the core issues of many policy Complementary to the development of ideas on
debates (Fisher and Forester, 1993; Schön and Rein, different types of support that may fit different types
1994, White, 1994). The underlying debates are often of policy situations (or may even complement each
essentially normative. The views of participants on other) is the notion that supporting specialists or ana-
what the problem is, what the possible solutions are, lysts may play a variety of roles in a policy process.
and what is desirable are framed by their world view Empirical research on the roles played by policy
and underlying norms. For example, conflicts on PVC analysts in practice, has shown the existence of dif-
regulations have been dominated by the normative ferent roles being played (adapted from Meltsner,
differences on how to act under the inevitable uncer- 1976):
tainty about the impacts of PVC on the environment
and human health, which uncertainty cannot be re- · the technician;
solved by more analysis (Bras-Klapwijk, 1999; van · the mediator–facilitator (also indicated as catalyst);
Eeten, 1999). · the policy entrepreneur;
Even when participants have largely the same val- · the policy advocate.
ues, they may still have difficulties in communication
because they may not speak the same ‘language’ A technician mainly concentrates on collecting and
(Bogetoft and Pruzan, 1997). As a response, so-called presenting objective, science-based information to
‘argumentative’ policy analysis has been proposed. In the decision-maker or the set of actors participating in
an argumentative discourse, the debate and learning the process. He or she limits attention to what can be
Table 3. Typology of problem situations with indicated different terms distinguishes situations according to
support approach
first the availability of substantive knowledge, and
second the degree of social or value consensus on the
Social/value Strong conflicts of
consensus values, interests
other (see Table 3).
Four archetypical situations emerge. When social
consensus is combined with sufficient knowledge, a
Ample substantive Rational problem Mediation
knowledge solving Negotiation support rational problem-solving approach will probably
Technical, objective work. When knowledge is lacking, either more re-
design search can provide a solution, or the choice of a solu-
Lack of Additional research Argumentative and tion is guided by a conscious (agreed upon) approach
knowledge, high Risk approach other approaches
uncertainty Facilitation or
to taking risks. When there are strong value conflicts
entrepreneurial styles and ample knowledge, additional analysis will not
Source: Adapted from Flood and Jackson, 1991; Hisschemoller,
help, and either negotiation support and mediation
1993; Dunn, 1994 approaches or a courtroom set-up with agreed deci-
sion rules might lead to an accepted solution. Cata-
considered value-free knowledge, leaving normative lytic or entrepreneurial approaches are generally
issues and trading off values to the individual or group advised in the messiest situations: combinations of
supported. A mediator–facilitator takes a more active lack of knowledge and disagreement on values or
role in the process by being instrumental in exchang- conflicts of interests may support the reaching of a
ing information between actors, pointing out differ- compromise solution.
ences and areas of agreement, and structuring the
discussion. He may search for compromises, identify
new options, suggest inviting new actors in, and so on. Implications for SEA
Both technicians and mediator–facilitators adopt a
more or less neutral, serving position with respect to Much of the earlier work in SEA is based on the as-
the parties and interests involved. sumption that the provision of better information on
A policy entrepreneur, however, may explicitly the environmental impacts of plans or policies will re-
choose to support a particular policy point of view that sult in decision-makers taking environmental aspects
he or she sees as being the most beneficial outcome of more seriously than would be the case without SEA,
the process, and then act from that perspective as a and that this will lead to decisions that will turn out to
leader instead of a servant. Policy advocates analyse be better for the environment. Recently, broader ap-
and act deliberately as the a priori representatives of proaches are being adopted targeting sustainability
one of the stakeholders or interests, and concentrate and pointing out the need for adaptation and integra-
on providing information and arguments from that tion (several papers in this issue). In addition, there is
particular point of view. Generally, the role of policy a tendency towards participatory approaches
advocate is considered to be incompatible with the (Thérivel and Partidário, 2000). Here, we will now
technician and mediator roles, as these require inde- concentrate on the implications of the theoretical and
pendence with respect to the interests of the parties empirical notions discussed above for the practice of
involved. SEA and for SEA-related research.
The distinction of different roles an analyst may First and foremost, the notion that different roles
play is similar to a distinction of different ways in can be fulfilled in the context of a multi-actor decision
which (scientific) information is, or can be, used in a process relates to the very essence of SEA. SEA in-
policy debate. First, information can be used in the tra- tends to promote environmental preservation or, more
ditional, rational sense as input to solving a given and broadly, sustainability. By taking that stance, it takes a
well specified problem, generally of the character position probably not shared by (all) other stake-
‘find the best solution given specific objectives and holders and thereby becomes a stakeholder itself. As a
constraints’. Second, information can provide new consequence, SEA plays an advocative role, and will
ideas to a policy debate, opening the way to new op- be seen as such by other stakeholders even if SEA
tions, to look at other angles, and so on (van Eeten, practitioners would prefer to consider themselves as
1999). Third, information can be used as ammunition being objective scientists.
in a strategic debate, to strengthen one’s own argu- There need to be nothing wrong with this. The pro-
ments and weaken those of the opponents. vision of information about environmental impacts,
The recognition of different types of roles and con- and the development and promotion of more sustain-
tributions, and different types of problem situations, able alternatives may indeed have the desired impact
has led several authors to come up with typologies in- on the decisions eventually taken. An advocative role
tended to assist analysts and policy-makers in choos- may be very appropriate in situations characterised as
ing an appropriate approach in a given situation. This a battle of special interest analyses, where SEA would
typology generally identifies problem situation char- provide counterarguments and balance amidst
acteristics on the one hand, and approaches that best economic, traffic, health, safety, or whatever other
fit these characteristic situations on the other. One partial impact assessments. Criteria for success of
simple typology mentioned by various authors in SEA would then relate to the degree to which
decision context, emphasis should not be on the SEA (or EIA) is embedded, or on specific approaches,
advancement of science, but on the use of existing techniques or tools to perform the content analysis,
scientific insights to enlighten decision-makers, and that is, the design of alternatives and the exploration
the information should be tuned to decision-maker of their impacts. More attention should be given to is-
capabilities, interests and timetables. sues such as process design, matching approaches to
The challenge for impact assessors is to identify problem and context characteristics, and to the selec-
those key issues in an effective and timely way. tion of methods and combinations of tools in relation
Quick-scan approaches early in the process look to problem characteristics.
promising. For example, a few interactive rounds with As a consequence, evaluative and comparative re-
stakeholders identifying their key interests, views on search should be broadened beyond evaluation of the
the issues and on potential solutions, supported by a qualities of the assessment process and its direct prod-
broad-brush evaluation may provide a good basis for ucts (usually the report). The use of assessment results
determining the scope of further analyses (Enserink, in, and their impacts on, decision-making should also
2000). be observed, as well as the contextual conditions
Fifth, impact assessors should consider broadening within which the assessment was performed and how
their analytic scope in two respects: broaden the sys- the assessment was designed to match those condi-
tem to be analysed, and broaden the aspects taken into tions. In addition, a sufficiently broad set of possible
account. impacts should be monitored, including impacts re-
Traditionally, impact assessment has mostly con- lated to the learning of participants and the social
centrated on policies, plans or projects and their po- structure (Thissen, 2000).
tential impacts on the environment and other aspects
of relevance. Decision- and policy-making, however,
in essence are activities of and between actors with Concluding remarks
different interests in and perspectives on the problem
situation. That means that an analysis of the positions, SEA is intended to affect policy processes and their
interests and interrelations of the actors involved in a outcomes. If SEA is to have the intended impact; the
decision situation may provide insights that could approach should be guided by insights into the nature
help to identify creative and workable solutions. of decision processes and the ways to influence these
Equally relevant is the suggestion of including val- processes. In this paper, we have explored a limited
ues and arguments in addition to ‘facts’ in an analysis number of characteristics of decision processes and
of a decision situation. This will help clarify the rea- paid attention to two levels: the individual and the
sons for diverging views or positions, and may, de- multi-actor. Individual decision characteristics justify
pending on the situation, provide ways to build only to a limited extent the assumption of rationality
bridges between different viewpoints (van Eeten, in the process, and of the added value of more detailed
1999). assessment information.
Sixth, and following directly from the preceding At the multi-actor level, which is most relevant for
point, the present focus of methods for analysis and SEA, the problems with the assumptions of full ratio-
assessment on the substance of the decision issue (for nality are even deeper. Research findings in, and
instance, on alternatives and their impacts) should be theories from, decision and policy sciences, and
broadened to include methods for analysis of actor developments in decision support and policy analysis
configurations, their interests and perceptions. provide a number of insights and experiences that
Methods to be developed may also extend to identifi- may help to redirect SEA to make it more effective.
cation of possible exchanges between actors. Recent Key notions include the type of information to be pro-
literature in the field of social sciences and policy vided, the transition to more open and emergent ap-
analysis provides some interesting starting points proaches based on interaction with relevant parties,
(Coleman, 1990). the need to include actor configurations and interests
Seventh, the need for flexibility and adaptability in as central elements in the analysis, and the need
policy contexts provides arguments against detailed deliberately to choose a role and function in the
regulation or legal prescription. The open and flexible process.
approach required might be at conflict with the rigour In addition, the debate on the roles of knowledge
and fixed terms that are often part of formal environ- and knowledge workers in policy processes points to
mental impact assessments. Therefore, possible legal the need for SEA to keep fundamentally apart two
frameworks for SEA should prescribe what should be missions that tend to get mixed up in present-day dis-
achieved (depending on the specific objectives of cussions: its advocative mission as an instrument to
SEA) rather than how exactly this should be done. enhance the preservation of the natural environment,
Eighth, the points made above suggest a number of and the ambition to support balanced decision-
new research directions in SEA. Generally, research making which requires a neutral position towards the
in and on SEA should pay more attention to the stakes in the process.
multi-actor characteristics of decision situations. At Nevertheless, the policy and decision sciences do
present, most of the attention is either focused on the not offer final answers. Both SEA and the policy
formal, institutional and/or legal structures in which sciences may benefit from further experiments and
research into what works and what does not, under James G March (1994), A Primer of Decision-making (The Free
Press, New York).
what conditions, and for whom. James G March and Johan P Olsen (1989), Rediscovering Institu-
tions —the Organizational Basis of Politics (The Free Press,
New York).
References I Mayer (1997), Debating Technologies; a methodological contribu-
tion to the design and evaluation of participatory policy analysis
Peter Bogetoft and Peter Pruzan (1997), Planning with Multiple Cri- (Tilburg University Press, Tilburg).
teria (Copenhagen Business School Press, Denmark). A J Meltsner (1976), Policy Analysts in the Bureaucracy (University
R M Bras-Klapwijk (1999): Adjusting Life Cycle Assessment Meth- of California Press, Berkeley).
odology for Use in Public Policy Discourse (Dissertation Delft H Miser and E S Quade (editors) (1985), Handbook of Systems
University of Technology, Delft, Netherlands). Analysis; Overview of Uses, Procedures, Applications and
M Breheny and A Hooper (editor) (1985), Rationality in Planning. Practice (North Holland, New York).
Critical Essays on the Role of Rationality in Urban and Regional H Miser and E S Quade (editors) (1988), Handbook of Systems
Planning (Page Bros, Great Britain). Analysis; Craft Issues and Procedural Choices (John Wiley and
Garry D Brewer (1973), Politicians, Bureaucrats, and the Consul- Sons, Chichester).
tant; a Critique of Urban Problem Solving (Basic Books, New Maria Rosário Partidário (1996), “Strategic environmental assess-
York). ment: key issues emerging from recent practice”, Environmen-
M D Cohen, J G March and J P Olsen (1972), “A garbage can model tal Impact Assessment Review, 16, pages 31–55.
of organisational choice”, Administrative Science Quarterly, Maria Rosário Partidário and Ray Clark (editors) (2000), Per-
17(1), pages 1–25. spectives on Strategic Environmental Assessment (Lewis
J S Coleman (1990), Foundations of Social Theory (Harvard Uni- Publishers/CRC Press, Boca Raton).
versity Press, Cambridge, MA). C V Patton and D Sawicki (1993), Basic Methods of Policy Analysis
R M Dawes (1988), Rational Choice in an Uncertain World (Har- and Planning (Prentice Hall, Englewood Cliffs, NJ).
court Brace College Publishers, Orlando, FL). Barry Sadler (1994), “Environmental assessment and development
J A de Bruijn and E F ten Heuvelhof (1999), “Scientific expertise in policy-making”, in R Goodland and V Edmundson (editors), En-
complex decision-making processes”, Science and Public Pol- vironmental Assessment and Development, an International
icy, 26(3), pages 179–184. Association for Impact Assessment–World Bank Symposium
W N Dunn (1994), Public Policy Analysis: An Introduction (Prentice (The World Bank, Washington).
Hall, Englewood Cliffs, 2nd edition). F W Scharpf, B Reissert and F Schnabel (1978), “Policy effective-
D Durning (1999), “The transition from traditional to postpositivist ness and conflict avoidance in intergovernmental policy formu-
policy analysis: a role for Q-Methodology”, Journal of Policy lation”, in K I Hanf and F W Scharpf (editors), Interorganisational
Analysis and Management, 18(3), pages 389–410. Policy-making: Limits to Coordination and Central Control
Bert Enserink (2000), “A quick scan for infrastructure planning: (Sage, London).
screening alternatives through interactive stakeholder analy- D Schön and M Rein (1994), Frame Reflection: Towards the Reso-
sis”, Impact Assessment and Project Appraisal, 18(1), pages lution of Intractable Policy Controversies (Basic Books, New
15–22. York).
Fisher and Forester (1993), The Argumentative Turn in Policy Anal- Richard W Scott (1987), Organizations. Rational, Natural, and
ysis and Planning (Duke University Press, Durham/London). Open Systems (Prentice-Hall, Englewood Cliffs, NJ).
R L Flood and M C Jackson (1991), Creative Problem Solving. Total Herbert A Simon (1957), Models of Man (John Wiley and Sons,
Systems Intervention (Wiley, New York). New York).
E G Guba and Y S Lincoln (1989), Fourth Generation Evaluation Herbert A Simon and James G March (1958), Organizations (John
(Sage Publications, Newbury Park). Wiley and Sons, New York).
M Hisschemoller (1993), De democratie van problemen; de relatie E Stokey and R Zeckhauser (1978), A Primer for Policy Analysis
tussen de inhoud van beleidsproblemen en methoden van (Norton, New York).
politieke besluitvorming (VU Uitgeverij, Amsterdam). G Teisman (1992), Complexe Besluitvorming, een Pluricentrisch
D Kahneman and A Tversky (1979), “Prospect theory: an analysis Perspectief op Besluitvorming over Ruimtelijke Investeringen
of decision under risk”, Econometrica, 47, pages 263–291. (VUGA, Den Haag, Netherlands).
Daniel Katz and Robert L Kahn (1966), The Social Psychology of Riki Therivél and Maria Partidário (editors) (1996), The Practice of
Organizations (John Wiley and Sons, New York). Strategic Environmental Assessment (Earthscan Publications,
R L Keeney (1994), Value-focused Thinking. A Path to Creative De- London).
cision-making (Harvard University Press, Cambridge, MA). Riki Thérivel and Maria Rosário Partidário (2000), “The future of
R L Keeney and H Raiffa (1976), Decisions with Multiple Objectives: SEA”, in Maria Rosário Partidário and Ray Clark (editors), Per-
Preferences and Value Tradeoffs (John Wiley and Sons, New spectives on Strategic Environmental Assessment (Lewis
York). Publishers/CRC Press, Boca Raton) chapter 19.
W Kickert, E Klijn and J Koppenjan (editors) (1997), Managing W A H Thissen (1997), “From SEA to integrated assessment: a pol-
Complex Networks — Strategies for the public sector (Sage, icy analysis perspective”, EA, Magazine of the Institute of
London). Environmental Assessment and the Environmental Auditors
J W Kingdon (1995), Agenda’s, Alternatives and Public Policies Registration Association, 3(3), Lincoln, UK, pages 25–26.
(Harper Collins, New York, 2nd edition). W Thissen (2000), “Evaluation criteria for strategic environmental
Charles Lindblom (1959), “The science of muddling through”, Pub- assessment”, in Maria Rosário Partidário and Ray Clark (edi-
lic Administration Review, 19, pages 79–88. tors), Perspectives on Strategic Environmental Assessment
G Majone and E S Quade (1980), Pitfalls of Analysis (John Wiley, (Lewis Publishers/CRC Press, Boca Raton) chapter 8.
Chichester). Thissen and Twaalfhoven (2000), “Towards a conceptual structure
James G March (1981), “Decisions in organizations and theories of for evaluating policy analytic activities”, accepted for publication
choice”, in Andrew H de Ven and William F Joyce (editors), Per- in European Journal of Operational Research.
spectives on Organization Design and Behaviour (John Wiley M van Eeten (1999), Dialogues of the Deaf. Defining New Agendas
and Sons, New York) pages 205–244. for Environmental Deadlocks (Eburon Publishers, Delft,
James G March (1987), “Ambiguity and accounting: the elusive link Netherlands).
between information and decision-making”, Accounting Louise G White (1994), “Policy analysis as discourse”, Journal of
Organization and Society, 12(2), pages 153–168. Policy Analysis and Management, 13(3), pages 506–525.
James G March (1988), Decisions and Organizations (Blackwell, A Wildavsky (1987), Speaking Truth to Power : The Art and Craft of
Oxford). Policy Analysis (Transaction Books, Brunswick, 2nd edition).