Professional Documents
Culture Documents
Measuring New Public Management and Governance
Measuring New Public Management and Governance
Giovanni Fattore is associate professor New Public Management (NPM) recently has been Next, we argue that content analysis of electoral
of health care and public management compared and contrasted with public governance (PG) to programs is an appropriate approach for our analysis.
at Bocconi University (Policy Analysis and
Public Management Department), Italy.
illustrate shifts in conceptions of public administrations We discuss this in light of broader applications of
Previously, he was research officer at the and in reform agendas. The authors develop measures content analysis to various types of texts in public
London School of Economics. His research to capture the relevance of NPM and PG in textual administration research. The 2005 regional elections
focuses on health policy and public
management reforms. He holds a degree in
discourse and investigate the extent to which they have in Italy are identified as a relevant, critical case. We
economics from Bocconi University and did entered the political debate. Content analysis of electoral move on, carefully describing the procedure that we
postgraduate studies at the Harvard School programs for the 2005 Italian regional elections reveals applied to measure reference to NPM and PG issues
of Public Health and the London School of
Economics.
that even in this legalistic country, considerable attention in these political documents. Descriptive statistics are
E-mail: giovanni.fattore@unibocconi.it was paid to both NPM and PG issues. An important presented and statistical analysis is applied to test for
explanatory variable in preference for NPM or PG differences in prevalence. The results are discussed
is party ideology, highlighting often-ignored within- and, finally, conclusions are drawn.
Hans F. W. Dubois is a research
officer at the European Foundation for the
country dynamics. Furthermore, the authors show how a
Improvement of Living and Working Condi- methodological approach adapted from mainly political The New Public Governance?
tions (Eurofound) in Dublin. Previously, science and business research can be exploited in the field NPM and PG have received considerable academic
he was assistant professor at Kozminski
University in Warsaw and worked with the
of public administration. attention over the last few decades, referred to as “the
European Observatory for Health Systems two grand narratives of public management reform”
N
and Policies in Madrid. He holds a doctorate ew Public Management (NPM) and public (Andresani and Ferlie 2006, 416). We present a brief
in business administration and manage-
ment from Bocconi University and studied
governance (PG) are two core sets of ideas literature review of both NPM and PG in turn and
economics and medical biology at the in the field of public administration. In a discuss how the second is gaining ground.
University of Amsterdam. provocative article, tellingly titled “The New Public
E-mail: Hans.Dubois@eurofound.
europa.eu
Governance?” Stephen P. Osborne (2006) argues that “New Public Management” is an umbrella term
NPM actually has been a transitory stage in the evolu- (e.g., Hood 1991). Scholars as well as professionals
Antonio Lapenta is an economist and
tion from traditional public administration to what he often have used the expression to refer to distinctive
public management specialist. He holds a calls New Public Governance. themes, styles, and patterns of public service manage-
doctorate in health care management and ment reforms of the last two decades (Barzelay 2001).
economics from Magna Græcia University of
Catanzaro, Italy, and has conducted training
We investigate whether the theoretical interest in PG While some see NPM and PG as two different para-
and research for the Public Management is expressed in the broader society, as reflected by the digms, we agree with those who see the two concepts
Department at Bocconi University from political debate. We also explore whether reference to as different sets of ideas. NPM’s origins lie in a mar-
2004 to 2008. He served as strategic
advisor to the Bolivian Health Minister for
NPM and PG issues depends on candidates’ ideologi- riage of new institutional economics (public choice,
the creation of a National Health System. cal roots. The interest in NPM and PG tends to be transaction cost, and principle–agent theory) and
He is currently an international consultant generalized to the country level of analysis. Inclusion scientific management–based business philosophies
and advisor for government institutions.
E-mail: Antonio.lapenta@yahoo.com
of a proxy for ideological background could reveal (Hood 1991). NPM’s principal focus is intraorganiza-
whether within-country differences and dynamics are tional processes and management, and it emphasizes
of significant magnitude. Furthermore, we make an the economy and efficiency of those service units in
attempt to develop specific measures for these two producing public services (Osborne 2006). The litera-
often referred to but rarely measured sets of issues. ture offers a large number of investigations into the
components of NPM (Ferlie et al. 1996; Hood 1991;
The article is organized as follows: In the next section, Osborne and Gaebler 1992). Following Andresani
we discuss recent developments in the NPM/PG and Ferlie (2006), NPM ideas stress a combination
Public Administration Review, debate and explore core ideas that fall under these two of empowered and entrepreneurial management
Vol. 72, Iss. 2, pp. 218–227. © 2012 by
The American Society for Public Administration.
broad labels, setting the conceptual basis of the meas- rather than traditionally autonomous public sector
DOI: 10.111/j.1540-6210.2011.02497.x. ures presented and discussed in the following sections. professionals and administrators. It favors the use of
218 Public Administration Review • March | April 2012
quasi-market forces rather than planning. Furthermore, it stresses participation of representatives from all stakeholders (Bovaird and
performance measurement, monitoring and management, and audit Loeffler 2002). Networks can include public and private (for profit
systems (Andresani and Ferlie 2006). and nonprofit) organizations and citizens. Existing quasi-legislative
and quasi-judicial new governance processes provide ways to engage
NPM reforms are typically top-down in nature, driven by a “reform- individual citizens, the public, and organized stakeholders in the
ist” central government trying to get the most out of large opera- work of government (Bingham, Nabatchi, and O’Leary 2005).
tional agencies and functions. NPM aims to enhance government As opposed to NPM, the PG approach overcomes the traditional
performance by promoting the “three Es” (economy, efficiency, and dichotomy between policy and administration (Hansen and Ejersbo
effectiveness) and by introducing management principles that often 2002). More generally, classical management tools require an evolu-
have been transferred from business. The common prescription for tion and upgrade to be applied to networked settings, as public
governments is to downsize and outsource. In the popular notion of interest should be pursued by managing institutional networks
one of Osborne and Gaebler’s (1992) principles of entrepreneurial in which governmental entities do not always have a pivotal role
government, governments should seek to improve performance by (Bourgon 2007; Metcalfe and Richards 1990). Governance struc-
“separating steering from rowing.” Governments should concentrate tures can be seen as dynamic relationships that are influenced by the
on steering (policy management) while reducing their involve- decisions and actions of public managers. These relationship struc-
ment in rowing (operational management). Steering organizations tures—through which public policy is made and implemented—are
set policy, deliver funds to operational bodies (public and private), multiple and reciprocal: multiple in the sense that many different
and evaluate performance, but they seldom play an operational interactions influence governance structures, and reciprocal in that
role themselves. NPM focuses on single government entities, and it public managers not only are subject to governance structures but
promotes competition between government agencies and contracted also play important roles in creating, executing, and changing the
providers. In NPM, the traditional policy–administration dichot- dimensions of governance (Feldman and Khademian 2002).
omy is restored, with a clear line between management and policy.
Resources and responsibilities among individuals and organizations The interest in NPM-inspired management tools has not evaporated
should be allocated accordingly (Metcalfe and Richards 1990). and is likely to stay (Ferlie and Fitzgerald 2002), but it is being chal-
lenged more than before. After two decades of public sector reforms
Similar to NPM, “public governance” also is an umbrella term, and inspired by NPM principles, the attention of scholars moved toward
there are many forms of governance (Kooiman 1993). The theoreti- PG approaches. The study of governance is growing in popularity
cal underpinnings of “new governance” ideals are constructed both (Van Kersbergen and Van Waarden 2004). Were this academic inter-
from supposed virtues of markets and third sector alternatives to the est to reflect a development in society true, we should be able to
state, as well as from the belief in the virtue of competition, choice, encounter references to PG issues in the political debate.
and multiagent collaboration (Considine and Lewis 2003). The
public administration/management/policy literature has highlighted Now that the possibility of a new PG movement has been
in particular the network governance model (Acevedo and Common raised, it is important not to overstate its diffusion, by present-
2006; Newman 2001; Pierre and Peters 2000; Rhodes 1997, 2000). ing it as a global development, before investigating it outside the
Anglo-American/Commonwealth world. In England, moderniza-
Here, clients, suppliers, and producers are linked together as copro-
ducers (Considine and Lewis 2003). When we use the term “public tion (Newman 2002) and/or governance (Newman 2001; Rhodes
governance,” we refer to this form of governance. PG developed 2000) rhetoric indeed was present in key New Labour policy and
from different academic disciplines, in particular organizational “ideological” documents (Ferlie and Fitzgerald 2002). While there
sociology and network theory (Osborne 2006). A common feature have been voices suggesting that PG issues might become more
of the PG approach is that the focus of analysis shifts from single popular than NPM issues in continental Europe (Andresani and
Ferlie 2006) and maybe elsewhere in the world, research takes an
entities to include interorganizational networks. Second, emphasis is
put on collaboration rather than competition. Anglo-American focus. To give some counterweight, we choose a
strongly legalistic context. While observations are context specific, as
PG implies an interaction between government and society— always, if we are able to measure and assess the issues at stake in an
between public, private, and voluntary actors—and attention “unfavorable environment,” they are likely to be observed elsewhere.
to a wider range of outcomes (Acevedo and Common 2006). In particular, our context is the 2005 regional elections in Italy,
The diffusion of administrative action, the a country that widely has been recognized
multiplication of administrative partners, for its legislative, “Napoleonic” administra-
and the proliferation of political influence Because of their nature, tive tradition (Capano 2003; Mussari 1997;
outside government’s circles are at the heart NPM issues are expected to Ongaro 2006). In other words, we apply a
of PG. It requires improved skills in negotia- be relatively popular among critical case strategy (Patton 2002) by focus-
tion and coordination. While understanding stakeholders that favor smaller ing on a context in which NPM and PG are
the use of hierarchy and authority, public relatively unlikely to prevail.
government. For PG issues,
administrators also must manage complex
networks, relying more on interpersonal and the reverse might well apply, Furthermore, the NPM versus PG discus-
interorganizational processes (Kettl 2002). as it is more concerned with sion tends to generalize at the country level.
The budget formulation, for example, was enhancing outcomes than with Within-country variance often is neglected.
seen as a top-down exercise in NPM, while streamlining budgets. Because of their nature, NPM issues are
with the PG approach, it requires the active expected to be relatively popular among
Measuring New Public Management and Governance in Political Debate 219
stakeholders that favor smaller government. For PG issues, the making a profit. Public organizations lack this element and, from an
reverse might well apply, as it is more concerned with enhancing institutional perspective, have relatively more to gain from textual
outcomes than with streamlining budgets. In addition, we can test output. Thus, it is not surprising that the public sector produces a
whether there are differences between challenging and incumbent relatively large textual output. The nature of public sector accounta-
parties. It is expected that, all else being equal, incumbents have bility provides us with another explanation for this abundance. Com-
a better understanding of their administrations and NPM issues. munication with citizens is expected to be more common than in the
Voters may easier relate public administration performance to private sector, where the role of citizens as stakeholders is likely to be
incumbents than to challengers. Incumbents thus are more likely less pronounced. Content analysis uses such verbal and written com-
to be attacked on the current state of the public sector. This would munications as its principal data input. Logically, one would expect
imply higher rates of both NPM and PG terms for the challenger, public sector researchers to gratefully exploit these (generally publicly
promising reform. available) textual resources and widely apply content analysis.
In conclusion, our research questions are as follows: We performed an explorative literature review to get a general
impression of the use of content analysis in public sector research.
1. Is the theoretical interest in the public management/admin- The search strategy that we applied was equal to Duriau, Reger,
istration literature on PG expressed in the broader society’s and Pfarrer’s (2007), in that we used the same keywords: “content
interests, as reflected by political programs? analysis” and “text analysis.” We searched 17 public management/
2. Is the theoretical interest in NPM expressed in the broader administration/policy journals: Climate Policy, Governance, Interna-
society, even in a legalistic country such as Italy, as reflected tional Journal of Public Administration, International Journal of Public
by political programs? Sector Management, International Public Management Journal, Journal
3. Does reference in political programs to NPM and/or PG of Policy Analysis and Management, Journal of Public Administration
issues differ depending on candidates’ ideological roots? Research and Theory, Philosophy and Public Affairs, Public Administra-
4. Does reference in political programs to NPM and/or PG tion and Development, Public Administration, Public Administration
issues differ depending on candidates’ status, whether Review, Public Policy Research, Public Management Review, Public
incumbent or challenger? Money and Management, Public Policy and Administration, Policy
Studies Journal, and Publius. The time span of our search is from
Content Analysis of Electoral Programs 1980 (or since the journal has been included in databases) to April
Content analysis is a research method that uses a set of categoriza- 2009. We excluded two studies that did not perform a content
tion procedures to make valid and replicable inferences from textual analysis themselves but used the results of other researchers’ content
data. Nevertheless, content analysis is more than a technique in that analysis as secondary data (Bertelli 2006; McHenry 1986). Other
it embodies a theoretical perspective that seeks to assign a major studies applied content analysis in the form of systematically coding
role to communication. Content analysis was applied on a day-to- and analyzing transcribed interview data or questionnaire responses
day basis during the First and Second World Wars to radio mes- (e.g., Bryer 2009; Wright and Taylor 2005). Finally, in some cases.
sages and other textual material from the enemy. It was not until “content analysis” referred to a through literature review of academic
the late 1940s that it was applied in science (Janowitz 1969). We articles or textbooks (e.g., Dunn 1988; Walsh et al. 1996). We
were unable to find any review of the use of content analysis in the excluded these studies, as our focus is on textual analysis of public
field of research on the administration of public entities. Conse- sector documents.
quently, we performed an explorative literature review ourselves
and contrasted it with the findings of Duriau, Reger, and Pfarrer’s To our surprise, public sector studies using content analysis methods
(2007) thorough review of research on the administration of private are scarce. Our literature search, which was similar in scope to that
entities. conducted by Duriau, Reger, and Pfarrer (2007) on private sector
research, identified only 22 relevant studies. This amounts to about
Duriau, Reger, and Pfarrer (2007) present a meta-analysis of 98 publi- one-fourth (22 of 98) of the number of studies identified by Duriau,
cations in the field of business administration and management using Reger, and Pfarrer. While we arguably were somewhat stricter in terms
content analysis methods. Their literature search involves 15 promi- of excluding literature reviews, the 30 studies that Duriau, Reger,
nent journals in the field over the years 1980–2005. They search and Pfarrer identify for one source category alone (annual reports)
within these journals using the keywords “content analysis” and “text easily outnumber the total number we encountered. This is in sharp
analysis.” Subsequently, the authors make a thorough comparison contrast to the massive body of research that we were expecting to
of these studies, with regard to issues such as the studies’ data source encounter, in a field so widely associated with textual output. In itself,
(mostly annual reports, 30.6 percent, and trade magazines, 18.4 this is a highly interesting observation that needs further research.
percent), broad methodological approach (77.6 percent quantitative,
15.3 percent qualitative, 7.1 percent mixed methods), data analysis Table 1 gives a brief overview of the public sector content analysis
(84.7 percent report some form of frequency count), and reliability studies that we identified. Data sources for these studies include
(62.2 percent use multiple raters and report interrater reliability). texts as diverse as official public administration documents, collec-
tive bargaining agreements, speeches, and submitted parliamentary
Before we focus on the particular data source that we used in this questions. The application of the method has been global, and most
article (electoral programs), we review the use of the method more studies take a qualitative approach. The relatively large number of
broadly in the field. For private, competing organizations, an studies published over the past five years suggests that the method is
important factor in legitimizing their activities and their existence is gaining in popularity in public sector research.
220 Public Administration Review • March | April 2012
Table 1 Content Analysis in 17 Public Sector Research Journals, 1980–2009
Author Year Publication Title Textual Source Country Context
Beierle and Konisky 2000 “Values, Conflict, and Trust in Participatory Case studies, project reports, etc., from cases U.S.
Environmental Planning” of environmental planning
Douglas 1987 “Collective Bargaining and Public Sector Supervisors: Collective bargaining agreements U.S.
A Trend Toward Exclusion?”
Jreisat 1988 “Administrative Reform in Developing Countries: A Official country statements submitted to a Iraq, Jordan, Morocco,
Comparative Perspective” conference Saudi Arabia, Sudan,
Syria, North Yemen
Carnevale 1993 “Federal Service 2000: Staff Training and Labor– Federal collective bargaining agreements U.S.
Management Cooperation”
Blake et al. 1998 “The Nature and Scope of State Government Ethics 39 state governments’ codes of ethics U.S.
Codes”
Ward and Spenneman 2000 “Meeting Local Needs? Case Study of a Final project document, two promotional Fiji, Samoa, Vanuatu
Communication Project in the Pacific Islands” project documents
Houston and Richardson 2000 “The Politics of Air Bag Safety: A Competition among Official record of one U.S. House and two U.S.
Problem Definitions” U.S. Senate hearings
Hall 2002 “Live Bureaucrats and Dead Public Servants: How Floor speeches from the 103rd and 104th U.S.
People in Government Are Discussed on the Floor Congresses
of the House”
Rittberger and Richardson 2003 “Old Wine in New Bottles? The Commission and the Environmental action programs European Union
Use of Environmental Policy Instruments”
Svensson and Wood 2004 “Codes of Ethics Best Practice in the Swedish Public 27 public sector units’ codes of ethics Sweden
Sector: A PUBSEC-Scale”
Cheung 2005 “What’s in a Pamphlet? Shortfalls and Paradoxical Performance pledges of public organizations Hong Kong
Flaws in Hong Kong’s Performance Pledges”
Higgins 2005 “Contemporary Public Library Provision in England: Public library inspection reports U.K.
A Content Analysis of the Highest and Lowest
Scoring Inspection Reports”
Erakovic and Wilson 2006 “The Interaction of Market and Technology in Annual reports New Zealand
Radical Transformation: The Case of Telecom New
Zealand”
Needham 2006 “Policing with a Smile: Narratives Of Consumerism in Prime minister’s speeches, central U.K.
New Labour’s Criminal Justice Policy” government department papers (white and
green papers and strategy documents),
local government corporate plans
Schuh and Miller 2006 “Maybe Wilson Was Right: Espoused Values and Their Agency mission statements, Speeches of U.S.
Relationship to Enacted Values” Presidents George H. W. Bush, Bill Clinton,
and George W. Bush, plus a subject matter
analysis of executive orders, and a survey
of senior executives
Penner, Blidook, and 2006 “Legislative Priorities and Public Opinion: Oral parliamentary questions Canada
Soroka Representation of Partisan Agendas in the
Canadian House of Commons”
Jewell and Bero 2006 “Public Participation And Claimsmaking: Evidence Notice and comment submissions U.S.
Utilization and Divergent Policy Frames in to California’s 1997 passage of an
California’s Ergonomics Rulemaking” ergonomics standard
Lim and Tang 2007 “Urban E-Government Initiatives and Environmental Government Web sites South Korea
Decision Performance in Korea”
Drumaux and Goethals 2007 “Strategic Management: A Tool for Public Government strategic plans Belgium
Management? An Overview of the Belgian
Federal Experience”
Marcuccio and Steccolini 2009 “Patterns of Voluntary Extended Performance Government extended performance reports Italy
Reporting in Italian Local Authorities”
Kapucu, Augustin, and 2009 “Interstate Partnerships in Emergency Management: News reports, government documents, U.S.
Garayev Emergency Management Assistance Compact in after-action reports from various
Response to Catastrophic Disasters” institutions
Kloot 2009 “Performance Measurement and Accountability Annual reports of 2006, for three firefighting Australia
in an Australian Fire Service” services
As far as the analysis is concerned, compared to private sector the topics of interest at the time, from relatively greater use of
research, our literature search revealed that few studies take a quanti- bargaining minutes in the 1980s to the early 1990s, to ethical codes
tative approach to content analysis. Exceptions in public administra- in the later 1990s and 2000s, and performance reports in the 2000s.
tion research include Marcuccio and Steccolini (2009) and Erakovic The use of Web site data is likely to increase with the massive expan-
and Wilson (2006), who analyze frequencies; Beierle and Konisky sion of governmental Web sites.
(2000), who report correlations; and Hall (2002), who applies
(logistic) regression. While quantitative approaches naturally have Most important for our study, we were unable to find any research
their limitations, they can provide important complementary analy- in the field that applies content analysis to electoral programs. One
sis, as indicated by broad application beyond public sector research. of the articles reviewed (Bertelli 2006) does make use of secondary
Another trend that can be observed is that the textual sources reflect data drawn from content analysis of electoral programs. It measures
Measuring New Public Management and Governance in Political Debate 221
political party preferences toward quangos, drawing on a book manner, and adopts the principles and laws establishing autonomy
by Budge et al. (2001) that maps policy preferences. Ever since and decentralization. Implementation was delayed, and it was only
Lasswell, Leites, and Fadner (1949) pioneered the content analysis in the mid-1970s that 15 regions were established and started to act.
of electoral programs, this has become popular in political science Regional parliaments have been elected by popular vote ever since.
research and a common approach in this discipline. Political science Over the past 30 years, regional governments have grown in size and
even knows a “Manifesto Research Group” that created a coding scope in highly relevant policy domains such as health care, social
book, with standard categories used to code party election programs. services, housing, industrial development, professional education,
and, more recently, policing and education.
While electoral programs might not be the most obvious textual
input for public administration research, it is relevant for the field Since 2000, regions have been governed by a directly elected
insofar as electoral programs refer to public administration issues. A governor who chairs the regional cabinet, which is approved by the
similar argument can be made for several of the other textual sources regional parliament. In April 2005, citizens of 14 Italian regions
that we found in the public administration literature (table 1), such renewed regional councils and elected for the second time their
as prime minister’s speeches. We think that electoral programs can governors. In these regions, accounting for about 80 percent of the
be content-analyzed in a way to generate valuable data for pub- Italian population, all but two outgoing governors ran for a second
lic administration research as well. On the one hand, what-to-do mandate and were challenged by only one principal candidate.
arguments in public management rely on rhetorical power (Hood These 28 incumbents and challengers constitute our sample.
1998). On the other hand, political programs in particular provide
us with a view on whether the academic debate on certain public Methods
administration issues reflects interest in society. Electoral programs The first step of the analysis is to document whether NPM and
are widely available and can be expected to reflect a politician’s PG issues are present at all in the programs of each candidate. We
position regarding issues better than a single speech. They also tend collected the candidates’ political programs from their Web sites,
to contain less anti-opponent rhetoric and more policy intentions checking their official Web site twice: five and three weeks before
than verbal communications in the heat of upcoming elections. election day. At the first check, four incumbents’ programs were
Most importantly, political programs—at least to a certain extent— already available on the Internet compared to nine challengers’
reflect what citizens find important at a certain programs. Two weeks later, all candidates had
moment in time. Politicians are unlikely to their political programs available on their
refer to such issues in their programs if voters [A]t least to some degree, own Web sites, with the exception of two
are in fact totally ignorant of them. Candidates candidates who were running in different
electoral programs may well
choose the rhetorical campaign strategy that regions. Most of the candidates presented a
they believe will give them the best chance of communicate visions about the program that was intended as a formal docu-
winning the election, although there inevitably future of government actions ment stating their aims, principles, and plans.
will be a great deal of uncertainty associated that may mobilize resources Otherwise, in some cases, there were candi-
with this choice (Lau and Pomper 2002). So, inside and outside public dates who uploaded only a one-page docu-
when politicians refer to NPM or PG issues administration. ment containing highlights of their political
in their political programs, this reflects the plans on their own Web site. In these cases,
expected values of their political target groups. we considered these one-page documents
Furthermore, at least to some degree, electoral programs may well relevant for the analysis. We converted the 26 electoral programs
communicate visions about the future of government actions that into Microsoft Word documents.
may mobilize resources inside and outside public administration. As
far as politicians are true to their intentions (Pierson 2000), electoral Our next step was to read the programs and extract all sentences
programs thus provide us with a look into the potential future. that referred to any issue related to the management of government
organizations or to public (government) governance. A “sentence” is
Context defined as a unit of language having a subject, an object, and a verb.
Another advantage of our context is that Italian regional elections The end of each sentence is represented by a full stop. The extracted
held in 2005 contrasted two candidates who were part of either a sentences were collected in a grid including four columns: (1) NPM,
“center-left” or a “center-right” coalition. “Left” and “right” mean (2) PG, (3) uncertain, and (4) NPM and PG. Next, we analyzed this
very different things in different countries or even in different classification in order to reassign all of the sentences to NPM or PG.
places within one country. In our Italian context, the label “left” As a general rule, we classified in the NPM category sentences that
is attached to candidates who are part of a coalition that gener- concerned primarily the internal perspective of the organization,
ally favors relatively large government, promotes, social services while we privileged the other category when the focus was mainly
and tends to be supported by labor unions. “Right,” in our Italian on the relations between public organizations and its stakeholders.
context, refers to a coalition that is more pro-market and tends to Some of the sentences were eliminated, as they were considered not
be supported by relatively conservative elements of the Catholic to be substantially related to any of the two issues. Some others were
Church. put in one of the two columns if one of the two issues was promi-
nent relative to the other. Sentences were attributed to NPM when
Italian regions were granted a degree of autonomy in the 1948 they referred to internal operations and to efficiency criteria. Instead,
constitution, which recognizes and promotes local autonomy, they were referred to PG when they primarily concerned with inter-
ensures that services are provided in a maximally decentralized organizational relations and with decision-making processes.
222 Public Administration Review • March | April 2012
Table 2 Candidates’ Most Frequently Used Word Roots agreement. In a subsequent phase, sentences that were rated differ-
NPM PG
ently by the authors were reviewed jointly once again, one by one.
Slightly different operationalizations of the categories or simple
ROOT MEANING ROOT MEANING
typing errors during the classification process were the most com-
BUROCRA- Bureaucracy To COINVOL- To involve Participation
bureaucratize mon causes of first-stage disagreement. After the second stage, there
CONTROLL- To audit COLLABOR- To collaborate still remained about 2 percent disagreement, which indicates some
EFFICAC- Efficacy CONCERTA- Concerted action inherent ambiguity.
EFFICIE- Efficiency CONDIV- To share
INNOV- To reform CONSENS- Agreement
To renew
We then counted the number of words attributed to the two catego-
MODERN- To update INTESA Agreement ries reported in each document and calculated their relative frequen-
SEMPLIFIC- To simplify PARTECIP- To participate cies (number of designated words over total number of words). The
SNELL- To simplify PARTENAR- Partnership computing procedure was performed electronically and double-
To lean
TRASPAREN- Transparency RETE Network Net
checked. After aggregating these data, we compared the frequency of
words between coalitions and between challengers and incumbents.
Note: Root in Italian, meaning in English.
Overall, the most-used roots refer to bureaucracy, participation, and
In order to help researchers classify sentences, we prepared a list of network. In qualitative, contextual terms, the first term generally is
words that have direct relevance for NPM and PG issues. We used used to underscore the intention to move away from bureaucratic
the roots of these words as the element to be identified in the docu- procedures and behaviors. The other two mainly refer to the external
ments, as the root is the essential core of a word, from which all relationships of public organizations.
potential words based on that root can be derived. Table 2 shows the
relevant roots of the words that refer to public administration. Each To verify the reliability of our measure, all extracted sentences also
root was used to identify the phrases that were potential candidates were evaluated according to a different approach. The research team
for the grid (NPM and PG categories), but the final decision about was asked to rank these sentences using a scale ranging from 0 to 10.
the attribution to each category was made in accordance with the Zero was assigned to extracted sentences focusing exclusively on
meaning they have in the programs. NPM themes and 10 for sentences exclusively focusing on PG
issues. Intermediate values were expected to reflect a mix of contents
In order to control and limit the errors inherent in the subjective, between the two themes. Mean scores were used to test differences
judgmental process of classifying sentences, various measures between coalitions and between incumbents and challengers.
were taken. The task was first performed by each author working
independently. Discrepancy between the classifications performed Results
by the authors was 10 percent. Interrater reliability, measured Candidate characteristics are presented in the first four columns
by Cohen’s Kappa, amounts to 0.798. This suggests substantial in table 3. The table also presents the first results of the analysis: