You are on page 1of 9

Environmental Impact Assessment Review 84 (2020) 106435

Contents lists available at ScienceDirect

Environmental Impact Assessment Review


journal homepage: www.elsevier.com/locate/eiar

Fiscal policy instruments in environmental protection T


a,⁎ b
Marta Postula , Katarzyna Radecka-Moroz
a
Faculty of Management, Warsaw University, ul. Szturmowa 1/3, 03-678 Warszawa, Poland
b
European Court of Auditors, 12, Alcide de Gasperi, 1615 Luxembourg

1. Introduction fixed effect panel models.

The need for greater government involvement in implementing 2. Government's involvement in the economy as a significant tool
sustainable development values and goals requires effective solutions to but only where its action is effective
be found and applied by national authorities. Environmental protec-
tion, being one of the fundamental tenets of sustainable development, is Classical economic theories ignored the relationship between the
a task that certainly calls for support from public finance. The aim of economy and natural environment. Moreover, in a linear economy it
this research is to determine the extent to which the spending and tax was wrongly assumed that natural resources necessary to continuously
policies of European Union member states can have a real impact on drive the economic growth are inexhaustible – such type of economy
changing strategic European environmental protection indicators. The was dubbed cowboy economy (K.E. Boulding, 1966).
authors wish to examine whether, and if so to what extent, the fiscal The phenomenon of climate crisis has exposed the imperfection of
measures taken by respective EU countries' authorities (taking into the existing economic theories, and consequently of the way it is re-
account the wealth of societies) influence the impact on environmental flected in the economic and social policy in place.
protection indicators. The authors will attempt to prove the hypothesis It turned out that the political and social expectations focusing on
that in order to improve the effectiveness of environmental protection sustainable development, financial stability and on mitigating the
measures, a policy mix should be adopted involving tools in both economic and social vulnerability require new economic paradigms and
spending and revenue (hypothesis 1). We will also try to demonstrate efficient national and international institutions. Preventive legislation
that air quality management in EU countries is determined differently which sets the effective course of action for the government and helps
for wealthy and other EU member states, and depends on the tax and avert crises, as well as modified economic propositions and social ex-
spending instruments in place (hypothesis 2). Moreover, the article will pectations as to how government and public services should function,
draw attention to the impact of environmental protection measures on have become the substance and organisational characteristics of poli-
the living standard of the population measured with GDP per capita, tical sciences, and to find the way to make science reflect the processes
namely by testing whether the growing national wealth corresponds taking place has become one of the key challenges of our time.
with an increase of public spending on environmental expenditure, and An interesting perspective was presented by Funtowicz and Ravetz
reflects the level of corresponding environmental taxes imposed, ulti- (1993) in their concept of post-normal science, which argues that a
mately influencing the level of environmental pollution. It is important positivist, linear approach to science is part of the problem that is
to conduct research on which of the instruments, namely taxes or present-day environmental crisis, and demonstrates the ineffectiveness
spending, are more efficient in exerting an impact on market players in of the “puzzle-solving” suggestions offered to date (Kuhn, 1997) which
the context of reducing the environment pollution with various gases. fail to take account of the system complexity in solving our top chal-
The article will also attempt to indicate for which gas emission in- lenges of today. Post-normal science accepts the existence of the in-
dicators more measurable effects are ensured by implementing tax so- herent contradictions and inconsistencies. A good example of such a
lutions in the form of additional pollution fees, and where support by seemingly unsolvable conflicts would be our constant pursuit of de-
public spending is more reasonable. velopment and enrichment while the planet's limited resources neces-
A mixed methodology combining the results of qualitative and sary to achieve this ambition are running out (Rockstrom et al., 2009).
quantitative research is used to empirically verify the hypotheses re- There is no single scientific method to solve this antagonism and that's
lated to the research problem presented. Qualitative research is based why the role of science in this perspective is defined as the initiator of
on descriptive analysis, and the quantitative research will include the the mutual learning process rather than an objective supplier of final
method of statistical information systemization, based on statistical solutions.
source data analysis, and static dependence methodology, including Irrespective of the research aimed to resolve the dispute within


Corresponding author.
E-mail addresses: mpostula@wz.uw.edu.pl (M. Postula), katarzyna.radecka@eca.europa.eu (K. Radecka-Moroz).

https://doi.org/10.1016/j.eiar.2020.106435
Received 20 November 2019; Received in revised form 13 June 2020
Available online 26 June 2020
0195-9255/ © 2020 The Authors. Published by Elsevier Inc. This is an open access article under the CC BY license
(http://creativecommons.org/licenses/BY/4.0/).
M. Postula and K. Radecka-Moroz Environmental Impact Assessment Review 84 (2020) 106435

economic theory, it is desirable to focus attention on the economic and imperfections identified in the previous model, where this very
policy actually implemented and on its outcomes for stable develop- fragmentation of environmental goals was seen as one of the major
ment, and thus to approach the problem relying on basic fiscal policy barriers to the effective accomplishment of the objectives at hand. With
parameters related to the scale of GDP redistribution and to the growth this new approach in place, environmental issues have been in-
rate achieved, while taking account of the policy's underlying qualita- corporated in a great majority of SDGs and there is a commitment to
tive factors related to social customs, procedures, legal regulations and interpret socio-economic development only in a manner that benefits
their application. The choice of the adequate scale of redistribution, the natural environment and its resources. In line with this approach,
measured with the revenue- and expenditure-to-GDP ratio, and the environmental protection plays a fundamental role in the sustainable
achievement of the desirable growth rate represent a fundamental development concept and, at the same time, poses challenges involved
problem for policymakers responsible for a given country's medium- in providing specific solutions, ways to implement them and measure
term social and economic development, irrespective of the political their effectiveness.
option they represent. The contemporary economic policy implemented In this context and in the globalised world it is, therefore, necessary
in different countries should also take account of the changing internal to create contemporary solutions regarding the financing of global
and external determinants. (horizontal) tasks, informed by certain economic schools of thought; to
External factors include the constant globalisation of processes, and create an element of a cash flow structure between countries, regions
membership of supra-national communities such as the European Union and continents modelled on the cash flow structure functioning in many
(EU). With respect to the ongoing globalisation G.W. Kolodko believes countries, and to divide tasks between them. Similarly as in the case of
that “The world is facing new challenges as globalization has entered a national-level policy where one can identify various tasks that can be
new stage. What should we expect in terms of interrelations between pursued either by given local government or by central government,
not only market and government but also the three fundamental com- here, they could be pursued either by a given country or by the
ponents of economic activity: market, government and the world” European Union as a whole or even on a global level, by the whole
(Kolodko, 2013). On the other hand, economic policy coordination world (Rambarran, 2015; Davidson, 2017; del Granado et al., 2018). In
measures implemented by member states and the European Community such a situation one should take into consideration that the challenges
alike may have direct or indirect implications for the fiscal policy and of the new, more complex reality may call for new, more complex re-
income distribution (Adam et al., 2014). It is hard to give a straight cipes for the reality around us and for policy implementation.
answer to the question of which solution will be optimal in a given
country and what is the role of the EU in this process. There are a 3. Environmental protection as a common task effectively
number of differing views on what the most effective economic policy- implemented on a global level
making and implementation tools are and on the role of supranational
communities and associations in this respect; however, it's worth Presently, the point of departure for conducting a performance as-
bearing in mind that they can enhance the effectiveness of individual sessment of environmental policy implementation is its assessment on
country-level measures (Sun and Ryzin, 2014). the national level. An analysis of spending indicators for respective
Countries supported with measures taken by communities such as member states between 1995 and 2018 suggests an uneven approach to
the European Union as part of the initiatives undertaken aim to im- environmental issues in respective countries (Dumciuviene et al.,
plement economic solutions that are based on the concept of sustain- 2015). These issues are discussed more in-depth in section four, while
able development, which requires adopting a long-term finance per- here the focus is only on their influence on the impact and outcome
spective for critical infrastructure, such as natural environment, and indicators.
addressing long-term threats (European Commission, 2018). It is also It is worth examining here the difficulties in defining the sustainable
concluded that as part of those actions the objective of sustainable development indicators. Each indicator can only represent certain as-
development must be supported by sustainability finance pect or simply one side of the coin, and therefore we need skills and
(Shrithongrung and Kriz, 2014). Actions undertaken as part of the experience to use them wisely, especially if we want to inform policy-
sustainability finance concept could contribute to re-orienting finance makers. We should always keep in mind that indicators can “(1) reveal ,
measures and to strengthening the efforts to generate a long-term po- (2) suggest , (3) distort and (4) conceal, but as objects of design, they
sitive impact on the socio-economic development (Collignon, 2008). A provide policy-relevant information rather than simple facts” (Ravetz,
particular role and importance in this respect is ascribed to public au- 2018). They should also vary depending on their function, e.g. for
thorities, which use public finance to achieve sustainable development, policy-making or educational purposes.
of which environmental protection is one of the main goals. The Ecological Footprint is one of informative examples. It was
It is worth emphasising here the fundamental significance of the created in the late nineties and has evolved since then (Wackernagel
following three values in the concept of sustainable development: et al., 1997). Currently it is used to measure one important aspect of
protection of the environment understood as a shared habitat of human sustainability: how much biocapacity humans demand, and how much
and non-human animals, responsibility for future generations, and so- is available. This indicator serves well the educational purpose. It
cial justice (Miller et al., 2014). Hence, public authorities have two makes us aware of the environmental burden that we, as individuals,
tasks as it were: firstly, to integrate these values as the basis for its create on every-day basis. In other words, it helps us understand our
action, and, secondly, to work out effective tools for implementing contribution to the environmental crisis. Yet, it has its own limitations.
goals pertaining to the concept of sustainable development. The process There are certain elements, specific to a particular country or a region,
of transforming the current understanding of public authorities' tasks that cannot be accurately reflected in this indicator and therefore
should come hand in hand with a non-stop dialogue on the practical render it unacceptable. For example, Luxembourgish authorities ques-
interpretation of the sustainable development concept, with a broadly tioned the accuracy of this indicator, as the contribution of tank-tourists
defined public and with the academic community and administration of cheap alcohol and fuel (Luxembourg imposed low taxes on these
alike. The aforementioned natural environment is one of the three products) distorted the Luxembourgish footprint enormously.
common denominators (the other two being social and economic is- Yet another important issue should not be neglected when designing
sues) underlying sustainable development goals (SDG) adopted in 2015 indicators. If we think about the way indicators are formulated, we can
by the UN. It is worth pointing out that the approach to SDG fulfilment classify them in two broad categories: experts-led top-down and com-
is in essence about combining those three dimensions and developing munity-based bottom–up. (Prabhu et al., 1999; Mendoza et al., 1999;
integrated indicators of their implementation. The decision to no longer Reed et al., 2006). In the basic top-down approach, a previously gen-
treat environmental issues as separate ones aims to avoid the problems erated set of is used initially and a team of experts adapts and modifies

2
M. Postula and K. Radecka-Moroz Environmental Impact Assessment Review 84 (2020) 106435

this set according to the local situation (Prabhu et al., 1999; McDougall on growth – programmes implemented with the use of public spending
et al., 2009). In the bottom-up approach, local communities actively can have all sorts of positive impact on the economic growth. Firstly,
engage in the development process in a participatory manner based on public goods are provided thanks to public spending, secondly – public
their perception of the individual situation (Prabhu et al., 1999). The spending is a source of products and services intended to fix market
accounting for sustainable development is not a new concept, but there imperfections and improve performance. The basis for evaluating the
is some criticism regarding the value of information gathered until now, consequences of public spending for sustainable development are ana-
as the already developed indicators do not necessary measure sustain- lyses assessing the effectiveness of public authorities exerting an impact
able development issues at the local level and may not capture in- on environmental protection indicators through tax and spending in-
formation essential for local communities (Reed et al., 2006). As Lux- struments, taking account of the wealth of respective countries' socie-
embourgish case study shows, due to these constraints, essential ties.
elements may not be taken into account. In consequence of such lim- A number of studies aimed to determine the impact of public
itations, local authorities/groups may not be willing to invest in col- spending on the level of environmental pollution are being conducted.
lecting necessary information. In some cases, because of that, all the The results obtained indicate that in European countries public
benefits that citizen science brings may be lost. Therefore, it is im- spending have contributed to limiting greenhouse gas emissions, while
portant to engage relevant stakeholders in both development and in the Middle East the effect was minor or even negative (Abid, 2017).
practical application of the indicators. As experience demonstrates, in Similar conclusions were reached in their analyses by Gholipour and
some cases such a collaborative process may contribute positively to the Farzanegan (2018), who, based on data from North African and Middle
quality and quantity of the proposed indicators. It can also lead to a Eastern countries, proved that public spending on environmental pro-
better understanding of environmental and social problems, enhance tection have no significant impact on the quality of environment. The
community capacity building, but also contribute to policy formulation amount of public funds spent does not in itself guarantee full success
process. unless they are managed adequately and effective distribution channels
The current biggest challenge is to combine these two types of ap- are created. This is also confirmed by the research conducted in this
proach, top-down and bottom-up, and benefit from the values that both article. There are four research trends in investigating the relationship
propose. between the environmental policy in place (the scale of influence of the
We should also not forget that indicators are defined in the political available instruments) and the quality of environment. The first group
process and therefore may, in some cases, be selected to bring benefits includes research aimed to assess the impact of respective environ-
to those in power. If we think about the indicators shaped to trace the mental quality policy mechanisms. Erjavec et al. (2017) argued that
national progress on SDGs, we should keep in mind that the UN fra- even though various instruments were used as part of the agricultural
mework provides a wide portfolio of areas that can be chosen by na- policy, they had no significant impact on the level of greenhouse
tional authorities to concentrate and consequently report on. In order to emissions. Similar issues were dealt with by Neufeldt and Schäfer
obtain a reliable picture of the situation in a particular country, we (2008), who analysed how the introduction of different instruments of
must be convinced that the selected SDGs were objectively chosen as environmental protection policy would decrease greenhouse gas emis-
the ones that require the biggest focus in terms of action and finance. sions from farming. The authors emphasised that it is difficult to choose
The opposite scenario is possible as well. Namely, the national autho- one mechanism as, for instance, introducing an emission cap means low
rities may select the SDGs that will allow them to concentrate public costs for farmers while an emission tax is cheaper on a macro scale.
efforts on issues that have the biggest chances to bring the government Morley (2012) used a panel composed of EU countries and Norway to
ad hoc political benefits instead of selecting goals whose fulfilment may demonstrate that there is a statistically significant negative correlation
be in reality more needed, but which are more difficult to achieve and between the level of environmental spending and the greenhouse gas
have a potential to generate social tensions. This is why trust between emissions. Hence, tax policy instruments proved effective, which was
the citizens, scientists and political authorities is of crucial importance, not entirely confirmed by the research conducted for the purposes of
as we need to trust that the right problems are addressed. this article. Meanwhile, Dholakia et al., 2013 pointed out that another
National authorities may use a number of fiscal instruments for factor in assessing the effectiveness of air quality policy is the quality
environmental protection measures, the most significant of which are metric used. Rules have contributed, for example in India, to a sig-
taxes and public spending. As a matter of fact, public transfers are at the nificant reduction of CO2 emissions, while having a limited impact on
core of public finance understood as the processes of raising and allo- NH3. The second research group includes papers investigating the en-
cating public funds. Public transfers relate to the fulfilment of the re- vironmental impact of expenditure across the society, sometimes ex-
distributive, allocative and stabilising functions as part of the public pressed as a ratio of GDP. Taking as an example 12 European countries
finance system (Musgrave Musgrave, 1985). The redistributive function in the period between 1995 and 2008, López and Palacios, 2014de-
has a direct impact on the revenue structure, and then an indirect one monstrated that public spending played a significant role in reducing
on the production, meaning that this instrument, when used for en- sulphur oxide and ozone emissions. However, no such effect was re-
vironmental protection, may contribute to a change in citizen and en- ported for nitric oxide. Meanwhile, Boston et al. (1996) and Czyżewski
trepreneur behaviours in the future. Meanwhile, the effect of the allo- et al. (2019) confirm the correlation between the scale of public
cative function involves mainly the structure of production. Public spending in EU-25 countries and the reduction of PM2,5 emissions,
transfers being part of the fiscal policy are intended to change the very namely it was demonstrated that the higher spending results in much
structure of Gross Domestic Product generation and distribution. An lower PM2,5. In another research Halkos and Paizanos (2013) analysed
assessment of the impact of public spending and taxes on the economic the impact of governmental spending on greenhouse gas emissions in
growth and environmental protection is not easy and evolves in parallel respective panels and they concluded that although a higher GDP share
with the developments in the economic and social thought (Gosh et al., of public spending was conducive to the reduction of sulphur and nitric
2009; Rogoff and Reinhart, 2009; Boston et al., 1996). The direction oxide emissions, there was no such impact on carbon dioxide. Generally
and consequences of income redistribution and, ultimately, of public speaking, an indirect effect of public spending is more important and
spending depend on the growth theory on which the analysis is based. becomes stronger in parallel with GDP growth and the democratisation
The alleged consequences of the public spending increase that are po- level, which is also analysed in the article by defining two variables
sitive, neutral or negative for the economic growth vary between re- taking account of those elements.
spective schools of economic thought (new classical, neoclassical,
neoKeynesian economics or the real business cycle theory). It still does
not solve, however, the core dilemma related to the effect of spending

3
M. Postula and K. Radecka-Moroz Environmental Impact Assessment Review 84 (2020) 106435

4. Material and methods management, waste water management, pollution abatement, protec-
tion of biodiversity and landscape, R&D environmental protection and
4.1. Description of the research method and of data sources environmental protection n.e.c. What is used for analysis in the article
is the group of spending on environmental protection function.
Taking account of the above theoretical discussion, a decision was As for tax revenue, Eurostat collects data on environmental tax
made to include in the analysis all EU member states between 2006 and revenue by its type - energy taxes, transport taxes, pollution and re-
2018, which use various tax and spending instruments for environ- source taxes, broken down by economic activity (tax payer). These
mental protection measures. The selection of the period for analysis was detailed data become available later than the overall revenue data. The
based on the availability, comparability and completeness of the data last reference year for which data is available is therefore 2018. The
from all EU member states. In the analysed period, there were data gaps share of energy taxes in the total revenue from environmental taxes
resulting from lower availability of data from countries that joined the differs widely across countries, and this needs to be taken into con-
EU after 2006, i.e. Bulgaria (2007), Romania (2007), Croatia (2013), sideration to properly evaluate the tax burden by taxpayer in the EU
the lack of data on environmental taxes for years 2017–2018 for France countries. Environmental taxes have been increasingly used to influ-
and Bulgaria and about NH3 for four countries throughout the whole ence the behaviour of economic operators, whether producers or con-
period of time. As regards the data on public fiscal instruments, the sumers. These taxes also generate revenue that can potentially be used
authors opted for using indicators that measure correlations between by government to increase its expenditure on environmental protection
the spending-to-GDP per capita ratio and, similarly, the tax amount is or efficient management of natural resources.
compared with GDP per capita as it is important to indicate whether The choice made is validated by the fact that this data is used by the
respective countries' authorities increase their commitment to en- European Environment Agency in its analyses. Keeping in mind the
vironmental protection in parallel with the society's growing wealth. availability of pooled cross-sectional and time-series data, the authors
This enabled conducting quantitative research to show how the na- opted for the panel study method. Using panel samples to build
tional authorities' spending and tax policy may drive the values of en- econometric models helps take account of the variability of the entities
vironmental protection indicators, and which of the instruments ap- analysed and of the changes observed over time in individual objects,
plied is more effective when it comes to the outcomes achieved. while ensuring data aggregation. Panel models with dummy variables
As for the environment, three indicators were selected for a detailed and random variable decomposition were used as the research tool.
analysis, which indicate the condition of the natural environment and The formula for basic unobserved effects model can be as follows for
the scale of environmental impact, such as: greenhouse gas emissions1 a random cross section observation i:
(GHG emissions in million tonnes CO2 equivalents), NH3 emissions
yit = xit β + c i + uit ; t = 1, 2, …, T
(tonne) and CO emissions (tonne). This data is sourced from European
Commission databases and it comes from research conducted by re- where xit is 1 x K and may include observable variables that vary
search centres that specialise in the topic. The choice of those para- across t but not i, variables that vary across i but not t, and variables
meters is not random and stems from the fact that as a result of human that vary across i and t. If i refers to individuals, ci can be called an
activities, all kinds of pollutants are emitted to the atmosphere, some of individual effect or individual heterogeneity, and corresponding terms
which, due to the volume of emissions and the harmful effect on human are used for families, firms, cities, and other cross-sectional units. The
health and environment, are subject to measurement of both emission uit are called the idiosyncratic errors or idiosyncratic disturbances be-
to air and their content in the air. cause they vary across t as well as across i. It is common for both
The available data from Eurostat databases was used for the ana- methodological papers and applications to specify whether ci is treated
lysis, which according to the Authors present the most objective and as a random effect or a fixed effect. In the classic approach to panel data
reliable data spanning a sufficient time series for the analysis. Eurostat models, ci is referred to as “random effect” whenever it is treated as a
collects environmental protection expenditure and tax data through a random variable and a “fixed effect” when it is treated as a parameter
joint Eurostat/OECD questionnaire on environmental protection ex- that needs estimating for each cross section observation i. Considering
penditure and revenues; this is based on EU methodology. the high number of random draws from the cross section, it's worth
In the public sphere, three action areas are defined, which are seeing the unobserved effects, ci, as random draws from the population,
classified as the functions of government (COFOG). To analyse func- same as yit and xit. This is certainly a valid approach from the point of
tions performed by governments in Europe, a decision was made to use view of omitted variables or neglected heterogeneity. In modern
COFOG classification, as it is an international standard created ex- econometric terms, “random effect” is tantamount to zero correlation
clusively for the central and local government institutions by the between the observed explanatory variables and the unobserved effect:
Organisation of Economic Cooperation and Development (OECD), and Cov(xit; ci) = 0, t = 1, 2, …, T. In fact, for the statistical inference to be
published by the United Nations Statistics Division. Another argument fully justified, a stronger conditional mean independence assumption, E
in favour of choosing data arranged this way for the analysis was the (ci|xi1, …, xiT) = E(ci), would be required In applied papers, when ci is
availability of comparable data for all EU member states. called, for example, an “individual random effect”, an assumption is
The functional classification was also recommendable for the ana- probably made that ci is uncorrelated with the xit. Hence, where ci is
lysis, because it is intended to group all of the government's areas of referred to as an “individual fixed effect” or a “firm fixed effect”, it
activity by purposes of the actions undertaken. This enables analysing means that ci can be correlated with xit.
outlays on respective groups of actions in the consecutive years and
indicating the changes achieved in each group. Such data arrangement 4.2. Researching the phenomenon in question
represents a comparative ground in terms of nature and direction of
public spending. In accordance with COFOG classification, spending by A decision was made to conduct the research using panel models
central and local government institutions is divided into 10 main areas with environmental indicator values as dependent variables and the
of government influence. One of these categories, spending on en- following explanatory variables:
vironmental protection includes, without limitation, spending on: waste
• Public spending on environmental protection per capita in EU
countries to GDP per capita (hereinafter: variable A)
1
A greenhouse gas (sometimes abbreviated is a gas that absorbs and emits
radiant energy within the thermal infrared range. Greenhouse gases cause the Variable A indicates the dependency of public spending for en-
greenhouse effect. vironmental protection on citizens' wealth measured by GDP per capita.

4
M. Postula and K. Radecka-Moroz Environmental Impact Assessment Review 84 (2020) 106435

Table 1
Analysis of correlations between the variables examined.
Details NH 3 Greenhouse gas CO emissions Public spending on Public revenue from Variable A Variable B
emissions emissions environmental protection environmental protection

NH3 emissions 1.0000


Greenhouse gas emissions −0.0961 1.0000
CO emissions 0.9424⁎ −0.0929 1.0000
Public spending on 0.1004 0.8817⁎ 1.0000
environmental protection
Public revenue from −0.1583⁎ 0.2860⁎ −0.2969⁎ −0.2236⁎ 1.0000
environmental protection
⁎ ⁎ ⁎
Variable A 0.9182 −0.0704 0.9304 0.9238 −0.2198⁎ 1.0000
Variable B −0.2280⁎ −0.3540⁎ −0.2139⁎ −0.5041⁎ 0.3433⁎ −0.2045⁎ 1.0000

Source: Own compilation.



Significant at 0.05.

The Authors defining this variable wished to analyse whether the observations comprising 24 EU countries (a complete data set is
growing national wealth corresponds with an increase of public available only for those countries).
spending on environmental expenditure, and ultimately influences the Public spending on environmental protection does not yield in the
level of environmental pollution. long term a real result of reducing the pollution but rather results from
the increase in the environmental pollution. This may stem from the
• Public revenue from environmental protection per capita to GDP per structure of this spending, as probably most of it does not represent
capita (hereinafter: variable B) as per categories and subcategories investment spending of preventive nature, but rather spending to mi-
used by Eurostat. tigate the consequences of the pollution.
The above claim seems legitimate as “Spending to GDP” yields a real
Variable B indicates the dependency of the public environmental tax impact that reduces the pollution level, with each change by 1 per-
revenues on the citizens' wealth measured by GDP per capita. The centage point reducing the pollution level by 0.9692 units ceteris par-
Authors defining this variable wished to analyse whether the growing ibus.
national wealth reflects the level of corresponding environmental taxes As for taxes, in the current period they do not yield, either, the
imposed, and whether it ultimately mitigates the level of environmental desirable outcome of reducing the pollution, however in the long term
pollution. (5 years analysed)(the sum total of those coefficients – long-run mul-
The analysis carried out in order to select the best model for testing tiplier in DL models) the effect is significantly positive, with a tax in-
selected variables showed that for all the variables examined, fixed crease by 1 unit in the current over 5 years yielding a drop in the pol-
effect models proved to be the best, for which the parameters of these lution level by 5.06353 units ceteris paribus.
models are consistent (see Table 1). Results of the analysis reveal that As regards revenue instruments intended to support NH3 emissions
environmental measures undertaken by national authorities using reduction, one can observe that the variable B defined has an insig-
spending tools fail to bring the intended outcome i.e. the pollution level nificant impact on NH3 reduction, which may suggest that a public
increases in proportion to the increase in public spending and variable spending instrument is more effective in the battle for environmental
A. This can have at least two causes, namely the ineffectiveness of non- protection. However, such radical conclusions cannot be drawn based
global measures taken by individual countries, as already pointed out in on one qualitative indicator, which is why a similar analysis was con-
the theoretical section, and the fact that measures undertaken in a given ducted for CO and CO2 emissions. The results obtained are presented in
period may yield results in the form of lower environmental pollution Tables 3 and 4.
indicators several years later (in 3 to 4 years because this is the average The model of the impact of fiscal instruments on CO emissions
lead time of investment projects intended to lower pollution indicators, (Table 3) was estimated based on 144 observations comprising 24
shift attitudes to the environmental protection etc.). The situation is countries due to lack of complete data for all 28 EU member states, like
different when it comes to the use of tax instruments, because in their in the previous case. This study explains 64.5% of the variance in
case there is a negative correlation between the value of variable B and pollution between the countries analysed.
all indicators measuring the pollution level, which may suggest that For those pollutants public spending in previous periods is sig-
taxes can have a faster impact in terms of reducing the scale of en- nificant and contributes to reducing the pollution. Over 5 years, 1
vironmental pollution. Considering the ambiguity of the results ob- spending unit will decrease the pollution by 0.14689 units (the same
tained, especially with respect to the impact of public spending and of methodology – sum total of coefficients for immediate and delayed
variable A on the environmental protection, it proved necessary to effects).
conduct further analyses. Other variables are statistically insignificant.
Further research was conducted based on data variability analysis, In this case, analyses revealed that environmental protection
and fixed effects model estimation (individual). As concerns the in- spending has a significant impact on CO pollution level by reducing it
dividual fixed effects model, the entity under analysis is an EU member after 1, 3, 4 years of making the expenditure. The spending increase by
state, which, by definition, causes the response variable to have sig- 1 unit in the current period will cause the CO pollution to drop in the
nificantly different values. The simplest assumption in panel models is long-term (5 years) by 0.12075 (sum total of those coefficients, the so
the existence of fixed, unknown (not observable) but constant differ- called long-run multiplier), assuming all other variables remain con-
ences between countries. Hence, as a first step, fixed effects models stant. When it comes to research into tax instruments, it points to a low
were prepared to examine the causes of changes in European Union effectiveness of the same in reducing CO emissions as the analyses re-
member states when it comes to the level of variable A for respective veal that the increase of variable B by 1 unit will cause CO emissions to
environmental protection indicators. drop by 121.8526 units only in the current period.
The impact of respective variables on the level of NH3 emissions was A more extensive data set was available for examining the third
analysed taking account of the effect results being felt only in years to indicator, i.e. greenhouse gas emissions, because in this case the model
come (see Table 2). The results were estimated based on 144 was estimated based on 174 observations comprising 28 countries (see

5
M. Postula and K. Radecka-Moroz Environmental Impact Assessment Review 84 (2020) 106435

Table 2
Fixed effects model of the impact of fiscal instruments on NH3 emissions.
NH3 emissions Coef. Std. t P > t [95% Conf. Interval]

Public spending on environmental protection


L1. 0.000283 0.0010244 0.28 0.783 −0.0017475 0.0023135
L2. 0.0037913 0.0010419 3.64 0.000 0.0017261 0.0058566
L3. −0.0030962 0.0010432 −2.97 0.004 −0.0051639 −0.0010284
L4. 0.000225 0.0007622 0.30 0.768 −0.0012858 0.0017358
Variable A −66.28311 24.01878 −2.76 0.007 −113.8875 −18.67868

Public revenue from environmental pollution % GDP


L1. 2.810286 3.862271 0.73 0.468 −4.845405 10.46598
L2. −2.569216 3.81916 −0.67 0.503 −10.13945 5.001021
L3. −1.842404 3.316224 −0.56 0.580 −8.415736 4.730927
L4. −0.7361011 2.29375 −0.32 0.749 −5.282711 3.810509
Public spending on environmental protection % GDP −96.92696 27.79474 −3.49 0.001 −152.021 −41.83296
Public revenue from environmental pollution % GDP −18,474.7 25,718.04 −0.72 0.474 −69,452.32 32,502.92
Variable B −24,286.94 25,964.95 −0.94 0.352 −75,748.64 27,174.76
_cons 149.8347 8.524392 17.58 0.000 132.9396 166.7298
sigma_u 180.05341
sigma_e 3.9318284
rho 0.99952337 (fraction of variance due to u_i)

L1 - time delays corresponding to 1, meaning by one year; L2 - time delays corresponding to 2, meaning by two years; L3 - time delays corresponding to 3, meaning by
three years; L4 - time delays corresponding to 4, meaning by four years.
Source: Own compilation.

Table 4). The fixed effects model developed explains in 4% the variance the public fiscal measures applied by EU member states to reduce en-
in pollution between countries and in as much as 75% the variance vironmental pollution. We also wanted to observe whether there is a
within countries. correlation between the growing wealth of societies and the condition
For these emissions only the spending share of GDP significantly of the environment. We assumed that, in order to improve the effec-
contributes to reducing the pollution, with an increase by 1 percentage tiveness of environmental protection measures, a policy mix should be
point reducing the pollution level by 0.860 unit ceteris paribus. applied involving tools for both spending and revenue. We tested the
Conversely, the share of taxes does not reduce the pollution level. hypothesis by analysing the impact of public spending and environ-
As regards greenhouse gas emissions, they are significantly im- mental taxes on the evolution of environmental indicators for the se-
pacted by both variable A and variable B. The model reveals that when lected pollutants, using panel models. We also checked whether the
variable A increases by 1 percentage point, the greenhouse gas emis- growing national wealth corresponds with an increase of public
sions drop on average by 0.64 unit ceteris paribus. Meanwhile, as for spending on environmental expenditure, and whether it reflects the
variable B, it is also statistically significant but it's an inefficient in- level of corresponding environmental taxes imposed, ultimately miti-
strument as the increase of this share by 1 percentage point causes, on gating the level of environmental pollution.
average, an increase in pollution ceteris paribus. The research has proved that our hypotheses were correct, however
under certain circumstances. Neither public spending, nor environ-
5. Research results mental taxes, applied separately, improve the condition of environment
as desired and therefore a policy mix should be applied in order to fully
The Authors' main goal was to check the long-term effectiveness of harvest the potential of both types of measures.

Table 3
Fixed effects model of the impact of fiscal instruments on CO emissions.
CO emissions Coef. Std. t P>t [95% Conf.

Public spending on environmental protection


L1. −0.0444271 0.0151882 −2.93 0.004 −0.0745297 −0.0143245
L2. −0.027816 0.0174543 −1.59 0.114 −0.06241 0.0067779
L3. −0.0433737 0.0176444 −2.46 0.016 −0.0783443 −0.0084031
L4. −0.032948 0.0124379 −2.65 0.009 −0.0575995 −0.0082965
Variable A 156.0121 404.1677 0.39 0.700 −645.0352 957.0594
–. −121.8526 65.70612 −1.85 0.066 −252.08 8.374784
L1. 7.945779 69.14039 0.11 0.909 −129.0882 144.9798
L2. 18.92311 65.26061 0.29 0.772 −110.4213 148.2675
L3. −22.64788 56.62374 −0.40 0.690 −134.8743 89.57853
L4. −1.608256 39.1689 −0.04 0.967 −79.23975 76.02324
Public spending on environmental protection % GDP 90.58914 477.001 0.19 0.850 −854.9096 1036.088
Public revenue from environmental pollution % GDP 820,791.9 441,361.6 1.86 0.066 −54,063.36 1,695,647
Variable B 808,383.1 436,916.4 1.85 0.067 −57,571 1,674,337
_cons 1544.626 143.4413 10.77 0.000 1260.33 1828.922
sigma_u 1810.6673
sigma_e 66.161496
rho 0.99866662 (fraction of variance due to
F F (23 109) = 169.13 Prob >

L1 - time delays corresponding to 1, meaning by one year; L2 - time delays corresponding to 2, meaning by two years; L3 - time delays corresponding to 3, meaning by
three years; L4 - time delays corresponding to 4, meaning by four years.
Source: Own compilation.

6
M. Postula and K. Radecka-Moroz Environmental Impact Assessment Review 84 (2020) 106435

Table 4
Fixed effect model of the impact of fiscal instruments on greenhouse gas emissions.
Greenhouse gas emissions Coef. Std. t P>t [95%] Conf.

Public spending on environmental protection


L1. −0.0014278 0.0011912 −1.20 0.233 −0.0037838 0.0009281
L2. −0.0005147 0.0013403 −0.38 0.702 −0.0031656 0.0021363
L3. −0.000998 0.0012711 −0.79 0.434 −0.0035121 0.0015161
L4. 0.0001231 0.0009192 0.13 0.894 −0.0016949 0.0019411
Variable A −64.50138 31.0844 −2.08 0.040 −125.9809 −3.021854

Public revenue from environmental pollution % GDP


L1. −1.867622 4.883349 −0.38 0.703 −11.52604 7.790792
L2. 1.10496 4.64851 0.24 0.812 −8.088983 10.2989
L3. 3.738207 4.155333 0.90 0.370 −4.480317 11.95673
L4. −4.761653 2.979511 −1.60 0.112 −10.65461 1.1313
Variable B 153,605.7 32,337.07 4.75 0.000 89,648.63 217,562.8
Public spending on environmental protection % GDP −84.60233 35.26804 −2.40 0.018 −154.3611 −14.84351
Public revenue from environmental pollution % GDP 157,637.7 32,458.69 4.86 0.000 93,435.68 221,839.7
_cons 91.26116 10.42964 8.75 0.000 70.63315 111.8892
lsigma_u 48.042956
sigma_e 5.2822276
rho 0.98805582 (fraction of variance due to
F u_i = 0: F(28 all = 103.14 Prob
134)

L1 - time delays corresponding to 1, meaning by one year; L2 - time delays corresponding to 2, meaning by two years; L3 - time delays corresponding to 3, meaning by
three years; L4 - time delays corresponding to 4, meaning by four years.
Source: Own compilation.

As regards NH3 emissions, the research revealed that public Research has demonstrated that in general, in the area of environ-
spending has proved to be an inefficient tool in reducing them. The mental protection, fiscal instruments do yield results but only after
main source of NH3 emissions is agriculture and until now, public po- several years, which is why decisions should be taken beyond the
licies have failed to observe the expected level of reduction of ammonia. partisan divide, by adopting the principle of their continued im-
Nitrogen management represents an integral means of reducing N plementation after change of power as only then can any results be
losses. Nitrogen management is based on the assumption that de- achieved. These results confirm our hypotheses. Moreover, political
creasing the nitrogen surplus (N surplus) and increasing the nitrogen commitment should be adapted to the wealth of relevant societies as in
use effectiveness (NUE) contribute to lower NH3 emissions. Nitrogen poorer countries the government should accept a greater burden as
management is also meant to identify and prevent any exchange of regards environmental action, making up for the lesser activity of its
pollutants between various N compounds and environmental com- citizens in this respect.
partments. Creating an N input/output balance at an entity is a pre- Overall, low effectiveness of environmental tax revenues might be
condition for integral optimisation of N management. In this case the partially explained by the fact that their level is decreasing overall,
countries' growing engagement by way of public spending does not while the level of emissions for some key pollutants is increasing (e.g.
allow for more effective results, which may come as a great surprise, CO2 or NH3), suggesting that the taxes are not imposed consistently.
but that is what the analyses point to. The possible cause is that the Additionally, pollution taxes represent only a small share of the total
public spending is assigned in response to growing pollution and ad hoc environmental tax revenues and their distribution varies significantly
rather than preventive measures are undertaken in this respect. It may between member states. For example, pollution taxes imposed on
be due to the choice of inefficient forms of support that do not yield the farmers (which is relevant for example for NH3 emissions) were gen-
expected outcomes or maybe one needs to wait for those outcomes erally very low, except for a few member states. It may suggest that the
longer than the 5-year horizon. Public spending as a share of GDP has a “pollution pay principle” is not applied consistently and as a result is
greater impact: in this case, its positive impact on NH3 reduction can be not delivering the expected results.
observed, confirming our hypothesis. The data indicating insufficient effectiveness of national spending
Global CO emissions related to human activities are steadily redu- implementation and the position of the EU authorities, which, ever
cing in European Union countries, but the process is not progressing since the first Environment Action Programme adopted in 1973, have
equally in respective member states. The largest sources of emissions emphasised the international nature of environmental pollution, sug-
for this pollutant are fossil fuel combustion at power plants, car and air gest a need to take action at the international and intercontinental level
transport, and processes related to the manufacture of industrial goods. to protect the environment. Of course some people are sceptical of such
The research conducted for the article showed that public spending proposals, and only swear by the national dimension of such measures
could be an efficient tool for authorities to reduce these emissions, but it's worth providing them with some examples of the recent years,
along with investment in biological projects absorbing CO from the which very strongly suggest that such a direction does not bring results
natural environment. in the long run. It would be useful to mention here one of the global
On the contrary, the effectiveness of tax instruments on reducing CO problems in the environmental protection that is air pollution. Despite
emissions has proven to be low. the noticeable improvement in air quality on a global scale, the efforts
Contrary to the previous case, the level of CO2 pollution continues undertaken by national authorities do not sufficiently protect our
to rise. As the research demonstrates, public spending is an effective health, and the problem of air pollution is especially acute for city
tool in reducing CO2 emissions, but again, taxes failed to have a positive dwellers. Bad air quality is a phenomenon that ignores administrative
impact on mitigating them, confirming our hypothesis. The low effec- borders, as locally generated emissions of air pollutants may sig-
tiveness of CO2 taxes could be partially explained by the fact that this nificantly contribute to a concentration of those pollutants in another
type of tax is still not very common in the EU, as most member states do area and that is why supra-national action is necessary to effectively
not have it. combat that threat. One must also stress the international dimension of

7
M. Postula and K. Radecka-Moroz Environmental Impact Assessment Review 84 (2020) 106435

environmental policies with respect to ensuring competitive balance. corresponding environmental taxes imposed, ultimately influencing the
Only by adopting uniform principles and goals at the global level is it level of environmental pollution.
possible to avoid distortion of competition resulting from the advantage The research result confirmed our hypotheses and revealed that
gained by an economy not subject to environmental protection goals or fiscal authorities need to take into account two main aspects when
fees. The best example in this respect would be the issue of limiting taking decisions affecting the scale and structure of expenditure and
pollutant emissions to the atmosphere. Should there be no harmonised taxes intended to ensure environmental protection. Firstly, the specific
approach in place, major inequalities would arise in the competitive- effect of the temporal dimension, and secondly the type of fiscal in-
ness of economies e.g. higher prices of energy or production. In view of struments to be used, otherwise the effectiveness of those measures risk
the above, only a common approach to the issue, both at the EU and being greatly limited. As part of the policy mix, the possible tax in-
global level, helps prevent respective economies from building their struments include tax reliefs for companies that invest in en-
competitive advantage on higher (not regulated by relevant standards vironmentally-friendly solutions, additional taxation of polluting com-
etc.) emissions of pollutants compared to other countries. Similarly for panies or non-refundable subsidies to support spending on
production, respective entities that are subject to emission reduction environmentally-friendly investment projects, public spending on en-
norms, standards and goals are obliged to incur costs of implementing vironmental protection measures, interest rate subsidies for entities that
cutting-edge solutions and technologies to meet the requirements. carry out environmentally-friendly investment projects or other mea-
Competition of such entities with enterprises that are not subject to sures. The research conducted revealed that it is necessary to create a
those restrictions and requirements would not ensure equal treatment policy mix of environmental measures, adjusting the appropriate tools
and would result in losing the market due to higher operating costs. to the type of environmental challenge, because when it comes to de-
Research has confirmed that “punishing” polluting entities by means of cisions taken in that respect one should always consider the costs and
a tax system has little impact on reducing such harmful activity in fu- benefits translated into the standard of living measured through GDP
ture. per capita. We are dealing with a phenomenon of a time lag between
To emphasise the horizontal dimension of environmental policies fiscal decisions and their consequences for the improvement of in-
and the need to include them in a global context, it is also worth dicators that measure the scale of pollution – with respect to public
mentioning here EU public opinion poll results. According to the latest spending – and quite an interesting phenomenon of taxes having no
survey in 2017 60% of respondents were of the view that environ- impact on decisions taken to limit the scale of environmental pollution
mental decisions need to be taken jointly at the EU level with 36% of in the medium term. The second conclusion proves the limited effec-
those polled being in favour of taking such decisions at a member state tiveness of a “polluter pays principle”, suggesting that this tool is not
level. Though such a result means that most respondents consider it effective or applied rigorously enough and therefore, in the latter case,
appropriate to solve environmental problems at the EU level, a drop in the use of this type of instrument would only make sense if applied
that ratio since 2008 is worth noting. According to a 2008 consistently. The results indicating a positive long-term impact of
Eurobarometer survey, the percentage of those indicating EU as the public spending advocates the necessity of boosting public spending for
suitable level for taking environmental action stood at 74% so in 9 years environmental protection, preferably at supra-national level and in a
it has fallen by 14% (European Commission, 2018). Such a situation coordinated manner. General support from the citizens for undertaking
may stem from both lack of social awareness on measures taken at the this type of efforts at the EU level may facilitate such a direction in
EU level and from new challenges being identified that are perceived by public spending. More research may be required at the national level to
the public as local problems. In the latter case, one can mention urban investigate in detail what the most effective tools are, in terms of their
pollution where the society believes local or national authorities to be impact on the condition of the environment.
the appropriate entity to take action. Nevertheless, as pointed out
earlier, there being no global goals or standards defined also with re- References
spect to problems occurring locally (noise, urban pollution), adequate
outcomes cannot be achieved. This means that it is necessary to take Abid, M., 2017. Does economic, financial and institutional developments matter for en-
measures to promote and increase social awareness of the scope and vironmental quality? A comparative analysis of EU and MEA countries. J. Environ.
Manag. 188, 183–194.
principles of common environmental policy. Adam, A., Delis, M.D., Kammas, P., 2014. Fiscal decentralization and public sector ef-
The above surveys show that, despite a certain decline in support for fectiveness: evidence from OECD Countries. Econ. Gov. 15 (1), 17–49.
taking environmental decisions at the EU level, a great majority of the Boston, J., Martin, J., Pallot, J., Walsh, P., 1996. Public Management: The New Zealand
Model, June 20. https://www.amazon.com/Public-Management-New-Zealand-
Community population consider environmental issues to be important Model/dp/0195583256 [08.08.2019].
(Pereira and Pereira, 2017). At the same time, most respondents believe Boulding, K.E, 1996. The Economics of the Coming Spaceship Earth - Kenneth E.
that the EU should introduce Community-level regulations addressing Boulding. http://www.laceiba.org.mx/wp-content/uploads/2017/08/Boulding-
1996-The-economics-of-the-coming-spaceship-earth.pdf.
environmental protection issues in respective countries. This means
Collignon, S., 2008. The Lisbon strategy, macroeconomic stability and the dilemma of
that the dimension of environmental policy is naturally understood and governance with governments; or why Europe is not becoming the world's most
identified as horizontal. dynamic economy. Int. J. Public Pol. 1/2, 72–99.
Czyżewski, B., Matuszczak, A., Kryszak, Ł., Czyżewski, A., 2019. Effectiveness of the EU
environmental policy in struggling with fine particulate matter (PM 2.5 ): how
6. Conclusions agriculture makes a difference? Sustain. MDPI Open Access J. 11 (18), 1–17.
Davidson, R., 2017. Crisis neoliberalism and regimes of permanent exception. Crit. Sociol.
We wished to examine whether, and if so to what extent, the fiscal 43 (4-5), 615–634.
del Granado, J.A., Martinez-Vazquez, J., McNab, R.M., 2018. Decentralized governance,
measures taken by respective EU countries' authorities influence the expenditure composition, and preferences for public goods. Public Financ. Rev. 46
impact on environmental protection indicators. We assumed that in (3), 359–388.
order to improve the effectiveness of environmental protection mea- Dholakia, H.H., Purohit, P., Rao, S., Garg, A., 2013. Impact of current policies on future
air quality and health outcomes in Delhi, India. Atmos. Environ. 75, 241–248.
sures, a policy mix should be adopted involving tools in both spending Dumciuviene, D., Stundziene, A., Startiene, G., 2015. Relationship between Structural
and revenue. In order to test this hypothesis, we analysed the impact of Funds and Economic Indicators of the European Union, “Engineering Economics”, nr
public spending and environmental taxes on the evolution of the se- 26(5).
Erjavec, E., Volk, T., Rednak, M., Rac, I., Zagorc, B., Moljk, B., Žgajnar, J., 2017.
lected environmental indicators. We also observed the link between the Interactions between European agricultural policy and climate change: a Slovenian
environmental protection measures and the living standard of the po- case study. Clim. Pol. 17, 1014–1030.
pulation (measured with GDP per capita), namely by testing whether Funtowicz, S.O., Ravetz, J.R., 1993. A new scientific methodology for global environ-
mental issues. In: Costanza, R. (Ed.), Ecological Economics -the Science and
the growing national wealth corresponds with an increase of public Management of Sustainability. New York, Columbia University Press.
spending on environmental expenditure, and reflects the level of

8
M. Postula and K. Radecka-Moroz Environmental Impact Assessment Review 84 (2020) 106435

Gholipour, H.F., Farzanegan, M.R., 2018. Institutions and the effectiveness of ex- agriculture using a regional economic-ecosystem model. Agric. Ecosyst. Environ. 123,
penditures on environmental protection: evidence from middle eastern countries. 305–316.
Constit. Polit. Econ. 29, 20–39. Pereira, R.M., Pereira, A.M., 2017. The economic and budgetary impact of climate policy
Gosh, A.R., Chamon, M., Crowe, C., Kim, J.I., Ostry, J.D., 2009. Coping with the Crisis: in Portugal: carbon taxation in a dynamic general equilibrium model with en-
Policy Options for Emerging Market Countries, IMF Staff Position Note, SPN/09/08. dogenous public sector behavior. Environ. Resour. Econ. 67 (2).
https:// www.imf.org/external/pubs/ft/spn/2009/spn0908.pdf [08.08.2019]. Prabhu, R., Colfer, C.J.P., Dudley, R.G., 1999. Guidelines for Developing, Testing and
Halkos, G.E., Paizanos, E.A., 2013. The effect of government expenditure on the en- Selecting Criteria and Indicators for Sustainable Forest Management (Criteria and
vironment: an empirical investigation. Ecol. Econ. 91, 48–56. Indicators Toolbox Series No. 1.). CIFOR, Bogor, Indonesia.
Kolodko, G.W, 2013. Determinants and Long-Term Implications of the Strategy for Rambarran, R., 2015. Crisis without End: Neoliberalism (in:) Globalized Environment
Poland, Gospodarka Narodowa. https://doi.org/10.33119/GN/108606. Modelling the Historic Rise of Neoliberalism and its Systematic Role in Recent
Kuhn, T.S., 1997. The structure of scientific revolutions, 3rd ed. University of Chicago Economic Downturns, Munich Personal Repec Archive, Paper No. 67410. Review and
Press, Chicago, IL. Basic Statistics. vol. 11. pp. 28–40.
López, R., Palacios, A., 2014. Why has Europe become environmentally cleaner? Ravetz, J., 2018. In: König, A. (Ed.), Sustainability Indicators, Quality and Quantity,
Decomposing the roles of fiscal, trade and environmental policies. Environ. Resour. Published in ‘Sustainability Science: Key Issues. Routledge.
Econ. 58, 91–108. Reed, M.S., Fraser, E.D.G., Dougill, A.J., 2006. An adaptive learning process for devel-
McDougall, C., Pandit, B.H., Banjade, M.R., Paudel, K.P., Ojha, H., Maharjan, M., et al., oping and applying sustainability indicators with local communities. Ecol. Econ. 59.
2009. Facilitating Forests of Learning: Enabling an Adaptive Collaborative Approach Rockstrom, et al., 2009. A safe operating space for humanity. Nature 461 (September).
in Community Forestry User Groups. CIFOR, Bogor, Indonesia. Rogoff, K., Reinhart, C., 2009. The Aftermath of Financial Crises. NBER Working Paper,
Mendoza, G.A., Macoun, P., Prabhu, R., Sukadri, D., Purnomo, H., Hartanto, H., 1999. No. 14656. https://doi.org/10.3386/w14656.
Guidelines for Applying Multi-Criteria Analysis to the Assessment of Criteria and Shrithongrung, A., Kriz, K.A., 2014. The impact of subnational fiscal policies on economic
Indicators. Center for International Forestry Research, Jakarta, Indonesia. growth: a dynamic analysis approach. J. Policy Anal. Manag. 33 (4).
Miller, T., Wiek, A., Sarewitz, D., Robinson, J., Olsson, L., Kriebel, D., Loorbach, D., 2014. Sun, R., Ryzin, G.G., 2014. Are performance management practices associated with better
The future of sustainability science: a solutions-oriented research agenda. Sustain. outcomes? empirical evidence from New York public schools. Am. Rev. Public
Sci. 9 (2), 239–246. https://doi.org/10.1007/s11625-013-0224-6. Administr. 44 (3), 324–338.
Morley, B., 2012. Empirical evidence on the effectiveness of environmental taxes. Appl. Wackernagel, M., Onisto, L., Linares, A.C., Falfán, I.S.L., García, J.M., Guerrero, A.I.S.,
Econ. Lett. 19, 1817–1820. Guerrero, M.G.S., 1997. Ecological Footprints of Nations: How Much Nature Do they
Musgrave, R.A., 1985. A brief history of fiscal Doctrine. In: Red, A.J., Auerbach, M. Use? How Much Nature Do they Have? Commissioned by the Earth Council for the
Feldstein (Eds.), Handbook of Public Economics. Elsevier, Amsterdam-New York. Rio + Forum. Distributed by the International Council for Local Environmental
Neufeldt, H., Schäfer, M., 2008. Mitigation strategies for greenhouse gas emissions from Initiatives, Toronto.

You might also like