Professional Documents
Culture Documents
Research article
article info a b s t r a c t
Article history: The individual carbon footprint has become a widely used concept for communicating both the causes of
Received 6 December 2017 climate change and the many opportunities to reduce greenhouse gas emissions. Thanks to standardized
Received in revised form 3 October 2018 greenhouse gas equivalencies and carbon-intensity metrics for everyday activities, many organizations
Accepted 4 December 2018
have created online carbon footprint calculators, often with a great deal of input categories and user
Available online 10 December 2018
customization. This particular study critically examines the state of online carbon footprint calculators
Keywords: that target the individual. A calculator Feature Index was developed using guidance from carbon calculator
Carbon emissions literature and an extensive review of common calculator features and architecture. This index was then
Carbon calculator applied to 31 online carbon footprint calculators, summarized in heat index tables and scores generated
Calculator comparison using radar plot methodology. Overall trends are identified and specific lessons are taken from the cluster
Footprint
of six calculators with highest Feature Index scores. Finally, this review of performance features is paired
Online
with a survey of individuals concerning their interactions with online carbon footprint calculators. Using
this feedback and the performance evaluation indices, recommendations are made for improving carbon
footprint calculator design.
© 2018 Institution of Chemical Engineers. Published by Elsevier B.V. All rights reserved.
https://doi.org/10.1016/j.spc.2018.12.001
2352-5509/© 2018 Institution of Chemical Engineers. Published by Elsevier B.V. All rights reserved.
34 J. Mulrow, K. Machaj, J. Deanes et al. / Sustainable Production and Consumption 18 (2019) 33–40
Table 1
Inventory of online carbon footprint calculators.
Type Name Link (accessed September 27, 2018)
Climate Neutral (United Nations) climateneutralnow.org/Pages/footprintcalculator.aspx
Government
Environmental Protection Agency (EPA) www3.epa.gov/carbon-footprint-calculator/
Carbon Fund carbonfund.org/individuals/
Carbon Offsets to Alleviate Poverty (COTAP) cotap.org/carbon-footprint-calculator/
Center for Climate and Energy Solutions (C2ES) carbonfootprint.c2es.org/
Cleaner and Greener www.cleanerandgreener.org/resources/pollutioncalculator.html
Conservation Fund gozero.conservationfund.org/calc/household
Conservation International www.conservation.org/act/get_involved/carbon_calculator/Pages/default.aspx
Cool Climate Network coolclimate.berkeley.edu/calculator
Non-Profit/Charitable Forest Credits www.forestcredits.org.uk/
Institute of Electrical and Electronics Engineers (IEEE Spectrum) spectrum.ieee.org/static/carbon-calculator-2009
International Student Carbon Footprint Challenge (ISCFC) web.stanford.edu/group/inquiry2insight/cgi-bin/i2sea-r2a/i2s.php?page=fpcalc
Lehigh University www.ei.lehigh.edu/learners/cc/carboncalc.html
My Climate www.myclimate.org/
Shrink Your Foot store.shrinkyourfoot.org/carbon-footprint-calculator
The Nature Conservancy www.nature.org/greenliving/carboncalculator/
World Wide Fund for Nature (WWF) footprint.wwf.org.uk/
CarboTax www.carbotax.org/
Carbon Footprint Ltd. www.carbonfootprint.com/calculator.aspx
Carbon Independent www.carbonindependent.org/
Carbon Solutions Group www.carbonsolutionsgroup.com/carbonfootprintcalc.html
Carbonify www.carbonify.com/carbon-calculator.html
Chuck Wright www.chuck-wright.com/calculators/carbon.html
Climate Care climatecare.org/calculator/
Private
Empowerment Institute www.empowermentinstitute.net/lcd/LCDcalcNet_2012.html
General Electric’s iVillage www.ge.com/ivillage/calculator/
Green Progress www.greenprogress.com/carbon_footprint_calculator.php
Henkel footprintcalculator.henkel.com/en
Michael Bluejay michaelbluejay.com/electricity/carboncalculator.html
Native Energy www.nativeenergy.com/household-carbon-calculator.html
TerraPass www.terrapass.com/carbon-footprint-calculator
contradictions between calculators to differences in assumptions Thus, whether two calculators provide the same carbon emissions
and input parameters. For example, carbon emissions from water measure, given the same inputs, is not a basis for comparison in this
use was considered to varying extents, and some calculators did study. Rather, factors such as the variety of activities (e.g., water
not consider it at all. Kim and Neff (2009) discussed the potential of use, transportation, electricity) considered and whether the calcu-
carbon footprint calculators to contribute to both public awareness lator includes behavior change suggestions is used as a basis in this
and behavior change. In particular, Kim and Neff (2009) empha- study.
sized the need to communicate carbon footprint information in The article continues by formulating the methodology of as-
a way that promotes education and action. Based on previous sessing and comparing carbon footprint calculators. In the next
data and articles, Birnik (2013) created a set of 13 principles for section, the results of the analysis are noted and illustrated through
evaluating carbon footprint calculators. Birnik (2013) used these a Feature Index and radar plots. These sections are then followed
principles to compare levels of detail and calculation methodology, by an interpretation of the results collected in this study.
as well as each calculators’ ability to compare results among users.
Here again, the study highlighted the lack of consistency between 2. Methodology
carbon footprint calculators and called for standardization. The
Birnik principles helped guide the basis of comparison used in this
2.1. Calculator comparison method
study.
In preparing a comparison of carbon footprint calculators, a
A standard set of indices and evaluation categories was used to
general survey was conducted of individuals who had and had
not used a carbon footprint calculator previously. The aims in qualitatively score each calculator’s depth of inputs and engage-
conducting this survey were to: (i) gather general perceptions of ment of users. These criteria were devised using carbon calculator
carbon footprint calculators, their popularity and their utility, and literature review and various test runs of the criteria. The indices
(ii) discover whether users changed their behavior as a result of and evaluation categories are listed in Table 2.
using a calculator. For the index Input Categories, the categories of comparison
This study of personal carbon footprint calculators is motivated were determined by the activity categories most commonly used
by a need to assess the depth (defined as the range of activities in a sub-set of test run calculators. The index Depth of Measure-
assessed) and engagement (defined as user interaction features) ment is concerned with the level of explanation provided to the
of currently available calculators, with an eye to designing better calculator user as well as the amount of input detail the calculator
calculators. In this study, a methodology was developed to assess required of the user. The evaluation categories for this index were
carbon footprint calculators and apply it to 31 online carbon foot- determined by common observations of input detail, found via
print calculators, selected from an intensive web search (Table 1). literature review and user survey. The categories of comparison for
The 31 calculators were chosen based on popularity within three the index Display Quality were determined by the authors based
categories: Government, Non-profit, and private. on observations of the most useful methods for communicating
The analysis and comparison of calculators are focused on their calculator results. Finally, the categories for Takeaway of Informa-
input categories and user engagement rather than on the calcula- tion were based on the need to communicate the meaning of the
tion methodology or assumptions behind each calculator (which calculator results and motivate users to modify aspects of their
has been done effectively by numerous researchers in the past). carbon footprint.
J. Mulrow, K. Machaj, J. Deanes et al. / Sustainable Production and Consumption 18 (2019) 33–40 35
Table 2
Carbon footprint calculator performance evaluation indices and categories.
Index Evaluation categories
Input categories Home Energy
Depth of inputs
Transportation
Air Transportation
Food
Water/Wastewater
Extra Categories
Depth of measurement Multiple Ways of Calculating Home Energy
Green Energy Option Included
Flight Categories Explained
Specifics Asked About Food Emissions
US State Differences Accounted
Display quality Emission Values Shown for Each Category
User engagement
Country and World Averages
Report Display
Final Value Display
Quick Version
Takeaway of information Carbon Footprint Comparisons
Advice for Lowering Emissions
Quantified Carbon Reduction from Following
Advice
Educates on Carbon Emissions
2.2. Assessment of data compare calculator user experiences and preferences with the
state of practice found among the reviewed calculators. The survey
For each of the 31 calculators, this study completed a full foot- also revealed the level of common knowledge of carbon calcula-
print assessment and recorded the details of calculator features in tors, greenhouse gas emissions, and home energy use. The sur-
each of the evaluation categories. Heat index tables were created to vey was conducted under an Internal Review Board (IRB) process
display qualitative and comparative information about each calcu- through the University of Illinois at Chicago. The survey was dis-
lator. Each calculator is given a High, Medium, or Low/None rating
tributed to a general audience through email, academic newslet-
for each category, communicating the extent to which a calculator
ters, and social media, and it garnered 216 participants. Survey
collected input data, communicated information, or engaged the
user. responses were gathered anonymously using Google Forms.
The color coding is as follows: High = green, Medium = yellow, Data was collected on participants’ gaps in greenhouse gas
Low/None = red. For the Home Energy category, a calculator that emissions knowledge and whether carbon calculators were ef-
collects data for at least 6 major types of home energy or included fective in changing the participants’ behavior. Participants were
Renewable Energy as an option received a High rating, 4–5 types also asked how they rank carbon footprint categories based on
received a Medium rating, and 0–3 types received a Low rating. knowledge, curiosity, and impact. In addition, data was collected
For the transportation category, a calculator that collects data for on home energy use and demographics. In total, the participants
at least 5 major modes of transportation received a High rating, were asked 32 questions and spent between 5–10 min taking the
3–4 modes received a Medium rating, and 0–2 modes received a survey.
Low rating. For air transportation, a calculator that collects detailed
data on flight origin/destination or specific airports received a High
Rating, a calculator that includes the type of flight (short, middle, 3. Results
long) or miles flown received a Medium Rating, and no information
on air transportation received a Low rating. In cases where a binary 3.1. Comparing online carbon footprint calculators
evaluation is conducted, only Medium and Low are used as eval-
uation markers. For example, in the Food and Water/Wastewater
categories a ‘‘Yes’’ equates to Medium or yellow or ‘‘No’’ equates The Index of Carbon Footprint Calculators by Input Category (Ta-
to Low or red. For the Extra Categories section, 3–4 categories ble 2) describes each calculator’s inclusion of carbon emission
received a High Rating, 1–2 categories received a Medium Rating, sources and the extent to which each calculator gathered user
and 0 categories received a Low Rating. information for the source category. For each category, the cal-
The calculator comparison process was completed by creating culator is given a rating based on the level of detail gathered
radar plots. These plots can be seen in Fig. 1 and serve as both from the user. All calculators collected at least some information
a quantitative and visual comparison. In the radar plots, the 15 on Home Energy use, and all but one calculator (97%) gathered
most data-rich evaluation categories are assigned to an axis that information on Transportation. Air Transportation was also com-
represents values from 0 (at the axes intersection) to 3 (at the edge monly recorded, factoring into 27 of 31 (87%) calculators. Food and
of the plot). Generally, these values correspond to the category’s Water/Wastewater were the least common categories, included in
rating (0 = None/Not Applicable, 1 = Low, 2 = Medium, 3 = High). 42% and 16% of calculators respectively. The review also identi-
For binary evaluations, 3 is assigned to ‘‘Yes’’ and 0 is assigned to
fied additional categories that appeared in each calculator. Com-
‘‘No’’. Plotting these values on a radar graph and connecting each
mon extra categories included waste and recycling, purchases or
point to its neighbor radially yields an area, which is used to score
consumption activities, health, education, and leisure/recreational
the overall performance of each calculator.
activities. More than half (61%) of calculators included input cat-
2.3. User survey egories beyond the five baseline categories on which the analysis
focused.
In addition to analyzing current carbon calculators, the sur- The full results of the study are provided in Tables A.1–A.3 in
vey ‘‘Your Carbon Footprint Identity’’ was conducted in order to the Supplementary Materials.
36 J. Mulrow, K. Machaj, J. Deanes et al. / Sustainable Production and Consumption 18 (2019) 33–40
Fig. 1. Radar plots for all online calculators. The names of the calculators are shown below the plot and the area for each calculator is shown in the top right corner of each
plot.
3.2. Radar plots were selected as dimensions for the radar plots. These fifteen
categories are: Home Energy, Transportation, Air Transportation,
Radar plots offer a visual synthesis of the data collected for the Food, Extra Categories, Multiple Ways of Calculating Home Energy,
four indices to assess carbon footprint calculators. Fifteen evalua- Flight Categories Explained, Specifics Asked About Food Emissions,
tion categories (of a total of 20 measured) were selected as dimen- State Differences Accounted, Emission Values Shown for Each Cat-
sions for the radar plots. The five categories with the least number egory, Country and World Averages, Report Display, Simple/Quick
of responses (Water/Wastewater, Green Energy Option Included, Version, Advice for Lowering Emissions, and Educates on Carbon
Final Value Display, Carbon Footprint Comparisons, and Quantified Emissions. The categories appear on the radar plots in the order
Carbon Reduction from Following Advice) were removed from the listed, arranged counterclockwise. It is noted that the category
radar plot analysis in order to avoid overweighting the least used ‘‘State Differences Accounted’’ defaulted to a score of zero (0)
categories. The categories that had the most positive responses for three of the calculators that were UK-focused. However, the
J. Mulrow, K. Machaj, J. Deanes et al. / Sustainable Production and Consumption 18 (2019) 33–40 37
Table 3
Index of carbon footprint calculator by input category.
results show that two of these – Carbon Independent and WWF of 18.51 and 17.69 respectively. Other calculators with notable
– were high-scoring despite the handicap. The category served as high performance measures are WWF (15.25), ISCFC (14.44), and
an attribute representing the inclusion of regional detail in the Carbotax (14.64). Generally, high-scoring calculators shared the
calculator design.
following features:
The radar plot scoring method yields an area measure, which
we used to evaluate the calculator’s overall performance. Results
show that the Carbon Independent calculator has the highest area • Allowed users to enter the greatest range of home energy
with 19.32 [no unit], with Carbon Footprint Ltd and Cool Cli- use, transportation, and food consumption data, from highly
mate Network being close second and third calculators with areas detailed to general averages.
38 J. Mulrow, K. Machaj, J. Deanes et al. / Sustainable Production and Consumption 18 (2019) 33–40
Table 3 (continued).
• Provided carbon footprint results in both aggregated and transportation was highly significant in determining one’s total
detailed/segregated forms. carbon footprint. These results suggest that participants know
• Paired carbon footprint results with actionable advice for about and are curious about transportation, and they also rec-
lowing emissions. ognize the significant influence of transportation activities on
their carbon footprint calculation. Thus, current carbon calculators
3.3. Survey results should continue to include the transportation category and take
into account multiple modes, including air transportation.
As seen in Fig. 2, out of all survey participants, a majority (53%) In contrast, survey participants ranked energy from electricity
had used a carbon footprint calculator previously; however, only and natural gas low when asked to estimate the most impactful
8.9% could recall their calculated footprint measure. Additionally, carbon footprint categories. This observation reflects a misunder-
15.9% of the participants indicated that a carbon footprint calcula- standing of the impact of home electricity and gas usage on the
tor was effective in changing their daily energy consumption habits carbon footprint. Although we do not know the reason for this
(Fig. 2). misunderstanding, we can speculate that the general lack of op-
Participants generally conveyed low familiarity with energy tions in electricity and gas providers (often under monopoly) and
use at home and how this translates to emissions factors or daily the fact that power plants are often ‘‘out of sight’’ is a disincentive
activities. Approximately 75% of participants reported knowing to learning about their impacts—unlike transportation since many
Little, Very little, or Nothing at all about their home energy use. people have the option to walk/bike, ride transit, or use a private
When asked how 1 kg of CO2 or 1 kWh of energy translates to daily vehicle, and their impact are felt directly.
activity, 8.8% and 16.2% of participants (respectively) indicated We note, however, that most carbon calculators score high for
that they could equate these measures to a corresponding level of the level of information detail gathered under the Home Energy
activity. category. Future calculators may concentrate on better describing
Despite general unfamiliarity with consumption data, partici- the role of electricity and gas on one’s carbon footprint specif-
pants demonstrated that they could easily access this data from ically, and factoring in variations in regional grid energy mixes.
their bills. A majority of participants indicated that they could Additionally, calculator evaluations show that many calculators
access gas (75.5% Yes), electricity (91.7% Yes) and water use (53.8% gather information on home energy use but fail to explain the links
Yes) information from utility bills they receive at home. Finally, between daily activity, energy use, and emissions. Based on survey
when survey participants were asked about how much they know respondent’s answers regarding prior knowledge of energy use
about their home’s energy use, 53.7% stated they know ‘‘a little’’, levels, an improved calculator would simultaneously ask detailed
while 21.8% stated they know ‘‘a lot’’ (Fig. 3). questions about home energy use and explain how impactful home
energy use is on the carbon footprint.
4. Analysis and discussion The calculator evaluation tables and radar plot scores provide a
guide to important features of carbon footprint calculators. Within
This study highlighted calculator users’ understanding of and each index we identified those evaluation categories that had the
engagement with carbon calculators. Survey participants gener- most ‘‘High’’ ratings. These categories represent calculator features
ally ranked transportation above other calculator input categories that have the most depth and detail across all calculators surveyed.
when asked which categories they were both knowledgeable and Within Depth of Measurement (Table A.1) the three top categories
curious about. Survey participants also generally estimated that were: Flight Categories Explained, Specifics Asked About Food
J. Mulrow, K. Machaj, J. Deanes et al. / Sustainable Production and Consumption 18 (2019) 33–40 39
Table 4
Birnik (2013) results comparison.
Calculator Birnik rating Radar plot equivalent
Carbon fund Average 6.91 (Weak)
Terra pass Weak 12.81 (Average)
EPA Weak 6.51 (Weak)
Nature conservancy Average 12.00 (Average)
Conservation international Average 11.19 (Average)
category calculated. The areas that need the most detail and in- References
formation are home energy, transportation, explanations for flight
categories, food emissions, how they account for state differences, Ahmad, N., Derrible, T., Eason, S., Cabezas, H., 2016. Using Fisher information to track
stability in multivariate systems. Open Sci. 3 (11), 160582.
and how they educate and advise on lowering emissions. Through
Baker, Lawrence A., Hartzheim, Paul M., Hobbie, Sarah E., King, Jennifer Y., Nel-
these findings and the development of the radar plots, the best son, Kristen C., 2007. Effect of consumption choices on fluxes of carbon, nitrogen
examples of carbon calculators studied are Carbon Footprint Ltd., and phosphorus through households. Urban Ecosyst. 10 (2), 97–117. http://dx.
Carbon Independent, and Cool Climate Network. doi.org/10.1007/s11252-006-0014-3.
This reinforces the importance of merging detail-oriented cal- Birnik, Andreas, 2013. An evidence-based assessment of online carbon calculators.
Int. J. Greenhouse Gas Control 17 (September), 280–293. http://dx.doi.org/10.
culator features with user-friendly calculator features, yielding 1016/j.ijggc.2013.05.013.
carbon footprint calculators that are both more accurate and en- Chatterton, T.J., Coulter, A., Musselwhite, C., Lyons, G., Clegg, S., 2009. Understanding
gaging, leading to higher use and better retention of knowledge how transport choices are affected by the environment and health: views
among users. There is also an opportunity to improve the gath- expressed in a study on the use of carbon calculators. Public Health 123 (1),
e45–49. http://dx.doi.org/10.1016/j.puhe.2008.10.022.
ering and interpretation of carbon footprint information using
Čuček, Lidija, Klemeš, Jiří Jaromír, Kravanja, Zdravko, 2012. A review of footprint
data science and machine-learning techniques (Derrible and Ah- analysis tools for monitoring impacts on sustainability. J. Cleaner Prod. 34
mad, 2015; Ahmad et al., 2016; Derrible, 2016a). Given that many (October), 9–20. http://dx.doi.org/10.1016/j.jclepro.2012.02.036.
calculators gathered address or zip-code information, there is a Derrible, S., 2016a. Complexity in future cities: the rise of networked infrastructure.
significant opportunity in aggregating regional carbon footprint Int. J. Urban Sci. 0 (0), 1–19.
Derrible, S., 2016b. Urban infrastructure is not a tree: Integrating and decentralizing
data to derive locally-tailored emissions reduction and infrastruc- urban infrastructure systems. Environ. Plan. B: Plann. Des. 0265813516647063.
ture decisions (Derrible, 2016b). Finally, there is much work to be Derrible, S., Ahmad, N., 2015. Network-based and binless frequency analyses. PLoS
done in improving carbon footprint calculators’ approach to user One 10 (11), e0142108.
interaction and behavior change, perhaps by better integrating Kenny, T., Gray, N.F., 2009. Comparative performance of six carbon footprint models
for use in Ireland. Environ. Impact Assess. Rev. 29 (1), 1–6. http://dx.doi.org/10.
with mobile phone/sensor technologies. In this context, calculators
1016/j.eiar.2008.06.001.
could easily move beyond simply calculating carbon emissions, Kim, Brent, Neff, Roni, 2009. Measurement and communication of greenhouse gas
combining measurement of economic, social and environmental emissions from U.S. Food consumption via carbon calculators. Ecol. Econ. 69 (1),
metrics. 186–196. http://dx.doi.org/10.1016/j.ecolecon.2009.08.017.
Mulrow, John S., Derrible, Sybil, Ashton, Weslynne S., Chopra, Shauhrat S., 2017.
Industrial Symbiosis at the Facility Scale: Facility-Scale Industrial Symbiosis. J.
Acknowledgments Ind. Ecol. 21 (3), 559–571. http://dx.doi.org/10.1111/jiec.12592.
Padgett, J. Paul, Steinemann, Anne C., Clarke, James H., Vandenbergh, Michael P.,
This work was supported by the National Science Foundation 2008. A comparison of carbon calculators. Environ. Impact Assess. Rev. 28 (2–3),
Graduate Research Fellowship Program, United States under Grant 106–115. http://dx.doi.org/10.1016/j.eiar.2007.08.001.
Rees, William E., 1992. Ecological footprints and appropriated carrying capacity:
No. 1444315. Any opinions, findings, and conclusions or recom-
What urban economics leaves out. Environ. Urbanization 4 (2), 121–130. http:
mendations expressed in this material are those of the author(s) //dx.doi.org/10.1177/095624789200400212.
and do not necessarily reflect the views of the National Science Wiedmann, Thomas, Minx, Jan, 2008. A definition of ‘carbon footprint. Ecol. Econ.
Foundation. Moreover, this research was supported in part by the Res. Trends 1, 1–11.
NSF CAREER award, United States 1551731.