You are on page 1of 10

Journal of Cleaner Production 275 (2020) 122888

Contents lists available at ScienceDirect

Journal of Cleaner Production


journal homepage: www.elsevier.com/locate/jclepro

Comparative life cycle assessment of aquaponics and hydroponics in


the Midwestern United States
Peng Chen a, 1, Gaotian Zhu b, 1, Hye-Ji Kim b, Paul B. Brown a, Jen-Yi Huang c, d, *
a
Department of Forestry and Natural Resources, Purdue University, West Lafayette, IN, United States
b
Department of Horticulture and Landscape Architecture, Purdue University, West Lafayette, IN, United States
c
Department of Food Science, Purdue University, West Lafayette, IN, United States
d
Environmental and Ecological Engineering, Purdue University, West Lafayette, IN, United States

a r t i c l e i n f o a b s t r a c t

Article history: With high productivity and low land and water use, controlled-environment agriculture (CEA) like
Received 9 February 2020 aquaponics and hydroponics has become a promising solution to feed the rapidly growing global pop-
Received in revised form ulation. However, both aquaponic and hydroponic systems require high energy input, leading to po-
29 May 2020
tential environmental burdens. This cradle-to-gate life cycle assessment (LCA), for the first time,
Accepted 13 June 2020
Available online 12 July 2020
compared the environmental performance, on an economic basis, of aquaponics and hydroponics with
identical system design in Indiana, US. For a one-month cultivation period, tilapia and six vegetables
Handling Editor: Zhifu Mi produced in the aquaponic system had almost twice the total value of the vegetables from the hydro-
ponic system. Aquaponics produced 45% lower endpoint environmental impact than hydroponics.
Keywords: Electricity use for greenhouse heating and lighting, and water pumping and heating contributed to the
Aquaponics majority of the environmental impacts of both systems, which was followed by the production of fish
Hydroponics feed and fertilizers. However, changing the energy source from coal to wind power could make the
Life cycle assessment hydroponic system more environment-friendly than the aquaponic system. This LCA study can provide
Economic functional unit
CEA farmers with the groundwork to reduce the environmental cost of their production.
Controlled-environment agriculture
© 2020 Elsevier Ltd. All rights reserved.
Sustainable aquaculture

1. Introduction times less water use, compared to lettuce grown in OFA (Barbosa
et al., 2015). More than 748 million dollars of vegetables and
World population is expected to be 9.7 billion by 2050 with fresh-cut herbs were produced by this surging technology in the US
more than two-thirds of the people living in urban areas, and the in 2017, representing an 18% increase over 2012 (Perdue and Hamer,
projected food demand of 70e100% over the current food pro- 2019). Given its great potential for high productivity, and water and
duction levels (FAO, 2011; NSF, 2015). However, open-field agri- nutrient use efficiency along with reduced environmental footprint
culture (OFA) is not an adequate approach to meet the near-term (Yang and Kim, 2020a), CEA could be a promising solution to feed
demand because of its considerable water and land uses and the rapidly growing global population.
associated environmental impacts (Gleick, 2010; NSF, 2015). In Hydroponics is a technology for growing plants using nutrient
contrast, controlled-environment agriculture (CEA) produces food solutions without soil. Compared to OFA, hydroponics needs less
in an enclosed structure under optimized conditions for the water and chemical fertilizer inputs as the spent nutrient solution
maximum yield of plant crops and/or aquatic animals using soilless can be recirculated for an extended period. Aquaponics in-
systems such as hydroponics, aquaponics, and recirculating aqua- corporates RAS into hydroponics to produce plants and aquatic
culture system (RAS) (Go mez et al., 2019). Hydroponic lettuce species in a system linked by water and nutrients, in which fish feed
culture offered an 11-time higher yield per acre of land with 13 is the major nutrient input in the system to provide fish with
protein-rich diet and essential nutrients (Yang and Kim, 2020b). In
aquaponics, rather than being discharged and causing eutrophica-
tion and hypoxia in nearby water bodies, nutrient-rich wastewater
* Corresponding author. 745 Agriculture Mall Drive, West Lafayette, IN, 47907,
derived from RAS, containing ammonia and feces excreted by fish,
USA.
E-mail address: huang874@purdue.edu (J.-Y. Huang). is directed to the hydroponic component, allowing nutrients to be
1
Contributed equally to this work. recycled for plant growth. Therefore, it is possible to achieve zero or

https://doi.org/10.1016/j.jclepro.2020.122888
0959-6526/© 2020 Elsevier Ltd. All rights reserved.
2 P. Chen et al. / Journal of Cleaner Production 275 (2020) 122888

reduced wastewater discharge through aquaponic production sys- Ca(OH)2). For plants to grow with the optimum nutrient environ-
tems (Yang and Kim, 2020a). Additionally, aquaponics can elimi- ment, the electrical conductivity (EC) of the hydroponic system was
nate fertilizer use, and thus the environmental burdens caused by kept at 1.5 dS/m over the experimental periods using the HydroGro
the production of chemical fertilizers, especially nitrogen fertil- hydroponic fertilizer (CropKing, Lodi, OH, USA) and calcium nitrate
izers, such as fossil fuel depletion, global warming, and acidification (CropKing, Lodi, OH, USA).
(Torrellas et al., 2012). However, both aquaponics and hydroponics
require high electricity input for heating, lighting, and water 2.2. Fish and plant cultivations
pumping which are essential for environment control (Yildizhan
and Taki, 2018), potentially leading to high global warming The fish tank was stocked with 6.4 kg (stocking density: 18.3 kg/
impact. Although there have been comparative studies between m3) Nile tilapia (Oreochromis niloticus), which was fed a commercial
aquaponic and hydroponic systems on crop production (Delaide fish feed (AquaMax® Sport Fish 500, Purina® Mills, Gray Summit,
et al., 2016; Pantanella et al., 2012; Suhl et al., 2016; Yang and MO, USA) at 64 g/day. Six plant species were grown in the plant
Kim, 2019), their environmental performance was rarely growth bed, including Swiss chard (Beta vulgaris L.), kale (Brassica
compared in a systematic way. oleracea L.), mustard green (Brassica juncea L.), cilantro (Coriandrum
Life Cycle Assessment (LCA) has been widely used for evaluating sativum L.), lettuce (Lactuca sativa L.), and arugula (Eruca vesicaria
the resource use and emissions of agricultural and aquacultural L.). The seeds were obtained from a commercial source (Johnny’s
production (Mattsson et al., 2000; Roy et al., 2009; Skowron ~ ska and Selected Seeds, Winslow, ME, USA) and sown in seedling trays (Jiffy,
Filipek, 2014; Sun, 2009). LCA is considered the most holistic Lorain, OH, USA). After the third true leaf of seedlings emerged,
approach to develop a more sustainable CEA system since the uniform healthy seedlings were randomly chosen and transplanted
method quantifies both direct and indirect environmental impacts. into mesh pots (diameter: 7.6 cm, height: 6.4 cm) each containing
Maucieri et al. (2018) evaluated a micro aquaponic system through 85 g of clay pebbles, then transferred to each system. The photo-
LCA and found all the processes involved in auqaponics operation period was 14 h (8:00 a.m. to 10:00 p.m.) consisting of natural
including material and electricity inputs contributed more than daylight with supplemental lighting using high-pressure sodium
84% of the total environmental impacts, and system building (HPS) lamps (1000 W, PARsource GROW LIGHT, Petaluma, CA, USA).
accounted for 9e15%. While the infrastructure of aquaponics affects The day (8:00 a.m. to 10:00 p.m.) and night (10:00 a.m. to 8:00
the amount of input required (i.e., fertilizer, energy, etc.) and pro- a.m.) temperatures were set at 24 and 18  C, respectively.
ductivity, the economic viability of an aquaponic system is mainly Depending on the ambient temperature, the greenhouse was
determined by the variety and value of its resulting products. Most heated using radiant hot-water-pipe heating when needed.
of the previous LCA studies on aquaponics were conducted on Furthermore, retractable shade curtains regulated by an environ-
lettuce considering it as the main product and fish as co-product mental control system (Maximizer Precision 10, Priva Computers
(Cohen et al., 2018; Forchino et al., 2017). This may result in an Inc., Vineland Station, ON, Canada) were used to modulate the
underestimation of the environmental impacts of fish, especially greenhouse temperature.
when they are allocated based on product mass.
In this study, the environmental performance of hydroponic and 2.3. Water quality
aquaponic systems was, for the first time, explicitly compared using
an identical infrastructure. We performed a cradle-to-gate LCA on To ensure that fish and plants grew under a healthy environ-
these two independent systems mainly based on our primary ment, water quality of the fish tank (or nutrient reservoir in hy-
experimental data collected over a one-month period. Both sys- droponic system) and hydroponic-culture unit (DO, temperature,
tems produced six plant species in addition to tilapia in aquaponics. pH, and EC, as shown in Table S1) were measured daily at 9:00 a.m.
This LCA study aimed to provide farmers with the groundwork to before feeding using the HQ40d Portable Water Quality Lab Pack-
design and operate CEA production at reduced environmental cost. age (HACH Corp., Loveland, CO, USA).

2. Materials and methods 2.4. Plant and fish yields

2.1. Aquaponic and hydroponic systems At harvest, the shoot parts were carefully removed from the
roots, and the fresh weight of the shoot was determined immedi-
Aquaponic and hydroponic systems with an identical design ately using an analytical balance. Total fish weight was measured at
were constructed in a greenhouse at Purdue University in West the beginning and at the end of the experiment by carefully col-
Lafayette, IN, USA. As shown in Fig. S1, each system consisted of a lecting an individual fish from the fish tank and transferring it into a
tank (350 L; containing fish for aquaponics, or nutrient solution for bucket filled with water. The difference between initial and final
hydroponics), a solids removal unit (20 L), two-stage biofilter tanks total weight was used to determine the fish weight increment over
(40 L), and a plant growth bed (350 L; 1 m2) (Wongkiew et al., 2017; a one-month cultivation. Feed conversion ratio (FCR) was calcu-
Yang and Kim, 2019). Plants were held by a foam raft which was set lated by the ratio of total feeding amount (g) to fish biomass
on the top edges of the plant growth bed. The plant holders allowed increment (g).
a growing density of 24 plants. The two systems shared a 75 W
peristaltic pump (Masterflex, Cole-Parmer, Vernon Hills, IL, USA). 2.5. Goal and scope of LCA
The total water volume in each aquaponic/hydroponic unit was
700 L, which was circulated at a flow rate of 125 L/h, giving a water The main goal of this cradle-to-gate study was to identify the
retention time of 5.6 h in the fish/nutrient solution tank and in the environmental impact hotspots of the aquaponic and hydroponic
floating system unit (Yang and Kim, 2020c). Each growth bed in the systems, thus more sustainable practices can be recommended to
hydroponic or fish tank in the aquaponic system had air stones CEA producers. The intended audience of this work included
connected to a 43.8 W air pump to maintain dissolved oxygen (DO) aquaponic and hydroponic farmers who want to improve the
concentration above 6 mg/L, and a 250 W heater to maintain the environmental performance of their production.
water temperature at 23  C. The pH of both systems were kept at 6 It is important to note that the products of aquaponics and hy-
using a combination of base solutions (1 N KOH and 0.05 N droponics are different. In addition to plants, aquaponics produces
P. Chen et al. / Journal of Cleaner Production 275 (2020) 122888 3

feed used in this study is a commercial product (Purina® Aqua-


Max® Sport Fish 500) and its precise composition is not disclosed,
we referred to the composition of another commercial trout feed
used by Avadí et al. (2015) for the inventory, which had highly
similar ingredients and nutrient contents (i.e., approximately 42%
protein, 12% lipid, 1% phosphorus, and 11% water). Furthermore, the
emissions from each system, including NOx through air and NH3,
NO3 , and PO34 through wastewater were considered.
The environmental profiles of both systems were analyzed
based on the monetary functional unit, i.e., the economic values of
their products. The unit prices (per kg) of fish and vegetables were
collected from the Aquatic Research Lab at Purdue University and
the USDA database (USDA, 2019), respectively, in April 2019. Table 1
also shows the total economic value of the products from a system
estimated by multiplying the unit price of each product by its yield
during the experimental period.

2.7. Impact assessment

The environmental performance of the developed aquaponic


and hydroponic systems was determined and compared based on
their midpoint impacts (CML-IA baseline method v3.05) and
endpoint impacts (Eco-indicator 99 (H) v2.10). Eleven midpoint
Fig. 1. Process flow diagram of (a) aquaponic and (b) hydroponic production. Dashed
box refers to the system boundary, T refers to transportation. environmental impacts were characterized here, including fossil
fuel abiotic resource depletion (AD, kg Sb eq), global warming po-
tential (GWP, for 100-year time horizon, kg CO2 eq), acidification
fish which generally has a higher market price. Therefore, instead of potential (AP, kg SO2 eq), eutrophication potential (EP, kg PO34 eq),
physical functional unit (FU), e.g., mass and volume, which is non-fossil fuel abiotic depletion (AD non-fossil fuels, kg Sb eq),
commonly used in LCA studies, we considered the difference in ozone layer depletion (ODP, kg CFC-11 eq), human toxicity (HTP, kg
product price by applying a monetary FU here for an economic- 1,4-DB eq), freshwater aquatic ecotoxicity (FAE, kg 1,4-DB eq),
based comparison, which was defined as 1 US dollar (market marine aquatic ecotoxicity (MAE, kg 1,4-DB eq), terrestrial ecotox-
price) of the products produced by each system. icity (TE, kg 1,4-DB eq), photochemical oxidation (PO, kg C2H4 eq).
Fig. 1 shows the system boundaries of this work, which were The endpoint impacts, in terms of damages to human health,
similar to previous aquaponic studies (Boxman et al., 2017; ecosystem quality, and resources, were characterized and aggre-
Forchino et al., 2017; Maucieri et al., 2018). Both production sys- gated into a single score. All the data were analyzed using SimaPro
tems were analyzed from cradle to farm gate, mainly including the v8.3 software.
production of fertilizers, chemicals and fish feed, feed milling, and
farming operation. Fish hatchery was not considered here due to its 3. Results and discussion
small impact on intensive aquaculture system (Ayer and Tyedmers,
2009; Pelletier et al., 2009). After milling at Land O’Lakes Purina® 3.1. Inventory analysis
Feed (Frankfort, IN, USA), fish feed was transported for 38.62 km to
the retail outlet (Lafayette, IN, USA), then to the experimental site The total yields of vegetables in the aquaponic and hydroponic
(2.74 km). Chemicals and fertilizers were transported from Lafay- systems were similar (4128 vs. 3872 g/1.5 m2/month), with eco-
ette, IN (0.48 km) and Lodi, OH (479.58 km), respectively. As shown nomic values of $16.21 and $15.37, respectively (Table 1). The yields
in Table S2, the material inputs for constructing the aquaponic and of these two experimental systems were found to be comparable to
hydroponic systems were either measured onsite or estimated, those of commercial aquaponics (Bailey and Ferrarezi, 2017)
including polyvinylchloride (PVC) pipes, high density polyethylene growing lettuce, kale, collards, Swiss chard, and basil (4840 g/
(HDPE)-made fish tank, plant grow bed, solids removal unit, and 1.5 m2/month), and commercial hydroponics (Barbosa et al., 2015)
biofilter tanks, polystyrene (PS) foam raft, and pumps. Furthermore, for lettuce (5125 g/1.5 m2/month). The fertilizer use efficiency
postharvest handling activities and transportation were not (fertilizer use per unit of product, kg/kg) of hydroponics in this case
included within the boundaries. study (N: 0.0022, P: 0.0018, K: 0.0067) was similar to that of a
vertical hydroponic croft in Lyon, France (N: 0.0026, P: 0.0013, K:
0.0036) (Romeo et al., 2018). The tilapia had a comparable FCR of 1.2
2.6. Life cycle inventory to the fish raised in RAS (Avadí et al., 2015; Davidson et al., 2011)
and aquaponics (Li et al., 2019), indicating that the fish were in a
Table 1 lists the life cycle inventory data on all the stages in the healthy and fast-growing state in our study. Daily weight gain of
system boundaries of the production of 1-US dollar vegetables/fish. tilapia is typically slow during the first 85 days (0.5 g/day) but in-
Unless specified otherwise, all data were primary, collected from creases up to 3 g/day during the grow-out stage from day 86 to day
the experiment conducted between February 25 and March 25, 180 (Teichert-Coddington, 1996). Since the growth rate of tilapia
2019. Due to the period of cold weather, the greenhouse air was reported in this study (0.99 g/day) was collected from a one-month
heated, and the associated electricity consumed by the aquaponic period, it is important to note that the average daily weight gain
and hydroponic units was allocated using the area occupied by each over the full 180-day growth cycle of tilapia and thus the value of
unit (3.62 m2) in the greenhouse. The electricity for heating, with fish in the aquaponics could be underestimated if they are pro-
coal being the main energy source in Indiana, US, was modeled and jected accordingly.
estimated via Virtual Grower software v3.1 (USDA). Since the fish Because of the higher total product value, the aquaponic system
4 P. Chen et al. / Journal of Cleaner Production 275 (2020) 122888

Table 1
Life cycle inventory of aquaponic and hydroponic systems for a 1-month operation.

Items Aquaponics Hydroponics Database

Inputsa Total Per FU Total Per FU

Water (L) 100 3.5 60 3.9


Electricity (kWh, IN, US) (Virtual Grower v3.1) US-EI 2.2
Greenhouse heating 222 7.76 222 14.44
Lighting 210 7.34 210 13.66
Water heater 39 1.36 39 2.53
Water pump 27 0.94 27 1.76
Air pump 21 0.73 21 1.36
Transportation of feed, chemicals and fertilizers (tkm) 0.08 0.0028 0.036 0.0023 US LCI
Fish feed (g) 1920 67.13
Ingredients (place of origin)c (Avadí et al., 2015) Agri-footprint (mass allocation)
Fish meal (PE) 384 13.43
Meat meal (poultry, NL) 288 10.07
Blood meal (poultry, NL) 96 3.36
Soybean meal (BR) 384 13.43
Fish oil (PE) 115.2 4.03
Soy oil (BR) 19.2 0.67
Palm oil (MY) 19.2 0.67
Maize (AR) 96 3.36
Maize gluten meal (US) 96 3.36
Rice (broken, CN) 192 6.71
Wheat (AR) 192 6.71
Electricity (kWh, IN, US) (Henriksson et al., 2017) 0.118 0.004 US-EI 2.2
Diesel (Henriksson et al., 2017) 0.047 0.002 US-EI 2.2
Fertilizer (HydroGro) (g) 75.2 4.89 US-EI 2.2
Total N 3.23 0.21
P2O5 6.99 0.46
K2O 26 1.71
MgSO4 2.93 0.19
Chemicals (g) US-EI 2.2
Ca(NO3)2 60 3.92
Ca(OH)2 1.63 0.057 0.19 0.012
KOH 58 2.03 6.71 0.46
Construction (adjusted for lifetime) Ecoinvent 3 APOS
HDPE, granulate (kg)
Fish tank 0.0608 0.0021 0.0608 0.0040
Biofilter tank 0.0068 0.0002 0.0068 0.0004
Settling tank 0.0034 0.0001 0.0034 0.0002
Plant grow bed 0.0881 0.0031 0.0881 0.0057
PS foam raft board (kg) 0.0075 0.0003 0.0075 0.0005
PVC pipe (kg) 0.0040 0.0001 0.0040 0.0003
40W pump (piece) 0.0155 0.0005 0.0155 0.0010

Emissions (g)a Total Per FU Total Per FU

NOx 9.09 0.32 1.39 0.09


NH3 0.08 0.00 0.00 0.00
NO3 25.49 0.89 1.20 0.08
PO34 28.21 0.99 10.02 0.65

Outputsa Weight (g) Economic value (USD)b Weight (g) Economic value (USD)b

Tilapia (weight gain in one month) 1606 12.39 0 0


Swiss chard 905 2.63 1077 3.14
Kale 816 1.78 633 1.38
Arugula 568 6.14 496 5.36
Cilantro 185 1.20 221 1.45
Boston lettuce 765 2.52 802 2.64
Mustard green 889 1.94 643 1.40
Total 5734 28.60 3872 15.37
a
Data on item without reference cited is measured onsite.
b
Based on the market price in April 2019.
c
Origin of fish feed ingredient: AR, Argentina; BR, Brazil; CN, China; MY, Malaysia; NL, the Netherlands; PE, Peru; US, United States.

used less water per FU (i.e., 1 US dollar-worth products) than hy- Commercial fertilizers and Ca(NO3)2 were used only for the hy-
droponics although it had a 1.67-fold higher total water con- droponic system to ensure the required nutrient concentration for
sumption. Greenhouse heating and lighting for plant growth were plant growth. However, an almost 9 times higher volume of KOH/
the most electricity-consuming components in this study, ac- Ca(OH)2 was needed for the aquaponics to maintain the pH of water
counting for 43% and 40% of total usage, while energy for fish feed because pH decreases rapidly in aquaponics compared to hydro-
production only contributed negligibly. The two systems also ponics due to nitrification and CO2 excretion by fish (Yang and Kim,
exhibited different profiles of the nutrients/chemicals added. 2019). To resemble a realistic production, where wastewaters are
P. Chen et al. / Journal of Cleaner Production 275 (2020) 122888 5

Fig. 2. Comparison between the midpoint environmental impacts of aquaponics and


hydroponics (in log scale). AD: fossil fuel abiotic depletion, GWP: global warming
potential, AP: acidification potential, EP: eutrophication potential. Fig. 3. Comparison between the endpoint environmental impacts (single score) of
aquaponics and hydroponics.

discharged and replaced by freshwater, the emissions of nitrogen


and phosphorus pollutants were included in the assessment. The The environmental profile of the aquaponic system (Fig. 4a)
emissions of NOx, NO3 , and PO34 from the aquaponics system were showed that electricity use was the dominant contributor to all the
almost 7-, 21-, and 3-folds, respectively, higher than those from the impact categories: AD (99.5%), GWP (98.8%), AP (99.0%), and EP
hydroponic system (Table 1), probably due to high fish feed input, (90.8%). Energy consumption has been identified as a major chal-
active denitrification, and high fish-to-plant ratio. Up to 20% of lenge for the sustainability of aquaponics regardless of facility scale
wastewater is discharged even in recirculating aquaponic systems (Forchino et al., 2017; Maucieri et al., 2018; Rakocy, 2007). Boxman
to maintain water quality (Delaide et al., 2017; Jaeger et al., 2019). et al. (2017) conducted an LCA study on a commercial-scale aqua-
Thus, developing a zero-discharge aquaponic system with more ponic system and found that electricity use contributed the greatest
efficient uses of nitrogen and phosphorus is essential. to GWP (74%), AP (93%), and EP (465%). Similar findings were re-
ported by Maucieri et al. (2018) that electricity use was the main
3.2. Midpoint impacts of aquaponics and hydroponics source of environmental burden of a micro-educational aquaponic
system. Despite the high electricity usage in each system, aqua-
3.2.1. Comparison between aquaponics and hydroponics ponics was considered more environment-friendly than hydro-
Since CEA operation is generally recognized for high energy ponics because it produced the food with a greater value. Fish feed
demand, here we present the four midpoint impacts which are production was the second major contributor (Fig. 4a) to the AD
related most closely to fossil energy use: AD, GWP, AP, and EP (0.5%), GWP (1.2%), and AP (0.9%), while emissions from aquaponics
(Maucieri et al., 2018). The results of the other seven impact cate- operation accounted for the second-highest EP (7.8%). These results
gories are reported in the Supplementary Material (Fig. S2). The indicated that the impacts associated with nutrient solution
environmental impacts of the hydroponic system (AD: 393.82 MJ; discharge should not be neglected in LCA studies on aquaponics.
GWP: 38.22 kg CO2 eq; AP: 0.24 kg SO2 eq; EP: 0.07 kg PO34 eq) Electricity use contributed even more significantly (>99.9%) to
were generally almost twice as high as the impacts generated by all the environmental impacts of the hydroponic system (Fig. 4b),
the aquaponic system (AD: 212.56 MJ; GWP: 20.77 kg CO2 eq; AP: greenhouse heating was responsible for more than 42.7%, followed
0.13 kg SO2 eq; EP: 0.04 kg PO34 eq), as shown in Fig. 2. With the by greenhouse lighting (40.4%) then water pump and heater op-
identical configuration and energy consumption, the higher envi- erations (16.7%). The high contribution of electricity use to the
ronmental impacts associated with the hydroponic systems can be environmental impacts of both aquaponics and hydroponics can be
mainly attributed to the lower total value of its products, which was attributed to the energy source, which consists of 88% of coal in
only half of that of the aquaponics (Table 1), resulting in a larger Indiana, US. Coal-fired power plants are known to produce
amount of products needed to fulfill the FU. Fig. 3 shows the single- numerous pollutants, including sulfur dioxide (SO2), nitrogen ox-
score results of the endpoint impacts of the two systems. The hy- ides (NOx), particulate matter (PM), and heavy metals. It is also
droponics caused 2 damage points, which was approximately 1.8 responsible for one-third of the CO2 emissions in the US, making
times higher than that produced by the aquaponics. The results coal-powered electricity a significant contributor to global warm-
indicated that the integration of fish cultivation into a CEA system ing (Freese, 2008).
can increase production value, and consequently improve its It is important to note that both the aquaponic and hydroponic
environmental performance on an economic basis. systems used in this study are rigid and considered as long-term
6 P. Chen et al. / Journal of Cleaner Production 275 (2020) 122888

Fig. 4. Environmental profiles of (a) aquaponic and (b) hydroponic systems. AD: fossil fuel abiotic depletion, GWP: global warming potential, AP: acidification potential, EP:
eutrophication potential.

infrastructures with lifetimes of at least 7 (polystyrene foam raft


and pumps) to 20 (PVC pipes and HDPE-made components) years
(Ghamkhar et al., 2020). Because our experiment was conducted
over a short period (i.e., 1 month), the environmental impacts
associated with the material uses for system construction were
negligible (less than 0.12% for all the four categories, as shown in
Table S3) and are not reported in Fig. 4.

3.2.2. Environmental impacts of fish feed and fertilizers


Although the environmental impacts contributed by fish feed
(aquaponics) and fertilizers (hydroponics) were less than 2% for all
the four categories in this study, their effects will become important
if CEAs are powered by renewable energy or located in tropical and
subtropical regions. Boxman et al. (2017) found that fish feed used
for a commercial aquaponic system without supplemental lighting
and heating was the second-highest contributor to the environ-
mental impacts (GWP: 32%; AP: 18%; EP: 1217%).
The environmental impacts of fish feed were higher than those
of fertilizers (i.e., HydroGro and Ca(NO3)2) by 4, 11, 16, and 31 times
for AD, GWP, AP, and EP, respectively, as shown in Fig. 5. Feed
production accounts for a large portion of the environmental im-
pacts generated by aquaculture systems (Henriksson et al., 2012).
For example, fish feed was responsible for 73% and 32% of the total
GWP of trout flow-through system and turbot recirculating system,
respectively (Aubin et al., 2009). Moreover, the environmental
performance of fish feed is strongly influenced by its ingredients Fig. 5. Midpoint impacts of fish feed (for aquaponics) and fertilizers (HydrGro and
and composition (Pelletier and Tyedmers, 2007). Feed is formu- Ca(NO3)2, for hydroponics) (in log scale).
lated based on the requirements of cultured fish for protein, lipids,
and energy. In this study, tilapia were fed a feed for carnivorous fish
(41.1%) and EP (37.7%) of the fish feed, which also had comparable
like trout, which has a higher protein content (42%) than the feed
levels of AD (18.7%) and GWP (26.8%) to fish meal and soybean
required by omnivorous fish (24e30%) (Avadí et al., 2015). High-
meal, respectively. The fish feed also includes 10% rice, whose
protein fish feed generally consists of a higher content of fish
production requires intensive pesticide and fertilizer uses in the
meal. However, due to fish depletion, fish meal is being replaced by
field (Nguyen-Van-Hung et al., 2019; Ramsden et al., 2017),
other animals (e.g., poultry by-products) or plant (e.g., soybean)
resulting in the higher terrestrial ecotoxicity of the aquaponics than
protein sources. The fish feed used in this study contains 20% fish
that of the hydroponics, as shown in Fig. S2. Therefore, the use of
meal, 20% poultry byproduct meal (meat and blood), and 20%
more environment-friendly protein source for fish feed, such as
soybean meal. As shown in Fig. 6a, animal-based ingredients
insects, is crucial for a more sustainable aquaponics.
caused higher environmental impacts than plant-based in-
As to the fertilizers, Ca(NO3)2 generated higher impacts than the
gredients. Poultry meat meal was the main contributor to the AP
P. Chen et al. / Journal of Cleaner Production 275 (2020) 122888 7

Fig. 6. Environmental profile of (a) fish feed (42% protein), and (b) HydroGro.

commercial HydroGro fertilizer mix (Fig. 5), which aligned with the using the economic value-based FU, which hence should highly
results of (Torrellas et al., 2012) that nitrogen fertilizer dominated depend on the price of the produce. A sensitivity analysis was
the environmental impacts of hydroponic tomato production. For conducted to evaluate the effect of price fluctuation on the envi-
HydroGro, its phosphorus component (9.3% P2O5) was responsible ronmental performance of the aquaponic and hydroponic systems.
for the highest portion (48.1%) of the AP, and the potassium Table S4 shows the market prices of the vegetables over time from
component (35.0% K2O) contributed the most (44.3%) to its AD, as June 2017 to April 2019 extracted from the USDA database
shown in Fig. 6b. Despite the low content in HydroGro (4.3%), total 2017e2019 (USDA, 2019). Due to limited data, only one price point
nitrogen showed dominating contributions to GWP (60.2%) and EP was collected for arugula and tilapia. However, in the authors’ ex-
(77.0%). This could be due to the nitrous oxide (N2O) emission periences, their prices are fairly stable over time. Since all the
during fertilizer production (Hasler et al., 2015). Moreover, nitrogen environmental impacts showed a similar trend, only the AD results
fertilizer has been identified as one of the major substances causing are presented here (Fig. 7a). The aquaponic system remained a
eutrophication (Hasler et al., 2015). more sustainable system than the hydroponics regardless of the
produce price. Noticeably, the environmental impacts of the hy-
3.3. Sensitivity analysis droponics were more sensitive to price fluctuation than those of the
aquaponics.
3.3.1. Functional unit Since the results of life cycle impact assessment highly depend
All the environmental impacts reported above were calculated on the FU defined, a separate LCA was carried out for comparison
8 P. Chen et al. / Journal of Cleaner Production 275 (2020) 122888

Fig. 7. The effects of (a) produce price and (b) growing season on the AD of aquaponics or hydroponics. Min, Avg, and Max refer to the sum of the minimum, average, and maximum
prices of all the produces listed in Table S4.

using the mass-based FU of 1 kg of vegetables produced from the tomatoes grown in Columbia (Bojaca  et al., 2014) had 127 times less
systems. Table S5 (the first two rows) shows that the hydroponic GWP than those grown in northern Europe (Williams et al., 2006).
system still had a higher GWP than the aquaponic system by 46%, Seasonal change in temperature can also cause a significant
but the difference was smaller than the economic value-based difference in the environmental performance of CEA. Representing
result (Fig. 2). Different aquaponic systems are designed to grow all the environmental impacts that had a similar trend, the AD
fish and vegetables at different ratios, which can directly affect the generated in winter season (December to February) was more than
results of the allocation of environmental impacts. On a mass basis, twice as high as that in summer season for both the aquaponics and
Maucieri et al. (2018) allocated 91.6% of the environmental impacts hydroponics systems (Fig. 7b).
generated by an aquaponics over one month to vegetables, which is
higher than the current study (72%). It is important to point out that 3.3.3. Energy source
our experiment was conducted at a research facility-scale, and both Since our results indicated that energy consumption was the
systems were not operated under optimized conditions, therefore, environmental hotspot of both the aquaponic and hydroponic
their environmental performance cannot be directly compared to systems, evaluating the environmental feasibility of different en-
conventional OFA at commercial-scale. Bartzas et al. (2015) ergy sources is needed. Fig. 8 compares the primary energy source
compared the environmental impacts of hydroponics with OFA at in Indiana (88% coal) with the US (30% coal, 34% gas) and California
a research facility-scale in subtropical region (Italy), and found that (44% natural gas) scenarios (Freese, 2008). The results showed that
the former produced lower GWP and EP. The results indicate that in if the source of the electricity used for supplemental lighting and
addition to the advantages of high water and nutrient use effi- greenhouse heating was changed from coal to natural gas, the EP of
ciency, CEA can have lower energy demand and associated envi- the hydroponics would be lower than that of the aquaponics, while
ronmental impacts than OFA if operated in warm climate regions. the trends of the other environmental impacts remained un-
changed. Moreover, if the primary energy source was replaced by
3.3.2. Region and season renewable energy (wind power), the hydroponics would become
The environmental performance of CEA is highly related to more sustainable than the aquaponics in terms of GWP, AP, and EP.
geographic location, climate, and light period. Temperature control In this scenario, the mass-based GWP of the aquaponic system
and energy-consuming machinery in CEA ensure the high yield of (18.5 kg CO2 eq/kg of products) could be as low as that of com-
crops. In the Midwestern US, featured by long winter with drastic mercial aquaponics in tropical climate regions (US Virgin Islands,
temperature changes in a day, heating and supplemental lighting 8.64 kg CO2 eq/kg of products (Boxman et al., 2017)).
throughout a day is necessary from October to April. Consequently,
both aquaponic and hydroponic production systems in the 4. Conclusions
temperate climate region require more energy, generated by elec-
tricity or propane than the regions with tropical and subtropical CEA is a surging technology to meet the rapidly growing global
climates. Table S5 summarizes the effect of region on the GWP of food demand because of its high productivity, and water and
1 kg of produce cultured in CEA system. Aquaponics in tropical nutrient use efficiency. This is the first study to evaluate and
areas, e.g., US Virgin Islands (Boxman et al., 2017), produced 12 compare the cradle-to-gate environmental performance of hydro-
times less GWP than the current study. Furthermore, hydroponic ponics and aquaponics operated with identical systems
P. Chen et al. / Journal of Cleaner Production 275 (2020) 122888 9

Fig. 8. Effect of energy source on the environmental impacts of aquaponics and hydroponics.

infrastructure via an economic-based LCA. Compared to hydro- Kim: Methodology, Resources, Data curation, Writing - review &
ponics, aquaponics produced nearly half the environmental im- editing, Supervision, Funding acquisition. Paul B. Brown: Meth-
pacts due to the higher total value of its products. Due to the odology, Resources, Data curation, Writing - review & editing, Su-
temperate climate region and winter season, electricity use for pervision, Funding acquisition. Jen-Yi Huang: Conceptualization,
operations of greenhouse and both systems was the environmental Methodology, Resources, Data curation, Writing - review & editing,
hotspot, in terms of AD, GWP, AP, and EP. However, the source of Visualization, Supervision, Project administration, Funding
energy played an important role, replacing fossil fuel by renewable acquisition.
energy could make hydroponics a more sustainable system.
Furthermore, fish feed production was the second major contrib- Declaration of competing interest
utor to the environmental impacts, except EP in which discharge of
nutrient solution from aquaponics played an important role. The authors declare that they have no known competing
Therefore, further assessment on the environmental feasibility of financial interests or personal relationships that could have
alternative fish feeds for aquaponics is needed. appeared to influence the work reported in this paper.
As sustainable production is one of the United Nation’s sus-
tainable development goals, our planet needs great efforts from Acknowledgements
both farmers and consumers to mitigate the environmental bur-
dens associated with food supply chains. The LCA model developed This work was supported by the USDA National Institute of Food
in this study is expected to provide CEA farmers in the Midwestern and Agriculture, Hatch project 1014964, Hatch/Multi State project
US with a decision-making tool to adapt farming practices with a NE-1335 Resource Management in Commercial Greenhouse Pro-
lower environmental footprint, including energy source and feed duction, and Purdue University Research Funds.
formula. In the long term, the results of this study also have prac-
tical implications for increasing Midwestern consumers’ awareness Appendix A. Supplementary data
of environmental issues of local CEA production, and guiding them
to purchase more environment-friendly CEA produce. Supplementary data to this article can be found online at
https://doi.org/10.1016/j.jclepro.2020.122888.

CRediT authorship contribution statement


References

Peng Chen: Conceptualization, Methodology, Formal analysis, Aubin, J., Papatryphon, E., van der Werf, H.M.G., Chatzifotis, S., 2009. Assessment of
Investigation, Data curation, Writing - original draft, Writing - re- the environmental impact of carnivorous finfish production systems using life
view & editing, Visualization. Gaotian Zhu: Conceptualization, cycle assessment. J. Clean. Prod. 17, 354e361. https://doi.org/10.1016/
J.JCLEPRO.2008.08.008.
Methodology, Formal analysis, Investigation, Data curation, Writing ~ ez, J., Fre
Avadí, A., Pelletier, N., Aubin, J., Ralite, S., Nún on, P., 2015. Comparative
- original draft, Writing - review & editing, Visualization. Hye-Ji environmental performance of artisanal and commercial feed use in Peruvian
10 P. Chen et al. / Journal of Cleaner Production 275 (2020) 122888

freshwater aquaculture. Aquaculture 435, 52e66. https://doi.org/10.1016/ 2018. Life cycle assessment of a micro aquaponic system for educational pur-
J.AQUACULTURE.2014.08.001. poses built using recovered material. J. Clean. Prod. 172, 3119e3127. https://
Ayer, N.W., Tyedmers, P.H., 2009. Assessing alternative aquaculture technologies: doi.org/10.1016/j.jclepro.2017.11.097.
life cycle assessment of salmonid culture systems in Canada. J. Clean. Prod. 17, Nguyen-Van-Hung, Sander, B.O., Quilty, J., Balingbing, C., Castalone, A.G.,
362e373. https://doi.org/10.1016/j.jclepro.2008.08.002. Romasanta, R., Alberto, M.C.R., Sandro, J.M., Jamieson, C., Gummert, M., 2019. An
Bailey, D.S., Ferrarezi, R.S., 2017. Valuation of vegetable crops produced in the UVI assessment of irrigated rice production energy efficiency and environmental
commercial aquaponic system. Aquac. Rep. 7, 77e82. https://doi.org/10.1016/ footprint with in-field and off-field rice straw management practices. Sci. Rep.
j.aqrep.2017.06.002. 9, 1e12. https://doi.org/10.1038/s41598-019-53072-x.
Barbosa, G.L., Gadelha, F.D.A., Kublik, N., Proctor, A., Reichelm, L., Weissinger, E., NSF, 2015. America’s future: environmental research and education for a thriving
Wohlleb, G.M., Halden, R.U., 2015. Comparison of land, water, and energy re- century. NSF Advis. Comm. Environ. Res. Educ. Washingt. 48.
quirements of lettuce grown using hydroponic vs. Conventional agricultural Pantanella, E., Cardarelli, M., Colla, G., Rea, E., Marcucci, A., 2012. Aquaponics vs.
methods. Int. J. Environ. Res. Publ. Health 12, 6879e6891. https://doi.org/ hydroponics: production and quality of lettuce crop. Acta Hortic. 887e893.
10.3390/ijerph120606879. https://doi.org/10.17660/ActaHortic.2012.927.109.
Bartzas, G., Zaharaki, D., Komnitsas, K., 2015. Life cycle assessment of open field and Pelletier, N., Tyedmers, P., 2007. Feeding farmed salmon: is organic better? Aqua-
greenhouse cultivation of lettuce and barley. Inf. Process. Agric. 2, 191e207. culture 272, 399e416. https://doi.org/10.1016/J.AQUACULTURE.2007.06.024.
https://doi.org/10.1016/j.inpa.2015.10.001. Pelletier, N., Tyedmers, P., Sonesson, U., Scholz, A., Ziegler, F., Flysjo, A., Kruse, S.,
Bojac a, C.R., Wyckhuys, K.A.G., Schrevens, E., 2014. Life cycle assessment of Cancino, B., Silverman, H., 2009. Not all salmon are created equal: life cycle
Colombian greenhouse tomato production based on farmer-level survey data. assessment (LCA) of global salmon farming systems. Environ. Sci. Technol. 43,
J. Clean. Prod. 69, 26e33. https://doi.org/10.1016/j.jclepro.2014.01.078. 8730e8736. https://doi.org/10.1021/es9010114.
Boxman, S.E., Zhang, Q., Bailey, D., Trotz, M.A., 2017. Life cycle assessment of a Perdue, S., Hamer, H., 2019. United States Summary and State Data Volume 1 
commercial-scale freshwater aquaponic system. Environ. Eng. Sci. 34, 299e311. Geographic Area Series  Part 51 United States Department of Agriculture.
https://doi.org/10.1089/ees.2015.0510. Rakocy, J., 2007. Ten guidelines for aquaponic systems. Aquaponics J. 46, 14e17.
Cohen, A., Malone, S., Morris, Z., Weissburg, M., Bras, B., 2018. Combined fish and Ramsden, S.J., Wilson, P., Phrommarat, B., 2017. Integrating economic and envi-
lettuce cultivation: an aquaponics life cycle assessment. Procedia CIRP 69, ronmental impact analysis: the case of rice-based farming in northern Thailand.
551e556. https://doi.org/10.1016/J.PROCIR.2017.11.029. Agric. Syst. 157, 1e10. https://doi.org/10.1016/j.agsy.2017.06.006.
Davidson, J., Good, C., Welsh, C., Summerfelt, S., 2011. The effects of ozone and water Romeo, D., Vea, E.B., Thomsen, M., 2018. Environmental impacts of urban hydro-
exchange rates on water quality and rainbow trout Oncorhynchus mykiss per- ponics in Europe: a case study in Lyon. Procedia CIRP 69, 540e545. https://
formance in replicated water recirculating systems. Aquacult. Eng. 44, 80e96. doi.org/10.1016/J.PROCIR.2017.11.048.
https://doi.org/10.1016/J.AQUAENG.2011.04.001. Roy, P., Nei, D., Orikasa, T., Xu, Q., Okadome, H., Nakamura, N., Shiina, T., 2009.
Delaide, B., Delhaye, G., Dermience, M., Gott, J., Soyeurt, H., Jijakli, M.H., 2017. Plant A review of life cycle assessment (LCA) on some food products. J. Food Eng.
and fish production performance, nutrient mass balances, energy and water use https://doi.org/10.1016/j.jfoodeng.2008.06.016.
of the PAFF Box, a small-scale aquaponic system. Aquacult. Eng. 78, 130e139. Skowron ~ ska, M., Filipek, T., 2014. Life cycle assessment of fertilizers: a review. Int.
https://doi.org/10.1016/j.aquaeng.2017.06.002. Agrophys. 28, 101e110. https://doi.org/10.2478/intag-2013-0032.
Delaide, B., Goddek, S., Gott, J., Soyeurt, H., Jijakli, M.H., 2016. Lettuce (Lactuca sativa Suhl, J., Dannehl, D., Kloas, W., Baganz, D., Jobs, S., Scheibe, G., Schmidt, U., 2016.
L. var. Sucrine) growth performance in complemented aquaponic solution Advanced aquaponics : evaluation of intensive tomato production in aqua-
outperforms hydroponics. Water (Switzerland). https://doi.org/10.3390/ ponics vs. conventional hydroponics. Agric. Water Manag. 178, 335e344.
w8100467. https://doi.org/10.1016/j.agwat.2016.10.013.
FAO, 2011. FAO in the 21st century : ensuring food security in a changing world. Sun, W., 2009. Life cycle assessment of indoor recirculating shrimp aquaculture
Food and Agriculture Organization of the United Nations. system. University of Michigan.
Forchino, A.A., Lourguioui, H., Brigolin, D., Pastres, R., 2017. Aquaponics and sus- Teichert-Coddington, D.R., 1996. Effect of stocking ratio on semi-intensive poly-
tainability: the comparison of two different aquaponic techniques using the Life culture of Colossoma macropomum and Oreochromis niloticus in Honduras,
Cycle Assessment (LCA). Aquacult. Eng. 77, 80e88. https://doi.org/10.1016/ Central America. Aquaculture 143, 291e302. https://doi.org/10.1016/0044-
j.aquaeng.2017.03.002. 8486(96)01271-9.
Freese, B., 2008. Coal power in a warming world a sensible transition to cleaner Torrellas, M., Anto n, A., Lo pez, J.C., Baeza, E.J., Parra, J.P., Mun
~ oz, P., Montero, J.I.,
energy options. Union Concerned Sci. URL. https://www.ucsusa.org/sites/ 2012. LCA of a tomato crop in a multi-tunnel greenhouse in Almeria. Int. J. Life
default/files/legacy/assets/documents/clean_energy/Coal-power-in-a- Cycle Assess. 17, 863e875. https://doi.org/10.1007/s11367-012-0409-8.
warming-world.pdf. accessed 9.27.19. USDA, 2019. Weekly advertised fruit & vegetables retail prices. URL. https://www.
Ghamkhar, R., Hartleb, C., Wu, F., Hicks, A., 2020. Life cycle assessment of a cold marketnews.usda.gov/mnp/fv-report-retail?
weather aquaponic food production system. J. Clean. Prod. 244, 118767. https:// repType=wiz&run=Run&portal=fv&locChoose
doi.org/10.1016/j.jclepro.2019.118767. =locState&commodityClass=allcommodity&startIndex=1&type=
Gleick, P.H., 2010. Roadmap for sustainable water resources in southwestern North retail&class=VEGETABLES&commodity=MUSTARD%aeion=MIDWEST. accessed
America. Proc. Natl. Acad. Sci. Unit. States Am. 107, 21300e21305. https:// 4.19.19.
doi.org/10.1073/pnas.1005473107. Williams, A.G., Audsley, E., Sandars, D.L., 2006. Determining the environmental
Gomez, C., Currey, C.J., Dickson, R.W., Kim, H.-J., Hern andez, R., Sabeh, N.C., burdens and resource use in the production of agricultural and horticultural
Raudales, R.E., Brumfield, R.G., Laury-Shaw, A., Wilke, A.K., Lopez, R.G., commodities. Main Rep. Defra Research Project IS0205. Bedford: Cranfield
Burnett, S.E., 2019. Controlled environment food production for urban agri- University and Defra. Available on www.silsoe.cranfield.ac.uk/ www.defra.gov.
culture. Hortscience 54, 1448e1458. https://doi.org/10.21273/hortsci14073-19. uk/.
Hasler, K., Bro€ring, S., Omta, S.W.F., Olfs, H.-W., 2015. Life cycle assessment (LCA) of Wongkiew, S., Popp, B.N., Kim, H.-J., Khanal, S.K., 2017. Fate of nitrogen in floating-
different fertilizer product types. Eur. J. Agron. 69, 41e51. https://doi.org/ raft aquaponic systems using natural abundance nitrogen isotopic composi-
10.1016/J.EJA.2015.06.001. tions. Int. Biodeterior. Biodegrad. 125, 24e32. https://doi.org/10.1016/
Henriksson, P.J.G., Dickson, M., Allah, A.N., Al-Kenawy, D., Phillips, M., 2017. J.IBIOD.2017.08.006.
Benchmarking the environmental performance of best management practice Yang, T., Kim, H.-J., 2020a. Comparisons of nitrogen and phosphorus mass balance
and genetic improvements in Egyptian aquaculture using life cycle assessment. for tomato-, basil-, and lettuce-based aquaponic and hydroponic systems.
Aquaculture 468, 53e59. https://doi.org/10.1016/j.aquaculture.2016.09.051. J. Clean. Prod. https://doi.org/10.1016/j.jclepro.2020.122619.
Henriksson, P.J.G., Guine e, J.B., Kleijn, R., de Snoo, G.R., 2012. Life cycle assessment of Yang, T., Kim, H.-J., 2020b. Characterizing nutrient composition and concentration
aquaculture systemsda review of methodologies. Int. J. Life Cycle Assess. 17, in tomato-, basil-, and lettuce-based aquaponic and hydroponic systems. Water
304e313. https://doi.org/10.1007/s11367-011-0369-4. 12, 1259. https://doi.org/10.3390/w12051259.
Jaeger, C., Foucard, P., Tocqueville, A., Nahon, S., Aubin, J., 2019. Mass balanced based Yang, T., Kim, H.-J., 2020c. Effects of hydraulic loading rate on spatial and temporal
LCA of a common carp-lettuce aquaponics system. Aquacult. Eng. 84, 29e41. water quality characteristics and crop growth and yield in aquaponic systems.
https://doi.org/10.1016/j.aquaeng.2018.11.003. Horticulturae 6, 9. https://doi.org/10.3390/horticulturae6010009.
Li, C., Zhang, B., Luo, P., Shi, H., Li, L., Gao, Y., Lee, C.T., Zhang, Z., Wu, W.-M., 2019. Yang, T., Kim, H.-J., 2019. Nutrient management regime affects water quality, crop
Performance of a pilot-scale aquaponics system using hydroponics and growth, and nitrogen use efficiency of aquaponic systems. Sci. Hortic. 256
immobilized biofilm treatment for water quality control. J. Clean. Prod. 208, https://doi.org/10.1016/J.SCIENTA.2019.108619, 108619.
274e284. https://doi.org/10.1016/J.JCLEPRO.2018.10.170. Yildizhan, H., Taki, M., 2018. Assessment of tomato production process by cumu-
Mattsson, B., Cederberg, C., Blix, L., 2000. Agricultural land use in life cycle lative exergy consumption approach in greenhouse and open field conditions:
assessment (LCA): case studies of three vegetable oil crops. J. Clean. Prod. 8, case study of Turkey. Energy 156, 401e408. https://doi.org/10.1016/
283e292. https://doi.org/10.1016/S0959-6526(00)00027-5. J.ENERGY.2018.05.117.
Maucieri, C., Forchino, A.A., Nicoletto, C., Junge, R., Pastres, R., Sambo, P., Borin, M.,

You might also like