Professional Documents
Culture Documents
doi:10.1093/aepp/ppq032
Featured Article
Index Funds, Financialization, and Commodity
Futures Markets
Scott H. Irwin* and Dwight R. Sanders
Abstract Some market participants and policy-makers believe that index fund
investment was a major driver of the 2007-2008 spike in commodity futures
prices. One group of empirical studies does find evidence that commodity index
investment had an impact on the level of futures prices. However, the data and
methods used in these studies are subject to criticisms that limit the confidence
one can place in their results. Moreover, another group of studies provides no sys-
tematic evidence of a relationship between positions of index funds and the level
of commodity futures prices. The lack of a direct empirical link between index
fund trading and commodity futures prices casts considerable doubt on the belief
that index funds fueled a price bubble.
Key words: Index funds, commodity, futures markets, prices, specu-
lation, bubble.
JEL Codes: D84, G12, G13, G14, Q13, Q41.
Introduction
The financial industry has developed new products that allow insti-
tutions and individuals to invest in commodities through long-only index
funds, over-the-counter (OTC) swap agreements, exchange traded funds,
and other structured products. Regardless of form, these instruments have
a common goal – to provide investors with buy-side exposure to returns
from a particular index of commodity prices.1
Several influential academic studies concluded that investors can
capture substantial risk premiums and reduce portfolio risk through rela-
tively modest investments in long-only commodity index funds (e.g.,
1
In the remainder of this article, the term “commodity index fund” or “index fund” is used generically
to refer to all of the varied long-only commodity investment instruments. See the discussion in the fol-
lowing section for further details.
# The Author(s) 2011. Published by Oxford University Press, on behalf of Agricultural and Applied
Economics Association. All rights reserved. For permissions, please email:
journals.permissions@oup.com.
1
Applied Economic Perspectives and Policy
Gorton and Rouwenhorst 2006; Erb and Harvey 2006). Combined with the
availability of deep and liquid exchange-traded futures contracts, these
conclusions set off a dramatic surge in commodity index fund invest-
ments. While there is uncertainty about the best way to measure the mag-
nitude of this surge, it is safe to say that at least $100 billion of new
investment moved into commodity futures markets between 2004 and
2008. Domanski and Heath (2007) term this the “financialization” of com-
modity futures markets. Given the size and scope of the index fund boom,
it should probably not come as a surprise that a worldwide debate has
ensued over the role of index funds in commodity markets. This debate
has important ramifications from a policy and regulatory perspective, as
well as practical implications for the efficient pricing of commodity
2
Index Funds and Futures
3
Applied Economic Perspectives and Policy
relatively large 67% weight towards the energy sector, and a fairly small
21% in traditional livestock and agricultural markets.4 The other industry
benchmark is the Dow Jones-UBS Commodity IndexTM (DJ-UBS). The
DJ-UBS market weights are based on a combination of economic signifi-
cance and market liquidity, with a maximum weight of 33% in any sector.
Energy markets receive a weight of 28%, and the livestock and agricultural
sectors combine to 40% of the DJ-UBS index.5 In both of these popular
indices, the market weights, contract switching or rollover conventions,
and contract months traded are well-publicized, resulting in a transparent
and well-defined index.
Investors can gain exposure to commodity indices through a number of
investment vehicles, but the positions often find their way to the commodity
4
As of October 15, 2010. (http://www2.goldmansachs.com/services/securities/products/sp-gsci-commodity-
index/index.html).
5
As of September 30, 2010. (http://www.djindices.com/mdsidx/downloads/fact_info/Dow_Jones-UBS_
Commodity_Index_Fact_Sheet.pdf ).
6
See Engelke and Yuen (2008) and Stoll and Whaley (2010) for further details on the various commod-
ity index investment instruments.
4
Index Funds and Futures
7
Index investment data collected by the CFTC provides smaller estimates of the assets in index funds.
At the end of the second quarter of 2008, CFTC data indicated the total was $201 billion compared to
$269 billion for the Barclays Capital data. The gap between the two series expanded to $132 billion at
the end of the second quarter of 2010.
5
Applied Economic Perspectives and Policy
Figure 2 U.S. and non-U.S. assets in commodity index products, first quarter, 2004-third
quarter, 2010
Figure 3 Weekly net long open interest of commodity index traders (CIT) and CIT percentage
of market (long) open interest for Chicago Board of Trade (CBOT) corn futures market,
January 6, 2004 - September 7, 2010
6
Index Funds and Futures
Figure 4 Weekly net long open interest of commodity index traders (CIT) and CIT percentage
of market (long) open interest for Chicago Board of Trade (CBOT) soybean futures market,
January 6, 2004 - September 7, 2010
(CIT).8 Trends in the net long positions of CITs in these four markets
roughly parallel the overall trends in commodity index investment shown
in Figure 2. There are some differences across markets, however. CIT net
long open interest in CBOT corn and wheat first peaked in early 2006, and
did not exceed this peak until very recently. CBOT soybeans and KCBOT
wheat did not reach their first peak until later, in mid- to late-2007. CIT
percentage of total market open interest probably best illustrates the sheer
size of index fund positions, which has ranged recently from approxi-
mately 20-30% of the long side of the market in CBOT corn and soybeans
8
Position data for 2004-2005 were prepared by the CFTC at the request of the U.S. Senate Permanent
Subcommittee on Investigations (USS/PSI 2009). We thank the staff of the subcommittee for allowing
us to use this data.
7
Applied Economic Perspectives and Policy
Figure 6 Weekly net long open interest of commodity index traders (CIT) and CIT percentage
of market (long) open interest for Kansas City Board of Trade (KCBOT) wheat futures
market, January 6, 2004 - September 7, 2010
What is a Bubble?
Brunnermeier (2008, p.578) defines a bubble as, “ . . . asset prices that
exceed an asset’s fundamental value because current owners believe that
they can resell the asset at an even higher price in the future.” While this
definition is slightly different from some of the more classical references
8
Index Funds and Futures
9
See Barlevy (2007) for a readable and non-technical discussion of the conditions in which asset
pricing bubbles can occur.
9
Applied Economic Perspectives and Policy
While it is arguable that bubbles have actually occurred with any fre-
quency in financial history, at least in the sense defined by economists, the
term has definitely been more in vogue over the last decade, with pro-
claimed “bubbles” in information technology stocks and residential
housing, as well as suspected bubbles in U.S. Treasury securities and com-
modity futures prices. Indeed, while economists are typically careful in
their use of the term “bubble,” the popular press has seemingly adopted
the label for any market that makes a large advance quickly and then
makes an equally hasty retreat. As Barlevy (2007) points out, the problem
with this popular usage is that large price swings sometimes occur natu-
rally and in response to shifts in supply and demand. This highlights the
main difficulty of identifying an asset pricing bubble: disentangling move-
It Was a Bubble
The Arguments
Masters (2008) has interwoven investment and price data to create the
most widely-cited bubble argument, painting the activity of index funds
as being akin to the infamous Hunt brothers’ cornering of the silver
market in the early 1980s. Masters blames the rapid increase in overall
commodity prices from 2007-2008 on institutional investors’ embrace of
commodities as an investable asset class. As discussed in the previous
section, it is clear that considerable investment dollars flowed into com-
modity index funds over this time period. However, the evidence pro-
vided by Masters is limited to anecdotes and the temporal correlation
between money flows and prices. Masters and White (2008) recommend
specific regulatory steps to address the alleged problems created by index
fund investment in commodity futures markets, including the
re-establishment of speculative position limits for all speculators in all
commodity futures markets, as well as the elimination or severe restriction
of index speculation.
A similar position was taken by the U.S. Senate Permanent
Subcommittee on Investigations in its examination of the performance of
the CBOT wheat futures contract:
“This Report finds that there is significant and persuasive evidence to conclude that
these commodity index traders, in the aggregate, were one of the major causes of
“unwarranted changes” – here, increases – in the price of wheat futures contracts
relative to the price of wheat in the cash market. The resulting unusual, persistent
and large disparities between wheat futures and cash prices impaired the ability of
participants in the grain market to use the futures market to price their crops and
hedge their price risks over time, and therefore constituted an undue burden on
interstate commerce. Accordingly, the Report finds that the activities of commodity
index traders, in the aggregate, constituted “excessive speculation” in the wheat
market under the Commodity Exchange Act,” (USS/PSI 2009, p. 2).
10
Index Funds and Futures
11
Applied Economic Perspectives and Policy
bubble in commodity prices. The model divides the world into two
regions; the first has developed financial markets, and the other does not.
Since commodity producers are assumed to be located in the region with
less developed financial markets, producers are forced to hold financial
assets from the developed region as a store of wealth, which leads to a
decline in real interest rates in this region. Bubbles form in asset markets,
including commodity markets, in response to the decline in real interest
rates. Once again, a key prediction of this model is that commodity inven-
tories accumulate during the building phase of the price bubble. An inter-
esting feature of this model is that equilibrium is invariant to the presence
of a futures market. The bubble is ultimately fed only by global imbal-
ances in the supply of liquid and safe financial assets.
12
Index Funds and Futures
analysis; and iii) without an explicit theory that establishes a link between
two variables, the meaning of a non-zero correlation is unclear.
The second reason is related to the index of commodity index fund
activity used by Gilbert (2009); his quantum index is a weighted average
of index trader positions in agricultural futures markets (as reported in
the CFTC’s CIT report). The weights are nearest-to-expiration futures
prices on the first date of his sample. Gilbert (2009) then applies this index
not only to three of the agricultural markets included in the index, but
also to the energy and metal markets not included in the index.
Application of an index constructed from the 12 CIT agricultural markets
to the energy and metals markets is justified only if one believes the
pattern of index trader positions in agricultural markets closely mirrors
13
Applied Economic Perspectives and Policy
14
Index Funds and Futures
15
Applied Economic Perspectives and Policy
16
Index Funds and Futures
commodity futures markets are zero-sum games. This implies that money
flows in and of themselves do not necessarily impact prices. Rather, prices
will only change if new information emerges that causes market partici-
pants to revise their estimates of physical supply and/or demand.
What happens when market participants are not equally informed?
When this is the case, it is rational for participants to condition demands
on both their own information and information about other participants’
demands that can be inferred (“inverted”) from the futures price
(Grossman 1986). The trades of uninformed participants can impact prices
in this more realistic model if informed traders mistakenly believe that
trades made by uninformed participants (“noise”) reflect valuable infor-
mation about supply and demand fundamentals. Hence, it is possible that
“Wearing multiple hats gives Cargill an unusually detailed view of the industries it
bets on, as well as the ability to trade on its knowledge in ways few others can
match. Cargill freely acknowledges it strives to profit from that information. “When
we do a good job of assimilating all those seemingly unrelated facts,” says Greg
Page, Cargill’s chief executive, in a rare interview, “it provides us an opportunity to
11
Hieronymus (1977) argued that large commercial firms dominated commodity futures markets, and
speculators tended to be at a disadvantage. Based on his theoretical analysis, Grossman (1986,
p. S140) asserted, “ . . . it should come as no surprise if a study of trading profit finds that traders
representing large firms involved in the spot commodity (i.e., commercial traders) make large trading
profits on futures markets.” In the classic empirical study on this subject, Hartzmark (1987) showed
that large commercial firms in six of seven futures markets make substantial profits on their futures
trades.
17
Applied Economic Perspectives and Policy
make money . . . without necessarily having to make directional trades, i.e., outguess
the weather, outguess individual governments,” (Davis 2009).
18
Index Funds and Futures
The third factual inconsistency with the bubble story is that speculation
was not excessive when correctly compared to hedging demands. The stat-
istics on long-only index fund trading reported in the media and discussed
at hearings tend to view speculation in a vacuum focusing on absolute pos-
ition size and activity. Working (1960) argued that speculation must be
gauged relative to hedging needs. In particular, speculation can only be con-
sidered “excessive” relative to the level of hedging activity in the market.
Utilizing Working’s speculative T-index, Sanders, Irwin, and Merrin (2010)
demonstrate that the level of speculation in nine agricultural futures
markets from 2006-2008 (adjusting for index fund positions) was not exces-
sive. Indeed, the levels of speculation in all markets examined were within
the realm of historical norms. Across most markets, the rise in index buying
Empirical Evidence
We review here nine studies that do not provide empirical evidence of a
bubble and/or a statistical linkage between index fund activity and com-
modity futures price movements.13 As in the previous section, studies are
selected because they contain statistical analysis that directly tests whether
the recent commodity price spike contained a bubble component and/or
index fund trading contributed to the price spike. Most of the studies
focus on testing for a relationship between index fund trading and com-
modity futures price movements since this is the most direct type of
evidence.14
Buyuksahin and Harris (2009) use daily data from the CFTC’s internal
large trader database from July 2000-March 2009 to conduct a variety of
tests on the relation between crude oil futures prices and positions of
various types of traders. Granger causality tests provide no statistical evi-
dence that position changes (number of contracts) by any trader group
13
As before, we make no claim to presenting an exhaustive review of all such studies.
14
Though not reviewed here, Robles, Torero, and von Braun (2009) utilize weekly CIT data to conduct
Granger causality tests between index positions and futures returns. Despite the overwhelmingly nega-
tive results of their statistical analysis, the authors nonetheless assert that there is sufficient evidence
of the damaging role of speculation to warrant the creation of a new international organization to
counteract this market failure. See Wright (2009) for further discussion.
19
Applied Economic Perspectives and Policy
systematically precede price changes. This result holds for the entire
sample period, and when the sample is broken into two parts: from July
2000-June 2004 and July 2004-March 2009. Buyuksahin and Harris assume
that swap dealer positions are linked to commodity index investing, and
hence, the results for swap dealers are interpreted as a failure to reject the
null hypothesis of no relation between crude oil futures prices and index
fund trading.
A key question, then, is whether it is reasonable to assume that swap
dealer positions in crude oil futures accurately reflect the total effective
“demand” of index investors. As noted earlier, swap dealers internally net
long commodity index positions with other long and short
over-the-counter (OTC) positions. A 2008 CFTC report indicates that swap
20
Index Funds and Futures
tests are conducted to determine whether the shifting of index fund pos-
itions between contracts impacts the relative price movements of the
nearest- and next-nearest futures contracts. This analysis is conducted for
six commodities tracked in the CIT report, as well as crude oil. These tests
find evidence of a significant relative price impact only in crude oil.
Overall, Stoll and Whaley conclude that commodity index investing has
little impact on futures prices.
Stoll and Whaley’s analysis generates virtually no evidence that index
trading had an impact on agricultural futures price movements. However,
it is not known whether their results generalize to a broader set of com-
modity futures markets, especially energy futures markets that have been
at the center of the current controversy. Another issue is that the power of
15
The same position data, updated through early September 2010, are used in figures 3-6 of this
article.
21
Applied Economic Perspectives and Policy
contracts or net long CIT contracts/total long market open interest) have
no impact on futures prices. Overall, the authors conclude that data trends
and statistical test results are not consistent with the widely-touted bubble
theory. A limitation of this study is that tests are restricted to four grain
futures markets.
Sanders and Irwin (2010c) investigate the price impact of index fund
trading in 12 agricultural markets and 2 energy futures markets (crude oil
and natural gas). Data compiled by the CFTC in the Disaggregated
Commitments of Traders (DCOT) report on positions held by swap dealers
from June 2006 to December 2009 is assumed to reflect index-type invest-
ments. Bivariate Granger causality tests are used to investigate lead-lag
dynamics between index fund positions and futures returns or price vola-
22
Index Funds and Futures
16
Silvennoinen and Thorp (2010) also investigate the source of increasing correlation between commod-
ity and financial returns and reach similar conclusions to Buyuksahin and Robe (2010).
23
Applied Economic Perspectives and Policy
Kilian and Murphy (2010) estimate the price elasticity of crude oil (and
gasoline) demand because theory indicates a zero or near zero price elas-
ticity of demand is required for speculation to impact spot prices in a stor-
able commodity market (see Hamilton 2009b). The authors develop a
structural VAR (vector autoregression) model of the global market for
crude oil that explicitly allows for shocks to the speculative demand for
crude oil, as well as shocks to the flow demand and flow supply. Their
median estimate of the short-run price elasticity of demand for crude oil is
-0.41, which is about seven times higher than typical conjectures in the
recent literature. In a related fashion, the median estimate of the short-run
price elasticity of demand for gasoline is -0.20, several times higher than
previous estimates. Since the short-run elasticity estimates are substan-
24
Index Funds and Futures
25
Applied Economic Perspectives and Policy
Acknowledgements
The authors thank Kevin Norrish of Barclays Capital for providing data on assets
in commodity index funds. Nicole Aulerich, Jean Cordier, Linda Fulponi, Jim
Hamilton, Todd Petzel, Aaron Smith, Carl Zulauf and participants in the OECD
Working Party on Agricultural Policies and Markets provided helpful comments
on earlier versions of this article.
26
Index Funds and Futures
References
Ai, Chunrong, Arjun Chatrath, and Frank Song. 2006. On the Comovement of
Commodity Prices. American Journal of Agricultural Economics 88(3): 574–88.
Baffes, John, and Tassos Haniotos. 2010. Placing the 2006/08 Commodity Boom
into Perspective. Policy Research Working Paper 5371, The World Bank,
Washington, D.C.
Barberis, Nicholas, Andrei Shleifer, and Jeffrey Wurgler. 2005. Comovement.
Journal of Financial Economics 75(2): 283– 317.
Barlvey, Gadi. 2007. Economic Theory and Asset Bubbles. Economic Perspectives.
Federal Reserve Bank of Chicago, third quarter, p. 44 –59.
Bjornson, Bruce, and Colin A. Carter. 1997. New Evidence on Agricultural
27
Applied Economic Perspectives and Policy
Einloth, James T. 2009. Speculation and Recent Volatility in the Price of Oil.
Working Paper, Division of Insurance and Research, Federal Deposit Insurance
Corporation, Washington, D.C.
Engelke, Lynn, and Jack C. Yuen. 2008. Types of Commodity Investments. In The
Handbook of Commodity Investing, Frank J. Fabozzi, Roland Fuss, and Dieter
Kaiser eds., pp. 549 –69. Hoboken, NJ: John Wiley and Sons.
Erb, Claude B., and Campbell R. Harvey. 2006. The Strategic and Tactical Value of
Commodity Futures. Financial Analysts Journal 62(2): 69 –97.
Etula, Erkko. 2009. Broker-Dealer Risk Appetite and Commodity Returns. Staff
Report No. 406, Federal Reserve Bank of New York.
Forsythe, Robert, Thomas Palfrey, and Charles Plott. 1984. Futures Markets and
Informational Efficiency: A Laboratory Examination. Journal of Finance 39(4):
955 –81.
28
Index Funds and Futures
Irwin, Scott H., Dwight R. Sanders, and Robert P. Merrin. 2009. Devil or Angel?
The Role of Speculation in the Recent Commodity Price Boom (and Bust).
Journal of Agricultural and Applied Economics 41(2): 393– 402.
Jacks, David S. 2007. Populists versus Theorists: Futures Markets and the Volatility
of Prices. Explorations in Economic History 44(2): 342–62.
Kaminska, Izabella. 2010. Why Base-Metal Physical ETFs Could Be a Bad Deal.
Financial Times, October 27. http://ftalphaville.ft.com/blog/2010/10/27/
384851/why-base-metal-physical-etfs-could-be-a-bad-deal/.
Kilian, Lutz, and Dan Murphy. 2010. The Role of Inventories and Speculative
Trading in the Global Market for Crude Oil. Working Paper, Department of
Economics, University of Michigan.
Kindleberger, Charles P. 1996. Manias, Panics, and Crashes: A History of Financial
Crises, Third Edition. New York, NY: John Wiley and Sons.
29
Applied Economic Perspectives and Policy
30
Index Funds and Futures
31