Professional Documents
Culture Documents
DOI 10.1007/s11138-010-0119-z
Roger Koppl
Abstract Garnett and Boettke both seek to identify the appropriate behavior for the
representative scientist. The social structure of science is better represented,
however, with a heterogeneous agent model. Social epistemology and epistemolog-
ical naturalism provide context for the argument against representative agent
methodology. Asking whether individual scientists should “commit themselves to
an approach and pursue it doggedly” or make “a professional commitment to
intellectual tolerance, openness, and broad-mindedness” is like asking whether it is
better to be a bouncer or a bookkeeper. The question depends on particulars that vary
from person to person. Down with representative agent methodology. Up with
diversity.
I thank Maria Minniti for helpful discussions. I thank David Colander, Lester Embree, and Thomas
McQuade for comments. None of these helpful people is to blame for any errors in my paper.
R. Koppl (*)
Institute for Forensic Science Administration, Fairleigh Dickinson University, Madison,
NJ 07940, USA
e-mail: koppl@fdu.edu
44 R. Koppl
Boettke and Garnett both place their methodology in the context of writers such
as Polanyi (1969) and Thomas Kuhn (1970), who emphasize the social dimension of
science. Science is a social process and the dispute between our two authors should
be understood within that context. And yet each of them seems to invoke a model of
science that radically simplifies its social structure.
Boettke (2007) distinguishes only two types of agents, the “caretakers of the
institutional framework of the republic of science” and the individual scientist,
whom he encourages to be “doggedly committed.” Garnett has a slightly more
complicated model in which he distinguishes a third type of agent, “disciplinary and
school-of-thought leaders.” Boettke thinks pluralism should be an explicit concern of
the caretakers of the institutional order, but not individual scientists. Garnett thinks
disciplinary and school-of-thought leaders should also be concerned with pluralism.
Garnett thinks it best if “all scholars participate in the constitutional process of
defining and enacting the epistemic rules of the game.” Disciplinary and school-of-
thought leaders have a special responsibility, however, because they have power.
In the models of Boettke and Garnett, scholars differ only in their opinions and
which of a small number of roles they might play in the system (two for Boettke,
three for Garnett). There is no cognitive or epistemic diversity and no explicit
attention to comparative advantage. There is very little attention paid to the
“intellectual division of labor” (von Mises 1935, p. 102) in science and none to the
intellectual division of labor that exists within schools of thought. This relatively thin
picture of the social structure of science that has led both Garnett and Boettke to ask
how “individual scholars must think or act.” In other words, they both ask how the
representative scholar should behave.
My criticism of Boettke and Garnett echoes the criticism D’Agostino (2009)
makes of Kitcher (1990) and of his own earlier work. Kitcher’s influential paper,
“The Division of Cognitive Labor,” made several points that seem to harmonize
more with Boettke than Garnett. He notes that truth-seeking scholars might all bet on
the same theoretical horse, generating collectively suboptimal portfolio of active
research programs. There is a gap between individual and collective rationality. He
notes the more vain and venal scientists might find it in their interest to bet on a long
shot they do not quite believe in because priority of discovery would bring fame or
fortune. “The very factors that are frequently thought of as interfering with the
rational pursuit of science—the thirst for fame and fortune, for example—might
actually play a constructive role in our community of epistemic projects” (Kitcher
1990, p. 16). For Kitcher, private vices lead to publick virtues. “[S]ocial institutions
within science might take advantage of our personal foibles to channel our efforts
toward community goals rather than toward the epistemic ends that we might set for
ourselves as individuals” (p. 16).
Kitcher even seems to anticipate Garnett’s concerns about the power of
disciplinary and school-of-thought leaders. If everyone is working on the more
probable of two theories, for example, then it may well be that no individual scientist
(whether piously truth seeking or hot for fame and fortune) has an incentive to work
alone on the less probable theory. The problem is that the chance of a breakthrough
depends on the number of persons working on a theory. Thus, the lone maverick
may have too small a chance of reaching a breakthrough. In this situation, Kitcher
says, powerful leaders may be able to get “several people to jump ship together”
Against representative agent methodology 45
(p. 17). He is thinking of laboratories and not schools of thought, but that difference
does not seem to affect the underlying logic of the case. As if to purge any doubt that
Kitcher is identifying a benefit of epistemic power, he compares labs to medieval
fiefdoms. “Imagine,” he says, “that the community is divided into fiefdoms
(laboratories) and that, when the local chief (the lab director) decides to switch,
the local peasantry (the graduate students) move, too.” This forced march produces
an epistemic benefit for the community by diversifying its portfolio of active
theories. Kitcher draws the moral that “a certain amount of local autocracy...can
enable the community to be more flexible than it otherwise would be” (p. 17).
Kitcher clearly sides with Boettke when he says, “Perseverance, personal
investment, personal and national loyalties, and devotion to political causes may,
on occasion, help” to bring the number of rival theories or methods up toward the
collectively rational level (p. 18).
D’Agostino criticized Kitcher, complaining, “Kitcher never really dealt with a
proper division of labor, in the sense of Adam Smith or Karl Marx” (2009, p. 103).
He forthrightly confesses, “Neither did I in earlier work. . . . What none of us did
was consider whether, for example, a project of enquiry might be subdivided into
different tasks that could then be distributed across different individuals or teams
within the community” (103, emphasis in original). The contributions of Kitcher and
D’Agostino come out of two related trends in Anglo-American philosophy, the trend
to social epistemology and the trend to epistemological naturalism.
After Kuhn, social epistemology has gained ground and philosophers of science
have generally recognized the importance of social structure in science.
While Berger and Luckmann are not subversive of science, there are
constructivist elements in their thought. They say at one point, for example, “the
social world was made by men—and, therefore, can be remade by them” (p. 89). We
now know what they could not know in 1966, namely, that the social world is not
“made by men” if that phrase remains unqualified. Advances in ethology and
psychology have shown us just how much of human social life is derived from our
pre-human ancestors and is, therefore, a product of Darwinian natural selection
rather than free human invention (Cosmides et al. 1992). Informed opinion in 1966
held that human sexuality, “is pliable both in the objects toward which it may be
directed and in its modalities of expression” (p. 49). Our current understandings of
homosexuality, transgendered persons, and incest all require a model that, while
more complex than certain old-fashioned models of what is “natural,” represents
human sexuality as far less pliable than we could reasonably have imagined in
earlier decades.
It may be somewhat ironic that Berger and Luckmann have been absorbed into
the radical tradition of social epistemology because their chief influence, Alfred
Schutz, was not a social constructionist or subversive of science. On the contrary,
Schutz was conservative on science (Schutz 1962, pp. 245-253). He was an explicit
follower of Edmund Husserl’s phenomenological philosophy and thus an anti-
naturalist in epistemology. He says, for example, that Husserlian “phenomenology is
the matrix from which all ontological insights originate” (Schutz 1975, p. 50). He
was a laissez-faire liberal (Prendergast 1986, 2001), a follower of Austrian
economist Ludwig von Mises (Schutz 1967, pp. 242-246). In a further irony,
Schutz, the chief influence on Berger and Luckmann’s sociology of knowledge, had
a decidedly individualistic philosophy of science. He says, “The theorizing self is
solitary; it has no social environment; it stands outside social relationships” (Schutz
1962, p. 253).
Several economists have applied social science models and reasoning to either
science in general or the methodology of economics and other social sciences. These
include Diamond (1988, 2008), Hands (2002, originally published in 1994), Leonard
(2002), Levy and Peart (2010), McQuade and Butos (2003), Mirowski and Sent
(2002), Stigler (1976), Tullock (2005; originally published in 1966), and Wible
(1998), among many others. Although these economists all apply social science
models to science, they represent a wide variety of epistemological and
methodological views. Colander (2009) links the repudiation of representative-
agent methodology to complexity when he says, “If one accepts my complex system
view of the profession, such a composite ‘representative researcher searching for the
truth’ view of the profession’s views is incorrect” (p. 7). This statement seems to link
representative agent methodology to the assumption that researchers are truth
seekers. The philosopher Nicholas Rescher (1978) applies an economic model to the
philosophy of science.
The trend toward epistemological naturalism is related to the trend toward social
epistemology. Kitcher (1992) says epistemological naturalism was the norm in the
history of Western philosophy until Russell, Schlick, and (especially) Frege helped
to make anti-naturalism the dominant view. Kitcher sees Frege as “the emblem of a
revolution which overthrew philosophical naturalism” (p. 54). In Kitcher’s account,
Descartes, Locke, Hume, Kant, and Mill all exhibited a “willingness to draw on the
48 R. Koppl
ideas of the emerging sciences, to cull concepts from ventures in psychology and
physics, [and] later still to find inspiration in Darwin” (p. 54). Frege and others,
however, resisted what they “perceived as intrusions from psychology or biology”
(p. 54). Kitcher notes two related dimensions to the distinction between naturalist
and anti-naturalist epistemologies. First, epistemological naturalism tends to be
psychologistic in some sense. Anti-naturalists oppose psychologism. Second,
epistemological naturalism tends to be a posteriori in some sense. Anti-naturalists
“conceive of the products of philosophical reflection as a priori” (Kitcher 1992,
p. 57). I use the fuzzy words “in some sense” because psychologism and apriorism
have many different meanings. Thus, labeling a position “psychologistic” or
“aprioristic” tells us little about it until further details are brought forward.
Kusch (2009) says, “Many authors use the term ‘psychologism’ for what they
perceive as the mistake of identifying non-psychological with psychological
entities.” Thus, “psychologism” identifies an indeterminate range of supposed errors
in which something is improperly labeled “psychological.” The most salient and
historically important forms of psychologism in some way reduce logic or
mathematics to psychology. Here again, there are many forms of the supposed the
error. We can generally speak of “psychologism” when a thinker wishes to draw on
empirical psychology to in some way bolster an epistemological argument.
The term “apriorism” is used when the supposed apriorist denies that facts may
induce change in a set of regulative ideas. This seemingly straightforward statement is
subject to multiple interpretations. Kant had a rather strict test for what is prior. He said,
“Necessity and strict universality, therefore, are infallible tests for distinguishing pure
from empirical knowledge, and are inseparably connected with each other” (Kant 1934,
originally published in 1787, p. 26 [section II of “Introduction”]). Imre Lakatos (1970)
introduced the notion of the “hard core” of a “research program,” which is prior to the
research program and not subject to direct empirical test. If the research program is not
“progressive,” however, we may pitch its hard core in favor of another. It is subject,
therefore, to an indirect test. Lakatos (1976) showed that the logic of “proofs and
refutations” in mathematics is similar to the logic of conjecture and falsification in
empirical sciences. This demonstration tends to weaken the epistemic authority of a
priori reasoning. In an interview, Fritz Machlup criticized the weight his teacher
Ludwig von Mises has given to the distinction between a priori and a posteriori. “You
may call any model a priori because you can ‘build’ the model, according to your own
specifications” (Machlup 1980 p. 9). Citing the physicist Henry Margenau, Machlup
went on to explain that “Construction is always a priori, even if you construe with
some experience in mind. The domain of construction needs constructs and postulated
relationships between constructs, but it is itself not the result of observation; it is a
priori. So you don’t have to take these distinctions so seriously as Mises himself did
and as some of his followers do today” (p. 9). The distinction between a priori and a
posteriori is not always clear and distinct.
Kitcher cites passages in Frege (1980; originally published in 1884) objecting to
the view that mathematical objects are “ideas.” Frege says, “Mathematics is not
concerned with the nature of our mind, and the answer to any question whatsoever in
psychology must be for mathematics a matter of complete indifference” (1980,
p. 105). In so saying, Frege firmly rejected psychologism in mathematics. Frege
influenced Husserl by helping to turn him away from psychologism in logic and
Against representative agent methodology 49
In the first experiment Weinberg et al. (2001) discuss, subjects are presented with
a version of the “Truetemp” hypothetical of academic philosophy originally put
forward by Lehrer (1990). A falling rock rewires Charles’ brain, causing him to have
an unerring sense of the ambient temperature. He is “unaware that his brain has been
altered in this way.” Sometime after this change Charles feels that the temperature in
his room is 71°. Experimental subjects were asked, “Does Charles really know that it
was 71° in the room, or does he only believe it?” (Weinberg et al. 2001, p. 15).
Truetemp is an important part of the epistemology literature. Presumably, “our”
intuition that Charles does not “know” that the temperature is indeed 71 casts doubt
on epistemologies that do not require the knower to know why his or her beliefs are
justified. (These are called “externalist” epistemologies.) Weinberg et al. (2001;
pp 16 and 40) report that East Asian students were much more likely to say that
Charles “only believes” the temperature is 71°. This epistemic diversity calls into question
the notion that “we” have common intuitions upon which philosophers may rely.
In the wake of the seminal article by Weinberg, Nichols, and Stich, several
philosophers have been conducting experiments in epistemology. Experimental
epistemology in the Stich tradition has begun to explore the variety of
epistemological intuitions among humans and, especially, how different cultures
correlate with different epistemological intuitions. Beebe (2010) reviews the
literature. He discusses experiments by Beebe and Buckwalter (forthcoming), Beebe
and Jensen (n.d.), Buckwalter (forthcoming), Cullen (2010), Feltz and Zarpentine
(forthcoming), Knobe (2003), May et al. (2010), Schaffer and Knobe (n.d.), and
Starmans and Friedman (n.d.). In all of these experiments, philosophers are probing
the epistemological intuitions of their subjects though questionnaires similar to that
of the original Weinberg, Nichols, and Stich study.
The experiments reviewed by Beebe are examples of epistemological naturalism.
Facts exposed in the human-subjects laboratory are inputs to the philosopher’s
epistemological reasoning. These experiments have not examined how alternative
social institutions might influence the distribution of opinion. In this sense, they are
individualistic. They form part of the tradition of epistemological naturalism, but not
of social epistemology. Koppl et al. (2008) report on experiments that bring in social
epistemology. Their experiments were designed to reproduce in the human-subjects
laboratory elements of the social structure of forensic science testing in the US and
to compare the current structure to one in which evidence is routinely subject to
independent redundant testing in separate laboratories. A sender, representing a
crime lab, examines evidence and sends a report on that evidence to a receiver, who
represents a jury. The receiver guesses what the evidence was based on the sender
report(s) he or she has received. Receivers have an incentive to guess correctly.
Senders, however, are sometimes given an incentive to send inaccurate reports. This
incentive represents bias that may exist in crime labs. Senders often give accurate
reports even when they have an incentive to send inaccurate reports. They are more
likely to send an inaccurate report, however, the stronger is their incentive to do so.
Koppl, Kurzban, & Kobilinsky compare epistemic performance of the system when
each receiver gets reports from only one sender with the performance when each
receiver gets three independent reports. The first treatment represents the current
structure of forensic science, whereby each crime lab has a monopoly on the testing
and interpretation of the forensic evidence it receives. The second treatment
Against representative agent methodology 51
3 Up with diversity
Recall that D’Agostino (2009) criticized Kitcher (1990) for failing to take the
division of cognitive labor seriously. This criticism comes in the context of social
52 R. Koppl
References
Akerlof, G. A. (1970). The market for ‘Lemons’: quality uncertainty and the market mechanism.
Quarterly Journal of Economics, 84(3), 488–500.
Asch, S. E. (1951). Effects of group pressure upon the modification and distortion of judgement. In H.
Guetzkow (Ed.), Groups, leadership and men. Pittsburgh: Carnegie Press.
Aumann, R. J. (1976). Agreeing to disagree. Annals of Statistics, 4, 1236–1239.
Beebe, J. R. (2010). Experimental epistemology. Accessed at http://experimentalphilosophy.typepad.com/
files/beebe_experimental_epistemology.pdf. Accessed on 20 May 2010.
Beebe, J., & Buckwalter, W. (forthcoming). The epistemic side-effect effect. Mind & Language.
Beebe, J., & Jensen, M. (n.d). Surprising connections between knowledge and intentional action: The
robustness of the epistemic side-effect effect
Berger, P., & Luckmann, T. (1966). The social construction of reality. New York: Anchor Books.
Bikhchandani, S., Hirshleifer, D., & Welch, I. (1992). A theory of fads, fashion, custom, and cultural
change as informational cascades. Journal of Political Economy, 100(5), 992–1026.
Bishop, M. (forthcoming). Reflections on cognitive and epistemic diversity: Does a stich in time save
quine? In Murphy, D. and Bishop M. (ed.), Stephen stich and his critics. Blackwell Press. Accessed at
http://www.fsu.edu/~philo/A%20Stich%20in%20Time.pdf. Accessed on 20 May 2010.
Bloor, D. (1976). Knowledge and social imagery. London: Routledge & Kegan Paul.
Boettke, P. (2007). Methodological pluralism and the austrian school of economics? Accessed at http://
austrianeconomists.typepad.com/weblog/2007/12/methodological.html. Accessed on 10 March 2010.
Brock, W., & Durlauf, S. N. (1999). A formal model of theory choice in science. Economic Theory, 14(1),
113–130.
Buckwalter. (forthcoming). Gender and epistemic intuition.
Against representative agent methodology 53
Lakatos, I. (1970). Falsification and the methodology of scientific research programs. In I. Lakatos & A.
Musgrave (Eds.), Criticism and the growth of knowledge. Cambridge: Cambridge University Press.
Lakatos, I. (1976). Proofs and refutations: the logic of mathematical discovery. Cambridge: Cambridge
University Press.
Latour, B. (1987). Science in action: how to follow scientists and engineers through society. Cambridge:
Harvard University Press.
Latour, B., & Woolgar, S. (1979). Laboratory life. London: Sage.
Lehrer, K. (1990). Theory of knowledge. Boulder and London: Westview Press and Routledge.
Leonard, T. C. (2002). Reflection on rules in science: an invisible hand perspective. Journal of Economic
Methodology, 9(2), 141–168.
Levy, D. M., & Peart, S. J. (2010). Tullock on motivated inquiry: Expert-induced uncertainty disquised as
risk.
Loasby, B. (1976). Choice. Complexity and Ignorance, Cambridge: Cambridge University Press.
Lütge, C. (1999). Naturalized philosophy of science and economic method. In The paideia project: 20th
world congress of philosophy, www.bu.edu/wcp/Papers/Scie/ScieLuet.htm. Accessed on 26 May
2010.
Machlup, F. (1980). An interview with Professor Machlup. Austrian Economics Newsletter, 3(1), 9–12.
Mannheim, K. (1985). Ideology and Utopia: an introduction to the sociology of knowledge. London:
Kegan Paul Trench Trubner & Co.
Marengo, L., & Dosi, G. (2005). Division of labor, organizational coordination and market mechanisms in
collective problem solving. Journal of Economic Behavior and Organization, 58, 303–326.
May, J., Sinnott-Armstrong, W., Hull, J. G., & Zimmerman, A. (2010). Practical interests, relevant
alternatives, and knowledge attributions: an empirical study, Review of Philosophy and Psychology, 1.
McQuade, T. J., & Butos, W. N. (2003). Order-dependent knowledge and the economics of science.
Review of Austrian Economics, 16(2/3), 133–152.
Merton, R. K. (1957). “Science and the Social Order”, in his Social Theory and Social Structure, revised
and enlarged edition. New York: The Free Press.
Milgrom, P., & Roberts, J. (1986). Relying on information of interested parties. The Rand Journal of
Economics, 17(1), 18–32.
Mirowski, P., & Sent, E.-M. (ed.). (2002). Science bought and sold: Essays in the economics of science.
Chicago: University of Chicago Press.
von Mises, L. (1935). Economic calculation in the socialist commonwealth. In F. A. Hayek (Ed.),
Collectivist economic planning. London: George Routledge & Sons, Ltd.
Mohanty, J. (1982). Husserl and Frege. Bloomington, Indiana: Indiana University Press.
Polanyi, M. (1969). The republic of science: its political and economic theory. In M. Green (Ed.),
Knowing and being: essays by Michael Polanyi (pp. 49–72). Chicago: University of Chicago Press.
Prendergast, C. (1986). Alfred Schutz and the Austrian school of economics. The American Journal of
Sociology, 92, 1–26.
Prendergast, C. (2001). By way of deduction: Schütz’s essay on taxation. Review of Austrian Economics,
14(2/3), 145–156.
Quine, W. V. O. (1969). “Epistemology Naturalized”, in ontological relativity and other essays (pp. 69–
90). Columbia University Press: New York.
Rescher, N. (1978). Scientific progress: a philosophical essay on the economics of research in natural
science. Pittsburgh: University of Pittsburgh Press.
Rosenthal, R. (1966). Experimenter effects in behavioral research. New York: Appleton-Century-Crofts.
Rosenthal, R. (1978). How often are our numbers wrong? The American Psychologist, 33(11), 1005–
1008.
Schaffer, J., & Knobe, J. (n.d). Contrastive knowledge surveyed.
Schutz, A. (1962). On multiple realities. In Natanson M. (ed.), Alfred schutz: Collected papers I. The
Hague/Boston/London: Marinus Nijhoff, pp. 207-259 (this essay was originally published in
Philosophy and Phenomenological Research 13, 1953).
Schutz, A. (1967). the phenomenology of the social world, translated by George Walsh and Frederick
Lehnert. Evanston, Illinois: Northwestern University Press.
Schutz, A. (1975). Phenomenology and the foundations of the social sciences (Ideas, Volume III by
Edmund Husserl). In Schutz I. (ed.), Alfred schutz: collected papers III. The Hague: Marinus Nijhoff,
pp. 40-50 (this essay was originally published in Philosophy and Phenomenological Research 5,
1945)
Simon, H. A. (1969). The sciences of the artificial. Cambridge, MA: MIT Press.
Starmans, C., & Friedman, O. (n. d). A sex difference in adults’ attributions of knowledge. manuscript.
Against representative agent methodology 55