Professional Documents
Culture Documents
Epistemology 1 : Introducing
Credences Michael G. Titelbaum
Visit to download the full and correct content document:
https://ebookmass.com/product/fundamentals-of-bayesian-epistemology-1-introducin
g-credences-michael-g-titelbaum/
Fundamentals of Bayesian Epistemology
1
Fundamentals of Bayesian
Epistemology 1
Introducing Credences
M I C H A E L G . T I T E L B AU M
Great Clarendon Street, Oxford, OX2 6DP, United Kingdom
Oxford University Press is a department of the University of Oxford.
It furthers the University’s objective of excellence in research, scholarship, and education by
publishing worldwide. Oxford is a registered trade mark of Oxford University Press in the UK
and in certain other countries
© Michael G. Titelbaum 2022
The moral rights of the author have been asserted
First Edition published in 2022
Impression:
All rights reserved. No part of this publication may be reproduced, stored in a retrieval
system, or transmitted, in any form or by any means, without the prior permission in
writing of Oxford University Press, or as expressly permitted by law, by licence or under
terms agreed with the appropriate reprographics rights organization. Enquiries concerning
reproduction outside the scope of the above should be sent to the Rights Department,
Oxford University Press, at the address above
You must not circulate this work in any other form and you must impose this same
condition on any acquirer
Published in the United States of America by Oxford University Press 198 Madison Avenue,
New York, NY 10016, United States of America
British Library Cataloguing in Publication Data
Data available
Library of Congress Control Number: 2021949533
ISBN 978-0-19-870760-8 (hbk.)
ISBN 978-0-19-870761-5 (pbk.)
ebook ISBN 978–0–19–101726–1
DOI: 10.1093/oso/9780198707608.001.0001
Printed and bound by CPI Group (UK) Ltd, Croydon, CR0 4YY
Links to third party websites are provided by Oxford in good faith and for information only.
Oxford disclaims any responsibility for the materials contained in any third party website
referenced in this work.
to Colleen
without whom nothing is possible
Contents
Quick Reference
Preface
0.1 What’s in this book
0.2 How to read—and teach—this book
0.3 Acknowledgments
VOLUME 1
I. OUR SUBJECT
2. Probability Distributions
2.1 Propositions and propositional logic
2.1.1 Relations among propositions
2.1.2 State-descriptions
2.1.3 Predicate logic
2.2 The probability axioms
2.2.1 Consequences of the probability axioms
2.2.2 A Bayesian approach to the Lottery scenario
2.2.3 Doxastic possibilities
2.2.4 Probabilities are weird! The Conjunction Fallacy
2.3 Alternative representations of probability
2.3.1 Probabilities in Venn diagrams
2.3.2 Probability tables
2.3.3 Using probability tables
2.3.4 Odds
2.4 What the probability calculus adds
2.5 Exercises
2.6 Further reading
3. Conditional Credences
3.1 Conditional credences and the Ratio Formula
3.1.1 The Ratio Formula
3.1.2 Consequences of the Ratio Formula
3.1.3 Bayes’s Theorem
3.2 Relevance and independence
3.2.1 Conditional independence and screening off
3.2.2 The Gambler’s Fallacy
3.2.3 Probabilities are weird! Simpson’s Paradox
3.2.4 Correlation and causation
3.3 Conditional credences and conditionals
3.4 Exercises
3.5 Further reading
4. Updating by Conditionalization
4.1 Conditionalization
4.1.1 Consequences of Conditionalization
4.1.2 Probabilities are weird! The Base Rate Fallacy
4.2 Evidence and certainty
4.2.1 Probabilities are weird! Total Evidence and the Monty
Hall Problem
4.3 Priors and standards
4.3.1 Initial priors
4.3.2 Epistemic standards
4.3.3 Hypothetical priors
4.4 Exercises
4.5 Further reading
5. Further Rational Constraints
5.1 Subjective and Objective Bayesianism
5.1.1 Frequencies and propensities
5.1.2 Two distinctions in Bayesianism
5.2 Deference principles
5.2.1 The Principal Principle
5.2.2 Expert principles and Reflection
5.3 The Principle of Indifference
5.4 Credences for infinitely many possibilities
5.5 Jeffrey Conditionalization
5.6 Exercises
5.7 Further reading
QUICK REFERENCE
VOLUME 2
III. APPLICATIONS
6. Confirmation
6.1 Formal features of the confirmation relation
6.1.1 Confirmation is weird! The Paradox of the Ravens
6.1.2 Further adequacy conditions
6.2 Carnap’s theory of confirmation
6.2.1 Confirmation as relevance
6.2.2 Finding the right function
6.3 Grue
6.4 Subjective Bayesian confirmation
6.4.1 Confirmation measures
6.4.2 Subjective Bayesian solutions to the Paradox of the
Ravens
6.5 Exercises
6.6 Further reading
7. Decision Theory
7.1 Calculating expectations
7.1.1 The move to utility
7.2 Expected utility theory
7.2.1 Preference rankings and money pumps
7.2.2 Savage’s expected utility
7.2.3 Jeffrey’s theory
7.2.4 Risk aversion and Allais’ Paradox
7.3 Causal Decision Theory
7.3.1 Newcomb’s Problem
7.3.2 A causal approach
7.3.3 Responses and extensions
7.4 Exercises
7.5 Further reading
8. Representation Theorems
8.1 Ramsey’s four-step process
8.2 Savage’s representation theorem
8.3 Representation theorems and probabilism
8.3.1 Objections to the argument
8.3.2 Reformulating the argument
8.4 Exercises
8.5 Further reading
9. Dutch Book Arguments
9.1 Dutch Books
9.1.1 Dutch Books for probabilism
9.1.2 Further Dutch Books
9.2 The Dutch Book Argument
9.2.1 Dutch Books depragmatized
9.3 Objections to Dutch Book Arguments
9.3.1 The Package Principle
9.3.2 Dutch Strategy objections
9.4 Exercises
9.5 Further reading
10. Accuracy Arguments
10.1 Accuracy as calibration
10.2 The gradational accuracy argument for probabilism
10.2.1 The Brier score
10.2.2 Joyce’s accuracy argument for probabilism
10.3 Objections to the accuracy argument for probabilism
10.3.1 The absolute-value score
10.3.2 Proper scoring rules
10.3.3 Are improper rules unacceptable?
10.4 Do we really need Finite Additivity?
10.5 An accuracy argument for Conditionalization
10.6 Exercises
10.7 Further reading
When I played junior varsity basketball in high school, our coach was
always yelling at us about “the fundamentals”. What my teammates
and I derisively called “the fundies”—shooting, passing, dribbling—
wouldn’t win you a game by themselves. But without them, you’d
have no chance of winning.
This book aims to teach you the fundamentals of Bayesian
epistemology. It won’t necessarily put you in a position to produce
cutting-edge research in the area. But I hope that after reading this
book you’ll be able to pick up an article that uses the tools of
Bayesian epistemology and understand what it says.
The word “Bayesian” is now familiar to academics across such
diverse fields as statistics, economics, psychology, cognitive science,
artificial intelligence, and even “legal probabilism” in the law.
Bayesianism contains a few core notions across all of these fields:
priors and posteriors, the probability calculus, updating by
conditionalization. This book will introduce all of those core ideas.
Still, this book was written by a philosopher, and a philosopher
with particular interests and areas of expertise. While I will make
some allusions to those other fields, and will certainly draw
connections to disparate parts of philosophy, I will focus on Bayesian
epistemology—roughly, the idea that an agent has numerical
degrees of belief subject to normative constraints based on
probability mathematics. And I will examine Bayesian epistemology
from a philosopher’s point of view, asking the kinds of questions
about it a philosopher would be interested in, and providing
arguments in an analytic philosophical style.
For that reason, it will probably be easier to read this book if you
have some background in philosophy (though that’s not strictly
necessary). As far as the mathematics goes, only a solid
understanding of high-school level algebra will be assumed (except
in Section 5.4). Chapter 2 quickly reviews the portions of elementary
deductive logic—most of sentential logic, plus a bit of predicate logic
—that will be needed later. If you’ve never had any exposure to
formal logic, you might want to peruse an introductory text in that
area before proceeding.
0.1 What’s in this book
After this preface, the book has five parts. The first two parts appear
in Volume 1, while the final three are in Volume 2. The first part,
consisting of Chapter 1, defines a Bayesian epistemology as any
theory adhering to two principles:
0.3 Acknowledgments
Below I’ve acknowledged everyone I can remember who provided
advice on this book, answered my questions about the material,
read a portion of it, taught it to their class, gave me notes on the
text, or contributed in any other way. My apologies to anyone who
should have appeared on this list but fell victim to my haphazard
note-keeping process. Before providing the list, I want to single out
a few resources and people for their special contributions. In writing
the book I have relied on previous texts on aspects of Bayesianism,
including Earman (1992), Skyrms (2000), Hacking (2001), Howson
and Urbach (2006), Weisberg (2009), Bradley (2015), Talbott
(2016), and unpublished lecture notes by Michael Strevens and Brian
Weatherson. Galavotti (2005) is a phenomenal account of the history
of Bayesian thought that I can’t recommend highly enough. I am
grateful to my editor, Peter Momtchiloff, who has been incredibly
patient through this book’s long gestation process; and to his Oxford
University Press team and the referees and advisors whom he
consulted along the way. Shimin Zhao read the final manuscript for
me, wrote solutions to all the exercises, and improved the ultimate
product in myriad ways. Shimin also checked the proofs with me.
David Makinson encountered this book in a seminar he was
attending, and without provocation conferred the great benefit of
page-by-page comments on the entire manuscript as it existed at
that time. Most importantly, Branden Fitelson introduced me to all of
this material in the first place, shaped my thinking about it in ways I
can’t begin to recognize, and has been a dear friend and mentor
ever since.
And now the list. My thanks to David Alexander, Dallas Amico,
Yuval Avnur, Michael Barkasi, Joseph Barnes, Zach Barnett, Marty
Barrett, Elizabeth Bell, John Bengson, JC. Bjerring, David Black,
Darren Bradley, Seamus Bradley, R.A. Briggs, Stuart Brock, Lara
Buchak, David Builes, Michael Caie, Catrin Campbell-Moore, Fabrizio
Cariani, Jennifer Carr, Lisa Cassell, Clinton Castro, Jake Chandler,
Isaac Choi, David Christensen, Hayley Clatterbuck, Nevin
Climenhaga, Stew Cohen, Mark Colyvan, Juan Comesaña, Vincenzo
Crupi, Martin Curd, Lars Dänzer, Glauber De Bona, Finnur Dellséen,
Nick DiBella, Josh DiPaolo, Sinan Dogramaci, Kevin Dorst, Billy
Dunaway, Kenny Easwaran, Philip Ebert, Andy Egan, Adam Elga,
Jordan Ellenberg, Nic Fillion, Malcolm Forster, Melissa Fusco, Dmitri
Gallow, Greg Gandenberger, Michał Godziszewski, Simon Goldstein,
Daniel Greco, Max Griffin, Alba Guijarro, Alan Hájek, Jacqueline
Harding, Casey Hart, Stephan Hartmann, Dan Hausman, Brian
Hedden, Sophie Horowitz, Franz Huber, Liz Jackson, Pavel Janda, Jim
Joyce, Mark Kaplan, Andrew Kernohan, Patrick Klug, Jason Konek,
Matt Kopec, Johannes Korbmacher, Stephan Krämer, Jon Kvanvig,
Tamar Lando, Bill Lawson, Hannes Leitgeb, Ben Lennertz, Ben
Levinstein, Hanti Lin, Clayton Littlejohn, Tracy Lupher, Aidan Lyon,
Amanda MacAskill, John MacFarlane, John Mackay, Anna Mahtani,
Barry Maguire, Anna-Sara Malmgren, Conor Mayo-Wilson, David
McCarthy, Tim McGrew, Brian McLoone, Chris Meacham, Silvia
Milano, Peter Milne, Andrew Moon, Sarah Moss, Corey Mulvihill,
André Neiva, Dilip Ninan, Ittay Nissan, Shannon Nolen, Samir
Okasha, Jeff Paris, Sarah Paul, Carlotta Pavese, Trevor Pearce,
Richard Pettigrew, Ted Poston, Vishal Prasad, Thomas Raleigh, Rosa
Runhardt, Joe Salerno, Richard Samuels, Paolo Santorio, Joshua
Schechter, Miriam Schoenfield, Jonah Schupbach, Teddy Seidenfeld,
Glenn Shafer, Larry Shapiro, Alan Sidelle, Paul Silva, Rory Smead,
Elliott Sober, Julia Staffel, Orri Stefáansson, Reuben Stern, Brian
Talbot, David Thorstad, Brett Topey, Aron Vallinder, Brandt van der
Gaast, Steven van Enk, Olav Vassend, Joel Velasco, Susan Vineberg,
Justin Vlastis, Jonathan Vogel, Peter Vranas, Christian Wallmann,
Petra Walta, Naftali Weinberger, Paul Weirich, Jonathan Weisberg,
Roger White, Robbie Williams, Seth Yalcin; my students in
Philosophy 504 and Philosophy 903 at the University of Wisconsin-
Madison, and a Foundations seminar at the Australian National
University; anyone I haven’t yet listed who’s ever attended the
Formal Epistemology Workshop; my philosophy colleagues at the
University of Wisconsin-Madison; and funding from the Australian
National University, the Marc Sanders Foundation, and the following
organizations affiliated with the University of Wisconsin-Madison: the
Wisconsin Alumni Research Foundation, the Vilas Trust, the Office of
the Vice Chancellor for Research and Graduate Education, and the
Institute for Research in the Humanities.
As the length of this list should indicate, philosophy is a
community. It has been much critiqued—in part because it’s our job
to critique things, and in part because there are genuine, significant
problems within that community. But it is also incredibly valuable,
and that value should not be overlooked. Every piece of philosophy I
have ever written has been dramatically improved by other members
of the philosophy community: friends, colleagues, correspondents,
audience members at conferences, etc. The formal epistemology
community in particular has helped me at every step of this project,
and is composed of a remarkably generous, intelligent, well-
informed group of scholars. 3 Still, as this book will make apparent,
there are many open questions right at the surface of our subject. If
you finish the book and find yourself interested in pursuing any of
them further, we invite you to join us.
Finally, I should add that while I am indebted to those listed here
for their invaluable help, I am sure there remain errors in the main
text, for which I assign sole responsibility to David Makinson.
Notes
1. Thanks to Joel Velasco for excellent advice on what teachers will want to
know about this book, and to Maria Debowsky for the peppers icon and
attendant LaTex code.
2. If you’d like to know how I personally prefer to build a formal Bayesian model,
see Titelbaum (2013a).
3. At the beginning of his (2004), Richard Jeffrey recalls being introduced to
Bayesianism by Carnap and Hempel. He writes that they were “the sweetest
guys in the world. It seems to go with the territory.” I couldn’t agree more.
PART I
UR SUBJECT
1
Beliefs and Degrees of Belief
Classificatory concepts are those which serve for the classification of things
or cases into two or a few [kinds]…. Quantitative concepts… are those
which serve for characterizing things or events or certain of their features by
the ascription of numerical values…. Comparative concepts… stand between
the two other kinds…. [They] serve for the formulation of the result of a
comparison in the form of a more-less-statement without the use of
numerical values. (p. 9)
A fair lottery has sold one million tickets. Because of the poor odds, an
agent who has purchased a ticket believes her ticket will not win. She also
believes, of each other ticket purchased in the lottery, that it will not win.
Nevertheless, she believes that at least one purchased ticket will win. 6
The beliefs attributed to the agent in the story seem rational. Yet
these beliefs are logically inconsistent—you cannot consistently
believe that at least one ticket will win while believing of each ticket
that it will lose. So if the agent’s beliefs in the story are rationally
permissible, we have a counterexample to Belief Consistency.
Moreover, if we focus just on the agent’s beliefs about the individual
tickets, that set of beliefs entails that none of the tickets will win. Yet
it seems irrational for the agent to believe that no ticket will win. So
the Lottery also provides a counterexample to Belief Closure.
Some defenders of Belief Consistency and Closure have
responded that, strictly speaking, it is irrational for the agent in the
Lottery to believe her ticket will lose. (If you believe your ticket will
lose, why buy it to begin with?) 7 If true, this resolves the problem.
But it’s difficult to resolve Makinson’s (1965) Preface Paradox in a
similar fashion:
You write a long nonfiction book with many claims in its main text, each of
which you believe. In the acknowledgments at the beginning of the book
you write, “While I am indebted to those listed here for their invaluable
help, I am sure there remain errors in the main text, for which I take sole
responsibility.”
To say that you believe a proposition is just to say that you are sufficiently
confident of its truth for your attitude to be one of belief. Then it is rational
for you to believe a proposition just in case it is rational for you to have
sufficiently high degree of confidence in it. (1993, p. 140)
22 7
Thus, without any disfranchisement, or violent displacement, fifteen
boroughs, at present returning twenty-two members, might be formed
into seven respectable constituencies, returning one member each to
Parliament. There are, however, four others—Knaresborough, Evesham,
Reigate, and Andover—which cannot be so easily thrown together. We
would proceed with these on the same principle, by adding them to
boroughs at present returning two members, but which Lord John Russell
proposes to restrict to one member each. The following is our view:—
Present Combined Present Future
County. Borough.
Electors. Electors. Members. Members.
Yorkshire, Knaresborough, 226 2
583 1
„ Ripon, 357 2
Worcester, Evesham, 396 2
755 2
„ Tewkesbury, 359 2
Surrey, Reigate, 297 1
„ Guildford, 595 1124 2 2
Hampshire, Andover, 232 2
13 5
Here there are twenty-three seats set at liberty, without disfranchisement
in any one instance. In justice to ourselves, we must state that we have
implicitly followed the schedule attached to Lord John Russell’s bill, and
not indulged in speculations of our own. Had the latter been the case, we
might have been tempted to ask why Westbury, with an electorate of 289,
is to be spared, while Wells, with 368, is to be blotted from the list of
boroughs?
Besides these, Lord John Russell proposes that thirty other seats shall
be made vacant, by restricting boroughs now returning two members to
one. (His number is thirty-three, but we have already noticed Ripon,
Tewkesbury, and Guildford.) If it could be shown that there is a really
clamant case for representation elsewhere, the reduction might be
allowed, but only to the extent required. It seems to us perfect madness to
proceed with wholesale disfranchisement, until the necessity of
transferring seats to other places is satisfactorily established. We can very
well understand why some of the smaller boroughs which have now two
members should be restricted to one, in order to satisfy the just
requirements of some rising township which has hitherto been
unrepresented. We have no doubt that Lord John Russell is quite right in
his proposals to give members to Birkenhead, Burnley, and Staleybridge,
and to erect Chelsea and Kensington into a Parliamentary borough to
return two members. We think that two additional members each might
be granted to the West Riding of Yorkshire and to the county of Lancaster
—that Salford should return two members instead of one—and that the
London University should be represented. We think that these are rational
demands, and such as might be accorded; and the necessary number for
these purposes, and for putting Scotland on a fair footing of equality with
England and Ireland, would amount to the vacation of about thirty or
thirty-two existing seats. We have already shown how, without entirely
disfranchising any borough, twenty-three seats may be obtained; and if
nine others are required, it would be no hardship to take from each of the
following boroughs one out of the two members which they presently
return:—
Towns. Constituencies.
Birmingham, 8,780
Bristol, 10,958
Bradford, 2,723
Leeds, 6,400
Liverpool, 15,382
Manchester, 17,826
Sheffield, 5,612
Wolverhampton, 3,499
It must strike every one that there can be no principle in this. The
constituencies both of Manchester and Liverpool are more than five times