CaltechAUTHORS
  A Caltech Library Service

Prediction Versus Accommodation and the Risk of Overfitting

Hitchcock, Christopher and Sober, Elliot (2004) Prediction Versus Accommodation and the Risk of Overfitting. British Journal for the Philisophy of Science, 55 (1). pp. 1-34. ISSN 0007-0882 . http://resolver.caltech.edu/CaltechAUTHORS:20111012-100623382

Full text is not posted in this repository. Consult Related URLs below.

Use this Persistent URL to link to this item: http://resolver.caltech.edu/CaltechAUTHORS:20111012-100623382

Abstract

When a scientist uses an observation to formulate a theory, it is no surprise that the resulting theory accurately captures that observation. However, when the theory makes a novel prediction—when it predicts an observation that was not used in its formulation—this seems to provide more substantial confirmation of the theory. This paper presents a new approach to the vexed problem of understanding the epistemic difference between prediction and accommodation. In fact, there are several problems that need to be disentangled; in all of them, the key is the concept of overfitting. We float the hypothesis that accommodation is a defective methodology only when the methods used to accommodate the data fail to guard against the risk of overfitting. We connect our analysis with the proposals that other philosophers have made. We also discuss its bearing on the conflict between instrumentalism and scientific realism.


Item Type:Article
Related URLs:
URLURL TypeDescription
http://dx.doi.org/10.1093/bjps/55.1.1DOIUNSPECIFIED
http://bjps.oxfordjournals.org/content/55/1/1.abstractPublisherUNSPECIFIED
Additional Information:© 2004 British Society for the Philosophy of Science. We thank Jed Buchwald, Mark Colyvan, Ellery Eells, Malcolm Forster, Mathias Frisch, Alan Hájek, Matthias Hild, Brian Keeley, Peter Lipton, Cornelius Menke, Jim Woodward, John Worrall and an anonymous referee for useful discussion.
Record Number:CaltechAUTHORS:20111012-100623382
Persistent URL:http://resolver.caltech.edu/CaltechAUTHORS:20111012-100623382
Usage Policy:No commercial reproduction, distribution, display or performance rights in this work are provided.
ID Code:27182
Collection:CaltechAUTHORS
Deposited By: Jason Perez
Deposited On:12 Oct 2011 19:59
Last Modified:08 Apr 2014 17:27

Repository Staff Only: item control page