Table of Contents
Fetching ...

E-values as statistical evidence: A comparison to Bayes factors, likelihoods, and p-values

Ben Chugg, Aaditya Ramdas, Peter Grünwald

Abstract

A recurring debate in the philosophy of statistics concerns what, exactly, should count as a measure of evidence for or against a given hypothesis. P-values, likelihood ratios, and Bayes factors all have their defenders. In this paper we add two additional candidates to this list: the e-value and its sequential analogue, the e-process. E-values enjoy several desirable properties as measures of evidence: they combine naturally across studies, handle composite hypotheses, provide long-run error rates, and admit a useful interpretation as the wealth accrued by a bettor in a game against the null distribution. E-processes additionally handle optional stopping and optional continuation. This work examines the extent to which e-values and e-processes satisfy the evidential desiderata of different statistical traditions, concluding that they combine attractive features of p-values, likelihood ratios, and Bayes factors, and merit serious consideration as interpretable and intuitive measures of statistical evidence.

E-values as statistical evidence: A comparison to Bayes factors, likelihoods, and p-values

Abstract

A recurring debate in the philosophy of statistics concerns what, exactly, should count as a measure of evidence for or against a given hypothesis. P-values, likelihood ratios, and Bayes factors all have their defenders. In this paper we add two additional candidates to this list: the e-value and its sequential analogue, the e-process. E-values enjoy several desirable properties as measures of evidence: they combine naturally across studies, handle composite hypotheses, provide long-run error rates, and admit a useful interpretation as the wealth accrued by a bettor in a game against the null distribution. E-processes additionally handle optional stopping and optional continuation. This work examines the extent to which e-values and e-processes satisfy the evidential desiderata of different statistical traditions, concluding that they combine attractive features of p-values, likelihood ratios, and Bayes factors, and merit serious consideration as interpretable and intuitive measures of statistical evidence.

Paper Structure

This paper contains 20 sections, 12 equations, 1 table.

Theorems & Definitions (11)

  • Example 1
  • Example 2: Likelihood ratio
  • Example 3: Gaussian e-variable
  • Example 4
  • Example 5: Universal inference
  • Example 6: t-test Bayes factor
  • Example 7: Bounded mean testing
  • Example 8
  • Example 9: Example \ref{['ex:oc']}, continued
  • Example 10
  • ...and 1 more