Skip to main content
Log in

Optimal hypothesis testing: from semi to fully Bayes factors

  • Published:
Metrika Aims and scope Submit manuscript

Abstract

We propose and examine statistical test-strategies that are somewhat between the maximum likelihood ratio and Bayes factor methods that are well addressed in the literature. The paper shows an optimality of the proposed tests of hypothesis. We demonstrate that our approach can be easily applied to practical studies, because execution of the tests does not require deriving of asymptotical analytical solutions regarding the type I error. However, when the proposed method is utilized, the classical significance level of tests can be controlled.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • Aitkin M (1991) Posterior Bayes factors. J R Stat Soc B 53: 111–142

    MATH  Google Scholar 

  • Berger JO (1993) Statistical decision theory and bayesian analysis, 2nd edn. Springer Series in Statistics, New York

    Google Scholar 

  • Brown RL, Durbin J, Evans JM (1975) Techniques for testing the constancy of regression relationships over time (with discussion). J R Stat Soc B 37: 149–192

    MATH  MathSciNet  Google Scholar 

  • Fisher RA (1925) Statistical methods for research workers, 1st edn. Oliver and Boyd, Edinburgh

    Google Scholar 

  • Gelfand AE, Dey DK (1994) Bayesian model choice: asymptotics and exact calculations. J R Stat Soc B 56: 501–514

    MATH  MathSciNet  Google Scholar 

  • Green PJ (1990) On use of the EM for penalized likelihood estimation.. J R Stat Soc B 52: 443–452

    MATH  Google Scholar 

  • Kass RE, Wasserman L (1995) A reference Bayesian test for nested hypotheses and its relationship to the Schwarz criterion. J Am Stat Assoc 90: 928–934

    Article  MATH  MathSciNet  Google Scholar 

  • Krieger AM, Pollak M, Yakir B (2003) Surveillance of a simple linear regression. J Am Stat Assoc 98: 456–469

    Article  MATH  MathSciNet  Google Scholar 

  • Lehmann EL, Romano JP (2005) Testing statistical hypotheses. Springer, New York

    MATH  Google Scholar 

  • Marden JI (2000) Hypothesis testing: from p values to Bayes factors. J Am Stat Assoc 95: 1316–1320

    Article  MATH  MathSciNet  Google Scholar 

  • Neyman J, Pearson E (1928) On the use and interpretation of certain test criteria for purposes of statistical inference: Part I. Biometrika 20A: 175–240

    Google Scholar 

  • Neyman J, Pearson E (1928) On the use and interpretation of certain test criteria for purposes of statistical inference: Part II. Biometrika 20A: 263–294

    Google Scholar 

  • Neyman J, Pearson E (1933) On the testing of statistical hypotheses in relation to probability a priori. Proc Camb Philos Soc 29: 492–510

    Article  Google Scholar 

  • Neyman J, Pearson E (1933) On the problem of the most efficient tests of statistical hypotheses. Philos Trans R Soc A 231: 289–337

    Article  MATH  Google Scholar 

  • Neyman J, Pearson E (1936) Contributions to the theory of testing statistical hypotheses. I. Unbiased critical region of type A and type A. Stat Res Mem 1: 1–37

    Google Scholar 

  • Neyman J, Pearson E (1936) Sufficient statistics and uniformly most powerful tests of statistical hypotheses. Stat Res Mem 1: 113–137

    Google Scholar 

  • Neyman J, Pearson E (1938) Contributions to the theory of testing statistical hypotheses. II. Stat Res Mem 2: 25–57

    Google Scholar 

  • O’Hagan A (1995) Fractional Bayes factors for model comparison. J R Stat Soc B 57: 99–138

    MATH  MathSciNet  Google Scholar 

  • Pearson K (1900) On the criterion that a given system of deviation from the probable in the case of a correlated system of variables is such that it can be reasonably supposed to have arisen from random sampling. Philos Mag Ser 5 50: 157–172

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Kai Fun Yu.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Vexler, A., Wu, C. & Yu, K.F. Optimal hypothesis testing: from semi to fully Bayes factors. Metrika 71, 125–138 (2010). https://doi.org/10.1007/s00184-008-0205-4

Download citation

  • Received:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00184-008-0205-4

Keywords

Navigation