Frequentist MCMC
Some definitions are introduced and exemplified that may help to relate Bayesian statistics to frequentist statistics. The idea is interesting. More work is required.
Practical implications would be:
- Opens up the possibility to use MCMC algorithms sampling parameters given data, e.g., Stan or WinBUGS, for frequentist hypothesis testing.
Conceptual implications would be:
- Formally relate results from Bayesian statistics to those from frequentist statistics.
- Define approaches and situations, in which frequentist and Bayesian approaches give identical results, or to explain differences obtained with different approaches.
References:
- Kass RE, Wasserman L (1996) The Selection of Prior Distributions by Formal Rules. JASA, 91 (435), 1343-1370
- Berger, James. "The case for objective Bayesian analysis." Bayesian Analysis 1.3 (2006): 385-402.
- Bernardo, José M. "Intrinsic credible regions: An objective Bayesian approach to interval estimation." Test 14.2 (2005): 317-384.
- Efron, Bradley. "A 250-year argument: Belief, behavior, and the bootstrap." Bulletin of the American Mathematical Society 50.1 (2013): 129-146.
- Berger, James O, Brunero Liseo, and Robert L Wolpert. "Integrated likelihood methods for eliminating nuisance parameters." Statistical Science 14.1 (1999): 1-28.
- Severini, Thomas A. "Integrated likelihood functions for non-Bayesian inference." Biometrika 94.3 (2007): 529-542.
- Berger, James O, José M Bernardo, and Dongchu Sun. "The formal definition of reference priors." The Annals of Statistics (2009): 905-938.
- Bjørnstad, Jan F. "On the generalization of the likelihood function and the likelihood principle." Journal of the American Statistical Association 91.434 (1996): 791-806.