Skip to main content
Log in

Coordinate sampler: a non-reversible Gibbs-like MCMC sampler

  • Published:
Statistics and Computing Aims and scope Submit manuscript

Abstract

We derive a novel non-reversible, continuous-time Markov chain Monte Carlo sampler, called Coordinate Sampler, based on a piecewise deterministic Markov process, which is a variant of the Zigzag sampler of Bierkens et al. (Ann Stat 47(3):1288–1320, 2019). In addition to providing a theoretical validation for this new simulation algorithm, we show that the Markov chain it induces exhibits geometrical ergodicity convergence, for distributions whose tails decay at least as fast as an exponential distribution and at most as fast as a Gaussian distribution. Several numerical examples highlight that our coordinate sampler is more efficient than the Zigzag sampler, in terms of effective sample size.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Similar content being viewed by others

References

  • Bierkens, J., Bouchard-Côté, A., Doucet, A., Duncan, A.B., Fearnhead, P., Lienart, T., Roberts, G., Vollmer, S.J.: Piecewise deterministic Markov processes for scalable Monte Carlo on restricted domains. Stat. Probab. Lett. 136, 148–154 (2018)

    Article  MathSciNet  Google Scholar 

  • Bierkens, J., Fearnhead, P., Roberts, G.: The Zig-zag process and super-efficient sampling for Bayesian analysis of big data. Ann. Stat. 47(3), 1288–1320 (2019)

    Article  MathSciNet  Google Scholar 

  • Bierkens, J., Roberts, G., et al.: A piecewise deterministic scaling limit of lifted Metropolis-Hastings in the Curie–Weiss model. Ann. Appl. Probab. 27(2), 846–882 (2017)

    Article  MathSciNet  Google Scholar 

  • Bouchard-Côté, A., Vollmer, S.J., Doucet, A.: The bouncy particle sampler: a nonreversible rejection-free Markov chain Monte Carlo method. J. Am. Stat. Assoc. 13, 1–13 (2018)

    MathSciNet  MATH  Google Scholar 

  • Davis, M.H.: Piecewise-deterministic Markov processes: a general class of non-diffusion stochastic models. J. R. Stat. Soc. Ser. B Methodol. 46(3), 353–388 (1984)

    MathSciNet  MATH  Google Scholar 

  • Davis, M.H.: Markov Models and Optimization, vol. 49. CRC Press, Boca Raton (1993)

    Book  Google Scholar 

  • Deligiannidis, G., Bouchard-Côté, A., Doucet, A.: Exponential ergodicity of the bouncy particle sampler. Ann. Stat. 47(3), 1268–1287 (2019)

    Article  MathSciNet  Google Scholar 

  • Fearnhead, P., Bierkens, J., Pollock, M., Roberts, G.O., et al.: Piecewise deterministic Markov processes for continuous-time Monte Carlo. Stat. Sci. 33(3), 386–412 (2018)

    Article  MathSciNet  Google Scholar 

  • Fontbona, J., Guérin, H., Malrieu, F.: Long time behavior of telegraph processes under convex potentials. Stoch. Process. Appl. 126(10), 3077–3101 (2016)

    Article  MathSciNet  Google Scholar 

  • Galbraith, N.: On event-chain Monte Carlo methods. Master’s thesis, Department of Statistics, Oxford University, p. 9 (2016)

  • Girolami, M., Calderhead, B.: Riemann manifold Langevin and Hamiltonian Monte Carlo methods. J. R. Stat. Soc. Ser. B Stat. Methodol. 73(2), 123–214 (2011)

    Article  MathSciNet  Google Scholar 

  • Glynn, P.W., Haas, P.J.: Laws of large numbers and functional central limit theorems for generalized semi-Markov processes. Stoch. Models 22(2), 201–231 (2006)

    Article  MathSciNet  Google Scholar 

  • Harland, J., Michel, M., Kampmann, T.A., Kierfeld, J.: Event-chain Monte Carlo algorithms for three-and many-particle interactions. EPL Europhys. Lett. 117(3), 30001 (2017)

    Article  Google Scholar 

  • Hastings, W.K.: Monte Carlo sampling methods using Markov chains and their applications. Biometrika 57(1), 97–109 (1970)

    Article  MathSciNet  Google Scholar 

  • Kingman, J.F.C.: Poisson Processes, vol. 3. Clarendon Press, Oxford (1992)

    MATH  Google Scholar 

  • Lewis, P.A., Shedler, G.S.: Simulation of nonhomogeneous Poisson processes by thinning. Naval Res. Logist. 26(3), 403–413 (1979)

    Article  MathSciNet  Google Scholar 

  • Liu, J.S.: Monte Carlo Strategies in Scientific Computing. Springer, Berlin (2008)

    MATH  Google Scholar 

  • Metropolis, N., Rosenbluth, A.W., Rosenbluth, M.N., Teller, A.H., Teller, E.: Equation of state calculations by fast computing machines. J. Chem. Phys. 21(6), 1087–1092 (1953)

    Article  Google Scholar 

  • Michel, M., Kapfer, S.C., Krauth, W.: Generalized event-chain Monte Carlo: constructing rejection-free global-balance algorithms from infinitesimal steps. J. Chem. Phys. 140(5), 054116 (2014)

    Article  Google Scholar 

  • Michel, M., Sénécal, S.: Forward event-chain Monte Carlo: a general rejection-free and irreversible Markov chain simulation method. arXiv preprint arXiv:1702.08397 (2017)

  • Neal, R.M., et al.: MCMC using Hamiltonian dynamics. In: Brooks, S., Gelman, A., Jones, G., Meng, X.-L. (eds.) Handbook of Markov Chain Monte Carlo, vol. 2(11). CRC, New York (2011)

    Google Scholar 

  • Pakman, A., Gilboa, D., Carlson, D., Paninski, L.: Stochastic bouncy particle sampler. In: Proceedings of the 34th International Conference on Machine Learning, PMLR, vol. 70, pp. 2741–2750 (2017)

  • Peters, E.A., et al.: Rejection-free Monte Carlo sampling for general potentials. Phys. Rev. E 85(2), 026703 (2012)

    Article  Google Scholar 

  • Robert, C.P., Casella, G.: Monte Carlo Statistical Methods. Springer, New York (2004)

    Book  Google Scholar 

  • Sherlock, C., Thiery, A.H.: A Discrete Bouncy Particle Sampler. arXiv preprint arXiv:1707.05200 (2017)

  • Vanetti, P., Bouchard-Côté, A., Deligiannidis, G., Doucet, A.: Piecewise Deterministic Markov Chain Monte Carlo. arXiv preprint arXiv:1707.05296 (2017)

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Christian P. Robert.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Electronic supplementary material

Below is the link to the electronic supplementary material.

Supplementary material 1 (pdf 358 KB)

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Wu, C., Robert, C.P. Coordinate sampler: a non-reversible Gibbs-like MCMC sampler. Stat Comput 30, 721–730 (2020). https://doi.org/10.1007/s11222-019-09913-w

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11222-019-09913-w

Keywords

Navigation