Abstract
We derive a novel non-reversible, continuous-time Markov chain Monte Carlo sampler, called Coordinate Sampler, based on a piecewise deterministic Markov process, which is a variant of the Zigzag sampler of Bierkens et al. (Ann Stat 47(3):1288–1320, 2019). In addition to providing a theoretical validation for this new simulation algorithm, we show that the Markov chain it induces exhibits geometrical ergodicity convergence, for distributions whose tails decay at least as fast as an exponential distribution and at most as fast as a Gaussian distribution. Several numerical examples highlight that our coordinate sampler is more efficient than the Zigzag sampler, in terms of effective sample size.
Similar content being viewed by others
References
Bierkens, J., Bouchard-Côté, A., Doucet, A., Duncan, A.B., Fearnhead, P., Lienart, T., Roberts, G., Vollmer, S.J.: Piecewise deterministic Markov processes for scalable Monte Carlo on restricted domains. Stat. Probab. Lett. 136, 148–154 (2018)
Bierkens, J., Fearnhead, P., Roberts, G.: The Zig-zag process and super-efficient sampling for Bayesian analysis of big data. Ann. Stat. 47(3), 1288–1320 (2019)
Bierkens, J., Roberts, G., et al.: A piecewise deterministic scaling limit of lifted Metropolis-Hastings in the Curie–Weiss model. Ann. Appl. Probab. 27(2), 846–882 (2017)
Bouchard-Côté, A., Vollmer, S.J., Doucet, A.: The bouncy particle sampler: a nonreversible rejection-free Markov chain Monte Carlo method. J. Am. Stat. Assoc. 13, 1–13 (2018)
Davis, M.H.: Piecewise-deterministic Markov processes: a general class of non-diffusion stochastic models. J. R. Stat. Soc. Ser. B Methodol. 46(3), 353–388 (1984)
Davis, M.H.: Markov Models and Optimization, vol. 49. CRC Press, Boca Raton (1993)
Deligiannidis, G., Bouchard-Côté, A., Doucet, A.: Exponential ergodicity of the bouncy particle sampler. Ann. Stat. 47(3), 1268–1287 (2019)
Fearnhead, P., Bierkens, J., Pollock, M., Roberts, G.O., et al.: Piecewise deterministic Markov processes for continuous-time Monte Carlo. Stat. Sci. 33(3), 386–412 (2018)
Fontbona, J., Guérin, H., Malrieu, F.: Long time behavior of telegraph processes under convex potentials. Stoch. Process. Appl. 126(10), 3077–3101 (2016)
Galbraith, N.: On event-chain Monte Carlo methods. Master’s thesis, Department of Statistics, Oxford University, p. 9 (2016)
Girolami, M., Calderhead, B.: Riemann manifold Langevin and Hamiltonian Monte Carlo methods. J. R. Stat. Soc. Ser. B Stat. Methodol. 73(2), 123–214 (2011)
Glynn, P.W., Haas, P.J.: Laws of large numbers and functional central limit theorems for generalized semi-Markov processes. Stoch. Models 22(2), 201–231 (2006)
Harland, J., Michel, M., Kampmann, T.A., Kierfeld, J.: Event-chain Monte Carlo algorithms for three-and many-particle interactions. EPL Europhys. Lett. 117(3), 30001 (2017)
Hastings, W.K.: Monte Carlo sampling methods using Markov chains and their applications. Biometrika 57(1), 97–109 (1970)
Kingman, J.F.C.: Poisson Processes, vol. 3. Clarendon Press, Oxford (1992)
Lewis, P.A., Shedler, G.S.: Simulation of nonhomogeneous Poisson processes by thinning. Naval Res. Logist. 26(3), 403–413 (1979)
Liu, J.S.: Monte Carlo Strategies in Scientific Computing. Springer, Berlin (2008)
Metropolis, N., Rosenbluth, A.W., Rosenbluth, M.N., Teller, A.H., Teller, E.: Equation of state calculations by fast computing machines. J. Chem. Phys. 21(6), 1087–1092 (1953)
Michel, M., Kapfer, S.C., Krauth, W.: Generalized event-chain Monte Carlo: constructing rejection-free global-balance algorithms from infinitesimal steps. J. Chem. Phys. 140(5), 054116 (2014)
Michel, M., Sénécal, S.: Forward event-chain Monte Carlo: a general rejection-free and irreversible Markov chain simulation method. arXiv preprint arXiv:1702.08397 (2017)
Neal, R.M., et al.: MCMC using Hamiltonian dynamics. In: Brooks, S., Gelman, A., Jones, G., Meng, X.-L. (eds.) Handbook of Markov Chain Monte Carlo, vol. 2(11). CRC, New York (2011)
Pakman, A., Gilboa, D., Carlson, D., Paninski, L.: Stochastic bouncy particle sampler. In: Proceedings of the 34th International Conference on Machine Learning, PMLR, vol. 70, pp. 2741–2750 (2017)
Peters, E.A., et al.: Rejection-free Monte Carlo sampling for general potentials. Phys. Rev. E 85(2), 026703 (2012)
Robert, C.P., Casella, G.: Monte Carlo Statistical Methods. Springer, New York (2004)
Sherlock, C., Thiery, A.H.: A Discrete Bouncy Particle Sampler. arXiv preprint arXiv:1707.05200 (2017)
Vanetti, P., Bouchard-Côté, A., Deligiannidis, G., Doucet, A.: Piecewise Deterministic Markov Chain Monte Carlo. arXiv preprint arXiv:1707.05296 (2017)
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Electronic supplementary material
Below is the link to the electronic supplementary material.
Rights and permissions
About this article
Cite this article
Wu, C., Robert, C.P. Coordinate sampler: a non-reversible Gibbs-like MCMC sampler. Stat Comput 30, 721–730 (2020). https://doi.org/10.1007/s11222-019-09913-w
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11222-019-09913-w