Skip to main content
Log in

Pseudo-Likelihood or Quadrature? What We Thought We Knew, What We Think We Know, and What We Are Still Trying to Figure Out

  • Published:
Journal of Agricultural, Biological and Environmental Statistics Aims and scope Submit manuscript

Abstract

Two predominant computing methods for generalized linear mixed models (GLMMs) are linearization, e.g., pseudo-likelihood (PL), and integral approximation, e.g., Gauss–Hermite quadrature. The primary GLMM package in R, LME4, only uses integral approximation. The primary GLMM procedure in SAS®, PROC GLIMMIX, was originally developed using linearization, but integral approximation methods were added in the 2008 release. This presents a dilemma for GLMM users: Which method should one use, and why? Linearization methods are more versatile and able to handle both conditional and marginal GLMMs. Linearization can be implemented with REML-like variance component estimation, whereas quadrature is strictly maximum likelihood. However, GLMM software documentation and the literature on which it is based tend to focus on linearization’s limitations. Stroup (Generalized linear mixed models: modern concepts, methods and applications, CRC Press, Boca Raton, 2013) reiterates this theme in his GLMM textbook. As a result, “conventional wisdom” has arisen that integral approximation—quadrature when possible—is always best. Meanwhile, ongoing experience with GLMMs and research about their small sample behavior suggest that “conventional wisdom” circa 2013 is often not true. Above all, it is clear there is no one-size-fits-all best method. The purpose of this paper is to provide an updated look at what we now know about quadrature and PL and to offer some general operating principles for making an informed choice between the two. A series of simulation studies investigating distributions and designs representative of research in agricultural and related disciplines provide an overview of each method with respect to estimation accuracy, type I error control, and robustness (or lack thereof) to model misspecification.

Supplementary materials accompanying this paper appear online.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2

Similar content being viewed by others

References

  • Bolker, B.M., Brooks, M.E., Clark, C.J. Geange, S.M., Poulsen, J.R., Stevens, H.H, and White, J.S. (2009) Generalized linear mixed models: a practical guide for ecology and evolution. Trends in Ecology & Evolution. 24:3: 127–135.

    Article  Google Scholar 

  • Breslow, N. E., and Clayton, D. G. (1993). “Approximate Inference in Generalized Linear Mixed Models.” Journal of the American Statistical Association 88:9–25.

    MATH  Google Scholar 

  • Breslow, N. E., and Lin, X. (1995). “Bias Correction in Generalised Linear Mixed Models with a Single Component of Dispersion.” Biometrika 81:81–91.

    Article  MathSciNet  Google Scholar 

  • Claassen, E. A. (2014). A Reduced Bias Method of Estimating Variance Components on Generalized Linear Mixed Models. PhD Dissertation. Lincoln, NE: University of Nebraska.

    Google Scholar 

  • Gbur, E.E., Stroup, W.W., McCarter, K.S., Durham, S., Young, L.J., Christman, M., West, M., and Kramer, M. (2012). Analysis of Generalized Linear Mixed Models in the Agricultural and Natural Resources Sciences. Madison, WI.: American Society of Agronomy, Soil Science Society of America, Crop Science Society of America.

  • Harville, D. A. (1977). “Maximum Likelihood Approaches to Variance Component Estimation and to Related Problems.” Journal of the American Statistical Association 72:320–338.Hilbe, J. M. (2014). Modeling Count Data. Cambridge: Cambridge University Press.

  • Molas, M. and Lesaffre, E. 2011. Hierarchical generalized linear models – the R package HGLMMM. Journal of Statistical Software. 39:13.

    Article  Google Scholar 

  • Murray, D. M., Varnell, S. P., and Blitstein, J. L. (2004). “Design and Analysis of Group-Randomized Trials: A Review of Recent Methodological Developments.” American Journal of Public Health 94:423–432.

    Article  Google Scholar 

  • Pinheiro, J. C., and Bates, D. M. (1995). “Approximations to the Log-Likelihood Function in the Nonlinear Mixed-Effects Model.” Journal of Computational and Graphical Statistics 4:12–35.

    Google Scholar 

  • Pinheiro, J. C., and Chao, E. C. (2006). “Efficient Laplacian and Adaptive Gaussian Quadrature Algorithms for Multilevel Generalized Linear Mixed Models.” Journal of Computational and Graphical Statistics 15:58–81.

    Article  MathSciNet  Google Scholar 

  • R Core Team (2013). R: A language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria. URL http://www.R-project.org/.

  • SAS Institute Inc. (2019) User’s Guide for SAS/STAT 14.3. Cary, NC: SAS Institute Inc. SAS/STAT 14.3. Cary, NC: SAS Institute Inc.

  • Schabenberer, O. and Stroup, W.W. W. (2008). Generalized Linear Mixed Models: Theory and Applications. Short Course, 2008 Joint Statistical Meetings.

  • Stroup, W.W. (2013) Generalized Linear Mixed Models: Modern Concepts, Methods and Applications. Boca Raton, FL: CRC Press.

    MATH  Google Scholar 

  • Stroup, W.W. (2014) Rethinking the analysis of non-normal data in plant and soil science. Agronomy Journal 106:1–17.

  • Stroup, W.W. and Littell, R.C. (2002). “Impact of Variance Component Estimates on Fixed Effect Inference in Unbalanced Linear Mixed Models. Conference on Applied Statistics in Agriculture. https://doi.org/10.4148/2475-7772.1198

  • Stroup, W., Milliken, G.A., Claassen, E.A. and Wolfinger, R.D. (2018) SAS for Mixed Models: Basic Concepts and Applications. Cary, NC: SAS Institute Inc.

  • Wolfinger, R. D., and O’Connell, M. A. (1993). “Generalized Linear Mixed Models: A Pseudo-likelihood Approach.” Journal of Statistical Computation and Simulation 48:233–243.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Walt Stroup.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Electronic supplementary material

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Stroup, W., Claassen, E. Pseudo-Likelihood or Quadrature? What We Thought We Knew, What We Think We Know, and What We Are Still Trying to Figure Out. JABES 25, 639–656 (2020). https://doi.org/10.1007/s13253-020-00402-6

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s13253-020-00402-6

Keywords

Navigation