Skip to main content
Log in

Inference of random effects for linear mixed-effects models with a fixed number of clusters

  • Published:
Annals of the Institute of Statistical Mathematics Aims and scope Submit manuscript

Abstract

We consider a linear mixed-effects model with a clustered structure, where the parameters are estimated using maximum likelihood (ML) based on possibly unbalanced data. Inference with this model is typically done based on asymptotic theory, assuming that the number of clusters tends to infinity with the sample size. However, when the number of clusters is fixed, classical asymptotic theory developed under a divergent number of clusters is no longer valid and can lead to erroneous conclusions. In this paper, we establish the asymptotic properties of the ML estimators of random-effects parameters under a general setting, which can be applied to conduct valid statistical inference with fixed numbers of clusters. Our asymptotic theorems allow both fixed effects and random effects to be misspecified, and the dimensions of both effects to go to infinity with the sample size.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • Bates, D., Mächler, M., Bolker, B., Walker, S. (2015). Fitting linear mixed-effects models using lm4. Journal of Statistical Software, 67, 1–48.

    Article  Google Scholar 

  • Bell, B. A., Morgan, G. B., Schoeneberger, J. A., Ferron, J. M. (2014). How low can you go? Methodology: European Journal of Research Methods for the Behavioral and Social Sciences, 10, 1–11.

    Article  Google Scholar 

  • Chang, C. H., Huang, H. C., Ing, C. K. (2017). Mixed domain asymptotics for a stochastic process model with time trend and measurement error. Bernoulli, 23, 159–190.

    Article  MathSciNet  Google Scholar 

  • Chang, C. H., Huang, H. C., Ing, C. K. (2022). Selection of linear mixed-effects models with a small Number of clusters. Submitted.

  • Crainiceanu, C. M., Ruppert, D. (2004). Likelihood ratio tests in linear mixed models with one variance component. Journal of Royal Statistical Society Series B, 66, 165–185.

    Article  MathSciNet  Google Scholar 

  • Fan, Y., Li, R. (2012). Variable selection in linear mixed effects models. The Annals of Statistics, 40, 2043–2068.

    Article  MathSciNet  Google Scholar 

  • Gumedze, F. N., Dunne, T. T. (2011). Parameter estimation and inference in the linear mixed model. Linear Algebra and Its Applications, 435, 1920–1944.

    Article  MathSciNet  Google Scholar 

  • Hartley, H. O., Rao, J. N. K. (1967). Maximum likelihood estimation for the mixed analysis of variance model. Biometrika, 54, 93–108.

    Article  MathSciNet  Google Scholar 

  • Harville, D. A. (1977). Maximum likelihood approaches to variance components estimation and related problems. Journal of the American Statistical Association, 7, 320–338.

    Article  MathSciNet  Google Scholar 

  • Huang, F. (2018). Using cluster bootstrapping to analyze nested data with a few clusters. Educational and Psychological Measurement, 78, 297–318.

    Article  Google Scholar 

  • Jiang, J. (2007). Linear and generalized linear mixed models and their applications. New York: Springers.

    MATH  Google Scholar 

  • Jiang, J. (2017). Asymptotic analysis of mixed effects models: Theory, applications, and open problems. New York: Springers.

    Book  Google Scholar 

  • Laird, N. M., Ware, J. H. (1982). Random-effects models for longitudinal data. Biometrics, 38, 963–974.

    Article  Google Scholar 

  • Longford, N. T. (1993). Random coefficient models oxford statistical science series 11. New York: Oxford University Press.

    Google Scholar 

  • Maas, C. J. M., Hox, J. J. (2004). Robustness issues in multilevel regression analysis. Statistica Neerlandica, 58, 127–137.

    Article  MathSciNet  Google Scholar 

  • Mardia, K. V., Marshall, R. J. (1984). Maximum likelihood estimation of models for residual covariance in spatial regression. Biometrika, 71, 135–146.

    Article  MathSciNet  Google Scholar 

  • McNeish, D., Stapleton, L. M. (2016). Modeling clustered data with very few clusters. Multivariate Behavioral Research, 51, 495–518.

    Article  Google Scholar 

  • McNeish, D., Stapleton, L. M. (2016). The effect of small sample size on two-level model estimates: A review and illustration. Educational Psychology Review, 28, 295–314.

    Article  Google Scholar 

  • Miller, J. J. (1977). Asymptotic properties of maximum likelihood estimates in the mixed model of the analysis of variance. The Annals of Statistics, 5, 746–762.

    Article  MathSciNet  Google Scholar 

  • Peng, H., Lu, Y. (2012). Model selection in linear mixed effect models. Journal of Multivariate Analysis, 109, 109–129.

    Article  MathSciNet  Google Scholar 

  • Pu, W., Niu, X.-F. (2006). Selecting mixed-effects models based on a generalized information criterion. Journal of Multivariate Analysis, 97, 733–758.

    Article  MathSciNet  Google Scholar 

  • Self, S. G., Liang, K. Y. (1987). Asymptotic properties of maximum likelihood estimators and likelihood ratio tests under nonstandard conditions. Journal of the American Statistical Association, 82, 605–610.

    Article  MathSciNet  Google Scholar 

  • Stram, D. O., Lee, J. W. (1994). Variance component testing in the longitudinal mixed effects model. Biometrics, 50, 1171–1177.

    Article  Google Scholar 

  • Verbeke, G., Molenberghs, G. (2000). Linear mixed models for longitudinal data. New York: Springers.

    MATH  Google Scholar 

Download references

Acknowledgements

The research of Chih-Hao Chang is supported by ROC Ministry of Science and Technology grant MOST 107-2118-M-390-001. The research of Hsin-Cheng Huang is supported by ROC Ministry of Science and Technology grant MOST 106-2118-M-001-002-MY3. The research of Ching-Kang Ing is supported by the Science Vanguard Research Program under the Ministry of Science and Technology, Taiwan, ROC.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Chih-Hao Chang.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Below is the link to the electronic supplementary material.

Supplementary file 1 (pdf 399 KB)

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Chang, CH., Huang, HC. & Ing, CK. Inference of random effects for linear mixed-effects models with a fixed number of clusters. Ann Inst Stat Math 74, 1143–1161 (2022). https://doi.org/10.1007/s10463-022-00825-7

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10463-022-00825-7

Keywords

Navigation