Abstract
In the Gauss–Markov model, this paper derives a necessary and sufficient condition under which two general ridge estimators coincide with each other. The condition is given as a structure of the dispersion matrix of the error term. Since the class of estimators considered here contains linear unbiased estimators such as the ordinary least squares estimator and the best linear unbiased estimator, our result can be viewed as a generalization of the well known theorems on the equality between these two estimators, which have been fully studied in the literature. Two related problems are also considered: equality between two residual sums of squares, and classification of dispersion matrices by a perturbation approach.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Arnold BF, Stahlecker P (2000) Another view of the Kuks-Olman estimator. J Stat Plan Inference 89(1–2):169–174
Baksalary OM, Trenkler G (2009) A projector oriented approach to the best linear unbiased estimator. Stat Papers 50(4):721–733
Frank IE, Friedman JH (1993) A statistical view of some chemometrics regression tools. Technometrics 35(2):109–135
Groß J (1997) A note on equality of MINQUE and simple estimator in the general Gauss–Markov model. Stat Prob Lett 35(4):335–339
Groß J (1998) On contractions in linear regression. J Stat Plan Inference 74(2):343–351
Groß J (2004) The general Gauss–Markov model with possibly singular dispersion matrix. Stat Papers 45(3):311–336
Groß J, Markiewicz A (2004) Characterizations of admissible linear estimators in the linear model. Linear Algebra Appl 388:239–248
Hoerl AE, Kennard RW (1970) Ridge regression: biased estimation for nonorthogonal problems. Technometrics 12(1):55–67
Kariya T (1980) Note on a condition for equality of sample variances in a linear model. J Am Stat Assoc 75(371):701–703
Kariya T, Kurata H (2004) Generalized least squares. Wiley, Chichester
Kurata H (1998) A generalization of Rao’s covariance structure with applications to several linear models. J Multivar Anal 67(2):297–305
Markiewicz A (1996) Characterization of general ridge estimators. Stat Prob Lett 27(2):145–148
Puntanen S, Styan GPH (1989) The equality of the ordinary least squares estimator and the best linear unbiased estimator (with discussions). Am Stat 43(3):153–164
Rao CR (1967) Least squares theory using an estimated dispersion matrix and its application to measurement of signals. In: Proceedings of the Fifth Berkeley Symposium on Mathematical Statistics and Probability (Berkeley, California, 1965/1966), Statistics, vol 1, pp 355–372, University of California Press, Berkeley, California
Rao CR (1976) Estimation of parameters in a linear model. Ann Stat 4(6):1023–1037
Zyskind G (1967) On canonical forms, non-negative covariance matrices and best and simple least squares linear estimators in linear models. Ann Math Stat 38:1092–1109
Acknowledgements
The portion of the second author’s work was supported by Japan Society for the Promotion of Science KAKENHI Grant Number JP26330035. The authors would like to express their gratitude to the referees for their valuable comments.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Tsukuda, K., Kurata, H. Covariance structure associated with an equality between two general ridge estimators. Stat Papers 61, 1069–1084 (2020). https://doi.org/10.1007/s00362-017-0975-8
Received:
Revised:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00362-017-0975-8