Abstract
Logistic Regression is a very popular method to model the dichotomous data. The maximum likelihood estimator (MLE) of unknown regression parameters of the logistic regression is not too accurate when multicollinearity exists among the covariates. It is well known that the presence of multicollinearity increases the variance of the MLE. To diminish the inflated mean square error (MSE) of the MLE due to the presence of multicollinearity, we proposed a new estimator designated as linearized ridge logistic estimator. The conditional superiority of the proposed estimator over the other existing estimators is derived theoretically and the optimal choice of shrinkage parameter is suggested. Monte Carlo simulations are performed to study the performance of the proposed estimator through MSE sense. Also, a numerical example is presented to support the results.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Gao F, Liu XQ (2011) Linearized ridge regression estimator under the mean square error criterion in a linear regression model. Commun Stat Simul Comput 40:1434–1443
Hosmer DW, Lemeshow S (1989) Applied logistic regression. Wiley, New York
Inan D, Erdogam BE (2013) Liu-type logistic estimator. Commun Stat Simul Comput 42(7):1578–11586
Kibria BMG, Mansson K, Shukur G (2012) Performance of some logistic ridge regression estimators. Comput Econ 40(4):401–414
Le Cessie S, Van Houwelingen JC (1992) Ridge estimators in logistic regression. J R Stat Soc Ser C Appl Stat 41:191–201
Lee AH, Silvapulle MJ (1988) Ridge estimation in logistic regression. Commun Stat Simul Comput 17(4):1231–1257
Lesaffre E, Marx BD (1993) Collinearity in generalized linear regression. Commun Stat Theory Methods 22(7):1933–1952
Liu KJ (1993) A new class of biased estimate in linear regression. Commun Stat Theory Methods 22:393–402
Liu XQ, Gao F (2011) Linearized ridge regression estimator in linear regression. Commun Stat Theory Methods 40(12):2182–2192
Mansson K, Shukur G (2011) On ridge parameters in logistic regression. Commun Stat Theory Methods 40(18):3366–3381
Mansson K, Kibria BMG, Shukur G (2011) On Liu estimators for the logit regression model. The Royal Institute of Technology Centre of Excellence for Science and Innovation Studies (CESIS) Sweden Paper No 259
Schaefer RL, Roi LD, Wolfe WA (1984) A ridge logistic estimator. Commun Stat Theory Methods 13(1):99–113
Schaeffer RL (1986) Alternative estimators in logistic regression when the data is collinear. J Stat Comput Simul 25:75–91
Weissfeld LA, Sereika SM (1991) A multicollinearity diagnostic for generalized linear models. Commun Stat Theory Methods 20(4):1183–1198
Funding
This work was partially supported by Shivaji University, Kolhapur, India under Research Initiation Scheme (Grant No. SU/C&U.D.Section/94/231).
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Jadhav, N.H. On linearized ridge logistic estimator in the presence of multicollinearity. Comput Stat 35, 667–687 (2020). https://doi.org/10.1007/s00180-019-00935-6
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00180-019-00935-6