Skip to main content
Log in

Performance of some ridge estimators for the gamma regression model

  • Regular Article
  • Published:
Statistical Papers Aims and scope Submit manuscript

Abstract

In this study, we proposed some ridge estimators by considering the work of Månsson (Econ Model 29(2):178–184, 2012), Dorugade (J Assoc Arab Univ Basic Appl Sci 15:94–99, 2014) and some others for the gamma regression model (GRM). The GRM is a special form of the generalized linear model (GLM), where the response variable is positively skewed and well fitted to the gamma distribution. The commonly used method for estimation of the GRM coefficients is the maximum likelihood (ML) estimation method. The ML estimation method perform better, if the explanatory variables are uncorrelated. There are the situations, where the explanatory variables are correlated, then the ML estimation method is incapable to estimate the GRM coefficients. In this situation, some biased estimation methods are proposed and the most popular one is the ridge estimation method. The ridge estimators for the GRM are proposed and compared on the basis of mean squared error (MSE). Moreover, the outperforms of proposed ridge estimators are also calculated. The comparison has done using a Monte Carlo simulation study and two real data sets. Results show that Kibria’s and Månsson and Shukur’s methods are preferred over the ML method.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  • Alkhamisi MA, Shukur G (2007) A Monte Carlo study of recent ridge parameters. Commun Stat Simul Comput 36(3):535–547

    Article  MathSciNet  Google Scholar 

  • Alkhamisi MA, Khalaf G, Shukur G (2006) Some modifications for choosing ridge parameter. Commun Stat Theory Methods 35:1–16

    Article  MathSciNet  Google Scholar 

  • Amin M, Ullah MA, Aslam M (2016) Empirical evaluation of the inverse gaussian regression residuals for the assessment of influential points. J Chemom 30(7):394–404

    Article  Google Scholar 

  • Chatterjee S, Hadi AS (1988) Sensitivity analysis in linear regression. Wiley, New York

    Book  Google Scholar 

  • Dorugade AV (2014) New ridge parameters for ridge regression. J Assoc Arab Univ Basic Appl Sci 15:94–99

    Google Scholar 

  • Evan DL, Drew JH, Leemis LM (2008) The distribution of the Kolmogorov–Smirnov, Cramer–von Mises, and Anderson–Darling test statistics for exponential populations with estimated parameters. Commun Stat Simul Comput 37:1396–1421

    Article  MathSciNet  Google Scholar 

  • Firinguetti L (1999) A generalized ridge regression estimator and its finite sample properties. Commun Stat Simul Comput 28(5):1217–1229

    MathSciNet  MATH  Google Scholar 

  • Frisch R (1934) Statistical confluence analysis by means of complete regression analysis. Universitetets Økonomiske Institutt

  • Gibbons DG (1981) A simulation study of some ridge estimators. J Am Stat Assoc 76:131–139

    Article  Google Scholar 

  • Hardin JW, Hilbe JM (2012) Generalized linear models and extensions. Stata Press, College Station

    MATH  Google Scholar 

  • Hoerl AE, Kennard RW (1970a) Ridge regression: biased estimation for nonorthogonal problems. Technometrics 12:55–67

    Article  Google Scholar 

  • Hoerl AE, Kennard RW (1970b) Ridge regression: application to nonorthogonal problems. Technometrics 12:69–82

    Article  Google Scholar 

  • Hoerl AE, Kennard RW, Baldwin KF (1975) Ridge regression: some simulation. Commun Stat Theory Methods 4:105–123

    MATH  Google Scholar 

  • Jearkpaporn D, Montgomery DC, Runger GC, Borror CM (2005) Model-based process monitoring using robust generalized linear models. Int J Prod Res 43(7):1337–1354

    Article  Google Scholar 

  • Khalaf G, Shukur G (2005) Choosing ridge parameter for regression problem. Commun Stat Theory Methods 34:1177–1182

    Article  MathSciNet  Google Scholar 

  • Khalaf G, Månsson K, Sjölander P, Shukur G (2014) A Tobit ridge regression estimator. Commun Stat Theory Methods 43(1):131–140

    Article  MathSciNet  Google Scholar 

  • Kibria BM, Banik S (2016) Some ridge regression estimators and their performances. J Mod Appl Stat Methods 15(1):12

    Article  Google Scholar 

  • Kibria BG, Månsson K, Shukur G (2012) Performance of some logistic ridge regression estimators. Comput Econ 40(4):401–414

    Article  Google Scholar 

  • Kibria BMG (2003) Performance of some new ridge regression estimators. Commun Stat Theory Methods 32:419–435

    MathSciNet  MATH  Google Scholar 

  • Kurtoğlu F, Özkale MR (2016) Liu estimation in generalized linear models: application on gamma distributed response variable. Stat Pap 57(4):911–928

    Article  MathSciNet  Google Scholar 

  • Lawless JF, Wang P (1976) A simulation study of ridge and other regression estimators. Commun Stat Theory Methods 14:1589–1604

    MATH  Google Scholar 

  • Le Cessie S, Van Houwelingen JC (1992) Ridge estimators in logistic regression. J R Stat Soc Ser C Appl Stat 41:191–201

    MATH  Google Scholar 

  • Lesaffre E, Marx BD (1993) Collinearity in generalized linear regression. Commun Stat Theory Methods 22(7):1933–1952

    Article  MathSciNet  Google Scholar 

  • Månsson K (2012) On ridge estimators for the negative binomial regression model. Econ Model 29(2):178–184

    Article  Google Scholar 

  • Månsson K, Shukur G (2010) On ridge parameters in logistic regression. Commun Stat Theory Methods 40(18):3366–3381

    Article  MathSciNet  Google Scholar 

  • Månsson K, Shukur G (2011) A Poisson ridge regression estimator. Econ Model 28:1475–1481

    Article  Google Scholar 

  • Månsson K, Shukur G, Kibria BMG (2010) A simulation study of some ridge regression estimators under different distributional assumptions. Commun Stat Simul Comput 39:1639–1670

    Article  MathSciNet  Google Scholar 

  • Masuo N (1998) On the almost unbiased ridge regression estimation. Commun Stat Simul Comput 17(3):729–743

    MATH  Google Scholar 

  • McDonald GC, Galarneau DI (1975) A Monte Carlo evaluation of some ridge-type estimators. J Am Stat Assoc 70:407–416

    Article  Google Scholar 

  • Muniz G, Kibria BMG (2009) On some ridge regression estimators: an empirical comparisons. Commun Stat Simul Comput 38:621–630

    Article  MathSciNet  Google Scholar 

  • Pasha GR, Shah MA (2004) Application of ridge regression to multicollinear data. J Res (Science) 15(1):97–106

    Google Scholar 

  • Schaefer RL, Roi LD, Wolfe RA (1984) A ridge logistic estimator. Commun Stat Theory Methods 13(1):99–113

    Article  Google Scholar 

  • Segerstedt B (1992) On ordinary ridge regression in generalized linear models. Commun Stat Theory Methods 21(8):2227–2246

    Article  MathSciNet  Google Scholar 

  • Segond ML, Onof C, Wheater HS (2006) Spatial-temporal disaggregation of daily rainfall from a generalized linear model. J Hydrol 331(3):674–689

    Article  Google Scholar 

  • Troskie CG, Chalton DO (1996) Detection of outliers in the presence of multicollinearity. In: Gupta AK, Girko VL (eds) Multidimensional statistical analysis and theory of random matrices. Proceedings of the sixth Lukacs symposium. VSP, Utrecht, pp 273–292

    Chapter  Google Scholar 

  • Zhang J (2011) Powerful goodness-of-fit and multi-sample tests. PhD Thesis, York University, Toronto

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Muhammad Amin.

Electronic supplementary material

Below is the link to the electronic supplementary material.

Supplementary material 1 (csv 1 KB)

Supplementary material 2 (csv 2 KB)

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Amin, M., Qasim, M., Amanullah, M. et al. Performance of some ridge estimators for the gamma regression model. Stat Papers 61, 997–1026 (2020). https://doi.org/10.1007/s00362-017-0971-z

Download citation

  • Received:

  • Revised:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00362-017-0971-z

Keywords

Navigation