Influential observation is one which either individually or together with
several other observations has a demonstrably large impact on the values of
various estimates of regression coefficient. It has been suggested by some
authors that multicollinearity should be controlled before attempting to
measure influence of data point. In using ridge regression to mitigate the
effect of multicollinearity, there arises a problem of choosing possible of
ridge parameter that guarantees stable regression coefficients in the
regression model. This paper seeks to check whether the choice of ridge
parameter estimator influences the identified influential data points.
References
[1]
Belsley, A., Kuh, E. and Welsch, R. (1989) Regression Diagnostics: Identifying Influential Data and Sources of Collinearity. John Wiley and Sons, New York.
Mickey, M.R., Dunn, O.J. and Clark, V. (1976) Note on the Use of Stepwise Regression in Detecting Outliers. Computers and Biomedical Research, 1, 105-111.
https://doi.org/10.1016/0010-4809(67)90009-2
[4]
Andrews, D.F. and Pregibon, D. (1978) Finding the Outliers That Matters. Journal of Royal Statistical Society, Series B, 40, 85-93.
https://doi.org/10.1111/j.2517-6161.1978.tb01652.x
[5]
Hoerl, A.E. and Kennard, R.W. (1970) Ridge Regression: Biased Estimation for Non-Orthogonal Problems. Technometrics, 12, 55-67.
https://doi.org/10.1080/00401706.1970.10488634
[6]
Hoerl, A.E., Kennard, R.W. and Baldwin, K.F. (1975) Ridge Regression: Some Simulations. Communications in Statistics, 4, 105-123.
https://doi.org/10.1080/03610917508548342
[7]
Lawless, J.F. and Wang, P. (1976) A Simulation Study of Ridge and Other Regression Estimators. Communications in Statistics A, 5, 307-323.
https://doi.org/10.1080/03610927608827353
[8]
Nomura, M. (1988) On the Almost Unbiased Ridge Regression Estimation. Communications in Statistics—Simulation and Computation, 17, 729-743.
https://doi.org/10.1080/03610918808812690
[9]
Khalaf, G. and Shukur, G. (2005) Choosing Ridge Regression Parameters for Regression Problems. Communications in Statistics—Simulation and Computations, 32, 419-435.
[10]
Dorugade, A. (2014) New Ridge Parameters for Ridge Regression. Journal of the Association of Arab Universities for Basic and Applied Sciences, 15, 94-99.
https://doi.org/10.1016/j.jaubas.2013.03.005
[11]
Al-Hassan, Y.M. (2010) Performance of a New Ridge Regression Estimator. Journal of the Association of Arab Universities for Basic and Applied Science, 9, 23-26.
https://doi.org/10.1016/j.jaubas.2010.12.006
[12]
Dorugade, A.V. and Kashid, D.N. (2010) Alternative Methods for Choosing Ridge Parameter for Regression. Applied Mathematical Science, 4, 447-456.
[13]
Saleh, A.K.Md. and Kibria, B.M.G. (1993) Performances of Some New Preliminary Test Ridge Regression Estimators and Their Properties. Communication in Statistics—Theory and Methods, 22, 2747-2764.
https://doi.org/10.1080/03610929308831183
[14]
Kibria, B.M.G. (2003) Performance of Some New Ridge Regression Estimators. Communications in Statistics—Simulation and Computation, 32, 417-435.
https://doi.org/10.1081/SAC-120017499
[15]
Zang, J. and Ibrahim, M. (2005) A Simulation Study on SPSS Ridge Regression and Ordinary Least Square Regression Procedures for Multicollinearity Data. Journal of Applied Statistics, 32, 571-588. https://doi.org/10.1080/02664760500078946
[16]
Alkhamisi, M., Khalaf, S. and Shukur, G. (2006) Some Modifications for Choosing Ridge Parameters. Communications in Statistics—Theory and Methods, 37, 544-564.
https://doi.org/10.1080/03610920701469152
[17]
Al-Hassan, Y.M. (2008) A Monte Carlo Evaluation of Some Ridge Estimators. Japan Journal of Applied Science: Natural Science Series, 10, 101-110.
[18]
Muniz, G. and Kibria, B.M.G. (2009) On Some Ridge Regression Estimators: An Empirical Comparison. Communications in Statistics—Simulations and Computation, 38, 621-630. https://doi.org/10.1080/03610910802592838
[19]
Khalaf, G. and Iguernane, M. (2014) Ridge Regression and Ill-Conditioning. Journal of Modern Applied Statistical Methods, 13, 355-363.
https://doi.org/10.22237/jmasm/1414815420
[20]
Uzuke, C.A., Mbegbu, J.I. and Nwosu, C.R. (2017) Performance of Kibria, Khalaf and Shukur’s Methods When the Eigenvalues Are Skewed. Communications in Statistics—Simulation and Computation, 46, 2071-2102.
https://doi.org/10.1080/03610918.2015.1035444
[21]
Cook, R. (1977) Detection of Influential Observations in Linear Regression. Technometrics, 19, 15-18. https://doi.org/10.1080/00401706.1977.10489493
[22]
Welsch, R. and Kuh, E. (1977) Linear Regression Diagnostics. Technical Report, Solan School of Management, Massachusetts Institute of Technology, Cambridge, 923-977.
https://doi.org/10.3386/w0173
[23]
Hadi, A. (1992) A New Measure of Overall Potential Influence in Linear Regression. Computational Statistics and Data Analysis, 14, 1-27.
https://doi.org/10.1016/0167-9473(92)90078-T
