A frequent problem in estimating logistic regression
models is a failure of the likelihood maximization algorithm to converge.
Although popular and extremely well established in bias correction for maximum
likelihood estimates of the parameters for logistic regression, the behaviour
and properties of the maximum likelihood method are less investigated. The main aim of this paper is to examine the behaviour
and properties of the parameters estimates methods with reduction technique. We
will focus on a method used a modified score function to reduce the bias of the
maximum likelihood estimates. We also present new and interesting examples by
simulation data with different cases of sample size and percentage of the
probability of outcome variable.
Cite this paper
Badi, N. H. S. (2017). Properties of the Maximum Likelihood Estimates and Bias Reduction for Logistic Regression Model. Open Access Library Journal, 4, e3625. doi: http://dx.doi.org/10.4236/oalib.1103625.
McCullagh,
P. (1986) The Conditional Distribution of Goodness-of-Fit Statistics for Discrete
Data. Journal of the American Statistical Association, 81, 104-107. https://doi.org/10.1080/01621459.1986.10478244
Nelder,
J.A. and
Wedderburn, R.W.M. (1972) Generalized
Linear Models. Journal of the Royal Statistical Society, Series A, 135, 370-384. https://doi.org/10.2307/2344614
Albert,
A. and Anderson, J.A. (1984) On the Existence of Maximum Likelihood Estimates
in Logistic Regression Models. Biometrika, 71, 1-10. https://doi.org/10.1093/biomet/71.1.1
Clogg,
C.C., Rubin, D.B., Schenker, N., Schultz, B. and
Weidman, L. (1991) Multiple Imputation
of Industry and Occupation Codes in Census Public-Use Samples Using Bayesian
Logistic Regression. Journal of the American Statistical Association,
86, 68-78. https://doi.org/10.1080/01621459.1991.10475005
