Main Article Content

Abstract

Reduction of the high dimensional binary classification data using penalized logistic regression is one of the challenges when the explanatory variables are correlated. To tackle both estimate the coefficients and perform variable selection simultaneously, elastic net penalty was successfully applied in high dimensional binary classification. However, elastic net has two major limitations. First it does not encouraging grouping effects when there is no high correlation. Second, it is not consistent in variable selection. To address these issues, an adjusted of the elastic net (AEN) and its adaptive adjusted elastic net (AAEM), are proposed to take into account the small and medium correlation between explanatory variables and to provide the consistency of the variable selection simultaneously. Our simulation and real data results show that AEN and AAEN has advantage with small, medium, and extremely correlated variables in terms of both prediction and variable selection consistency comparing with other existing penalized methods.

Keywords

High dimensional Penalization Logistic regression LASSO Elastic net

Article Details

How to Cite
Algamal, Z. Y., & Lee, M. H. (2015). High Dimensional Logistic Regression Model using Adjusted Elastic Net Penalty. Pakistan Journal of Statistics and Operation Research, 11(4), 667-676. https://doi.org/10.18187/pjsor.v11i4.990