What is LASSO regression?
LASSO (Least Absolute Shrinkage and Selection Operator) adds a penalty on the sum of the absolute regression coefficients. As the penalty grows, coefficients of weakly associated variables shrink to exactly zero and those variables leave the model, so the method performs shrinkage and feature selection at the same time. For binary outcomes it is applied as L1-penalized logistic regression (Tibshirani, 1996).
