Elastic Net

Elastic Net#

  1. OLS can overfit

  2. ridge helpw sith over fitting, but not variable selection

  3. lasso helps reduce the dimensionality

  • p>n lasso saturates at n variables

  • lasso predicts 1 of correlated variables at random

  • ridge is better in correlated case