7주차-Regularization

• Regularization(정규화,규제화)

어떤 규제를 가해서 모델의 학습 데이터에 대한 overfitting을 완화하는 방법

(EX) L2-regularization, L1-regularization, Drop out, Weight decay

- Training Accuracy(TA)
- Test Accuracy = Gemeralization Performance(일반화 성능)(GP)

 

• Regression

 

• Classification

 

• Regularization

EX)

 

• L2-Regularization (polynomial fitting)

 

• Gradient Descent with L2-Regularization

• L2-Regularization (Classification)

 

• L1-Regularization (LASSO)

 

• Multi Layer Network (XOR) ⭐⭐⭐