Regularization and Cross Validation Archives

Machine Learning: Non-linear Regression, Regularization & Cross Validation Simplified (Part 1)

· Roopam Upadhyay · 3 Comments

In this 3-part series of articles, you will gain an intuitive understanding of some fundamental concepts in machine learning such as: Building blocks of curves Non-linear regression Curve fitting and overfitting Regularization to prevent overfitting Hyper-parameters in machine learning Cross-validation to fine-tune models You will also get hands-on practice to understand these concepts better. For this

Machine Learning : Regularization – Ridge, Lasso, & Elastic Net Simplified (Part 2)

· Roopam Upadhyay · 2 Comments

In the previous article, we started with the theme that overfitting is an inherent problem in machine learning associated with big data. Essentially, if you have many variables and their polynomial terms (X-variables) in a model you could fit any response data (y-variable) to perfection. This perfect fit for the observed data is overfitting since this model will

Machine Learning : Cross Validation and Hyper-Parameter Tuning (Part 3)

· Roopam Upadhyay · 2 Comments

In the last part of this series on fundamental machine learning, you learned about regularization and cross-validation. Here, you will gain a sound understanding of model hyper-parameter tuning to develop robust models. The machines do learn but they still need a good human tutor. In the last part, you were also introduced to my paternal grandmother to