Skip to main content

Tutorial 5 Model Selection: Bias-variance trade-off

Difficulty level

This is Tutorial 5 of a series on fitting models to data. We start with simple linear regression, using least squares optimization (Tutorial 1) and Maximum Likelihood Estimation (Tutorial 2). We will use bootstrapping to build confidence intervals around the inferred linear model parameters (Tutorial 3). We'll finish our exploration of regression models by generalizing to multiple linear regression and polynomial regression (Tutorial 4). We end by learning how to choose between these various models. We discuss the bias-variance trade-off (Tutorial 5) and Cross Validation for model selection (Tutorial 6).

In this tutorial, we will learn about the bias-variance tradeoff and see it in action using polynomial regression models.

Topics covered in this lesson
  • Understand difference between test and train data
  • Compare train and test error for models of varying complexity
  • Understand how bias-variance tradeoff relates to what model we choose

Experience with Python Programming Language