Skip to main content

Tutorial 2: Linear regression with Maximum Likelihood Estimation

Difficulty level
Beginner
Speaker
Duration
8:00

This is Tutorial 2 of a series on fitting models to data. We start with simple linear regression, using least squares optimization (Tutorial 1) and Maximum Likelihood Estimation (Tutorial 2). We will use bootstrapping to build confidence intervals around the inferred linear model parameters (Tutorial 3). We'll finish our exploration of regression models by generalizing to multiple linear regression and polynomial regression (Tutorial 4). We end by learning how to choose between these various models. We discuss the bias-variance trade-off (Tutorial 5) and Cross Validation for model selection (Tutorial 6).

 

In this tutorial, we will use a different approach to fit linear models that incorporates the random 'noise' in our data.

Topics covered in this lesson
  • Learn about probability distributions and probabilistic models
  • Learn how to calculate the likelihood of our model parameters
  • Learn how to implement the maximum likelihood estimator, to find the model parameter with the maximum likelihood
Prerequisites

Experience with Python Programming Language