Skip to main content

Tutorial 2: Markov Processes

Difficulty level
Beginner

This tutorial provides an introduction to the Markov process in a simple example where the state transitions are probabilistic.

 

Overview of this tutorial:

  • Understand Markov processes and history dependence
  • Explore the behavior of a two-state telegraph process and understand how its equilibrium distribution is dependent on its parameters
Topics covered in this lesson
  • Telegraph process
  • Distributional process
  • Equilibrium of the Telegraph process
Prerequisites

Experience with Python Programming Language.

Back to the course