Skip to main content

Tutorial 2: Markov Processes

Difficulty level

This tutorial provides an introduction to the Markov process in a simple example where the state transitions are probabilistic.


Overview of this tutorial:

  • Understand Markov processes and history dependence
  • Explore the behavior of a two-state telegraph process and understand how its equilibrium distribution is dependent on its parameters
Topics covered in this lesson
  • Telegraph process
  • Distributional process
  • Equilibrium of the Telegraph process

Experience with Python Programming Language.

Back to the course