Skip to main content

Tutorial 2: Markov Processes

Difficulty level
Beginner

This tutorial provides an introduction to the Markov process in a simple example where the state transitions are probabilistic. The aims of this tutorial is to help you understand Markov processes and history dependence, as well as to explore the behavior of a two-state telegraph process and understand how its equilibrium distribution is dependent on its parameters.

Topics covered in this lesson
  • Telegraph process
  • Distributional process
  • Equilibrium of the Telegraph process
Prerequisites

Experience with Python Programming Language.

Back to the course