Tutorial 2: Markov Processes
Tutorial 2: Markov Processes
This tutorial provides an introduction to the Markov process in a simple example where the state transitions are probabilistic.
Overview of this tutorial:
- Understand Markov processes and history dependence
- Explore the behavior of a two-state telegraph process and understand how its equilibrium distribution is dependent on its parameters
Topics covered in this lesson
- Telegraph process
- Distributional process
- Equilibrium of the Telegraph process
Prerequisites
Experience with Python Programming Language.
Back to the course