Tutorial 2: Markov Processes
Tutorial 2: Markov Processes
This tutorial provides an introduction to the Markov process in a simple example where the state transitions are probabilistic. The aims of this tutorial is to help you understand Markov processes and history dependence, as well as to explore the behavior of a two-state telegraph process and understand how its equilibrium distribution is dependent on its parameters.
Topics covered in this lesson
- Telegraph process
- Distributional process
- Equilibrium of the Telegraph process
External Links
Prerequisites
Experience with Python Programming Language.
Back to the course