Tutorial 2: Markov Processes
This tutorial provides an introduction to the Markov process in a simple example where the state transitions are probabilistic. The aims of this tutorial is to help you understand Markov processes and history dependence, as well as to explore the behavior of a two-state telegraph process and understand how its equilibrium distribution is dependent on its parameters.
- Telegraph process
- Distributional process
- Equilibrium of the Telegraph process
Experience with Python Programming Language.