Simulation and Modeling20765 marksProcess Examples
Explain Markov's chain with a suitable example.
Explain Markov's chain with a suitable example. [5]
A Markov chain is a sequence of random variables X₁, X₂, X₃, ... with the Markov property, namely that, given the present state, the future and past states are independent. Mathematically, this is expressed as: P(Xₙ₊₁ = xₙ₊₁ X₁ = x₁, X₂ = x₂, ..., Xₙ = xₙ) = P(Xₙ₊₁ = xₙ₊₁ Xₙ = xₙ) This is called ...