Simulation and Modeling20805 marksFeatures
Explain Markov chain with suitable example.
Explain Markov chain with suitable example. [5]
A Markov chain is a sequence of random variables X₁, X₂, X₃, ... with the Markov property, namely that, given the present state, the future and past states are independent. Mathematically: P(Xₙ₊₁ = xₙ₊₁ X₁ = x₁, X₂ = x₂, ..., Xₙ = xₙ) = P(Xₙ₊₁ = xₙ₊₁ Xₙ = xₙ) This means the next state depends onl...