Simulation and Modeling20825 marksFeatures
Define Markov Chain. Explain with suitable example.
Define Markov Chain. Explain with suitable example. [5]
A Markov Chain is a sequence of random variables X₁, X₂, X₃, ... with the Markov property, namely that, given the present state, the future and past states are independent. Formally, this can be written as: P(Xₙ₊₁ = xₙ₊₁ X₁ = x₁, X₂ = x₂, ..., Xₙ = xₙ) = P(Xₙ₊₁ = xₙ₊₁ Xₙ = xₙ) This property is ca...