Simulation and Modeling20795 marksProcess Examples
What is markov chain? Explain with example.
What is markov chain? Explain with example. [5]
A Markov Chain is a sequence of random variables X₁, X₂, X₃, ... with the Markov property, namely that, given the present state, the future and past states are independent. Mathematically, this property is expressed as: P(Xₙ₊₁ = xₙ₊₁ X₁ = x₁, X₂ = x₂, ..., Xₙ = xₙ) = P(Xₙ₊₁ = xₙ₊₁ Xₙ = xₙ) This m...