I've got some troubles understanding all connections between different Markov chains and their meaning, more specifically:
I know that if the matrix P is regular, it has a limiting distribution which also is the unique stationary distribution. But what if P is non regular, what does it tells us about the stationary distribution? Does it have multiple, or none stationary distribution?
Thanks!