lec12_markov.pdf