Markov Chain Approximation