Decision-making problems in uncertain or stochastic domains are often formulated as markov decision processes (MDPs). policy iteration (PI) is a popular algorithm for searching over policy-space, the size of whic