Decision-Theoretic Planning with a Possible Models Action Formalism

This paper extends classical action formalisms so as to account for uncertainty about the state of the world and about the effects of actions. We show how this formalism can be combined with decision theory in order to guide the search for reaction plans and to estimate their quality, thereby providing a basis for anytime ~ planning under uncertainty.