POMDPs in OpenMarkov and ProbModelXML

OpenMarkov is an open-source tool for editing and evaluating probabilistic graphical models, such as Bayesian networks, influence diagrams, MDPs, POMDPs, Dec-POMDPs, etc. ProbModelXML is a format for encoding probabilistic graph-ical models. In this paper we explain how to edit MDPs and POMDPs using OpenMarkov’s graphical user interface, and how these models can be stored in ProbModelXML. 1