Create and optimize MDPs or hierarchical MDPs with discrete time steps and state space.
Lars Relund lars@relund.dk and Anders Ringgaard Kristensen