Publications

| Sorted by Date | Classified by Publication Type | Classified by Research Category |

A Flexible Approach to Modeling Unpredictable Events in MDPs

Stefan Witwicki, Francisco S. Melo, Jesús Capitán, and Matthijs T. J. Spaan. A Flexible Approach to Modeling Unpredictable Events in MDPs. In Proc. of Int. Conf. on Automated Planning and Scheduling, pp. 260–268, 2013.

Download

pdf [767.1kB]  

Abstract

In planning with a Markov decision process (MDP) framework, there is the implicit assumption that the world is predictable. Practitioners must simply take it on good faith the MDP they have constructed is comprehensive and accurate enough to model the exact probabilities with which all events may occur under all circumstances. Here, we challenge the conventional assumption of complete predictability, arguing that some events are inherently unpredictable. Towards more effectively modeling problems with unpredictable events, we develop a hybrid framework that explicitly distinguishes decision factors whose probabilities are not assigned precisely while still representing known probability components using conventional principled MDP transitions. Our approach is also flexible, resulting in a factored model of variable abstraction whose usage for planning results in different levels of approximation. We illustrate the application of our framework to an intelligent surveillance planning domain.

BibTeX Entry

@InProceedings{Witwicki13icaps,
  author =       {Stefan Witwicki and Francisco S. Melo and Jes\'us
                  Capit\'an and Matthijs T. J. Spaan},
  title =        {A Flexible Approach to Modeling Unpredictable Events
                  in {MDPs}},
  booktitle =    {Proc. of Int. Conf. on Automated Planning and
                  Scheduling},
  year =         2013,
  pages =        {260--268}
}

Note: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. In most cases, these works may not be reposted without the explicit permission of the copyright holder.

Generated by bib2html.pl (written by Patrick Riley) on Thu Feb 29, 2024 16:15:45 UTC