Publications

| Sorted by Date | Classified by Publication Type | Classified by Research Category |

Pessimistic Iterative Planning with RNNs for Robust POMDPs

Maris F. L. Galesloot, Marnix Suilen, Thiago D. Simão, Steven Carr, Matthijs T. J. Spaan, Ufuk Topcu, and Nils Jansen. Pessimistic Iterative Planning with RNNs for Robust POMDPs. In Proc. of European Conference on Artificial Intelligence, pp. 4823–4831, 2025.

Download

HTML 

Abstract

Robust POMDPs extend classical POMDPs to incorporate model uncertainty using so-called uncertainty sets on the transition and observation functions, effectively defining ranges of probabilities. Policies for robust POMDPs must be (1) memory-based to account for partial observability and (2) robust against model uncertainty to account for the worst-case probability instances from the uncertainty sets. To compute such robust memory-based policies, we propose the pessimistic iterative planning (PIP) framework, which alternates between (1) selecting pessimistic POMDPs via worst-case probability instances from the uncertainty sets, and (2) computing finite-state controllers (FSCs) for these pessimistic POMDPs. Within PIP, we propose the RFSCNET algorithm, which optimizes a recurrent neural network to compute the FSCs. The empirical evaluation shows that RFSCNET can compute better-performing robust policies than several baselines and a state-of-the-art robust POMDP solver.

BibTeX Entry

@inproceedings{Galesloot25,
  author =       {Maris F. L. Galesloot and Marnix Suilen and Thiago
                  D. Sim{\~a}o and Steven Carr and Matthijs
                  T. J. Spaan and Ufuk Topcu and Nils Jansen},
  title =        {Pessimistic Iterative Planning with {RNNs} for
                  Robust {POMDPs}},
  booktitle =    {Proc. of European Conference on Artificial
                  Intelligence},
  pages =        {4823--4831},
  year =         2025
}

Note: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. In most cases, these works may not be reposted without the explicit permission of the copyright holder.

Generated by bib2html.pl (written by Patrick Riley) on Fri Aug 28, 2026 12:56:06 UTC