Publications

| Sorted by Date | Classified by Publication Type | Classified by Research Category |

Constrained Multiagent Markov Decision Processes: a Taxonomy of Problems and Algorithms

Frits de Nijs, Erwin Walraven, Mathijs M. de Weerdt, and Matthijs T. J. Spaan. Constrained Multiagent Markov Decision Processes: a Taxonomy of Problems and Algorithms. Journal of Artificial Intelligence Research, 70:955–1001, 2021.

Download

pdf [531.8kB]  HTML 

Abstract

In domains such as electric vehicle charging, smart distribution grids and autonomous warehouses, multiple agents share the same resources. When planning the use of these resources, agents need to deal with the uncertainty in these domains. Although several models and algorithms for such constrained multiagent planning problems under uncertainty have been proposed in the literature, it remains unclear when which algorithm can be applied. In this survey we conceptualize these domains and establish a generic problem class based on Markov decision processes. We identify and compare the conditions under which algorithms from the planning literature for problems in this class can be applied: whether constraints are soft or hard, whether agents are continuously connected, whether the domain is fully observable, whether a constraint is momentarily (instantaneous) or on a budget, and whether the constraint is on a single resource or on multiple. Further we discuss the advantages and disadvantages of these algorithms. We conclude by identifying open problems that are directly related to the conceptualized domains, as well as in adjacent research areas.

BibTeX Entry

@Article{DeNijs21jair,
  author =       {Frits de Nijs and Erwin Walraven and Mathijs M. de
                  Weerdt and Matthijs T. J. Spaan},
  title =        {Constrained Multiagent {M}arkov Decision Processes:
                  a Taxonomy of Problems and Algorithms},
  journal =      {Journal of Artificial Intelligence Research},
  volume =       70,
  pages =        {955--1001},
  year =         2021
}

Note: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. In most cases, these works may not be reposted without the explicit permission of the copyright holder.

Generated by bib2html.pl (written by Patrick Riley) on Thu Feb 29, 2024 16:15:45 UTC