Publications

| Sorted by Date | Classified by Publication Type | Classified by Research Category |

Decision-theoretic Planning under Uncertainty with Information Rewards for Active Cooperative Perception

Matthijs T. J. Spaan, Tiago S. Veiga, and Pedro U. Lima. Decision-theoretic Planning under Uncertainty with Information Rewards for Active Cooperative Perception. Autonomous Agents and Multi-Agent Systems, 29(6):1157–1185, 2015.

Download

pdf HTML 

Abstract

Partially observable Markov decision processes (POMDPs) provide a principled framework for modeling an agent's decision-making problem when the agent needs to consider noisy state estimates. POMDP policies take into account an action's influence on the environment as well as the potential information gain. This is a crucial feature for robotic agents which generally have to consider the effect of actions on sensing. However, building POMDP models which reward information gain directly is not straightforward, but is important in domains such as robot-assisted surveillance in which the value of information is hard to quantify. Common techniques for uncertainty reduction such as expected entropy minimization lead to non-standard POMDPs that are hard to solve. We present the POMDP with Information Rewards (POMDP-IR) modeling framework, which rewards an agent for reaching a certain level of belief regarding a state feature. By remaining in the standard POMDP setting we can exploit many known results as well as successful approximate algorithms. We demonstrate our ideas in a toy problem as well as in real robot-assisted surveillance, showcasing their use for active cooperative perception scenarios. Finally, our experiments show that the POMDP-IR framework compares favorably with a related approach on benchmark domains.

BibTeX Entry

@Article{Spaan15jaamas,
  author =       {Matthijs T. J. Spaan and Tiago S. Veiga and Pedro
                  U. Lima},
  title =        {Decision-theoretic Planning under Uncertainty with
                  Information Rewards for Active Cooperative
                  Perception},
  journal =      {Autonomous Agents and Multi-Agent Systems},
  year =         2015,
  volume =       29,
  number =       6,
  pages =        {1157--1185}
}

Note: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. In most cases, these works may not be reposted without the explicit permission of the copyright holder.

Generated by bib2html.pl (written by Patrick Riley) on Thu Feb 29, 2024 16:15:45 UTC