Publications

| Sorted by Date | Classified by Publication Type | Classified by Research Category |

Note: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. In most cases, these works may not be reposted without the explicit permission of the copyright holder.

Classified by Publication Type

| Journal | Book | Book Chapter | Conference (international) | Conference (local) | Workshop | Technical Report | Master's Thesis | PhD Thesis |

Journal

• Qisong Yang, Thiago D. Simão, Simon H. Tindemans, and Matthijs T. J. Spaan. Safety-Constrained Reinforcement Learning with a Distributional Safety Critic. Machine Learning, 112(3):859–887, Springer, 2023.
  Details     Download: pdf 
• Johan Los, Frederik Schulte, Margaretha Gansterer, Richard F. Hartl, Matthijs T. J. Spaan, and Rudy R. Negenborn. Large-scale collaborative vehicle routing. Annals of Operations Research, Springer, 2022.
  Details     Download: HTML 
• Frits de Nijs, Erwin Walraven, Mathijs M. de Weerdt, and Matthijs T. J. Spaan. Constrained Multiagent Markov Decision Processes: a Taxonomy of Problems and Algorithms. Journal of Artificial Intelligence Research, 70:955–1001, 2021.
  Details     Download: pdf [531.8kB]  HTML 
• Joris Scharpff, Daan Schraven, Leentje Volker, Matthijs T. J. Spaan, and Mathijs M. de Weerdt. Can multiple contractors self-regulate their joint service delivery? A serious gaming experiment on road maintenance planning. Construction Management and Economics, 39(2):99–116, Routledge, 2021.
  Details     Download: HTML 
• Nils H. van der Blij, Pavel Purgat, Thiago B. Soeiro, Laura M. Ramirez-Elizondo, Matthijs T. J. Spaan, and Pavol Bauer. Decentralized plug-and-play protection scheme for low voltage DC grids. Energies, 13(12):1–21, 2020.
  Details     Download: HTML 
• Nils H. van der Blij, Laura M. Ramirez-Elizondo, Matthijs T. J. Spaan, and Pavol Bauer. Grid sense multiple access: A decentralized control algorithm for DC grids. International Journal of Electrical Power & Energy Systems, Elsevier, 2020.
  Details     Download: HTML 
• Martine van den Boomen, Matthijs T. J. Spaan, Yue Shang, and A. R. M. Wolfert. Infrastructure maintenance and replacement optimization under multiple uncertainties and managerial flexibility. Construction Management and Economics, 38(1):91–107, Routledge, 2020.
  Details     Download: HTML 
• Johan Los, Frederik Schulte, Matthijs T. J. Spaan, and Rudy R. Negenborn. The value of information sharing for platform-based collaborative vehicle routing. Transportation Research Part E: Logistics and Transportation Review, 141, 2020.
  Details     Download: HTML 
• Erwin Walraven and Matthijs T. J. Spaan. Point-Based Value Iteration for Finite-Horizon POMDPs. Journal of Artificial Intelligence Research, 65:307–341, 2019.
  Details     Download: pdf [948.4kB]  HTML 
• C. J. A. Ter Berg, G. Leontaris, M. van den Boomen, M. T. J. Spaan, and A. R. M. Wolfert. Expert judgement based maintenance decision support method for structures with a long service-life. Structure & Infrastructure Engineering, 15(4):492–503, Taylor & Francis, 2019.
  Details     Download: HTML 
• Nils H. van der Blij, Laura M. Ramirez-Elizondo, Matthijs T. J. Spaan, and Pavol Bauer. A State-Space Approach to Modelling DC Distribution Systems. IEEE Transactions on Power Systems, 33:943–950, 2018.
  Details     Download: HTML 
• Nils H. van der Blij, Laura M. Ramirez-Elizondo, Matthijs T. J. Spaan, and Pavol Bauer. Symmetrical Component Decomposition of DC Distribution Systems. IEEE Transactions on Power Systems, 33:2733–2741, 2018.
  Details     Download: HTML 
• M. van den Boomen, M. T. J. Spaan, R. Schoenmaker, and A.R.M. Wolfert. Untangling decision tree and real options analyses: a public infrastructure case study dealing with political decisions, structural integrity and price uncertainty. Construction Management and Economics, 37(1):24–43, Routledge, 2018.
  Details     Download: HTML 
• Yash Satsangi, Shimon Whiteson, Frans A. Oliehoek, and Matthijs T. J. Spaan. Exploiting Submodular Value Functions for Scaling Up Active Perception. Autonomous Robots, 42:209–233, 2018.
  Details     Download: pdf HTML 
• Erwin Walraven and Matthijs T. J. Spaan. Column Generation Algorithms for Constrained POMDPs. Journal of Artificial Intelligence Research, 62:489–533, 2018.
  Details     Download: pdf 
• Nils H. van der Blij, Laura M. Ramirez-Elizondo, Matthijs T.J . Spaan, and Pavol Bauer. Stability and Decentralized Control of Plug-and-Play DC Distribution Grids. IEEE Access, 6:63726–63736, 2018.
  Details     Download: HTML 
• Nils H. van der Blij, Laura M. Ramirez-Elizondo, Matthijs T. J. Spaan, and Pavol Bauer. Stability of DC Distribution Systems: An Algebraic Derivation. Energies, 10(9), 2017.
  Details     Download: pdf 
• Frans A. Oliehoek, Matthijs T. J. Spaan, Bas Terwijn, Philipp Robbel, and João V. Messias. The MADP Toolbox: An Open Source Library for Planning and Learning in (Multi-)Agent Systems. Journal of Machine Learning Research, 18(89):1–5, 2017.
  Details     Download: pdf HTML 
• Nisar Ahmed, Paul Bello, Selmer Bringsjord, Micah Clark, Bradley Hayes, Andrey Kolobov, Christopher Miller, Frans Oliehoek, Frank Stein, and Matthijs Spaan. The 2015 AAAI Fall Symposium Series Reports. AI Magazine, Summer:85–90, 2016.
  Details     Download: HTML 
• Erwin Walraven, Matthijs T. J. Spaan, and Bram Bakker. Traffic flow optimization: A reinforcement learning approach. Engineering Applications of Artificial Intelligence, 52:203–212, 2016.
  Details     Download: HTML 
• Matthijs T. J. Spaan, Tiago S. Veiga, and Pedro U. Lima. Decision-theoretic Planning under Uncertainty with Information Rewards for Active Cooperative Perception. Autonomous Agents and Multi-Agent Systems, 29(6):1157–1185, 2015.
  Details     Download: pdf HTML 
• Jesús Capitán, Matthijs T. J. Spaan, Luis Merino, and An\'ibal Ollero. Decentralized Multi-robot Cooperation with Auctioned POMDPs. International Journal of Robotics Research, 32(6):650–671, 2013.
  Details     Download: pdf HTML 
• Frans A. Oliehoek, Matthijs T. J. Spaan, Christopher Amato, and Shimon Whiteson. Incremental Clustering and Expansion for Faster Optimal Planning in Dec-POMDPs. Journal of Artificial Intelligence Research, 46:449–509, 2013.
  Details     Download: pdf [7.2MB]  
• Rajneesh Sharma and Matthijs T. J. Spaan. Bayesian Game Based Fuzzy Reinforcement Learning Control for Decentralized POMDPs. IEEE Transactions on Computational Intelligence and AI in Games, 4(4):309–328, 2012.
  Details     Download: (unavailable)
• Alberto Sanfeliu, Juan Andrade-Cetto, Marco Barbosa, Richard Bowden, Jesús Capitán, Andreu Corominas, Andrew Gilbert, John Illingworth, Luis Merino, Josep M. Mirats, Plinio Moreno, An\'ibal Ollero, João Sequeira, and Matthijs T. J. Spaan. Decentralized Sensor Fusion for Ubiquitous Networking Robotics in Urban Areas. Sensors, 10(3):2274–2314, 2010.
  Details     Download: pdf [2.3MB]  
• Frans A. Oliehoek, Matthijs T. J. Spaan, and Nikos Vlassis. Optimal and Approximate Q-value Functions for Decentralized POMDPs. Journal of Artificial Intelligence Research, 32:289–353, 2008.
  Details     Download: pdf [613.0kB]  ps [1.1MB]  
• Josep M. Porta, Nikos Vlassis, Matthijs T. J. Spaan, and Pascal Poupart. Point-Based Value Iteration for Continuous POMDPs. Journal of Machine Learning Research, 7:2329–2367, November 2006.
  Details     Download: pdf [515.5kB]  
• Jelle R. Kok, Matthijs T. J. Spaan, and Nikos Vlassis. Non-communicative multi-robot coordination in dynamic environments. Robotics and Autonomous Systems, 50(2-3):99–114, February 2005.
  Details     Download: pdf [233.5kB]  
• Matthijs T. J. Spaan and Nikos Vlassis. Perseus: Randomized Point-based Value Iteration for POMDPs. Journal of Artificial Intelligence Research, 24:195–220, 2005.
  Details     Download: pdf [1.3MB]  ps.gz [488.2kB]  

Book

• Katia Sycara, Vasant Honavar, and Matthijs Spaan, editors. Proceedings of the Thirty-Sixth AAAI Conference on Artificial Intelligence, AAAI Press, 2022.
  Details     Download: HTML 
• Mathijs de Weerdt, Sven Koenig, Gabriele Röger, and Matthijs Spaan, editors. Proceedings of the Twenty-Eighth International Conference on Automated Planning and Scheduling, AAAI Press, 2018.
  Details     Download: HTML 
• Matthijs T. J. Spaan, Frans A. Oliehoek, Christopher Amato, Andrey Kolobov, and Pascal Poupart, editors. Sequential Decision Making for Intelligent Agents, Fall Symposium Series Technical Report, AAAI Press, 2015.
  Details     Download: HTML 

Book Chapter

• Frits de Nijs, Mathijs M. de Weerdt, and Matthijs T. J. Spaan. Multi-agent Planning Under Uncertainty for Capacity Management. In Peter Palensky, Milo\vs Cvetkovi\'c, and Tamás Keviczky, editors, Intelligent Integrated Energy Systems: The PowerWeb Program at TU Delft, pp. 197–213, Springer International Publishing, 2019.
  Details     Download: HTML 
• Francisco S. Melo, Matthijs T. J. Spaan, and Stefan Witwicki. QueryPOMDP: POMDP-based Communication in Multiagent Systems. In Massimo Cossentino, Michael Kaisers, Karl Tuyls, and Gerhard Weiss, editors, Multi-Agent Systems, number 7541 in LNCS, pp. 189–204, Springer, 2012. 9th European Workshop, EUMAS 2011, Maastricht, The Netherlands, November 14-15, 2011. Revised Selected Papers
  Details     Download: pdf [186.7kB]  
• Matthijs T. J. Spaan. Partially Observable Markov Decision Processes. In Marco Wiering and Martijn van Otterlo, editors, Reinforcement Learning: State of the Art, pp. 387–414, Springer Verlag, 2012.
  Details     Download: pdf [206.7kB]  
• Frans C. A. Groen, Matthijs T. J. Spaan, Jelle R. Kok, and Gregor Pavlin. Real World Multi-agent Systems: Information Sharing, Coordination and Planning. In Balder D. ten Cate and Henk W. Zeevat, editors, Logic, Language, and Computation, Lecture Notes in Computer Science 4363, pp. 154–165, Springer Verlag, 2007. ISBN: 978-3-540-75143-4
  Details     Download: pdf [1.3MB]  

Conference (international)

• Pascal R. Van der Vaart, Neil Yorke-Smith, and Matthijs T. J. Spaan. Bayesian Ensembles for Exploration in Deep Reinforcement Learning. In Proc. of Int. Conference on Autonomous Agents and Multi Agent Systems, 2024. Extended abstract
  Details     Download: (unavailable)
• Moritz A. Zanger, Wendelin Böhmer, and Matthijs T. J. Spaan. Diverse Projection Ensembles for Distributional Reinforcement Learning. In Proc. Int. Conf. on Learning Representations, 2024.
  Details     Download: (unavailable)
• Alberto Castellini, Federico Bianchi, Edoardo Zorzi, Thiago D. Simão, Alessandro Farinelli, and Matthijs T. J. Spaan. Scalable Safe Policy Improvement via Monte Carlo Tree Search. In International Conference on Machine Learning, pp. 3732–3756, Proceedings of Machine Learning Research 202, 2023.
  Details     Download: pdf 
• Qisong Yang and Matthijs T. J. Spaan. CEM: Constrained Entropy Maximization for Task-Agnostic Safe Exploration. In Proceedings of the Thirty-Seventh AAAI Conference on Artificial Intelligence, pp. 10798–10806, 2023.
  Details     Download: pdf 
• Sebastian Junges and Matthijs T. J. Spaan. Abstraction-Refinement for Hierarchical Probabilistic Models. In Proc. Int. Conf. on Computer Aided Verification, pp. 102–123, 2022.
  Details     Download: pdf 
• Danial Kamran, Thiago D. Simão, Qisong Yang, Canmanie T. Ponnambalam, Johannes Fischer, Matthijs T. J. Spaan, and Martin Lauer. A Modern Perspective on Safe Automated Driving for Different Traffic Dynamics using Constrained Reinforcement Learning. In Proceedings of the IEEE International Conference on Intelligent Transportation Systems, pp. 4017–4023, 2022.
  Details     Download: HTML 
• Johan Los, Frederik Schulte, Matthijs T. J. Spaan, and Rudy R. Negenborn. An Auction-Based Multi-Agent System for the Pickup and Delivery Problem with Autonomous Vehicles and Alternative Locations. In Proceedings of the 8th International Conference on Dynamics in Logistics, pp. 244–260, 2022.
  Details     Download: HTML 
• Johan Los, Frederik Schulte, Matthijs T. J. Spaan, and Rudy R. Negenborn. Strategic Bidding in Decentralized Collaborative Vehicle Routing. In Proceedings of the 8th International Conference on Dynamics in Logistics, pp. 261–274, 2022.
  Details     Download: HTML 
• Miguel Suau, Jinke He, Matthijs T. J. Spaan, and Frans A. Oliehoek. Speeding up Deep Reinforcement Learning through Influence-Augmented Local Simulators. In Proc. of Int. Conference on Autonomous Agents and Multi Agent Systems, pp. 1735–1737, 2022.
  Details     Download: pdf 
• Miguel Suau, Jinke He, Matthijs T. J. Spaan, and Frans A. Oliehoek. Influence-Augmented Local Simulators: A Scalable Solution for Fast Deep RL in Large Networked Systems. In International Conference on Machine Learning, pp. 20604–20624, Proceedings of Machine Learning Research 162, 2022.
  Details     Download: pdf 
• Miguel Suau, Jinke He, Mustafa Mert Çelikok, Matthijs T. J. Spaan, and Frans A. Oliehoek. Distributed Influence-Augmented Local Simulators for Parallel MARL in Large Networked Systems. In Advances in Neural Information Processing Systems, pp. 28305–28318, 2022.
  Details     Download: pdf 
• Nils H. van der Blij, Pavel Purgat, Thiago B. Soeiro, Laura M. Ramirez-Elizondo, Matthijs T. J. Spaan, and Pavol Bauer. Protection Framework for Low Voltage DC Grids. In Proceedings 2021 IEEE 19th International Power Electronics and Motion Control Conference, pp. 331–337, 2021.
  Details     Download: HTML 
• Steven Carr, Nils Jansen, Suda Bharadwaj, Matthijs T. J. Spaan, and Ufuk Topcu. Safe Policies for Factored Partially Observable Stochastic Games. In Robotics: Science and System XVII, 2021.
  Details     Download: pdf 
• Canmanie T. Ponnambalam, Frans A. Oliehoek, and Matthijs T. J. Spaan. Abstraction-Guided Policy Recovery from Expert Demonstrations. In Proc. of Int. Conf. on Automated Planning and Scheduling, pp. 560–568, 2021.
  Details     Download: pdf [989.6kB]  HTML 
• Thiago D. Simão, Nils Jansen, and Matthijs T. J. Spaan. AlwaysSafe: Reinforcement Learning without Safety Constraint Violations during Training. In Proc. of Int. Conference on Autonomous Agents and Multi Agent Systems, pp. 1226–1235, 2021.
  Details     Download: pdf 
• Qisong Yang, Thiago D. Simão, Simon H. Tindemans, and Matthijs T. J. Spaan. WCSAC: Worst-Case Soft Actor Critic for Safety-Constrained Reinforcement Learning. In Proceedings of the Thirty-Fifth AAAI Conference on Artificial Intelligence, pp. 10639–10646, 2021.
  Details     Download: pdf [1008.5kB]  HTML 
• Nils H. van der Blij, Dario Chaifouroosh, Claudio A. Canizares, Thiago B. Soeiro, Laura M. Ramirez-Elizondo, Matthijs T. J. Spaan, and Pavol Bauer. Improved Power Flow Methods for DC Grids. In Proc. IEEE Int. Symposium on Industrial Electronics, pp. 1135–1140, IEEE, 2020.
  Details     Download: HTML 
• Johan Los, Frederik Schulte, Margaretha Gansterer, Richard F. Hartl, Matthijs T. J. Spaan, and Rudy R. Negenborn. Decentralized Combinatorial Auctions for Dynamic and Large-Scale Collaborative Vehicle Routing. In Proc. Int. Conf. on Computational Logistics, pp. 215–230, Springer, 2020.
  Details     Download: HTML 
• Johan Los, Frederik Schulte, Matthijs T. J. Spaan, and Rudy R. Negenborn. Collaborative Vehicle Routing when Agents have Mixed Information Sharing Attitudes. Transportation Research Procedia, 44:94–101, Elsevier, 2020.
  Details     Download: HTML 
• Jennifer Renoux, Tiago S. Veiga, Pedro U. Lima, and Matthijs T. J. Spaan. A Unified Decision-Theoretic Model for Information Gathering and Communication Planning. In IEEE Int. Conf. on Robot and Human Interactive Communication (RO-MAN), pp. 67–74, 2020.
  Details     Download: HTML 
• Thiago D. Simão and Matthijs T. J. Spaan. Safe Policy Improvement with Baseline Bootstrapping in Factored Environments. In Proceedings of the 32nd AAAI Conference on Artificial Intelligence, pp. 4967–4974, 2019.
  Details     Download: pdf [1.2MB]  HTML 
• Thiago D. Simão and Matthijs T. J. Spaan. Structure Learning for Safe Policy Improvement. In Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence, pp. 3453–3459, 2019.
  Details     Download: pdf [348.5kB]  HTML 
• Yi-Chun Chen, Mykel J. Kochenderfer, and Matthijs T. J. Spaan. Improving Offline Value-Function Approximations for POMDPs by Reducing Discount Factors. In Proc. of International Conference on Intelligent Robots and Systems, 2018.
  Details     Download: (unavailable)
• Johan Los, Matthijs T. J. Spaan, and Rudy R. Negenborn. Fleet Management for Pickup and Delivery Problems with Multiple Locations and Preferences. In International Conference on Dynamics in Logistics, pp. 86–94, 2018.
  Details     Download: HTML 
• Frits de Nijs, Georgios Theocharous, Nikos Vlassis, Mathijs M. de Weerdt, and Matthijs T. J. Spaan. Capacity-aware Sequential Recommendations. In Proc. of Int. Conference on Autonomous Agents and Multi Agent Systems, pp. 416–424, 2018.
  Details     Download: pdf 
• Frits de Nijs, Matthijs T. J. Spaan, and Mathijs M. de Weerdt. Preallocation and Planning under Stochastic Resource Constraints. In Proceedings of the 32nd AAAI Conference on Artificial Intelligence, pp. 4662–4669, 2018.
  Details     Download: pdf 
• Diederik M. Roijers, Erwin Walraven, and Matthijs T. J. Spaan. Bootstrapping LPs in Value Iteration for Multi-Objective and Partially Observable MDPs. In Proc. of Int. Conf. on Automated Planning and Scheduling, pp. 218–226, 2018.
  Details     Download: pdf 
• Nils H. van der Blij, Laura M. Ramirez-Elizondo, Pavol Bauer, and Matthijs T. J. Spaan. Design Guidelines for Stable DC Distribution Systems. In IEEE Int. Conf. on DC Microgrids, 2017.
  Details     Download: HTML 
• Frits de Nijs, Erwin Walraven, Mathijs M. de Weerdt, and Matthijs T. J. Spaan. Bounding the Probability of Resource Constraint Violations in Multi-Agent MDPs. In Proceedings of the 31st AAAI Conference on Artificial Intelligence, pp. 3562–3568, 2017.
  Details     Download: pdf [256.6kB]  
• Erwin Walraven and Matthijs T. J. Spaan. Accelerated Vector Pruning for Optimal POMDP Solvers. In Proceedings of the 31st AAAI Conference on Artificial Intelligence, pp. 3672–3678, 2017.
  Details     Download: pdf [446.1kB]  
• Frits de Nijs, Matthijs T. J. Spaan, and Mathijs M. de Weerdt. Decoupling a Resource Constraint through Fictitious Play in Multi-agent Sequential Decision Making. In Proc. of European Conference on Artificial Intelligence, pp. 1724–1725, 2016.
  Details     Download: HTML 
• Joris Scharpff, Diederik M. Roijers, Frans A. Oliehoek, Matthijs T. J. Spaan, and Mathijs M. de Weerdt. Solving Transition-Independent Multi-agent MDPs with Sparse Interactions. In Proceedings of the Thirtieth AAAI Conference on Artificial Intelligence, pp. 3174–3180, 2016.
  Details     Download: pdf [593.5kB]  
• Erwin Walraven and Matthijs T. J. Spaan. Planning under Uncertainty for Aggregated Electric Vehicle Charging with Renewable Energy Supply. In Proc. of European Conference on Artificial Intelligence, pp. 904–912, 2016.
  Details     Download: pdf [367.2kB]  
• Frits de Nijs, Matthijs T. J. Spaan, and Mathijs M. de Weerdt. Best-Response Planning of Thermostatically Controlled Loads under Power Constraints. In Proceedings of the Twenty-Ninth AAAI Conference on Artificial Intelligence, pp. 615–621, 2015.
  Details     Download: pdf 
• Frans A. Oliehoek, Matthijs T. J. Spaan, and Stefan J. Witwicki. Influence-Optimistic Local Values for Multiagent Planning. In Proc. of Int. Conference on Autonomous Agents and Multi Agent Systems, pp. 1703–1704, 2015. Extended abstract.
  Details     Download: (unavailable)
• Frans A. Oliehoek, Matthijs T. J. Spaan, and Stefan J. Witwicki. Factored Upper Bounds for Multiagent Planning Problems under Uncertainty with Non-Factored Value Functions. In Proc. of International Joint Conference on Artificial Intelligence, pp. 1645–1651, 2015.
  Details     Download: pdf 
• Tiago S. Veiga, Matthijs T. J. Spaan, and Pedro U. Lima. Improving Value Function Approximation in Factored POMDPs by Exploiting Model Structure. In Proc. of Int. Conference on Autonomous Agents and Multi Agent Systems, pp. 1872–1873, 2015. Extended abstract.
  Details     Download: (unavailable)
• Erwin Walraven and Matthijs T. J. Spaan. Planning under Uncertainty with Weighted State Scenarios. In Proc. of Uncertainty in Artificial Intelligence, pp. 912–921, 2015.
  Details     Download: pdf [250.1kB]  
• Jesus Capitan, Matthijs Spaan, Luis Merino, and Anibal Ollero. Decentralized Multi-Robot Cooperation with Auctioned POMDPs. In Proc. of Int. Conf. on Automated Planning and Scheduling, pp. 515–518, 2014. ICAPS Journal track.
  Details     Download: (unavailable)
• Diederik M. Roijers, Joris Scharpff, Matthijs T. J. Spaan, Frans A. Oliehoek, Mathijs de Weerdt, and Shimon Whiteson. Bounded Approximations for Linear Multi-Objective Planning under Uncertainty. In Proc. of Int. Conf. on Automated Planning and Scheduling, pp. 262–270, 2014.
  Details     Download: pdf [385.0kB]  
• Tiago S. Veiga, Matthijs T. J. Spaan, and Pedro U. Lima. Point-based POMDP Solving with Factored Value Function Approximation. In Proceedings of the Twenty-Eighth AAAI Conference on Artificial Intelligence, pp. 2512–2518, 2014.
  Details     Download: pdf [908.5kB]  
• Stefan J. Witwicki, José Carlos Castillo, Jesús Capitán, João V. Messias, João C. Reis, Pedro U. Lima, Francisco S. Melo, and Matthijs T. J. Spaan. A Testbed for Autonomous Robot Surveillance (Demonstration). In Proc. of Int. Conference on Autonomous Agents and Multi Agent Systems, pp. 1635–1636, 2014.
  Details     Download: (unavailable)
• João V. Messias, Matthijs T. J. Spaan, and Pedro U. Lima. GSMDPs for Multi-Robot Sequential Decision-Making. In Proceedings of the Twenty-Seventh AAAI Conference on Artificial Intelligence, pp. 1408–1414, 2013.
  Details     Download: pdf [711.0kB]  
• João V. Messias, Matthijs T. J. Spaan, and Pedro U. Lima. Multiagent POMDPs with Asynchronous Execution. In Proc. of Int. Conference on Autonomous Agents and Multi Agent Systems, pp. 1273–1274, 2013. Extended abstract.
  Details     Download: pdf [541.7kB]  
• Frans A. Oliehoek, Shimon Whiteson, and Matthijs T. J. Spaan. Approximate Solutions for Factored Dec-POMDPs with Many Agents. In Proc. of Int. Conference on Autonomous Agents and Multi Agent Systems, pp. 563–570, 2013.
  Details     Download: pdf [588.8kB]  
• Joris Scharpff, Matthijs T. J. Spaan, Leentje Volker, and Mathijs M. de Weerdt. Coordinating Maintenance Planning under Uncertainty. In Proc. of Int. Conference on Autonomous Agents and Multi Agent Systems, pp. 1405–1406, 2013. Demonstration
  Details     Download: pdf [1.6MB]  
• Joris Scharpff, Matthijs T. J. Spaan, Leentje Volker, and Mathijs M. de Weerdt. Planning under Uncertainty for Coordinating Infrastructural Maintenance. In Proc. of Int. Conf. on Automated Planning and Scheduling, pp. 425–433, 2013.
  Details     Download: pdf [287.1kB]  
• Stefan Witwicki, Francisco S. Melo, Jesús Capitán, and Matthijs T. J. Spaan. A Flexible Approach to Modeling Unpredictable Events in MDPs. In Proc. of Int. Conf. on Automated Planning and Scheduling, pp. 260–268, 2013.
  Details     Download: pdf [767.1kB]  
• Jesús Capitán, Matthijs T. J. Spaan, Luis Merino, and An\'ibal Ollero. Decentralized Multi-Robot Cooperation with Auctioned POMDPs. In Proceedings of the IEEE International Conference on Robotics and Automation, pp. 3323–3328, 2012.
  Details     Download: (unavailable)
• Frans A. Oliehoek and Matthijs T. J. Spaan. Tree-based Solution Methods for Multiagent POMDPs with Delayed Communication. In Proc. of the AAAI Conference on Artificial Intelligence, pp. 1415–1421, 2012.
  Details     Download: pdf [145.0kB]  
• Frans A. Oliehoek and Matthijs T. J. Spaan. Tree-based Pruning for Multiagent POMDPs with Delayed Communication. In Proc. of Int. Conference on Autonomous Agents and Multi Agent Systems, pp. 1229–1230, 2012.
  Details     Download: pdf [112.5kB]  
• Frans A. Oliehoek, Shimon Whiteson, and Matthijs T. J. Spaan. Exploiting Structure in Cooperative Bayesian Games. In Proc. of Uncertainty in Artificial Intelligence, pp. 654–664, 2012.
  Details     Download: pdf [1.2MB]  
• João V. Messias, Matthijs T. J. Spaan, and Pedro U. Lima. Efficient Offline Communication Policies for Factored Multiagent POMDPs. In Advances in Neural Information Processing Systems, pp. 1917–1925, 2011.
  Details     Download: pdf [156.7kB]  
• Rajneesh Sharma and Matthijs T. J. Spaan. Fuzzy Reinforcement Learning Control for Decentralized Partially Observable Markov Decision Processes. In Proc. of IEEE Int. Conf. on Fuzzy Systems, 2011.
  Details     Download: (unavailable)
• Matthijs T. J. Spaan, Frans A. Oliehoek, and Christopher Amato. Scaling Up Optimal Heuristic Search in Dec-POMDPs via Incremental Expansion. In Proc. of International Joint Conference on Artificial Intelligence, pp. 2027–2032, 2011.
  Details     Download: pdf [160.2kB]  
• Frans A. Oliehoek, Matthijs T. J. Spaan, Jilles S. Dibangoye, and Christopher Amato. Heuristic Search for Identical Payoff Bayesian Games. In Proc. of Int. Conference on Autonomous Agents and Multi Agent Systems, pp. 1115–1122, 2010.
  Details     Download: pdf [179.3kB]  
• Abdolkarim Pahliani, Matthijs T. J. Spaan, and Pedro U. Lima. Fault-Tolerant Probabilistic Sensor Fusion for Distributed Multi-Agent Systems. In Proc. of International Conference on Intelligent Robots and Systems, pp. 4812–4817, 2010.
  Details     Download: pdf [636.2kB]  
• Rajneesh Sharma and Matthijs T. J. Spaan. A Bayesian Game based Adaptive Fuzzy Controller for Multiagent POMDPs. In Proc. of IEEE Int. Conf. on Fuzzy Systems, pp. 1422–1429, 2010.
  Details     Download: pdf [966.1kB]  
• Matthijs T. J. Spaan, Nelson Gonçalves, and João Sequeira. Multirobot Coordination by Auctioning POMDPs. In Proceedings of the IEEE International Conference on Robotics and Automation, pp. 1446–1451, 2010.
  Details     Download: pdf [96.2kB]  
• Matthijs T. J. Spaan, Tiago S. Veiga, and Pedro U. Lima. Active Cooperative Perception in Network Robot Systems Using POMDPs. In Proc. of International Conference on Intelligent Robots and Systems, pp. 4800–4805, 2010.
  Details     Download: pdf [154.5kB]  
• Marco Barbosa, Alexandre Bernardino, Dario Figueira, José Gaspar, Nelson Gonçalves, Pedro U. Lima, Plinio Moreno, Abdolkarim Pahliani, José Santos-Victor, Matthijs T. J. Spaan, and João Sequeira. ISRobotNet: A Testbed for Sensor and Robot Network Systems. In Proc. of International Conference on Intelligent Robots and Systems, pp. 2827–2833, 2009.
  Details     Download: pdf [2.5MB]  
• Frans A. Oliehoek, Shimon Whiteson, and Matthijs T. J. Spaan. Lossless Clustering of Histories in Decentralized POMDPs. In Proc. of Int. Conference on Autonomous Agents and Multi Agent Systems, pp. 577–584, May 2009.
  Details     Download: pdf [209.6kB]  
• Abdolkarim Pahliani, Matthijs T. J. Spaan, and Pedro U. Lima. Decision-theoretic Robot Guidance for Active Cooperative Perception. In Proc. of International Conference on Intelligent Robots and Systems, pp. 4837–4842, 2009.
  Details     Download: pdf [267.8kB]  
• Alberto Reyes, Matthijs T. J. Spaan, and L. Enrique Sucar. An Intelligent Assistant for Power Plants based on Factored MDPs. In Int. Conf. on Intelligent System Applications to Power Systems, 2009.
  Details     Download: pdf [288.5kB]  
• Matthijs T. J. Spaan and Pedro U. Lima. A Decision-theoretic Approach to Dynamic Sensor Selection in Camera Networks. In Int. Conf. on Automated Planning and Scheduling, pp. 279–304, 2009.
  Details     Download: pdf [1.5MB]  
• Frans A. Oliehoek, Matthijs T. J. Spaan, Shimon Whiteson, and Nikos Vlassis. Exploiting Locality of Interaction in Factored Dec-POMDPs. In Proc. of Int. Conference on Autonomous Agents and Multi Agent Systems, pp. 517–524, 2008.
  Details     Download: pdf [2.1MB]  
• Matthijs T. J. Spaan and Francisco S. Melo. Interaction-Driven Markov Games for Decentralized Multiagent Planning under Uncertainty. In Proc. of Int. Conference on Autonomous Agents and Multi Agent Systems, pp. 525–532, 2008.
  Details     Download: pdf [167.4kB]  
• Matthijs T. J. Spaan, Frans A. Oliehoek, and Nikos Vlassis. Multiagent Planning under Uncertainty with Stochastic Communication Delays. In Proc. of Int. Conf. on Automated Planning and Scheduling, pp. 338–345, 2008.
  Details     Download: pdf [141.2kB]  
• Matthijs T. J. Spaan, Geoffrey J. Gordon, and Nikos Vlassis. Decentralized planning under uncertainty for teams of communicating agents. In Proc. of Int. Conference on Autonomous Agents and Multi Agent Systems, pp. 249–256, 2006.
  Details     Download: pdf [183.6kB]  
• Josep M. Porta, Matthijs T. J. Spaan, and Nikos Vlassis. Robot Planning in Partially Observable Continuous Domains. In Robotics: Science and Systems, pp. 217–224, MIT Press, 2005.
  Details     Download: pdf [319.6kB]  
• Matthijs T. J. Spaan and Nikos Vlassis. Planning with continuous actions in partially observable environments. In Proceedings of the IEEE International Conference on Robotics and Automation, pp. 3469–3474, Barcelona, Spain, 2005.
  Details     Download: pdf [1.1MB]  
• Matthijs T. J. Spaan and Nikos Vlassis. A point-based POMDP algorithm for robot planning. In Proceedings of the IEEE International Conference on Robotics and Automation, pp. 2399–2404, New Orleans, Louisiana, 2004.
  Details     Download: pdf [1.9MB]  
• Jelle R. Kok, Matthijs T. J. Spaan, and Nikos Vlassis. Multi-robot decision making using coordination graphs. In Proceedings of the 11th International Conference on Advanced Robotics, pp. 1124–1129, Coimbra, Portugal, 2003.
  Details     Download: pdf [163.1kB]  
• M. T. J. Spaan and F. C. A. Groen. Team coordination among robotic soccer players. In RoboCup 2002, pp. 409–416, Springer-Verlag, 2003.
  Details     Download: pdf [114.2kB]  ps [182.0kB]  
• F.C.A. Groen, M.T.J. Spaan, and N. Vlassis. Robot Soccer Game or Science. In Proceedings CNR-2002, pp. 92–98, Editura Universitaria Craiova, October 2002. ISBN:973-8043-165-5
  Details     Download: (unavailable)
• M. Spaan, M. Wiering, R. Bartelds, R. Donkervoort, P. Jonker, and F. Groen. Clockwork Orange: The Dutch RoboSoccer Team. In RoboCup 2001: Robot Soccer World Cup V, pp. 627–630, LNCS 2377, Springer-Verlag, 2002.
  Details     Download: pdf [227.5kB]  ps.gz [1.3MB]  

Conference (local)

• Joris Scharpff, Diederik M. Roijers, Frans A. Oliehoek, Matthijs T. J. Spaan, and Mathijs de Weerdt. Conditional Return Policy Search for TI-MMDPs with Sparse Interactions. In Proceedings of the 28th Benelux Conference on Artificial Intelligence, 2016. Extended abstract
  Details     Download: (unavailable)
• Frits de Nijs, Mathijs M. de Weerdt, and Matthijs T. J. Spaan. Efficient Heuristics for Power Constrained Planning of Thermostatically Controlled Loads. In Proceedings of the 26th Benelux Conference on Artificial Intelligence, pp. 162–163, 2014. Extended abstract
  Details     Download: (unavailable)
• Diederik M. Roijers, Joris Scharpff, Matthijs T. J. Spaan, Frans A. Oliehoek, Mathijs de Weerdt, and Shimon Whiteson. Bounded Approximations for Linear Multi-Objective Planning under Uncertainty. In Proceedings of the 26th Benelux Conference on Artificial Intelligence, pp. 168–169, 2014. Extended abstract
  Details     Download: (unavailable)
• Jan Elffers, Dyan Konijnenberg, Erwin Walraven, and Matthijs T. J. Spaan. Enhancing SAT Based Planning with Landmark Knowledge. In Proceedings of the 25th Benelux Conference on Artificial Intelligence, pp. 64–71, 2013.
  Details     Download: pdf [103.8kB]  
• Frans A. Oliehoek, Shimon Whiteson, and Matthijs T. J. Spaan. Approximate Solutions for Factored Dec-POMDPs with Many Agents. In Proceedings of the 25th Benelux Conference on Artificial Intelligence, pp. 340–341, 2013. Extended abstract
  Details     Download: (unavailable)
• Joris Scharpff, Matthijs T. J. Spaan, Leentje Volker, and Mathijs M. de Weerdt. Planning under Uncertainty for Coordinating Infrastructural Maintenance. In Proceedings of the 25th Benelux Conference on Artificial Intelligence, pp. 352–353, 2013. Extended abstract
  Details     Download: (unavailable)
• Joris Scharpff, Matthijs T. J. Spaan, and Mathijs M. de Weerdt. Dynamic Mechanism Design for Efficient Planning under Uncertainty. In Proc. of 24th Benelux Conference on Artificial Intelligence, pp. 218–225, 2012.
  Details     Download: (unavailable)
• Matthijs T. J. Spaan and Frans A. Oliehoek. Tree-based Solution Methods for Multiagent POMDPs with Delayed Communication. In Proc. of 24th Benelux Conference on Artificial Intelligence, pp. 319–320, 2012. Extended abstract.
  Details     Download: (unavailable)
• Ana Rita Mendes, Matthijs T. J. Spaan, and Pedro U. Lima. Planning under Uncertainty for Search and Rescue. In Robótica -- 11th Int. Conf. on Mobile Robots and Competitions, pp. 52–57, 2011.
  Details     Download: (unavailable)
• Matthijs T. J. Spaan, Frans A. Oliehoek, and Christopher Amato. Scaling Up Optimal Heuristic Search in Dec-POMDPs via Incremental Expansion. In Proc. of 23rd Benelux Conference on Artificial Intelligence, pp. 433–434, 2011. Extended abstract.
  Details     Download: (unavailable)
• Frans Oliehoek, Matthijs T. J. Spaan, and Nikos Vlassis. Best-response play in partially observable card games. In Benelearn 2005: Proceedings of the 14th Annual Machine Learning Conference of Belgium and the Netherlands, pp. 45–50, February 2005.
  Details     Download: pdf [115.6kB]  
• Josep M. Porta, Matthijs T. J. Spaan, and Nikos Vlassis. Robot Planning in Partially Observable Continuous Domains. In Proc. of the 17th Belgian-Dutch Conference on Artifical Intelligence, pp. 375–376, Brussels, Belgium, October 2005. Extended abstract.
  Details     Download: (unavailable)
• Nikos Vlassis and Matthijs T. J. Spaan. A fast point-based algorithm for POMDPs. In Benelearn 2004: Proceedings of the Annual Machine Learning Conference of Belgium and the Netherlands, pp. 170–176, Brussels, Belgium, January 2004. (Also presented at the NIPS 16 workshop `Planning for the Real-World', Whistler, Canada, Dec 2003)
  Details     Download: pdf [231.4kB]  
• Jelle R. Kok, Matthijs T. J. Spaan, and Nikos Vlassis. An approach to noncommunicative multiagent coordination in continuous domains. In Benelearn 2002: Proceedings of the Twelfth Belgian-Dutch Conference on Machine Learning, Utrecht, The Netherlands, December 2002.
  Details     Download: pdf [126.7kB]  ps.gz [109.2kB]  
• Frans C. A. Groen, Jeroen Roodhart, Matthijs Spaan, Raymond Donkervoort, and Nikos Vlassis. A distributed world model for robot soccer that supports the development of team skills. In Proceedings of the 13th Belgian-Dutch Conference on Artificial Intelligence (BNAIC'01), pp. 389–396, Amsterdam, 2001.
  Details     Download: pdf [160.1kB]  ps.gz [64.9kB]  

Workshop

• Yaniv Oren, Matthijs T. J. Spaan, and Wendelin Böhmer. E-MCTS: Deep Exploration in Model-Based Reinforcement Learning by Planning with Epistemic Uncertainty. In European Workshop on Reinforcement Learning, 2023.
  Details     Download: pdf 
• Miguel Suau, Matthijs T. J. Spaan, and Frans A. Oliehoek. Bad Habits: Policy Confounding and Out-of-Trajectory Generalization in RL. In European Workshop on Reinforcement Learning, 2023.
  Details     Download: pdf 
• Pascal Van der Vaart, Matthijs T. J. Spaan, and Neil Yorke-Smith. Bayesian Deep Q-Learning via Sequential Monte Carlo. In European Workshop on Reinforcement Learning, 2023.
  Details     Download: pdf 
• Canmanie Ponnambalam, Danial Kamran, Thiago D. Simão, Frans A. Oliehoek, and Matthijs T. J. Spaan. Back to the Future: Solving Hidden Parameter MDPs with Hindsight. In Adaptive and Learning Agents, 2022. Workshop at AAMAS22
  Details     Download: pdf 
• Qisong Yang, Thiago D. Simão, Nils Jansen, Simon H. Tindemans, and Matthijs T. J. Spaan. Training and Transferring Safe Policies in Reinforcement Learning. In Adaptive and Learning Agents, 2022. Workshop at AAMAS22
  Details     Download: pdf 
• Qisong Yang, Thiago D. Simão, Simon H. Tindemans, and Matthijs T. J. Spaan. Refined Risk Management in Safe Reinforcement Learning with a Distributional Safety Critic. In Safe Reinforcement Learning, 2022. Workshop at IJCAI22
  Details     Download: pdf 
• Jordi Smit, Canmanie Ponnambalam, Matthijs T. J. Spaan, and Frans A. Oliehoek. PEBL: Pessimistic Ensembles for Offline Deep Reinforcement Learning. In Robust and Reliable Autonomy in the Wild, 2021. Workshop at IJCAI-21
  Details     Download: pdf 
• Grigory Neustroev, Canmanie T. Ponnambalam, Mathijs M. de Weerdt, and Matthijs T. J. Spaan. Interval Q-Learning: Balancing Deep and Wide Exploration. In Adaptive and Learning Agents, 2020. Workshop at AAMAS20
  Details     Download: pdf 
• Canmanie T. Ponnambalam, Frans A. Oliehoek, and Matthijs T. J. Spaan. Abstraction-Guided Policy Recovery from Expert Demonstrations. In Offline Reinforcement Learning Workshop at Neural Information Processing Systems (NeurIPS), 2020.
  Details     Download: pdf [233.6kB]  
• Thiago D. Simão and Matthijs T. J. Spaan. An Empirical Evaluation of Safe Policy Improvement in Factored Environments. In ICML/IJCAI/AAMAS 2018 Workshop on Planning and Learning, 2018.
  Details     Download: (unavailable)
• Frits de Nijs, Erwin Walraven, Mathijs M. de Weerdt, and Matthijs T. J. Spaan. Resource-constrained Multi-agent MDP Planning with Bounded Violation Probability. In NIPS workshop on Learning, Inference and Control of Multi-Agent Systems, 2016.
  Details     Download: (unavailable)
• Erwin Walraven and Matthijs T. J. Spaan. Planning under Uncertainty for Aggregated Electric Vehicle Charging using Markov Decision Processes. In International Workshop on Artificial Intelligence for Smart Grids and Smart Buildings, 2016.
  Details     Download: pdf [219.9kB]  
• Frits de Nijs, Matthijs T. J. Spaan, and Mathijs M. de Weerdt. A Challenge for Multi-Agent Sequential Decision Problems: Global Resource Constraints. In Multi-agent Sequential Decision Making under Uncertainty, 2015. Workshop at AAMAS15.
  Details     Download: (unavailable)
• Frans A. Oliehoek, Matthijs T. J. Spaan, and Stefan Witwicki. Influence-Optimistic Local Values for Multiagent Planning. In Multi-agent Sequential Decision Making under Uncertainty, 2015. Workshop at AAMAS15.
  Details     Download: (unavailable)
• Frans A. Oliehoek, Matthijs T. J. Spaan, Philipp Robbel, and João V. Messias. The MADP Toolbox: An Open-Source Library for Planning and Learning in (Multi-)Agent Systems. In AAAI Fall Symposium on Sequential Decision Making for Intelligent Agents, 2015.
  Details     Download: (unavailable)
• Joris Scharpff, Diederik M. Roijers, Frans A. Oliehoek, Matthijs T. J. Spaan, and Mathijs M. de Weerdt. Solving Multi-agent MDPs Optimally with Conditional Return Graphs. In Multi-agent Sequential Decision Making under Uncertainty, 2015. Workshop at AAMAS15.
  Details     Download: (unavailable)
• Erwin Walraven and Matthijs T. J. Spaan. A Scenario State Representation for Scheduling Deferrable Loads under Wind Uncertainty. In Multi-agent Sequential Decision Making under Uncertainty, 2015. Workshop at AAMAS15.
  Details     Download: (unavailable)
• Erwin Walraven and Matthijs T. J. Spaan. Planning under Uncertainty with Weighted State Scenarios. In AAAI Fall Symposium on Sequential Decision Making for Intelligent Agents, 2015. Extended abstract
  Details     Download: (unavailable)
• Frits de Nijs, Mathijs M. de Weerdt, and Matthijs T. J. Spaan. Efficient Heuristics for Power Constrained Planning of Thermostatically Controlled Loads. In International Workshop on Demand Response (Wattalyst), 2014. Co-located with ACM e-Energy 2014. Also presented at Future Energy Business & Energy Informatics.
  Details     Download: pdf [1.1MB]  
• João V. Messias, Matthijs T. J. Spaan, and Pedro U. Lima. Asynchronous Execution in Multiagent POMDPs: Reasoning Over Partially-Observable Events. In Multi-agent Sequential Decision Making under Uncertainty, 2013. Workshop at AAMAS13.
  Details     Download: pdf [459.2kB]  
• Joris Scharpff, Matthijs T. J. Spaan, Leentje Volker, and Mathijs M. de Weerdt. Coordinating Stochastic Multi-Agent Planning in a Private Values Setting. In Distributed and Multi-Agent Planning, 2013. Workshop at ICAPS.
  Details     Download: (unavailable)
• Joris Scharpff, Matthijs T. J. Spaan, Leentje Volker, and Mathijs M. de Weerdt. Planning under Uncertainty for Coordinating Infrastructural Maintenance. In Multi-agent Sequential Decision Making under Uncertainty, 2013. Workshop at AAMAS13.
  Details     Download: pdf [271.7kB]  
• Stefan Witwicki, Francisco S. Melo, Jesús Capitán, Matthijs T. J. Spaan, and José Carlos Castillo. Robot Planning under Uncertainty with Unpredictable Events. In Autonomous Robots and Multirobot Systems, 2013. Workshop at AAMAS 13.
  Details     Download: (unavailable)
• Jesús Capitán, Matthijs T. J. Spaan, and Luis Merino. Role-based Cooperation for Environmental Monitoring with Multiple UAVs. In IROS Workshop on Robotics for Environmental Monitoring, 2012.
  Details     Download: (unavailable)
• Francisco S. Melo, Alberto Sardinha, Stefan Witwicki, Laura M. Ramirez-Elizondo, and Matthijs T. J. Spaan. Decentralized Multiagent Planning for Balance Control in Smart Grids. In Procs. of the 1st Int'l Workshop on Information Technology for Energy Applications (IT4ENERGY'2012), CEUR Workshop Proceedings 923, 2012. ISSN 1613-0073
  Details     Download: (unavailable)
• Francisco S. Melo, Matthijs T. J. Spaan, and Stefan Witwicki. Exploiting Sparse Interactions for Optimizing Communication in Dec-MDPs. In Multi-agent Sequential Decision Making under Uncertainty, 2012. Workshop at AAMAS12
  Details     Download: pdf [154.7kB]  
• Frans A. Oliehoek and Matthijs T. J. Spaan. Tree-based Pruning for Multiagent POMDPs with Delayed Communication. In Multi-agent Sequential Decision Making under Uncertainty, 2012. Workshop at AAMAS12
  Details     Download: pdf [200.6kB]  
• Jesús Capitán, Matthijs T. J. Spaan, Luis Merino, and An\'ibal Ollero. Decentralized Multi-Robot Cooperation with Auctioned POMDPs. In Multi-agent Sequential Decision Making in Uncertain Domains, 2011. Workshop at AAMAS11
  Details     Download: pdf [217.3kB]  
• Francisco S. Melo and Matthijs T. J. Spaan. A POMDP-based Model for Optimizing Communication in Multiagent Systems. In European Workshop on Multi-agent Systems, 2011.
  Details     Download: pdf [171.6kB]  
• João V. Messias, Matthijs T. J. Spaan, and Pedro U. Lima. Exploiting Sparse Dependencies for Communication Reduction in Multiagent Planning under Uncertainty. In Decision Making in Partially Observable, Uncertain Worlds: Exploring Insights from Multiple Communities, 2011. Workshop at IJCAI11
  Details     Download: pdf [303.4kB]  
• Matthijs T. J. Spaan, Frans A. Oliehoek, and Christopher Amato. Scaling Up Optimal Heuristic Search in Dec-POMDPs via Incremental Expansion. In Multi-agent Sequential Decision Making in Uncertain Domains, 2011. Workshop at AAMAS11
  Details     Download: pdf [229.0kB]  
• João V. Messias, Matthijs T. J. Spaan, and Pedro U. Lima. Multi-robot planning under uncertainty with communication: a case study. In Multi-agent Sequential Decision Making in Uncertain Domains, 2010. Workshop at AAMAS10
  Details     Download: pdf [512.7kB]  
• Matthijs T. J. Spaan and Pedro U. Lima. Decision-theoretic Planning under Uncertainty for Active Cooperative Perception. In POMDP Practitioners Workshop: solving real-world POMDP problems, 2010. Workshop at ICAPS10
  Details     Download: (unavailable)
• Matthijs T. J. Spaan, Nelson Gonçalves, and João Sequeira. Multiagent Coordination by Auctioning POMDP Tasks. In Multi-agent Sequential Decision Making in Uncertain Domains, 2009. Workshop at AAMAS09
  Details     Download: pdf [117.4kB]  
• Matthijs T. J. Spaan and Pedro U. Lima. Decision-theoretic Planning under Uncertainty for Cooperative Active Perception. In NIPS Workshop on Adaptive Sensing, Active Learning and Experimental Design, 2009.
  Details     Download: (unavailable)
• Matthijs T. J. Spaan and Frans A. Oliehoek. The MultiAgent Decision Process toolbox: software for decision-theoretic planning in multiagent systems. In Multi-agent Sequential Decision Making in Uncertain Domains, 2008. Workshop at AAMAS08
  Details     Download: pdf [178.7kB]  
• Matthijs T. J. Spaan. Cooperative Active Perception using POMDPs. In AAAI 2008 Workshop on Advancements in POMDP Solvers, July 2008.
  Details     Download: pdf [2.0MB]  
• Frans A. Oliehoek, Matthijs T. J. Spaan, and Nikos Vlassis. Dec-POMDPs with delayed communication. In Multi-agent Sequential Decision Making in Uncertain Domains, 2007. Workshop at AAMAS07
  Details     Download: pdf [146.0kB]  
• Frans C. A. Groen, Matthijs T. J. Spaan, and Jelle R. Kok. Real world multiagent systems: information sharing, coordination and planning. In Trilateral workshop on Military Applications of Agent Technology in ICT and Robotics, TNO FEL, The Hague, November 2004.
  Details     Download: (unavailable)
• M. T. J. Spaan, M. Koutek, B. Terwijn, J. R. Kok, H. E. Bal, M. Boasson, F. C. A. Groen, and N. Vlassis. Interactive visualization, information sharing, planning and learning for a team of robots. In Proc. 5th PROGRESS Workshop on Embedded Systems, Nieuwegein, The Netherlands, 2004.
  Details     Download: (unavailable)
• M. T. J. Spaan, M. Koutek, B. Terwijn, J. R. Kok, H. E. Bal, M. Boasson, F. C. A. Groen, and N. Vlassis. Coordination, data sharing, and remote visualization of a team of autonomous robots. In Proc. 4th PROGRESS Workshop on Embedded Systems, Nieuwegein, The Netherlands, 2003.
  Details     Download: (unavailable)
• M. T. J. Spaan, N. Vlassis, and F. C. A. Groen. High level coordination of agents based on multiagent Markov decision processes with roles. In IROS'02 Workshop on Cooperative Robotics, pp. 66–73, October 2002.
  Details     Download: pdf [111.4kB]  ps [233.6kB]  

Technical Report

• Davide Mambelli, Stephan Bongers, Onno Zoeter, Matthijs T. J. Spaan, and Frans A. Oliehoek. When Do Off-Policy and On-Policy Policy Gradient Methods Align?. arXiv:2402.12034, 2024.
  Details     Download: pdf 
• Max Weltevrede, Matthijs T. J. Spaan, and Wendelin Böhmer. The Role of Diverse Replay for Generalisation in Reinforcement Learning. arXiv:2306.05727, 2023.
  Details     Download: pdf 
• Qisong Yang, Thiago D. Simão, Nils Jansen, Simon H. Tindemans, and Matthijs T. J. Spaan. Reinforcement Learning by Guided Safe Exploration. arXiv:2307.14316, 2023.
  Details     Download: pdf 
• Moritz A. Zanger, Wendelin Böhmer, and Matthijs T. J. Spaan. Diverse Projection Ensembles for Distributional Reinforcement Learning. arXiv:2306.07124, 2023.
  Details     Download: pdf 
• Miguel Suau, Jinke He, Matthijs T. J. Spaan, and Frans A. Oliehoek. Influence-Augmented Local Simulators: A Scalable Solution for Fast Deep RL in Large Networked Systems. arXiv:2202.01534, 2022.
  Details     Download: pdf 
• Joris Scharpff, Diederik M. Roijers, Frans A. Oliehoek, Matthijs T. J. Spaan, and Mathijs M. de Weerdt. Solving Transition-Independent Multi-agent MDPs with Sparse Interactions (Extended version). arXiv:1511.09047, 2016.
  Details     Download: pdf [726.1kB]  
• Frans A. Oliehoek, Matthijs T. J. Spaan, and Stefan Witwicki. Influence-Optimistic Local Values for Multiagent Planning --- Extended Version. arXiv:1502.05443, 2015.
  Details     Download: pdf [483.4kB]  
• Yash Satsangi, Shimon Whiteson, and Matthijs T. J. Spaan. An Analysis of Piecewise-Linear and Convex Value Functions for Active Perception POMDPs. Technical Report IAS-UVA-15-01, Informatics Institute, University of Amsterdam, 2015.
  Details     Download: pdf [562.9kB]  
• Frans A. Oliehoek, Shimon Whiteson, and Matthijs T. J. Spaan. Exploiting Agent and Type Independence in Collaborative Graphical Bayesian Games. arXiv:1108.0404, 2011.
  Details     Download: pdf [662.3kB]  
• Frans A. Oliehoek, Nikos Vlassis, and Matthijs T. J. Spaan. Properties of the QBG-value function. Technical Report IAS-UVA-07-03, Informatics Institute, University of Amsterdam, 2007.
  Details     Download: pdf [196.7kB]  ps.gz [203.3kB]  
• Josep M. Porta, Matthijs T. J. Spaan, and Nikos Vlassis. Value iteration for continuous-state POMDPs. Technical Report IAS-UVA-04-04, Informatics Institute, University of Amsterdam, 2004.
  Details     Download: (unavailable)
• Matthijs T. J. Spaan and Nikos Vlassis. Perseus: randomized point-based value iteration for POMDPs. Technical Report IAS-UVA-04-02, Informatics Institute, University of Amsterdam, 2004.
  Details     Download: pdf [1.2MB]  

Master's Thesis

• M. T. J. Spaan. Team play among soccer robots. Master's Thesis, University of Amsterdam,2002.
  Details     Download: pdf [10.1MB]  ps.gz [4.1MB]  

PhD Thesis

• Matthijs T. J. Spaan. Approximate planning under uncertainty in partially observable environments. Ph.D. Thesis, Universiteit van Amsterdam, 2006.
  Details     Download: pdf [23.0MB]  

Generated by bib2html.pl (written by Patrick Riley) on Thu Feb 29, 2024 16:15:45 UTC