Publications

Note: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. In most cases, these works may not be reposted without the explicit permission of the copyright holder.

Classified by Research Category

Planning under uncertainty (POMDPs)

Sebastian Junges and Matthijs T. J. Spaan. Abstraction-Refinement for Hierarchical Probabilistic Models. In Proc. Int. Conf. on Computer Aided Verification, pp. 102–123, 2022.
Details Download: pdf
Joris Scharpff, Daan Schraven, Leentje Volker, Matthijs T. J. Spaan, and Mathijs M. de Weerdt. Can multiple contractors self-regulate their joint service delivery? A serious gaming experiment on road maintenance planning. Construction Management and Economics, 39(2):99–116, Routledge, 2021.
Details Download: HTML
Martine van den Boomen, Matthijs T. J. Spaan, Yue Shang, and A. R. M. Wolfert. Infrastructure maintenance and replacement optimization under multiple uncertainties and managerial flexibility. Construction Management and Economics, 38(1):91–107, Routledge, 2020.
Details Download: HTML
Jennifer Renoux, Tiago S. Veiga, Pedro U. Lima, and Matthijs T. J. Spaan. A Unified Decision-Theoretic Model for Information Gathering and Communication Planning. In IEEE Int. Conf. on Robot and Human Interactive Communication (RO-MAN), pp. 67–74, 2020.
Details Download: HTML
Erwin Walraven and Matthijs T. J. Spaan. Point-Based Value Iteration for Finite-Horizon POMDPs. Journal of Artificial Intelligence Research, 65:307–341, 2019.
Details Download: pdf [948.4kB] HTML
C. J. A. Ter Berg, G. Leontaris, M. van den Boomen, M. T. J. Spaan, and A. R. M. Wolfert. Expert judgement based maintenance decision support method for structures with a long service-life. Structure & Infrastructure Engineering, 15(4):492–503, Taylor & Francis, 2019.
Details Download: HTML
M. van den Boomen, M. T. J. Spaan, R. Schoenmaker, and A.R.M. Wolfert. Untangling decision tree and real options analyses: a public infrastructure case study dealing with political decisions, structural integrity and price uncertainty. Construction Management and Economics, 37(1):24–43, Routledge, 2018.
Details Download: HTML
Yi-Chun Chen, Mykel J. Kochenderfer, and Matthijs T. J. Spaan. Improving Offline Value-Function Approximations for POMDPs by Reducing Discount Factors. In Proc. of International Conference on Intelligent Robots and Systems, 2018.
Details Download: (unavailable)
Frits de Nijs, Georgios Theocharous, Nikos Vlassis, Mathijs M. de Weerdt, and Matthijs T. J. Spaan. Capacity-aware Sequential Recommendations. In Proc. of Int. Conference on Autonomous Agents and Multi Agent Systems, pp. 416–424, 2018.
Details Download: pdf
Diederik M. Roijers, Erwin Walraven, and Matthijs T. J. Spaan. Bootstrapping LPs in Value Iteration for Multi-Objective and Partially Observable MDPs. In Proc. of Int. Conf. on Automated Planning and Scheduling, pp. 218–226, 2018.
Details Download: pdf
Yash Satsangi, Shimon Whiteson, Frans A. Oliehoek, and Matthijs T. J. Spaan. Exploiting Submodular Value Functions for Scaling Up Active Perception. Autonomous Robots, 42:209–233, 2018.
Details Download: pdf HTML
Erwin Walraven and Matthijs T. J. Spaan. Column Generation Algorithms for Constrained POMDPs. Journal of Artificial Intelligence Research, 62:489–533, 2018.
Details Download: pdf
Erwin Walraven and Matthijs T. J. Spaan. Accelerated Vector Pruning for Optimal POMDP Solvers. In Proceedings of the 31st AAAI Conference on Artificial Intelligence, pp. 3672–3678, 2017.
Details Download: pdf [446.1kB]
Erwin Walraven and Matthijs T. J. Spaan. Planning under Uncertainty for Aggregated Electric Vehicle Charging using Markov Decision Processes. In International Workshop on Artificial Intelligence for Smart Grids and Smart Buildings, 2016.
Details Download: pdf [219.9kB]
Erwin Walraven, Matthijs T. J. Spaan, and Bram Bakker. Traffic flow optimization: A reinforcement learning approach. Engineering Applications of Artificial Intelligence, 52:203–212, 2016.
Details Download: HTML
Erwin Walraven and Matthijs T. J. Spaan. Planning under Uncertainty for Aggregated Electric Vehicle Charging with Renewable Energy Supply. In Proc. of European Conference on Artificial Intelligence, pp. 904–912, 2016.
Details Download: pdf [367.2kB]
Yash Satsangi, Shimon Whiteson, and Matthijs T. J. Spaan. An Analysis of Piecewise-Linear and Convex Value Functions for Active Perception POMDPs. Technical Report IAS-UVA-15-01, Informatics Institute, University of Amsterdam, 2015.
Details Download: pdf [562.9kB]
Matthijs T. J. Spaan, Tiago S. Veiga, and Pedro U. Lima. Decision-theoretic Planning under Uncertainty with Information Rewards for Active Cooperative Perception. Autonomous Agents and Multi-Agent Systems, 29(6):1157–1185, 2015.
Details Download: pdf HTML
Matthijs T. J. Spaan, Frans A. Oliehoek, Christopher Amato, Andrey Kolobov, and Pascal Poupart, editors. Sequential Decision Making for Intelligent Agents, Fall Symposium Series Technical Report, AAAI Press, 2015.
Details Download: HTML
Tiago S. Veiga, Matthijs T. J. Spaan, and Pedro U. Lima. Improving Value Function Approximation in Factored POMDPs by Exploiting Model Structure. In Proc. of Int. Conference on Autonomous Agents and Multi Agent Systems, pp. 1872–1873, 2015. Extended abstract.
Details Download: (unavailable)
Erwin Walraven and Matthijs T. J. Spaan. Planning under Uncertainty with Weighted State Scenarios. In AAAI Fall Symposium on Sequential Decision Making for Intelligent Agents, 2015. Extended abstract
Details Download: (unavailable)
Erwin Walraven and Matthijs T. J. Spaan. Planning under Uncertainty with Weighted State Scenarios. In Proc. of Uncertainty in Artificial Intelligence, pp. 912–921, 2015.
Details Download: pdf [250.1kB]
Diederik M. Roijers, Joris Scharpff, Matthijs T. J. Spaan, Frans A. Oliehoek, Mathijs de Weerdt, and Shimon Whiteson. Bounded Approximations for Linear Multi-Objective Planning under Uncertainty. In Proceedings of the 26th Benelux Conference on Artificial Intelligence, pp. 168–169, 2014. Extended abstract
Details Download: (unavailable)
Diederik M. Roijers, Joris Scharpff, Matthijs T. J. Spaan, Frans A. Oliehoek, Mathijs de Weerdt, and Shimon Whiteson. Bounded Approximations for Linear Multi-Objective Planning under Uncertainty. In Proc. of Int. Conf. on Automated Planning and Scheduling, pp. 262–270, 2014.
Details Download: pdf [385.0kB]
Tiago S. Veiga, Matthijs T. J. Spaan, and Pedro U. Lima. Point-based POMDP Solving with Factored Value Function Approximation. In Proceedings of the Twenty-Eighth AAAI Conference on Artificial Intelligence, pp. 2512–2518, 2014.
Details Download: pdf [908.5kB]
Jan Elffers, Dyan Konijnenberg, Erwin Walraven, and Matthijs T. J. Spaan. Enhancing SAT Based Planning with Landmark Knowledge. In Proceedings of the 25th Benelux Conference on Artificial Intelligence, pp. 64–71, 2013.
Details Download: pdf [103.8kB]
Matthijs T. J. Spaan. Partially Observable Markov Decision Processes. In Marco Wiering and Martijn van Otterlo, editors, Reinforcement Learning: State of the Art, pp. 387–414, Springer Verlag, 2012.
Details Download: pdf [206.7kB]
Ana Rita Mendes, Matthijs T. J. Spaan, and Pedro U. Lima. Planning under Uncertainty for Search and Rescue. In Robótica -- 11th Int. Conf. on Mobile Robots and Competitions, pp. 52–57, 2011.
Details Download: (unavailable)
Matthijs T. J. Spaan, Tiago S. Veiga, and Pedro U. Lima. Active Cooperative Perception in Network Robot Systems Using POMDPs. In Proc. of International Conference on Intelligent Robots and Systems, pp. 4800–4805, 2010.
Details Download: pdf [154.5kB]
Matthijs T. J. Spaan and Pedro U. Lima. Decision-theoretic Planning under Uncertainty for Active Cooperative Perception. In POMDP Practitioners Workshop: solving real-world POMDP problems, 2010. Workshop at ICAPS10
Details Download: (unavailable)
Marco Barbosa, Alexandre Bernardino, Dario Figueira, José Gaspar, Nelson Gonçalves, Pedro U. Lima, Plinio Moreno, Abdolkarim Pahliani, José Santos-Victor, Matthijs T. J. Spaan, and João Sequeira. ISRobotNet: A Testbed for Sensor and Robot Network Systems. In Proc. of International Conference on Intelligent Robots and Systems, pp. 2827–2833, 2009.
Details Download: pdf [2.5MB]
Abdolkarim Pahliani, Matthijs T. J. Spaan, and Pedro U. Lima. Decision-theoretic Robot Guidance for Active Cooperative Perception. In Proc. of International Conference on Intelligent Robots and Systems, pp. 4837–4842, 2009.
Details Download: pdf [267.8kB]
Alberto Reyes, Matthijs T. J. Spaan, and L. Enrique Sucar. An Intelligent Assistant for Power Plants based on Factored MDPs. In Int. Conf. on Intelligent System Applications to Power Systems, 2009.
Details Download: pdf [288.5kB]
Matthijs T. J. Spaan and Pedro U. Lima. A Decision-theoretic Approach to Dynamic Sensor Selection in Camera Networks. In Int. Conf. on Automated Planning and Scheduling, pp. 279–304, 2009.
Details Download: pdf [1.5MB]
Matthijs T. J. Spaan and Pedro U. Lima. Decision-theoretic Planning under Uncertainty for Cooperative Active Perception. In NIPS Workshop on Adaptive Sensing, Active Learning and Experimental Design, 2009.
Details Download: (unavailable)
Josep M. Porta, Nikos Vlassis, Matthijs T. J. Spaan, and Pascal Poupart. Point-Based Value Iteration for Continuous POMDPs. Journal of Machine Learning Research, 7:2329–2367, November 2006.
Details Download: pdf [515.5kB]
Matthijs T. J. Spaan. Approximate planning under uncertainty in partially observable environments. Ph.D. Thesis, Universiteit van Amsterdam, 2006.
Details Download: pdf [23.0MB]
Frans Oliehoek, Matthijs T. J. Spaan, and Nikos Vlassis. Best-response play in partially observable card games. In Benelearn 2005: Proceedings of the 14th Annual Machine Learning Conference of Belgium and the Netherlands, pp. 45–50, February 2005.
Details Download: pdf [115.6kB]
Josep M. Porta, Matthijs T. J. Spaan, and Nikos Vlassis. Robot Planning in Partially Observable Continuous Domains. In Proc. of the 17th Belgian-Dutch Conference on Artifical Intelligence, pp. 375–376, Brussels, Belgium, October 2005. Extended abstract.
Details Download: (unavailable)
Josep M. Porta, Matthijs T. J. Spaan, and Nikos Vlassis. Robot Planning in Partially Observable Continuous Domains. In Robotics: Science and Systems, pp. 217–224, MIT Press, 2005.
Details Download: pdf [319.6kB]
Matthijs T. J. Spaan and Nikos Vlassis. Planning with continuous actions in partially observable environments. In Proceedings of the IEEE International Conference on Robotics and Automation, pp. 3469–3474, Barcelona, Spain, 2005.
Details Download: pdf [1.1MB]
Matthijs T. J. Spaan and Nikos Vlassis. Perseus: Randomized Point-based Value Iteration for POMDPs. Journal of Artificial Intelligence Research, 24:195–220, 2005.
Details Download: pdf [1.3MB] ps.gz [488.2kB]
Frans C. A. Groen, Matthijs T. J. Spaan, and Jelle R. Kok. Real world multiagent systems: information sharing, coordination and planning. In Trilateral workshop on Military Applications of Agent Technology in ICT and Robotics, TNO FEL, The Hague, November 2004.
Details Download: (unavailable)
Josep M. Porta, Matthijs T. J. Spaan, and Nikos Vlassis. Value iteration for continuous-state POMDPs. Technical Report IAS-UVA-04-04, Informatics Institute, University of Amsterdam, 2004.
Details Download: (unavailable)
Matthijs T. J. Spaan and Nikos Vlassis. A point-based POMDP algorithm for robot planning. In Proceedings of the IEEE International Conference on Robotics and Automation, pp. 2399–2404, New Orleans, Louisiana, 2004.
Details Download: pdf [1.9MB]
M. T. J. Spaan, M. Koutek, B. Terwijn, J. R. Kok, H. E. Bal, M. Boasson, F. C. A. Groen, and N. Vlassis. Interactive visualization, information sharing, planning and learning for a team of robots. In Proc. 5th PROGRESS Workshop on Embedded Systems, Nieuwegein, The Netherlands, 2004.
Details Download: (unavailable)
Matthijs T. J. Spaan and Nikos Vlassis. Perseus: randomized point-based value iteration for POMDPs. Technical Report IAS-UVA-04-02, Informatics Institute, University of Amsterdam, 2004.
Details Download: pdf [1.2MB]
Nikos Vlassis and Matthijs T. J. Spaan. A fast point-based algorithm for POMDPs. In Benelearn 2004: Proceedings of the Annual Machine Learning Conference of Belgium and the Netherlands, pp. 170–176, Brussels, Belgium, January 2004. (Also presented at the NIPS 16 workshop `Planning for the Real-World', Whistler, Canada, Dec 2003)
Details Download: pdf [231.4kB]

Cooperative multirobot systems

Stefan J. Witwicki, José Carlos Castillo, Jesús Capitán, João V. Messias, João C. Reis, Pedro U. Lima, Francisco S. Melo, and Matthijs T. J. Spaan. A Testbed for Autonomous Robot Surveillance (Demonstration). In Proc. of Int. Conference on Autonomous Agents and Multi Agent Systems, pp. 1635–1636, 2014.
Details Download: (unavailable)
Jesús Capitán, Matthijs T. J. Spaan, Luis Merino, and An\'ibal Ollero. Decentralized Multi-Robot Cooperation with Auctioned POMDPs. In Proceedings of the IEEE International Conference on Robotics and Automation, pp. 3323–3328, 2012.
Details Download: (unavailable)
Jesús Capitán, Matthijs T. J. Spaan, and Luis Merino. Role-based Cooperation for Environmental Monitoring with Multiple UAVs. In IROS Workshop on Robotics for Environmental Monitoring, 2012.
Details Download: (unavailable)
Jesús Capitán, Matthijs T. J. Spaan, Luis Merino, and An\'ibal Ollero. Decentralized Multi-Robot Cooperation with Auctioned POMDPs. In Multi-agent Sequential Decision Making in Uncertain Domains, 2011. Workshop at AAMAS11
Details Download: pdf [217.3kB]
Abdolkarim Pahliani, Matthijs T. J. Spaan, and Pedro U. Lima. Fault-Tolerant Probabilistic Sensor Fusion for Distributed Multi-Agent Systems. In Proc. of International Conference on Intelligent Robots and Systems, pp. 4812–4817, 2010.
Details Download: pdf [636.2kB]
Alberto Sanfeliu, Juan Andrade-Cetto, Marco Barbosa, Richard Bowden, Jesús Capitán, Andreu Corominas, Andrew Gilbert, John Illingworth, Luis Merino, Josep M. Mirats, Plinio Moreno, An\'ibal Ollero, João Sequeira, and Matthijs T. J. Spaan. Decentralized Sensor Fusion for Ubiquitous Networking Robotics in Urban Areas. Sensors, 10(3):2274–2314, 2010.
Details Download: pdf [2.3MB]
Matthijs T. J. Spaan, Nelson Gonçalves, and João Sequeira. Multirobot Coordination by Auctioning POMDPs. In Proceedings of the IEEE International Conference on Robotics and Automation, pp. 1446–1451, 2010.
Details Download: pdf [96.2kB]
Matthijs T. J. Spaan. Cooperative Active Perception using POMDPs. In AAAI 2008 Workshop on Advancements in POMDP Solvers, July 2008.
Details Download: pdf [2.0MB]
Frans C. A. Groen, Matthijs T. J. Spaan, Jelle R. Kok, and Gregor Pavlin. Real World Multi-agent Systems: Information Sharing, Coordination and Planning. In Balder D. ten Cate and Henk W. Zeevat, editors, Logic, Language, and Computation, Lecture Notes in Computer Science 4363, pp. 154–165, Springer Verlag, 2007. ISBN: 978-3-540-75143-4
Details Download: pdf [1.3MB]
Jelle R. Kok, Matthijs T. J. Spaan, and Nikos Vlassis. Non-communicative multi-robot coordination in dynamic environments. Robotics and Autonomous Systems, 50(2-3):99–114, February 2005.
Details Download: pdf [233.5kB]
Jelle R. Kok, Matthijs T. J. Spaan, and Nikos Vlassis. Multi-robot decision making using coordination graphs. In Proceedings of the 11th International Conference on Advanced Robotics, pp. 1124–1129, Coimbra, Portugal, 2003.
Details Download: pdf [163.1kB]
M. T. J. Spaan and F. C. A. Groen. Team coordination among robotic soccer players. In RoboCup 2002, pp. 409–416, Springer-Verlag, 2003.
Details Download: pdf [114.2kB] ps [182.0kB]
M. T. J. Spaan, M. Koutek, B. Terwijn, J. R. Kok, H. E. Bal, M. Boasson, F. C. A. Groen, and N. Vlassis. Coordination, data sharing, and remote visualization of a team of autonomous robots. In Proc. 4th PROGRESS Workshop on Embedded Systems, Nieuwegein, The Netherlands, 2003.
Details Download: (unavailable)
F.C.A. Groen, M.T.J. Spaan, and N. Vlassis. Robot Soccer Game or Science. In Proceedings CNR-2002, pp. 92–98, Editura Universitaria Craiova, October 2002. ISBN:973-8043-165-5
Details Download: (unavailable)
Jelle R. Kok, Matthijs T. J. Spaan, and Nikos Vlassis. An approach to noncommunicative multiagent coordination in continuous domains. In Benelearn 2002: Proceedings of the Twelfth Belgian-Dutch Conference on Machine Learning, Utrecht, The Netherlands, December 2002.
Details Download: pdf [126.7kB] ps.gz [109.2kB]
M. Spaan, M. Wiering, R. Bartelds, R. Donkervoort, P. Jonker, and F. Groen. Clockwork Orange: The Dutch RoboSoccer Team. In RoboCup 2001: Robot Soccer World Cup V, pp. 627–630, LNCS 2377, Springer-Verlag, 2002.
Details Download: pdf [227.5kB] ps.gz [1.3MB]
M. T. J. Spaan, N. Vlassis, and F. C. A. Groen. High level coordination of agents based on multiagent Markov decision processes with roles. In IROS'02 Workshop on Cooperative Robotics, pp. 66–73, October 2002.
Details Download: pdf [111.4kB] ps [233.6kB]
M. T. J. Spaan. Team play among soccer robots. Master's Thesis, University of Amsterdam,2002.
Details Download: pdf [10.1MB] ps.gz [4.1MB]
Frans C. A. Groen, Jeroen Roodhart, Matthijs Spaan, Raymond Donkervoort, and Nikos Vlassis. A distributed world model for robot soccer that supports the development of team skills. In Proceedings of the 13th Belgian-Dutch Conference on Artificial Intelligence (BNAIC'01), pp. 389–396, Amsterdam, 2001.
Details Download: pdf [160.1kB] ps.gz [64.9kB]

Decentralized planning under uncertainty

Steven Carr, Nils Jansen, Suda Bharadwaj, Matthijs T. J. Spaan, and Ufuk Topcu. Safe Policies for Factored Partially Observable Stochastic Games. In Robotics: Science and System XVII, 2021.
Details Download: pdf
Frits de Nijs, Erwin Walraven, Mathijs M. de Weerdt, and Matthijs T. J. Spaan. Constrained Multiagent Markov Decision Processes: a Taxonomy of Problems and Algorithms. Journal of Artificial Intelligence Research, 70:955–1001, 2021.
Details Download: pdf [531.8kB] HTML
Frits de Nijs, Matthijs T. J. Spaan, and Mathijs M. de Weerdt. Preallocation and Planning under Stochastic Resource Constraints. In Proceedings of the 32nd AAAI Conference on Artificial Intelligence, pp. 4662–4669, 2018.
Details Download: pdf
Frits de Nijs, Erwin Walraven, Mathijs M. de Weerdt, and Matthijs T. J. Spaan. Bounding the Probability of Resource Constraint Violations in Multi-Agent MDPs. In Proceedings of the 31st AAAI Conference on Artificial Intelligence, pp. 3562–3568, 2017.
Details Download: pdf [256.6kB]
Frans A. Oliehoek, Matthijs T. J. Spaan, Bas Terwijn, Philipp Robbel, and João V. Messias. The MADP Toolbox: An Open Source Library for Planning and Learning in (Multi-)Agent Systems. Journal of Machine Learning Research, 18(89):1–5, 2017.
Details Download: pdf HTML
Frits de Nijs, Matthijs T. J. Spaan, and Mathijs M. de Weerdt. Decoupling a Resource Constraint through Fictitious Play in Multi-agent Sequential Decision Making. In Proc. of European Conference on Artificial Intelligence, pp. 1724–1725, 2016.
Details Download: HTML
Frits de Nijs, Erwin Walraven, Mathijs M. de Weerdt, and Matthijs T. J. Spaan. Resource-constrained Multi-agent MDP Planning with Bounded Violation Probability. In NIPS workshop on Learning, Inference and Control of Multi-Agent Systems, 2016.
Details Download: (unavailable)
Joris Scharpff, Diederik M. Roijers, Frans A. Oliehoek, Matthijs T. J. Spaan, and Mathijs M. de Weerdt. Solving Transition-Independent Multi-agent MDPs with Sparse Interactions. In Proceedings of the Thirtieth AAAI Conference on Artificial Intelligence, pp. 3174–3180, 2016.
Details Download: pdf [593.5kB]
Joris Scharpff, Diederik M. Roijers, Frans A. Oliehoek, Matthijs T. J. Spaan, and Mathijs M. de Weerdt. Solving Transition-Independent Multi-agent MDPs with Sparse Interactions (Extended version). arXiv:1511.09047, 2016.
Details Download: pdf [726.1kB]
Joris Scharpff, Diederik M. Roijers, Frans A. Oliehoek, Matthijs T. J. Spaan, and Mathijs de Weerdt. Conditional Return Policy Search for TI-MMDPs with Sparse Interactions. In Proceedings of the 28th Benelux Conference on Artificial Intelligence, 2016. Extended abstract
Details Download: (unavailable)
Frits de Nijs, Matthijs T. J. Spaan, and Mathijs M. de Weerdt. Best-Response Planning of Thermostatically Controlled Loads under Power Constraints. In Proceedings of the Twenty-Ninth AAAI Conference on Artificial Intelligence, pp. 615–621, 2015.
Details Download: pdf
Frits de Nijs, Matthijs T. J. Spaan, and Mathijs M. de Weerdt. A Challenge for Multi-Agent Sequential Decision Problems: Global Resource Constraints. In Multi-agent Sequential Decision Making under Uncertainty, 2015. Workshop at AAMAS15.
Details Download: (unavailable)
Frans A. Oliehoek, Matthijs T. J. Spaan, and Stefan J. Witwicki. Influence-Optimistic Local Values for Multiagent Planning. In Proc. of Int. Conference on Autonomous Agents and Multi Agent Systems, pp. 1703–1704, 2015. Extended abstract.
Details Download: (unavailable)
Frans A. Oliehoek, Matthijs T. J. Spaan, and Stefan Witwicki. Influence-Optimistic Local Values for Multiagent Planning --- Extended Version. arXiv:1502.05443, 2015.
Details Download: pdf [483.4kB]
Frans A. Oliehoek, Matthijs T. J. Spaan, and Stefan J. Witwicki. Factored Upper Bounds for Multiagent Planning Problems under Uncertainty with Non-Factored Value Functions. In Proc. of International Joint Conference on Artificial Intelligence, pp. 1645–1651, 2015.
Details Download: pdf
Frans A. Oliehoek, Matthijs T. J. Spaan, and Stefan Witwicki. Influence-Optimistic Local Values for Multiagent Planning. In Multi-agent Sequential Decision Making under Uncertainty, 2015. Workshop at AAMAS15.
Details Download: (unavailable)
Frans A. Oliehoek, Matthijs T. J. Spaan, Philipp Robbel, and João V. Messias. The MADP Toolbox: An Open-Source Library for Planning and Learning in (Multi-)Agent Systems. In AAAI Fall Symposium on Sequential Decision Making for Intelligent Agents, 2015.
Details Download: (unavailable)
Joris Scharpff, Diederik M. Roijers, Frans A. Oliehoek, Matthijs T. J. Spaan, and Mathijs M. de Weerdt. Solving Multi-agent MDPs Optimally with Conditional Return Graphs. In Multi-agent Sequential Decision Making under Uncertainty, 2015. Workshop at AAMAS15.
Details Download: (unavailable)
Erwin Walraven and Matthijs T. J. Spaan. A Scenario State Representation for Scheduling Deferrable Loads under Wind Uncertainty. In Multi-agent Sequential Decision Making under Uncertainty, 2015. Workshop at AAMAS15.
Details Download: (unavailable)
Jesus Capitan, Matthijs Spaan, Luis Merino, and Anibal Ollero. Decentralized Multi-Robot Cooperation with Auctioned POMDPs. In Proc. of Int. Conf. on Automated Planning and Scheduling, pp. 515–518, 2014. ICAPS Journal track.
Details Download: (unavailable)
Frits de Nijs, Mathijs M. de Weerdt, and Matthijs T. J. Spaan. Efficient Heuristics for Power Constrained Planning of Thermostatically Controlled Loads. In Proceedings of the 26th Benelux Conference on Artificial Intelligence, pp. 162–163, 2014. Extended abstract
Details Download: (unavailable)
Frits de Nijs, Mathijs M. de Weerdt, and Matthijs T. J. Spaan. Efficient Heuristics for Power Constrained Planning of Thermostatically Controlled Loads. In International Workshop on Demand Response (Wattalyst), 2014. Co-located with ACM e-Energy 2014. Also presented at Future Energy Business & Energy Informatics.
Details Download: pdf [1.1MB]
Jesús Capitán, Matthijs T. J. Spaan, Luis Merino, and An\'ibal Ollero. Decentralized Multi-robot Cooperation with Auctioned POMDPs. International Journal of Robotics Research, 32(6):650–671, 2013.
Details Download: pdf HTML
João V. Messias, Matthijs T. J. Spaan, and Pedro U. Lima. GSMDPs for Multi-Robot Sequential Decision-Making. In Proceedings of the Twenty-Seventh AAAI Conference on Artificial Intelligence, pp. 1408–1414, 2013.
Details Download: pdf [711.0kB]
João V. Messias, Matthijs T. J. Spaan, and Pedro U. Lima. Multiagent POMDPs with Asynchronous Execution. In Proc. of Int. Conference on Autonomous Agents and Multi Agent Systems, pp. 1273–1274, 2013. Extended abstract.
Details Download: pdf [541.7kB]
João V. Messias, Matthijs T. J. Spaan, and Pedro U. Lima. Asynchronous Execution in Multiagent POMDPs: Reasoning Over Partially-Observable Events. In Multi-agent Sequential Decision Making under Uncertainty, 2013. Workshop at AAMAS13.
Details Download: pdf [459.2kB]
Frans A. Oliehoek, Shimon Whiteson, and Matthijs T. J. Spaan. Approximate Solutions for Factored Dec-POMDPs with Many Agents. In Proc. of Int. Conference on Autonomous Agents and Multi Agent Systems, pp. 563–570, 2013.
Details Download: pdf [588.8kB]
Frans A. Oliehoek, Shimon Whiteson, and Matthijs T. J. Spaan. Approximate Solutions for Factored Dec-POMDPs with Many Agents. In Proceedings of the 25th Benelux Conference on Artificial Intelligence, pp. 340–341, 2013. Extended abstract
Details Download: (unavailable)
Frans A. Oliehoek, Matthijs T. J. Spaan, Christopher Amato, and Shimon Whiteson. Incremental Clustering and Expansion for Faster Optimal Planning in Dec-POMDPs. Journal of Artificial Intelligence Research, 46:449–509, 2013.
Details Download: pdf [7.2MB]
Joris Scharpff, Matthijs T. J. Spaan, Leentje Volker, and Mathijs M. de Weerdt. Coordinating Maintenance Planning under Uncertainty. In Proc. of Int. Conference on Autonomous Agents and Multi Agent Systems, pp. 1405–1406, 2013. Demonstration
Details Download: pdf [1.6MB]
Joris Scharpff, Matthijs T. J. Spaan, Leentje Volker, and Mathijs M. de Weerdt. Planning under Uncertainty for Coordinating Infrastructural Maintenance. In Proceedings of the 25th Benelux Conference on Artificial Intelligence, pp. 352–353, 2013. Extended abstract
Details Download: (unavailable)
Joris Scharpff, Matthijs T. J. Spaan, Leentje Volker, and Mathijs M. de Weerdt. Planning under Uncertainty for Coordinating Infrastructural Maintenance. In Proc. of Int. Conf. on Automated Planning and Scheduling, pp. 425–433, 2013.
Details Download: pdf [287.1kB]
Joris Scharpff, Matthijs T. J. Spaan, Leentje Volker, and Mathijs M. de Weerdt. Coordinating Stochastic Multi-Agent Planning in a Private Values Setting. In Distributed and Multi-Agent Planning, 2013. Workshop at ICAPS.
Details Download: (unavailable)
Joris Scharpff, Matthijs T. J. Spaan, Leentje Volker, and Mathijs M. de Weerdt. Planning under Uncertainty for Coordinating Infrastructural Maintenance. In Multi-agent Sequential Decision Making under Uncertainty, 2013. Workshop at AAMAS13.
Details Download: pdf [271.7kB]
Stefan Witwicki, Francisco S. Melo, Jesús Capitán, Matthijs T. J. Spaan, and José Carlos Castillo. Robot Planning under Uncertainty with Unpredictable Events. In Autonomous Robots and Multirobot Systems, 2013. Workshop at AAMAS 13.
Details Download: (unavailable)
Stefan Witwicki, Francisco S. Melo, Jesús Capitán, and Matthijs T. J. Spaan. A Flexible Approach to Modeling Unpredictable Events in MDPs. In Proc. of Int. Conf. on Automated Planning and Scheduling, pp. 260–268, 2013.
Details Download: pdf [767.1kB]
Francisco S. Melo, Matthijs T. J. Spaan, and Stefan Witwicki. QueryPOMDP: POMDP-based Communication in Multiagent Systems. In Massimo Cossentino, Michael Kaisers, Karl Tuyls, and Gerhard Weiss, editors, Multi-Agent Systems, number 7541 in LNCS, pp. 189–204, Springer, 2012. 9th European Workshop, EUMAS 2011, Maastricht, The Netherlands, November 14-15, 2011. Revised Selected Papers
Details Download: pdf [186.7kB]
Francisco S. Melo, Alberto Sardinha, Stefan Witwicki, Laura M. Ramirez-Elizondo, and Matthijs T. J. Spaan. Decentralized Multiagent Planning for Balance Control in Smart Grids. In Procs. of the 1st Int'l Workshop on Information Technology for Energy Applications (IT4ENERGY'2012), CEUR Workshop Proceedings 923, 2012. ISSN 1613-0073
Details Download: (unavailable)
Francisco S. Melo, Matthijs T. J. Spaan, and Stefan Witwicki. Exploiting Sparse Interactions for Optimizing Communication in Dec-MDPs. In Multi-agent Sequential Decision Making under Uncertainty, 2012. Workshop at AAMAS12
Details Download: pdf [154.7kB]
Frans A. Oliehoek and Matthijs T. J. Spaan. Tree-based Solution Methods for Multiagent POMDPs with Delayed Communication. In Proc. of the AAAI Conference on Artificial Intelligence, pp. 1415–1421, 2012.
Details Download: pdf [145.0kB]
Frans A. Oliehoek and Matthijs T. J. Spaan. Tree-based Pruning for Multiagent POMDPs with Delayed Communication. In Multi-agent Sequential Decision Making under Uncertainty, 2012. Workshop at AAMAS12
Details Download: pdf [200.6kB]
Frans A. Oliehoek and Matthijs T. J. Spaan. Tree-based Pruning for Multiagent POMDPs with Delayed Communication. In Proc. of Int. Conference on Autonomous Agents and Multi Agent Systems, pp. 1229–1230, 2012.
Details Download: pdf [112.5kB]
Frans A. Oliehoek, Shimon Whiteson, and Matthijs T. J. Spaan. Exploiting Structure in Cooperative Bayesian Games. In Proc. of Uncertainty in Artificial Intelligence, pp. 654–664, 2012.
Details Download: pdf [1.2MB]
Joris Scharpff, Matthijs T. J. Spaan, and Mathijs M. de Weerdt. Dynamic Mechanism Design for Efficient Planning under Uncertainty. In Proc. of 24th Benelux Conference on Artificial Intelligence, pp. 218–225, 2012.
Details Download: (unavailable)
Rajneesh Sharma and Matthijs T. J. Spaan. Bayesian Game Based Fuzzy Reinforcement Learning Control for Decentralized POMDPs. IEEE Transactions on Computational Intelligence and AI in Games, 4(4):309–328, 2012.
Details Download: (unavailable)
Matthijs T. J. Spaan and Frans A. Oliehoek. Tree-based Solution Methods for Multiagent POMDPs with Delayed Communication. In Proc. of 24th Benelux Conference on Artificial Intelligence, pp. 319–320, 2012. Extended abstract.
Details Download: (unavailable)
Francisco S. Melo and Matthijs T. J. Spaan. A POMDP-based Model for Optimizing Communication in Multiagent Systems. In European Workshop on Multi-agent Systems, 2011.
Details Download: pdf [171.6kB]
João V. Messias, Matthijs T. J. Spaan, and Pedro U. Lima. Exploiting Sparse Dependencies for Communication Reduction in Multiagent Planning under Uncertainty. In Decision Making in Partially Observable, Uncertain Worlds: Exploring Insights from Multiple Communities, 2011. Workshop at IJCAI11
Details Download: pdf [303.4kB]
João V. Messias, Matthijs T. J. Spaan, and Pedro U. Lima. Efficient Offline Communication Policies for Factored Multiagent POMDPs. In Advances in Neural Information Processing Systems, pp. 1917–1925, 2011.
Details Download: pdf [156.7kB]
Frans A. Oliehoek, Shimon Whiteson, and Matthijs T. J. Spaan. Exploiting Agent and Type Independence in Collaborative Graphical Bayesian Games. arXiv:1108.0404, 2011.
Details Download: pdf [662.3kB]
Rajneesh Sharma and Matthijs T. J. Spaan. Fuzzy Reinforcement Learning Control for Decentralized Partially Observable Markov Decision Processes. In Proc. of IEEE Int. Conf. on Fuzzy Systems, 2011.
Details Download: (unavailable)
Matthijs T. J. Spaan, Frans A. Oliehoek, and Christopher Amato. Scaling Up Optimal Heuristic Search in Dec-POMDPs via Incremental Expansion. In Proc. of 23rd Benelux Conference on Artificial Intelligence, pp. 433–434, 2011. Extended abstract.
Details Download: (unavailable)
Matthijs T. J. Spaan, Frans A. Oliehoek, and Christopher Amato. Scaling Up Optimal Heuristic Search in Dec-POMDPs via Incremental Expansion. In Proc. of International Joint Conference on Artificial Intelligence, pp. 2027–2032, 2011.
Details Download: pdf [160.2kB]
Matthijs T. J. Spaan, Frans A. Oliehoek, and Christopher Amato. Scaling Up Optimal Heuristic Search in Dec-POMDPs via Incremental Expansion. In Multi-agent Sequential Decision Making in Uncertain Domains, 2011. Workshop at AAMAS11
Details Download: pdf [229.0kB]
João V. Messias, Matthijs T. J. Spaan, and Pedro U. Lima. Multi-robot planning under uncertainty with communication: a case study. In Multi-agent Sequential Decision Making in Uncertain Domains, 2010. Workshop at AAMAS10
Details Download: pdf [512.7kB]
Frans A. Oliehoek, Matthijs T. J. Spaan, Jilles S. Dibangoye, and Christopher Amato. Heuristic Search for Identical Payoff Bayesian Games. In Proc. of Int. Conference on Autonomous Agents and Multi Agent Systems, pp. 1115–1122, 2010.
Details Download: pdf [179.3kB]
Rajneesh Sharma and Matthijs T. J. Spaan. A Bayesian Game based Adaptive Fuzzy Controller for Multiagent POMDPs. In Proc. of IEEE Int. Conf. on Fuzzy Systems, pp. 1422–1429, 2010.
Details Download: pdf [966.1kB]
Frans A. Oliehoek, Shimon Whiteson, and Matthijs T. J. Spaan. Lossless Clustering of Histories in Decentralized POMDPs. In Proc. of Int. Conference on Autonomous Agents and Multi Agent Systems, pp. 577–584, May 2009.
Details Download: pdf [209.6kB]
Matthijs T. J. Spaan, Nelson Gonçalves, and João Sequeira. Multiagent Coordination by Auctioning POMDP Tasks. In Multi-agent Sequential Decision Making in Uncertain Domains, 2009. Workshop at AAMAS09
Details Download: pdf [117.4kB]
Frans A. Oliehoek, Matthijs T. J. Spaan, Shimon Whiteson, and Nikos Vlassis. Exploiting Locality of Interaction in Factored Dec-POMDPs. In Proc. of Int. Conference on Autonomous Agents and Multi Agent Systems, pp. 517–524, 2008.
Details Download: pdf [2.1MB]
Frans A. Oliehoek, Matthijs T. J. Spaan, and Nikos Vlassis. Optimal and Approximate Q-value Functions for Decentralized POMDPs. Journal of Artificial Intelligence Research, 32:289–353, 2008.
Details Download: pdf [613.0kB] ps [1.1MB]
Matthijs T. J. Spaan and Francisco S. Melo. Interaction-Driven Markov Games for Decentralized Multiagent Planning under Uncertainty. In Proc. of Int. Conference on Autonomous Agents and Multi Agent Systems, pp. 525–532, 2008.
Details Download: pdf [167.4kB]
Matthijs T. J. Spaan, Frans A. Oliehoek, and Nikos Vlassis. Multiagent Planning under Uncertainty with Stochastic Communication Delays. In Proc. of Int. Conf. on Automated Planning and Scheduling, pp. 338–345, 2008.
Details Download: pdf [141.2kB]
Matthijs T. J. Spaan and Frans A. Oliehoek. The MultiAgent Decision Process toolbox: software for decision-theoretic planning in multiagent systems. In Multi-agent Sequential Decision Making in Uncertain Domains, 2008. Workshop at AAMAS08
Details Download: pdf [178.7kB]
Frans A. Oliehoek, Matthijs T. J. Spaan, and Nikos Vlassis. Dec-POMDPs with delayed communication. In Multi-agent Sequential Decision Making in Uncertain Domains, 2007. Workshop at AAMAS07
Details Download: pdf [146.0kB]
Frans A. Oliehoek, Nikos Vlassis, and Matthijs T. J. Spaan. Properties of the QBG-value function. Technical Report IAS-UVA-07-03, Informatics Institute, University of Amsterdam, 2007.
Details Download: pdf [196.7kB] ps.gz [203.3kB]
Matthijs T. J. Spaan, Geoffrey J. Gordon, and Nikos Vlassis. Decentralized planning under uncertainty for teams of communicating agents. In Proc. of Int. Conference on Autonomous Agents and Multi Agent Systems, pp. 249–256, 2006.
Details Download: pdf [183.6kB]

Smart energy systems

Nils H. van der Blij, Pavel Purgat, Thiago B. Soeiro, Laura M. Ramirez-Elizondo, Matthijs T. J. Spaan, and Pavol Bauer. Protection Framework for Low Voltage DC Grids. In Proceedings 2021 IEEE 19th International Power Electronics and Motion Control Conference, pp. 331–337, 2021.
Details Download: HTML
Nils H. van der Blij, Pavel Purgat, Thiago B. Soeiro, Laura M. Ramirez-Elizondo, Matthijs T. J. Spaan, and Pavol Bauer. Decentralized plug-and-play protection scheme for low voltage DC grids. Energies, 13(12):1–21, 2020.
Details Download: HTML
Nils H. van der Blij, Laura M. Ramirez-Elizondo, Matthijs T. J. Spaan, and Pavol Bauer. Grid sense multiple access: A decentralized control algorithm for DC grids. International Journal of Electrical Power & Energy Systems, Elsevier, 2020.
Details Download: HTML
Nils H. van der Blij, Dario Chaifouroosh, Claudio A. Canizares, Thiago B. Soeiro, Laura M. Ramirez-Elizondo, Matthijs T. J. Spaan, and Pavol Bauer. Improved Power Flow Methods for DC Grids. In Proc. IEEE Int. Symposium on Industrial Electronics, pp. 1135–1140, IEEE, 2020.
Details Download: HTML
Frits de Nijs, Mathijs M. de Weerdt, and Matthijs T. J. Spaan. Multi-agent Planning Under Uncertainty for Capacity Management. In Peter Palensky, Milo\vs Cvetkovi\'c, and Tamás Keviczky, editors, Intelligent Integrated Energy Systems: The PowerWeb Program at TU Delft, pp. 197–213, Springer International Publishing, 2019.
Details Download: HTML
Nils H. van der Blij, Laura M. Ramirez-Elizondo, Matthijs T. J. Spaan, and Pavol Bauer. A State-Space Approach to Modelling DC Distribution Systems. IEEE Transactions on Power Systems, 33:943–950, 2018.
Details Download: HTML
Nils H. van der Blij, Laura M. Ramirez-Elizondo, Matthijs T. J. Spaan, and Pavol Bauer. Symmetrical Component Decomposition of DC Distribution Systems. IEEE Transactions on Power Systems, 33:2733–2741, 2018.
Details Download: HTML
Nils H. van der Blij, Laura M. Ramirez-Elizondo, Matthijs T.J . Spaan, and Pavol Bauer. Stability and Decentralized Control of Plug-and-Play DC Distribution Grids. IEEE Access, 6:63726–63736, 2018.
Details Download: HTML
Nils H. van der Blij, Laura M. Ramirez-Elizondo, Pavol Bauer, and Matthijs T. J. Spaan. Design Guidelines for Stable DC Distribution Systems. In IEEE Int. Conf. on DC Microgrids, 2017.
Details Download: HTML
Nils H. van der Blij, Laura M. Ramirez-Elizondo, Matthijs T. J. Spaan, and Pavol Bauer. Stability of DC Distribution Systems: An Algebraic Derivation. Energies, 10(9), 2017.
Details Download: pdf

Fleet management

Johan Los, Frederik Schulte, Margaretha Gansterer, Richard F. Hartl, Matthijs T. J. Spaan, and Rudy R. Negenborn. Large-scale collaborative vehicle routing. Annals of Operations Research, Springer, 2022.
Details Download: HTML
Johan Los, Frederik Schulte, Matthijs T. J. Spaan, and Rudy R. Negenborn. An Auction-Based Multi-Agent System for the Pickup and Delivery Problem with Autonomous Vehicles and Alternative Locations. In Proceedings of the 8th International Conference on Dynamics in Logistics, pp. 244–260, 2022.
Details Download: HTML
Johan Los, Frederik Schulte, Matthijs T. J. Spaan, and Rudy R. Negenborn. Strategic Bidding in Decentralized Collaborative Vehicle Routing. In Proceedings of the 8th International Conference on Dynamics in Logistics, pp. 261–274, 2022.
Details Download: HTML
Johan Los, Frederik Schulte, Margaretha Gansterer, Richard F. Hartl, Matthijs T. J. Spaan, and Rudy R. Negenborn. Decentralized Combinatorial Auctions for Dynamic and Large-Scale Collaborative Vehicle Routing. In Proc. Int. Conf. on Computational Logistics, pp. 215–230, Springer, 2020.
Details Download: HTML
Johan Los, Frederik Schulte, Matthijs T. J. Spaan, and Rudy R. Negenborn. Collaborative Vehicle Routing when Agents have Mixed Information Sharing Attitudes. Transportation Research Procedia, 44:94–101, Elsevier, 2020.
Details Download: HTML
Johan Los, Frederik Schulte, Matthijs T. J. Spaan, and Rudy R. Negenborn. The value of information sharing for platform-based collaborative vehicle routing. Transportation Research Part E: Logistics and Transportation Review, 141, 2020.
Details Download: HTML
Johan Los, Matthijs T. J. Spaan, and Rudy R. Negenborn. Fleet Management for Pickup and Delivery Problems with Multiple Locations and Preferences. In International Conference on Dynamics in Logistics, pp. 86–94, 2018.
Details Download: HTML

Reinforcement learning

Davide Mambelli, Stephan Bongers, Onno Zoeter, Matthijs T. J. Spaan, and Frans A. Oliehoek. When Do Off-Policy and On-Policy Policy Gradient Methods Align?. arXiv:2402.12034, 2024.
Details Download: pdf
Pascal R. Van der Vaart, Neil Yorke-Smith, and Matthijs T. J. Spaan. Bayesian Ensembles for Exploration in Deep Reinforcement Learning. In Proc. of Int. Conference on Autonomous Agents and Multi Agent Systems, 2024. Extended abstract
Details Download: (unavailable)
Moritz A. Zanger, Wendelin Böhmer, and Matthijs T. J. Spaan. Diverse Projection Ensembles for Distributional Reinforcement Learning. In Proc. Int. Conf. on Learning Representations, 2024.
Details Download: (unavailable)
Alberto Castellini, Federico Bianchi, Edoardo Zorzi, Thiago D. Simão, Alessandro Farinelli, and Matthijs T. J. Spaan. Scalable Safe Policy Improvement via Monte Carlo Tree Search. In International Conference on Machine Learning, pp. 3732–3756, Proceedings of Machine Learning Research 202, 2023.
Details Download: pdf
Yaniv Oren, Matthijs T. J. Spaan, and Wendelin Böhmer. E-MCTS: Deep Exploration in Model-Based Reinforcement Learning by Planning with Epistemic Uncertainty. In European Workshop on Reinforcement Learning, 2023.
Details Download: pdf
Miguel Suau, Matthijs T. J. Spaan, and Frans A. Oliehoek. Bad Habits: Policy Confounding and Out-of-Trajectory Generalization in RL. In European Workshop on Reinforcement Learning, 2023.
Details Download: pdf
Pascal Van der Vaart, Matthijs T. J. Spaan, and Neil Yorke-Smith. Bayesian Deep Q-Learning via Sequential Monte Carlo. In European Workshop on Reinforcement Learning, 2023.
Details Download: pdf
Max Weltevrede, Matthijs T. J. Spaan, and Wendelin Böhmer. The Role of Diverse Replay for Generalisation in Reinforcement Learning. arXiv:2306.05727, 2023.
Details Download: pdf
Qisong Yang, Thiago D. Simão, Simon H. Tindemans, and Matthijs T. J. Spaan. Safety-Constrained Reinforcement Learning with a Distributional Safety Critic. Machine Learning, 112(3):859–887, Springer, 2023.
Details Download: pdf
Qisong Yang and Matthijs T. J. Spaan. CEM: Constrained Entropy Maximization for Task-Agnostic Safe Exploration. In Proceedings of the Thirty-Seventh AAAI Conference on Artificial Intelligence, pp. 10798–10806, 2023.
Details Download: pdf
Qisong Yang, Thiago D. Simão, Nils Jansen, Simon H. Tindemans, and Matthijs T. J. Spaan. Reinforcement Learning by Guided Safe Exploration. arXiv:2307.14316, 2023.
Details Download: pdf
Moritz A. Zanger, Wendelin Böhmer, and Matthijs T. J. Spaan. Diverse Projection Ensembles for Distributional Reinforcement Learning. arXiv:2306.07124, 2023.
Details Download: pdf
Danial Kamran, Thiago D. Simão, Qisong Yang, Canmanie T. Ponnambalam, Johannes Fischer, Matthijs T. J. Spaan, and Martin Lauer. A Modern Perspective on Safe Automated Driving for Different Traffic Dynamics using Constrained Reinforcement Learning. In Proceedings of the IEEE International Conference on Intelligent Transportation Systems, pp. 4017–4023, 2022.
Details Download: HTML
Canmanie Ponnambalam, Danial Kamran, Thiago D. Simão, Frans A. Oliehoek, and Matthijs T. J. Spaan. Back to the Future: Solving Hidden Parameter MDPs with Hindsight. In Adaptive and Learning Agents, 2022. Workshop at AAMAS22
Details Download: pdf
Miguel Suau, Jinke He, Matthijs T. J. Spaan, and Frans A. Oliehoek. Speeding up Deep Reinforcement Learning through Influence-Augmented Local Simulators. In Proc. of Int. Conference on Autonomous Agents and Multi Agent Systems, pp. 1735–1737, 2022.
Details Download: pdf
Miguel Suau, Jinke He, Matthijs T. J. Spaan, and Frans A. Oliehoek. Influence-Augmented Local Simulators: A Scalable Solution for Fast Deep RL in Large Networked Systems. arXiv:2202.01534, 2022.
Details Download: pdf
Miguel Suau, Jinke He, Matthijs T. J. Spaan, and Frans A. Oliehoek. Influence-Augmented Local Simulators: A Scalable Solution for Fast Deep RL in Large Networked Systems. In International Conference on Machine Learning, pp. 20604–20624, Proceedings of Machine Learning Research 162, 2022.
Details Download: pdf
Miguel Suau, Jinke He, Mustafa Mert Çelikok, Matthijs T. J. Spaan, and Frans A. Oliehoek. Distributed Influence-Augmented Local Simulators for Parallel MARL in Large Networked Systems. In Advances in Neural Information Processing Systems, pp. 28305–28318, 2022.
Details Download: pdf
Qisong Yang, Thiago D. Simão, Nils Jansen, Simon H. Tindemans, and Matthijs T. J. Spaan. Training and Transferring Safe Policies in Reinforcement Learning. In Adaptive and Learning Agents, 2022. Workshop at AAMAS22
Details Download: pdf
Qisong Yang, Thiago D. Simão, Simon H. Tindemans, and Matthijs T. J. Spaan. Refined Risk Management in Safe Reinforcement Learning with a Distributional Safety Critic. In Safe Reinforcement Learning, 2022. Workshop at IJCAI22
Details Download: pdf
Canmanie T. Ponnambalam, Frans A. Oliehoek, and Matthijs T. J. Spaan. Abstraction-Guided Policy Recovery from Expert Demonstrations. In Proc. of Int. Conf. on Automated Planning and Scheduling, pp. 560–568, 2021.
Details Download: pdf [989.6kB] HTML
Thiago D. Simão, Nils Jansen, and Matthijs T. J. Spaan. AlwaysSafe: Reinforcement Learning without Safety Constraint Violations during Training. In Proc. of Int. Conference on Autonomous Agents and Multi Agent Systems, pp. 1226–1235, 2021.
Details Download: pdf
Jordi Smit, Canmanie Ponnambalam, Matthijs T. J. Spaan, and Frans A. Oliehoek. PEBL: Pessimistic Ensembles for Offline Deep Reinforcement Learning. In Robust and Reliable Autonomy in the Wild, 2021. Workshop at IJCAI-21
Details Download: pdf
Qisong Yang, Thiago D. Simão, Simon H. Tindemans, and Matthijs T. J. Spaan. WCSAC: Worst-Case Soft Actor Critic for Safety-Constrained Reinforcement Learning. In Proceedings of the Thirty-Fifth AAAI Conference on Artificial Intelligence, pp. 10639–10646, 2021.
Details Download: pdf [1008.5kB] HTML
Grigory Neustroev, Canmanie T. Ponnambalam, Mathijs M. de Weerdt, and Matthijs T. J. Spaan. Interval Q-Learning: Balancing Deep and Wide Exploration. In Adaptive and Learning Agents, 2020. Workshop at AAMAS20
Details Download: pdf
Canmanie T. Ponnambalam, Frans A. Oliehoek, and Matthijs T. J. Spaan. Abstraction-Guided Policy Recovery from Expert Demonstrations. In Offline Reinforcement Learning Workshop at Neural Information Processing Systems (NeurIPS), 2020.
Details Download: pdf [233.6kB]
Thiago D. Simão and Matthijs T. J. Spaan. Safe Policy Improvement with Baseline Bootstrapping in Factored Environments. In Proceedings of the 32nd AAAI Conference on Artificial Intelligence, pp. 4967–4974, 2019.
Details Download: pdf [1.2MB] HTML
Thiago D. Simão and Matthijs T. J. Spaan. Structure Learning for Safe Policy Improvement. In Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence, pp. 3453–3459, 2019.
Details Download: pdf [348.5kB] HTML
Thiago D. Simão and Matthijs T. J. Spaan. An Empirical Evaluation of Safe Policy Improvement in Factored Environments. In ICML/IJCAI/AAMAS 2018 Workshop on Planning and Learning, 2018.
Details Download: (unavailable)

Unspecified

Katia Sycara, Vasant Honavar, and Matthijs Spaan, editors. Proceedings of the Thirty-Sixth AAAI Conference on Artificial Intelligence, AAAI Press, 2022.
Details Download: HTML
Mathijs de Weerdt, Sven Koenig, Gabriele Röger, and Matthijs Spaan, editors. Proceedings of the Twenty-Eighth International Conference on Automated Planning and Scheduling, AAAI Press, 2018.
Details Download: HTML
Nisar Ahmed, Paul Bello, Selmer Bringsjord, Micah Clark, Bradley Hayes, Andrey Kolobov, Christopher Miller, Frans Oliehoek, Frank Stein, and Matthijs Spaan. The 2015 AAAI Fall Symposium Series Reports. AI Magazine, Summer:85–90, 2016.
Details Download: HTML

Generated by bib2html.pl (written by Patrick Riley) on Thu Feb 29, 2024 16:15:45 UTC