I am a PhD student at the department of software science at Radboud University, working on the project Provably Correct Policies for Uncertain Partially Observable Markov Decision Processes under supervision of dr. Nils Jansen and prof. dr. Frits Vaandrager.

My research interests are formal verification and learning in probabilistic systems such as (partially observable) Markov decision processes and variations that extend these models with uncertainty. Other interests include coalgebra (especially for probabilistic systems), (robust) convex optimization, and algorithms in general.

You can reach me at m.suilen {AT} science.ru.nl

Publications

See also my DBLP or Google scholar profiles.

Currently under submission:
Marnix Suilen, Nils Jansen, David Parker. Anytime Learning and Verification of Uncertain Markov Decision Processes.
Accepted publications:
PDF Thom S. Badings, Arnd Hartmanns, Nils Jansen, Marnix Suilen. Balancing Wind and Batteries: Towards Predictive Verification of Smart Grids. In NASA Formal Methods Symposium 2021.
PDF Murat Cubuktepe, Nils Jansen, Sebastian Junges, Ahmadreza Marandi, Marnix Suilen, Ufuk Topcu. Robust Finite-State Controllers for Uncertain POMDPs. In AAAI 2021.
PDF Marnix Suilen, Nils Jansen, Murat Cubuktepe, Ufuk Topcu. Robust Policy Synthesis for Uncertain POMDPs via Convex Optimization. In IJCAI 2020.
Theses:
PDF Marnix Suilen, Entropy Guided Decision Making in Multiple-Environment Markov Decision Processes, 2020, master thesis, Radboud University Nijmegen.
PDF Marnix Suilen, Reachability properties for uncertain Markov decision processes, 2018, bachelor thesis, Radboud University Nijmegen.

Professional activities

Talks and Presentations

Robust Policies for Uncertain POMDPs. R4P 2021.
Robust Policies for Uncertain POMDPs. FUNCTION 2021.
Robust Policy Synthesis for Uncertain POMDPs via Convex Optimization. IJCAI 2020.

Teaching

As a teaching assistant:
Mathematical Foundations of Computer Science Seminar, fall 2021.
Model Checking, spring 2021.
Model Checking, spring 2020.
Algorithms and Datastructures, fall 2019.
Algorithms and Datastructures, fall 2018.

Other

Student volunteer for FORMATS 2020, part of QONFEST 2020.