I am a PhD student at the department of software science at Radboud University, working on the project Provably Correct Policies for Uncertain Partially Observable Markov Decision Processes under supervision of dr. Nils Jansen.

My research interests are formal verification and learning in probabilistic systems such as (partially observable) Markov decision processes and variations that extend these models with uncertainty. Other interests include coalgebra (especially for probabilistic systems), (robust) convex optimization, and algorithms in general.

In my spare time I enjoy playing and talking about video games, reading, and watching movies.

You can reach me at m.suilen {AT} science.ru.nl

News

December 2, 2020:
Our paper Robust Finite-State Controllers for Uncertain POMDPs has been accepted for publication at AAAI 2021!

August 1, 2020:
I have joined the department of software science at Radboud University as a PhD student in the project Provably Correct Policies for Uncertain Partially Observable Markov Decision Processes under supervision of dr. Nils Jansen.

April 20, 2020:
Our paper Robust Policy Synthesis for uncertain POMDPs via Convex Optimization has been accepted for publication at IJCAI 2020!

Publications

See also my DBLP or Google scholar profiles.

Currently under submission:
Accepted publications:
Preprint Murat Cubuktepe, Nils Jansen, Sebastian Junges, Ahmadreza Marandi, Marnix Suilen, Ufuk Topcu. Robust Finite-State Controllers for Uncertain POMDPs. In AAAI 2021 (to appear).
PDF Marnix Suilen, Nils Jansen, Murat Cubuktepe, Ufuk Topcu. Robust Policy Synthesis for Uncertain POMDPs via Convex Optimization. In IJCAI 2020.
Theses:
PDF Marnix Suilen, Entropy Guided Decision Making in Multiple-Environment Markov Decision Processes, 2020, master thesis, Radboud University Nijmegen.
PDF Marnix Suilen, Reachability properties for uncertain Markov decision processes, 2018, bachelor thesis, Radboud University Nijmegen.

Teaching

As a teaching assistant:
Model Checking, spring 2020.
Algorithms and Datastructures, fall 2019.
Algorithms and Datastructures, fall 2018.

Professional activities

Student volunteer for FORMATS 2020, part of QONFEST 2020.