← Toutes les offres
Inria

Post-Doctoral Research Visit F/M Safe Planning for Markov Decision Processes via Shielding

Inria

Rennes
Internet And Software
Publié le 17 novembre 2026

Description du poste

*Le descriptif de l’offre ci-dessous est en Anglais* **Type de contrat :** CDD **Contrat renouvelable :** Oui **Niveau de diplôme exigé :** Thèse ou équivalent **Fonction :** Post-Doctorant **A propos du centre ou de la direction fonctionnelle** ------------------------------------------------------- The Inria Centre at Rennes University is one of Inria's nine centres and has more than thirty research teams. The Inria Centre is a major and recognized player in the field of digital sciences. It is at the heart of a rich R&D and innovation ecosystem: highly innovative PMEs, large industrial groups, competitiveness clusters, research and higher education players, laboratories of excellence, technological research institute, etc. **Contexte et atouts du poste** ------------------------------- The post-doc position is part of a collaboration between Inria and Mitsubishi Electric R&D Centre Europe (MERCE) within the FRAIME project on artificial intelligence and formal methods. The project explores, on the one hand, how Formal Methods can provide guarantees on AI systems, and on the other hand how AI can help Formal Methods to be more efficient and easier to use by practitioners. The vision is to intertwine Formal Methods and AI to efficiently design safe systems. This is a postdoctoral position in the fields of AI planning, formal methods, and reinforcement learning (RL). The position is initially funded for 12 months, but it is possibly extendible. While this is an academic position based at Inria Rennes, the candidate will collaborate with researchers from both Inria and MERCE, thus benefiting from both academic and industrial research environments. The work will be supervised by Ocan Sankur (Inria - IRISA https://devine.inria.fr/), Nicolas Waldburger (MERCE). We will moreover collaborate with Francesco Belardinelli from Imperial College London. **Mission confiée** ------------------- The main objective is to develop safe planning algorithms with stronger guarantees in Markov decision processes. More precisely, we will study shielding techniques to ensure the safety of policies computed by reinforcement learning (RL) algorithms. One of the possible object of study is the beyond-worst case framework [1]. Here, algorithms are given to optimize a given objective in expectation while ensuring guarantees in the worst-case. This can be interpreted as a constrained MDP where the constraints are to be satisfied in the worst case. We will revisit this framework with a shielding point of view: the average case can be optimized using RL algorithms while the worst-case guarantees can be ensured by solving two-player zero-sum games. The work will consist in identifying appropriate applications, building the right setting to apply shielding, which includes pre-shields and post-shields for RL as in [2], and experimentally evaluating the overall approach. Expected theoretical developments concern scalability issues addressed using game a