Portrait de Mohamad H. Danesh

Mohamad H. Danesh

Doctorat - McGill
Superviseur⋅e principal⋅e
Hsiu-Chin Lin
Sujets de recherche
Apprentissage par renforcement
Robotique
Site web
Google Scholar
GitHub

Publications

Safe Domain Randomization via Uncertainty-Aware Out-of-Distribution Detection and Policy Adaptation
Mohamad H. Danesh
Maxime Wabartha
Stanley Wu
Joelle Pineau
Hsiu-Chin Lin
Deploying reinforcement learning (RL) policies in real-world involves significant challenges, including distribution shifts, safety concerns… (voir plus), and the impracticality of direct interactions during policy refinement. Existing methods, such as domain randomization (DR) and off-dynamics RL, enhance policy robustness by direct interaction with the target domain, an inherently unsafe practice. We propose Uncertainty-Aware RL (UARL), a novel framework that prioritizes safety during training by addressing Out-Of-Distribution (OOD) detection and policy adaptation without requiring direct interactions in target domain. UARL employs an ensemble of critics to quantify policy uncertainty and incorporates progressive environmental randomization to prepare the policy for diverse real-world conditions. By iteratively refining over high-uncertainty regions of the state space in simulated environments, UARL enhances robust generalization to the target domain without explicitly training on it. We evaluate UARL on MuJoCo benchmarks and a quadrupedal robot, demonstrating its effectiveness in reliable OOD detection, improved performance, and enhanced sample efficiency compared to baselines.
2025-07-08
ArXiv (prépublication)
doi.org
arxiv.org