Portrait de Ivan Anokhin n'est pas disponible

Ivan Anokhin

ivan.anokhin@mila.quebec
Doctorat - Université de Montréal
Superviseur⋅e principal⋅e
Irina Rish
Co-superviseur⋅e
Samira Ebrahimi Kahou
Github
Google Scholar

Publications

Thinker: Learning to Plan and Act
Stephen Chung
Ivan Anokhin
David Scott Krueger
We propose the Thinker algorithm, a novel approach that enables reinforcement learning agents to autonomously interact with and utilize a le… (voir plus)arned world model. The Thinker algorithm wraps the environment with a world model and introduces new actions designed for interacting with the world model. These model-interaction actions enable agents to perform planning by proposing alternative plans to the world model before selecting a final action to execute in the environment. This approach eliminates the need for handcrafted planning algorithms by enabling the agent to learn how to plan autonomously and allows for easy interpretation of the agent's plan with visualization. We demonstrate the algorithm's effectiveness through experimental results in the game of Sokoban and the Atari 2600 benchmark, where the Thinker algorithm achieves state-of-the-art performance and competitive results, respectively. Visualizations of agents trained with the Thinker algorithm demonstrate that they have learned to plan effectively with the world model to select better actions. Thinker is the first work showing that an RL agent can learn to plan with a learned world model in complex environments.
openreview.net