Portrait of Zhiyuan Sun is unavailable

Zhiyuan Sun

Alumni

Publications

Enhancing Agent Learning through World Dynamics Modeling
Zhiyuan Sun
Haochen Shi
Marc-Alexandre Côté
Glen Berseth
Xingdi Yuan
Bang Liu
Large language models (LLMs) have been increasingly applied to tasks in language understanding and interactive decision-making, with their i… (see more)mpressive performance largely attributed to the extensive domain knowledge embedded within them. However, the depth and breadth of this knowledge can vary across domains. Many existing approaches assume that LLMs possess a comprehensive understanding of their environment, often overlooking potential gaps in their grasp of actual world dynamics. To address this, we introduce Discover, Verify, and Evolve (DiVE), a framework that discovers world dynamics from a small number of demonstrations, verifies the accuracy of these dynamics, and evolves new, advanced dynamics tailored to the current situation. Through extensive evaluations, we assess the impact of each component on performance and compare the dynamics generated by DiVE to human-annotated dynamics. Our results show that LLMs guided by DiVE make more informed decisions, achieving rewards comparable to human players in the Crafter environment and surpassing methods that require prior task-specific training in the MiniHack environment.
2024-07-24
arXiv (Cornell University) (preprint)
doi.org
arxiv.org