Portrait de Saurav Jha

Saurav Jha

Postdoctorat - Polytechnique
Superviseur⋅e principal⋅e
Sarath Chandar
Sujets de recherche
Apprentissage continu
Modèles génératifs
Site web
Google Scholar
GitHub

Publications

Probing the effectiveness of World Models for Spatial Reasoning through Test-time Scaling
Saurav Jha
Muhammad Jehanzeb Mirza
Wei Lin
Shiqi Yang
A. Chandar
Vision-Language Models (VLMs) remain limited in spatial reasoning tasks that require multi-view understanding and embodied perspective shift… (voir plus)s. Recent approaches such as MindJourney attempt to mitigate this gap through test-time scaling where a world model imagines action-conditioned trajectories and a heuristic verifier selects helpful views from such trajectories. In this work, we systematically examine how such test-time verifiers behave across benchmarks, uncovering both their promise and their pitfalls. Our uncertainty-based analyses show that MindJourney's verifier provides little meaningful calibration, and that random scoring often reduces answer entropy equally well, thus exposing systematic action biases and unreliable reward signals. To mitigate these, we introduce a Verification through Spatial Assertions (ViSA) framework that grounds the test-time reward in verifiable, frame-anchored micro-claims. This principled verifier consistently improves spatial reasoning on the SAT-Real benchmark and corrects trajectory-selection biases through more balanced exploratory behavior. However, on the challenging MMSI-Bench, none of the verifiers, including ours, achieve consistent scaling, suggesting that the current world models form an information bottleneck where imagined views fail to enrich fine-grained reasoning. Together, these findings chart the bad, good, and ugly aspects of test-time verification for world-model-based reasoning. Our code is available at https://github.com/chandar-lab/visa-for-mindjourney.
2025-11-30
arXiv (publié)
doi.org
arxiv.org