• Imagine while Reasoning in Space: Multimodal Visualization-of-Thought with Chengzu Li - #722

  • Mar 10 2025
  • Length: 42 mins
  • Podcast

Imagine while Reasoning in Space: Multimodal Visualization-of-Thought with Chengzu Li - #722

Listen for free

View show details

  • Summary

  • Today, we're joined by Chengzu Li, PhD student at the University of Cambridge to discuss his recent paper, “Imagine while Reasoning in Space: Multimodal Visualization-of-Thought.” We explore the motivations behind MVoT, its connection to prior work like TopViewRS, and its relation to cognitive science principles such as dual coding theory. We dig into the MVoT framework along with its various task environments—maze, mini-behavior, and frozen lake. We explore token discrepancy loss, a technique designed to align language and visual embeddings, ensuring accurate and meaningful visual representations. Additionally, we cover the data collection and training process, reasoning over relative spatial relations between different entities, and dynamic spatial reasoning. Lastly, Chengzu shares insights from experiments with MVoT, focusing on the lessons learned and the potential for applying these models in real-world scenarios like robotics and architectural design. The complete show notes for this episode can be found at https://twimlai.com/go/722.
    Show more Show less
Show more Show less

What listeners say about Imagine while Reasoning in Space: Multimodal Visualization-of-Thought with Chengzu Li - #722

Average customer ratings

Reviews - Please select the tabs below to change the source of reviews.

Audible.com reviews

Amazon reviews
No Reviews are Available