• AI Agents for Data Analysis with Shreya Shankar - #703

  • Oct 1 2024
  • Length: 48 mins
  • Podcast

AI Agents for Data Analysis with Shreya Shankar - #703

Listen for free

View show details

  • Summary

  • Today, we're joined by Shreya Shankar, a PhD student at UC Berkeley to discuss DocETL, a declarative system for building and optimizing LLM-powered data processing pipelines for large-scale and complex document analysis tasks. We explore how DocETL's optimizer architecture works, the intricacies of building agentic systems for data processing, the current landscape of benchmarks for data processing tasks, how these differ from reasoning-based benchmarks, and the need for robust evaluation methods for human-in-the-loop LLM workflows. Additionally, Shreya shares real-world applications of DocETL, the importance of effective validation prompts, and building robust and fault-tolerant agentic systems. Lastly, we cover the need for benchmarks tailored to LLM-powered data processing tasks and the future directions for DocETL. The complete show notes for this episode can be found at https://twimlai.com/go/703.
    Show more Show less
activate_Holiday_promo_in_buybox_DT_T2
Show more Show less

What listeners say about AI Agents for Data Analysis with Shreya Shankar - #703

Average customer ratings

Reviews - Please select the tabs below to change the source of reviews.

Audible.com reviews

Amazon reviews
No Reviews are Available