• Stealing Part of a Production Language Model with Nicholas Carlini - #702

  • Sep 23 2024
  • Length: 1 hr and 4 mins
  • Podcast

Stealing Part of a Production Language Model with Nicholas Carlini - #702

Listen for free

View show details

  • Summary

  • Today, we're joined by Nicholas Carlini, research scientist at Google DeepMind to discuss adversarial machine learning and model security, focusing on his 2024 ICML best paper winner, “Stealing part of a production language model.” We dig into this work, which demonstrated the ability to successfully steal the last layer of production language models including ChatGPT and PaLM-2. Nicholas shares the current landscape of AI security research in the age of LLMs, the implications of model stealing, ethical concerns surrounding model privacy, how the attack works, and the significance of the embedding layer in language models. We also discuss the remediation strategies implemented by OpenAI and Google, and the future directions in the field of AI security. Plus, we also cover his other ICML 2024 best paper, “Position: Considerations for Differentially Private Learning with Large-Scale Public Pretraining,” which questions the use and promotion of differential privacy in conjunction with pre-trained models. The complete show notes for this episode can be found at https://twimlai.com/go/702.
    Show more Show less
activate_Holiday_promo_in_buybox_DT_T2
Show more Show less

What listeners say about Stealing Part of a Production Language Model with Nicholas Carlini - #702

Average customer ratings

Reviews - Please select the tabs below to change the source of reviews.

Audible.com reviews

Amazon reviews
No Reviews are Available