PyTorch Developer Podcast

By: Edward Yang Team PyTorch
Listen for free

  • Summary

  • The PyTorch Developer Podcast is a place for the PyTorch dev team to do bite sized (10-20 min) topics about all sorts of internal development topics in PyTorch.
    2021 - PyTorch Developer Podcast
    Show more Show less
Show more Show less
activate_Holiday_promo_in_buybox_DT_T2
Episodes
  • Compiler collectives

    Compiler collectives
    Aug 4 2024

    Compiler collectives are a PT2 feature where by compiler instances across multiple ranks use NCCL collectives to communicate information to other instances. This is used to ensure we consistently decide if inputs or static or dynamic across all ranks. See also PR at https://github.com/pytorch/pytorch/pull/130935
    Show more Show less
    17 mins
  • TORCH_TRACE and tlparse

    TORCH_TRACE and tlparse
    Apr 29 2024
    TORCH_TRACE and tlparse are a structured log and log parser for PyTorch 2. It gives useful information about what code was compiled and what the intermediate build products look like.
    Show more Show less
    15 mins
  • Higher order operators

    Higher order operators
    Apr 21 2024
    Higher order operators are a special form of operators in torch.ops which have relaxed input argument requirements: in particular, they can accept any form of argument, including Python callables. Their name is based off of their most common use case, which is to represent higher order functions like control flow operators. However, they are also used to implement other variants of basic operators and can also be used to smuggle in Python data that is quite unusual. They are implemented using a Python dispatcher.
    Show more Show less
    17 mins

What listeners say about PyTorch Developer Podcast

Average customer ratings

Reviews - Please select the tabs below to change the source of reviews.

Audible.com reviews

Amazon reviews
No Reviews are Available