PyTorch Developer Podcast Podcast By Edward Yang Team PyTorch cover art

PyTorch Developer Podcast

PyTorch Developer Podcast

By: Edward Yang Team PyTorch
Listen for free

About this listen

 The PyTorch Developer Podcast is a place for the PyTorch dev team to do bite sized (10-20 min) topics about all sorts of internal development topics in PyTorch.2021 - PyTorch Developer Podcast
Episodes
  • Compiler collectives

    Compiler collectives
    Aug 4 2024

    Compiler collectives are a PT2 feature where by compiler instances across multiple ranks use NCCL collectives to communicate information to other instances. This is used to ensure we consistently decide if inputs or static or dynamic across all ranks. See also PR at https://github.com/pytorch/pytorch/pull/130935
    Show more Show less
    17 mins
  • TORCH_TRACE and tlparse

    TORCH_TRACE and tlparse
    Apr 29 2024
    TORCH_TRACE and tlparse are a structured log and log parser for PyTorch 2. It gives useful information about what code was compiled and what the intermediate build products look like.
    Show more Show less
    15 mins
  • Higher order operators

    Higher order operators
    Apr 21 2024
    Higher order operators are a special form of operators in torch.ops which have relaxed input argument requirements: in particular, they can accept any form of argument, including Python callables. Their name is based off of their most common use case, which is to represent higher order functions like control flow operators. However, they are also used to implement other variants of basic operators and can also be used to smuggle in Python data that is quite unusual. They are implemented using a Python dispatcher.
    Show more Show less
    17 mins
adbl_web_global_use_to_activate_webcro805_stickypopup
No reviews yet