Couverture de PyTorch Developer Podcast

PyTorch Developer Podcast

PyTorch Developer Podcast

De : Edward Yang Team PyTorch
Écouter gratuitement

À propos de ce contenu audio

 The PyTorch Developer Podcast is a place for the PyTorch dev team to do bite sized (10-20 min) topics about all sorts of internal development topics in PyTorch.2021 - PyTorch Developer Podcast
Les membres Amazon Prime bénéficient automatiquement de 2 livres audio offerts chez Audible.

Vous êtes membre Amazon Prime ?

Bénéficiez automatiquement de 2 livres audio offerts.
Bonne écoute !
    Épisodes
    • Compiler collectives

      Compiler collectives
      Aug 4 2024

      Compiler collectives are a PT2 feature where by compiler instances across multiple ranks use NCCL collectives to communicate information to other instances. This is used to ensure we consistently decide if inputs or static or dynamic across all ranks. See also PR at https://github.com/pytorch/pytorch/pull/130935
      Afficher plus Afficher moins
      17 min
    • TORCH_TRACE and tlparse

      TORCH_TRACE and tlparse
      Apr 29 2024
      TORCH_TRACE and tlparse are a structured log and log parser for PyTorch 2. It gives useful information about what code was compiled and what the intermediate build products look like.
      Afficher plus Afficher moins
      15 min
    • Higher order operators

      Higher order operators
      Apr 21 2024
      Higher order operators are a special form of operators in torch.ops which have relaxed input argument requirements: in particular, they can accept any form of argument, including Python callables. Their name is based off of their most common use case, which is to represent higher order functions like control flow operators. However, they are also used to implement other variants of basic operators and can also be used to smuggle in Python data that is quite unusual. They are implemented using a Python dispatcher.
      Afficher plus Afficher moins
      17 min
    Aucun commentaire pour le moment