PyTorch Developer Podcast

Technology Podcasts

The PyTorch Developer Podcast is a place for the PyTorch dev team to do bite sized (10-20 min) topics about all sorts of internal development topics in PyTorch.

Episodes

Compiler collectives

TORCH_TRACE and tlparse

Higher order operators

Inductor - Post-grad FX passes

CUDA graph trees

Min-cut partitioner

AOTInductor

Tensor subclasses and PT2

Compiled autograd

PT2 extension points

Inductor - Define-by-run IR

Unsigned integers

Inductor - IR

Dynamo - VariableTracker

Unbacked SymInts

Zero-one specialization

torchdynamo

PyTorch 2.0

History of functorch

Learning rate schedulers