Distributed Model Training and Parallelism Techniques

Automatic Mixed Precision Training in PyTorch

Simplify neural networks with pruning and compression

Efficient Data Pipeline

Model Training Optimizations

Under the Hood of torch.compile

Introduction to torch.compile

The Llama 3 Herd of Models

Getting Started with Docker

Speculative Decoding

Programming on GPU with Triton

High Performance LLM Serving

Crash Course on CUDA