I'm writing this article to document my learning journey. This is my first compiler. I first discovered tensor compilers last year while digging through the PyTorch codebase. At the time, I wanted to transition into low-level programming, and since PyTorch was the only framework I was familiar with, I decided to explore their codebase. There, I discovered their compiler toolchain, TorchDynamo and TorchInductor, which, in simple terms, serve as PyTorch's machine learning compi

Note: These are some of the models introduced in the Deep Learning Specialization course by DeepLearning.ai from Course 4 Week 2. I'm...