Cuda

Showcase of a simple way of running custom CUDA kernels in PyTorch with extensions and a quick way of benchmarking them with respect to native functions

Conv 1D is a simple kernel to write, however if you want to optimize it, you will learn about all layers of GPU memory hierarchy.

Beautiful graphics that explain how kernels are executed on the GPU

Place to store resources that I used, use or will use on my journey to learn GPU programming (and bunch of other stuff LLM related).