Understanding Attention & Transformers
A deep dive into attention mechanisms and Transformer architecture, from the original attention mechanism to building a working model in PyTorch. How modern AI systems like GPT and BERT work under the hood.
Blog
Thoughts on technology, development, AI, and the occasional life update.