Code

Coding Practice | Implementing a Tokenizer: Word-based and Byte Pair Encoding
An introduction to tokenizers, together with a code implementation.
Jul 3, 2024 13 min read Coding Practice
Code Course
Coding Practice | Implementing a Tokenizer: Word-based and Byte Pair Encoding
Coding Practice | Implementing Self-Attention from Scratch
A from-scratch code walkthrough of the self-attention mechanism behind the Transformer.
Mar 10, 2024 7 min read Coding Practice
Paper Reference
Coding Practice | Implementing Self-Attention from Scratch