Notes

Coding Practice | Implementing a Tokenizer: Word-based and Byte Pair Encoding
An introduction to tokenizers, together with a code implementation.
Jul 3, 2024 13 min read Coding Practice
Code Course
Coding Practice | Implementing a Tokenizer: Word-based and Byte Pair Encoding
Graph Data Mining Notes — NIPS 2020 Workshop
Notes from the workshop given by Google’s Graph Mining team at NeurIPS 2020.
Mar 14, 2024 12 min read Notes
Workshop Slides
Graph Data Mining Notes — NIPS 2020 Workshop
Coding Practice | Implementing Self-Attention from Scratch
A from-scratch code walkthrough of the self-attention mechanism behind the Transformer.
Mar 10, 2024 7 min read Coding Practice
Paper Reference
Coding Practice | Implementing Self-Attention from Scratch
How Do We Supervise AI Smarter Than Us? | Weak-to-Strong Generalization
AI is growing more capable by the day and in some areas already surpasses us, which makes supervising it increasingly hard. So how do we supervise AI that is stronger than we are?
Dec 15, 2023 3 min read Notes
Paper Blog
How Do We Supervise AI Smarter Than Us? | Weak-to-Strong Generalization