Blog
Writing about AI engineering, machine learning, and building intelligent systems
- Tokenizer From Scratch: BPE as Learned Compression
A beginner-friendly walkthrough of byte-level BPE, starting from a tiny toy example and ending with a runnable tokenizer, labeled charts, and an optional merge microscope.