6m
We Are Learning to Speak Machine
The story of AI has been about machines understanding us. But something else is happening: we are changing how we write. Read →
Writings
Below are my latest writings on AI and code. You can browse the full writings archive, subscribe to the RSS feed, or get any post as a markdown file by
adding .md to the URL.
-
- 7m
What is LoRA
LoRA lets you fine-tune large language models by training only small low-rank matrices instead of billions of parameters. Here is how it works. Read → - 4m
Tokenization and Byte Pair Encoding
LLMs do not read words — they read tokens. Here is how tokenization works and how the BPE algorithm builds a vocabulary that balances efficiency with coverage. Read →