Lavee Singh

Founder-engineer and former CTO of TripGuru. I write about how frontier AI systems work, from the inside.

Writing

The Cache Is the Bill
How prompt caching works inside frontier LLMs, and what it does to the cost of long agent sessions. With a simulator for a whole working day on Claude Opus 5.5.
28 September 2026 · 8 interactive figures

All writing →

Books

Frontier LLMs, From the Inside
How large language models work, from the next-token game to training runs, alignment, serving, and the applications built on top. For engineers who already use AI every day.
27 chapters · interactive figures · free to read online