blog

enough ball knowledge to larp about understanding llm backends

a backend engineer's guide to tokens, caching, routing, batching, streaming, and the words people keep throwing around.