• Tokenisation: the cost surface of LLMs

    Lesson 01 — the cost surface of LLMs. A practical first look at what every other lesson on this site will assume you’ve felt for yourself. The mistake nobody catches You’re sitting across from the head of a Maltese SME. They want to deploy an AI chat agent for their customer support. They ask the…

  • Forward pass: what actually happens when an LLM emits one token

    Lesson 02 — what actually happens when a model emits one token. After this lesson you should be able to narrate the forward pass without hand-waving. One token. Seven steps. Every token a large language model produces comes from the same seven-stage pipeline. Skip any one of them and you lose the ability to reason…

  • Sampling: temperature, top-k, top-p

    Lesson 03 — the difference between “the model said it” and “the model could have said it”. Sampling is where probability becomes language. From logits to a chosen token After the last block of the transformer, the model produces a vector of logits — one real number per token in the vocabulary. They’re unbounded. They…

  • KV cache: the serving bottleneck

    Lesson 04 — the single most operationally important fact about LLM serving. Most teams discover this the expensive way. Why caching K and V matters To generate token N, self-attention has to read the keys and values of every previous token. Token N+1 needs the same plus one more. Without caching, position N would re-compute…