Chapter 8 · The Rise of Large Language Models

Choose the Next Word

Turn the temperature, top-k and top-p dials on a model's next-word probabilities, build a sentence word by word, and compare whole generations.