Large Language Models explained briefly

The sentence to pause on is at 1:20: “even though the model itself is deterministic, a given prompt typically gives a different answer each time it's run.” Same weights and same prompt give the same probabilities every time. The variety is added afterwards, on purpose: the software sometimes picks a less likely word because the result reads more naturally. That's a setting in the code serving the model, not the model changing its mind.

So two different answers to the same question aren't two opinions. They're two draws from one set of odds. Worth remembering before anyone screenshots one of them as “what the AI thinks.”