1FundamentalsExplainer18 min
Tokens: the one idea that explains most of AI's odd behaviour
Why a model that can explain quantum tunnelling cannot count the letters in strawberry, why long conversations get slow and expensive, and why Dutch costs more than English. It all comes back to the very first thing that happens to your text.