browse/

3 results
ai/tokens-how-a-chatbot-cuts-your-text-into-pieces-before-it-reads-a-word.md Tokens: how a chatbot cuts your text into pieces before it reads a word A chatbot never sees your letters. Before it reads anything, a small program called a tokenizer cuts the text into pieces and gives each… 5 min read · 25 Oct ai/tokens-why-a-chatbot-never-reads-your-letters-only-numbered-pieces.md Tokens: why a chatbot never reads your letters, only numbered pieces A chatbot never reads your letters. Before it sees anything, your text is chopped into pieces called tokens, and every piece is swapped for… 6 min read · 6 Oct ai/how-a-chatbot-writes-one-guessed-word-at-a-time.md How a chatbot writes: one guessed word at a time A chatbot doesn't plan its reply and then type it out. It repeats one small step: look at the text so far, give every possible next token… 12 min read · 1 Oct