ai/
Models, training, prompts and how language models work.
10 results
ai/rag-how-a-chatbot-looks-things-up-before-it-answers.md
RAG: how a chatbot looks things up before it answers
A chatbot has never read your shop's rules, so when you ask it about them it may guess, and a confident wrong guess is called a…
ai/accuracy-why-a-spam-filter-that-is-99-right-can-still-catch-nothing.md
Accuracy: why a spam filter that is 99% right can still catch nothing
A spam filter that never flags anything can score 99% accuracy when only 1 email in 100 is spam. So what should you measure instead? This…
ai/the-context-window-why-a-chatbot-forgets-the-start-of-a-long-chat.md
The context window: why a chatbot forgets the start of a long chat
A chatbot does not remember your conversation. Each time you press send, the app hands the model the whole chat again, and the model can…
ai/gradient-descent-how-a-computer-learns-a-number-by-rolling-downhill.md
Gradient descent: how a computer learns a number by rolling downhill
How does a computer learn a number? It can't solve for it in one go. It tries a guess, measures how wrong it is, and nudges the guess…
ai/embeddings-how-a-computer-knows-a-pony-is-closer-to-a-horse-than-a-tru.md
Embeddings: how a computer knows a pony is closer to a horse than a truck
A computer sees the letters in "pony" and nothing else, yet search boxes can still tell that a pony is closer to a horse than to a truck…
ai/next-word-prediction-how-a-chatbot-s-core-trick-is-just-counting.md
Next-word prediction: how a chatbot's core trick is just counting
A chatbot's core job is to guess the next word, and the simplest version of that is just counting. In this article you read a few…
ai/temperature-why-a-chatbot-answers-differently-each-time.md
Temperature: why a chatbot answers differently each time
Ask a chatbot the same question twice and the answers can differ. That is not a bug: the model chooses each next word using chance, and a…
ai/overfitting-why-a-perfect-score-on-practice-questions-can-still-fail.md
Overfitting: why a perfect score on practice questions can still fail
A model that scores perfectly on the examples it learned from can still fail badly on new ones. That failure is called overfitting, and you…
ai/embeddings-how-a-computer-measures-that-a-kitten-is-like-a-cat.md
Embeddings: how a computer measures that a kitten is like a cat
How does a computer know that kitten is closer to cat than to car? It can't read meaning, but it can measure it. An embedding turns a word…
ai/machine-learning-by-example-how-a-computer-learns-apples-from-oranges.md
Machine learning by example: how a computer learns apples from oranges
Normal programs follow rules a person wrote. Machine learning turns that around: you give the computer examples with the right answers, and…