ELI5 - What is an LLM?

Graphic depicting an LLM

Imagine a very smart parrot that has read almost the entire library of the internet. Stories. Textbooks. Recipes. News. Conversations. That parrot is an LLM.

LLM means Large Language Model. That sounds big and scary, but the idea is simple. It is a computer program that learns how words usually go together. It does not understand things like a human does. It is very good at guessing what word should come next.

Think about a sentence like this. “The cat sat on the…” Your brain expects “mat.” An LLM does the same thing. It looks at all the words so far and guesses the most likely next word. Then it does it again. And again. One word at a time. That is how it writes full sentences and long answers. The “large” part means it learned from a huge amount of text. Way more than any human could ever read. During training, the model is shown billions of sentences. It keeps making guesses. When it is wrong, it gets corrected. Slowly, it gets better at predicting language patterns. Over time, it learns grammar, facts, styles, and even jokes.

The LLM does not have memory like people do. It does not remember your past unless it is designed to. It does not have feelings. It does not know things in the human sense. It only sees patterns in words and numbers. Everything is math under the hood. When you ask an LLM a question, it does not look up an answer like Google. Instead, it generates a response based on what usually makes sense in similar situations. That is why it can explain things, write stories, help with homework, or pretend to be a pirate. It is following patterns it learned.

Sometimes it gets things wrong. That happens because it is guessing, not thinking. If the patterns it learned are confusing or incomplete, the answer can be too. That is also why it can sound confident even when it is mistaken. So an LLM is like a super powered autocomplete. Your phone suggests the next word in a text message. An LLM does that at a massive scale, with way more training, and much better results.

In short, an LLM is a machine that learns language by reading a huge amount of text and practicing guessing the next word until it gets really good at it.

Next
Next

ELI5 - What is a Graphics Card and how does it work?