How does a large language model work?
A language model does not read text as words but as tokens: small pieces of text. A token can be a short word, part of a longer word, or a punctuation mark. During training, the model saw enormous amounts of text and learned, again and again, to predict which token is likely to come next. That sounds simple. But a model that does it well enough can also answer an email, summarize a contract, or write code.
A second step follows that first training. The model learns to follow instructions and to answer in a conversation. That is why you can simply ask it something instead of having it complete a text. After that, the model itself no longer changes because of what you type. It does not learn from your conversations, unless the provider later uses them to train a new version. Whether that happens is in the provider’s terms.
What is a context window?
The context window is the amount of text the model can look at in one go: your question, the earlier messages, the documents you pass in, and its own answer. Anything outside it, the model does not see. That is why a long conversation sometimes seems to “forget” what was said at the very start.
For an AI agent, that window matters. An agent reads more than your question: it also reads files, search results, and tool output. According to the Hermes documentation on local models with Ollama, Hermes needs at least 64,000 tokens to work with tools. A model with a smaller window can still chat, but it quickly gets stuck on real tasks.
Why does an LLM sometimes make things up?
A language model picks the most likely continuation. Usually that is also the right answer, but not always. When the model does not know something, it can still give a convincing answer. That is called a hallucination. In a publication from September 2025, OpenAI describes hallucinations as “plausible but false statements generated by language models.” According to the same publication, this happens partly because training and evaluation reward models for guessing instead of admitting uncertainty.
For a business, that means: do not let a model recite facts from memory when it can look them up. An agent that first checks your own documents, your CRM, or a source, and names that source, makes fewer mistakes. And a person keeps checking what goes out the door, such as a quote, a price, or a legal statement.
What is the difference between an LLM and an AI agent?
An LLM produces text. It cannot send an email, open a file, or look up a customer by itself. An AI agent adds tools, memory, and tasks. The language model decides which step makes sense, the agent carries out that step and hands the result back to the model. That is how Hermes, the open-source agent Voltti works with, operates: Hermes handles the tools, the memory, and the rules, and you choose the language model.
That distinction is practical. You can swap the model without rebuilding the agent. Your skills, connections, and memory stay in place; only the thinking comes from a different model. There are three ways to connect such a model to your agent.