Token probability is the probability a language model assigns to a particular token at one generation step. Low-probability tokens can signal uncertainty or possible hallucinated content, but they cannot establish that a claim is false: models may produce high-probability hallucinations that match strong patterns in training data. section 5.3.2
A practical token-probability workflow is:
- Request token log probabilities when the model endpoint exposes them. section 5.3.2
- Mark tokens below a chosen threshold for inspection, then combine this signal with broader hallucination checks. section 5.3.2
- Use monitoring during production rather than treating low probability alone as an automatic blocking rule. section 5.4.2
Comparing factual confidence
For “Einstein was born in 1879,” a probability of 0.98 for “1879” indicates greater model confidence than a probability of 0.15 for “1876.” The scores still require verification because confidence is not factual support. section 5.3.2

