What happens when nobody is left to correct the source
A model does not know a source has gone stale. It only knows the source was there, and it keeps using it.
An AI answer is a summary of sources that were correct at the moment somebody wrote them. Nothing in that chain checks whether they still are.
Usually this is harmless. Sources get updated, newer material outranks older material, and the answer shifts on its own. The interesting failure is when the correction mechanism is gone, when the publisher folded, the archive shut, the record was lawfully deleted, or nobody who cared is still there.
Then the stale source is not competing with anything. It becomes the answer.
How a source goes stale without anyone noticing
- Relative dates. A piece written in February 2019 calling something "last October" was accurate then. Read today, it resolves to the wrong year, and it stays wrong forever because nobody revisits the sentence.
- Missing end dates. Something that began and finished gets described only at its start. The reader, or the model, has no way to know it is over.
- Deletion of the authoritative record. When the official register is expunged by statute, the article describing it becomes the only remaining source, and it is frozen at the moment it was written.
- The publisher disappearing. Trade titles fold, archives go read-only, and contact addresses stop working.
Why this is worse than ordinary inaccuracy
A person reading a stale page can check the date. A model summarising it usually cannot tell the difference between a fact that is current and a fact that was current once.
And because the answer is written in fluent, confident prose, the reader has no cue that they are looking at something unverified. They are not reading a list they could interrogate. They are reading a paragraph that sounds like it knows what it is talking about.
What actually helps
- Find out which sources are being cited. Assistants usually show their working. That list is the entire problem statement.
- Ask the publisher to add an absolute date or an outcome. One sentence is often enough, and it is a smaller ask than it sounds.
- If the publisher is unreachable, publish something better. A newer, clearer, better-structured page on the same subject can enter the source set and change the answer.
- Keep it current. A dated page that is never updated becomes the next stale source.
The part I cannot promise
None of this is guaranteed. A model may keep citing the old source regardless, and there is no appeal process. You can only change the material it chooses from and then check whether the choice changed.
The uncomfortable part is how often the answer is assembled from three or four pages, and how little it takes for one of them to be permanently wrong.
ShowUp Labs shows you which sources are driving the answer, so you know what to fix.
ShowUp Labs →