The AI That Reads Your Assumptions at the Last Moment
Every AI model has its beliefs baked in at training time. A new approach lets you hand a model your assumptions as data, right before it predicts, and it reasons as carefully as a statistician who never has to sleep.
A doctor runs a diagnostic algorithm that learned what a healthy patient looks like from the people who passed through one hospital. Then she moves, and her new patients are older, poorer, sick in different ways. The algorithm has no way to take that in. Whatever it decided counts as normal, it decided when its training stopped, and it will keep deciding it forever. You might think she could just retrain it, but retraining for a new population takes weeks and needs data that often doesn't exist yet. So the assumptions stay frozen. This is the ordinary condition of nearly every AI system we use. Its sense of the world is a fossil, hardened the moment it was made.
There is a gold-standard cure for this, and it is old. A careful statistician can write her assumptions down explicitly, feed in the evidence, and get back a probability that reflects both. Change the assumptions, and the answer changes with them. The trouble is that doing this properly, on a real problem like a hospital population or a climate map, can mean minutes or hours of grinding computation. It is like hiring a perfect accountant who insists on starting from scratch for every client. Beyond reproach, and far too slow to actually use. So the practical world reaches for the fast, frozen machine instead, and lives with the fossil.
The new idea is to stop welding the assumptions into the machine at all. Instead, you write them down as a stack of example datasets and place that stack in front of the model at the moment it makes its prediction. The model reads the stack and reasons as if those examples define the world it now lives in. Swap the stack, and you have swapped its whole frame, the way you might hand a new hire a thick folder of past cases before she touches yours. Her judgment is the same; her sense of what to expect is completely different. The model itself was a modest one, trained only on invented practice problems, yet it lands in nearly the same place as the slow, exact calculation. On the hardest cases it got there a hundred thousand times faster, finishing in six milliseconds a job that took the careful method twenty-two minutes.
Strip the folder of examples away, and the model's guesses drift about six times further from the ideal. The folder is doing real work.
Then comes the part that should not work at all. There are distributions so wild that averages stop meaning anything, where a single freak value can dwarf everything that came before and the very idea of a typical case has no value. The model was never taught these. Yet show it a folder of examples drawn from one, and it still tracks the careful answer.
The edges are real. Hand it a far thicker folder than it ever saw in practice and it falters; in the most violent cases its footing slips. And it has only learned to imitate the careful method, not to guarantee it. An excellent student of the form, which is usually enough, and exactly where it isn't is where the next problem waits. But the thing it learned is worth sitting with. It had not memorized any one set of beliefs. It had learned what updating looks like, the act of revising what you expect in light of what you see, separate from what you happen to be updating about. Hand it a new folder, and it knows what to do with it.
How can practitioners reliably obtain or construct the prerequisite prior‑example datasets needed for new domains where such data are scarce or only partially known, and what impact does this have on the method’s performance?