When AI Grades AI, the Danger Is the Wiring, Not the Model

`★ Insight ─────────────────────────────────────` The two real surgical targets here: the "quietly rewards" crutch in ¶2 and two instances of negative parallelism ("not in a line but in a dense web" in ¶4, "isn't the numbers… but the question" in ¶6). Each gets stated directly rather than via the X-versus-Y scaffold. The piece is otherwise clean — the discipline is touching only what's flagged. `─────────────────────────────────────────────────`

Peer review is one of our most trusted ideas. Two heads are better than one; outside eyes catch what inside eyes miss. So it was natural, as people began stringing artificial intelligence systems together, to build the same habit into the machines. One model writes an answer, another grades it, flags the weak reasoning, and pushes the first toward something better. The hope is the old hope of any review process: that judgment, shared across many reviewers, lands closer to the truth than any single judge could reach alone.

But reviewers have leanings. One human grader rewards cautious, hedged answers; another prefers the confident ones. AI graders, shaped by different instructions, carry the same kind of slant. So researchers asked a worried question: when a biased AI grades the AI beside it, does the bias spread? You'd guess it might leak a little, then fade fast, the way a rumor garbles and dies as it passes down a line of whisperers.

They tested it. They wired three AI agents in a chain, each with a different built-in bias, and watched a slant travel hop by hop. The result was reassuring. By the third step, more than 99 percent of the original bias had drained away. In a line, the signal dies.

Then the researchers did something cheaper than another experiment. They took those same hop-by-hop measurements and asked, on paper, what the numbers would do if the agents were wired in a dense web instead of a line, every one grading every other. They never built that web. They just ran the arithmetic the chain had handed them. And the arithmetic turned ugly. There is a single number that captures how much a network amplifies whatever circulates through it, and the calculation put it above one. Below one, a disturbance shrinks each time it goes around and dies out. Above one, it grows each lap and feeds on itself. It is the difference between one sick person in an empty hallway, who simply recovers, and the same person in a packed subway car, who starts an outbreak. The contagion hadn't changed. The density had.

There is at least one fix. Instead of trusting a lone AI grader, convene a small committee of them. Going from one grader to two cut the bias passed along by more than half; adding a third cut it by nearly three-quarters. A spread of opinions means no single slant runs the table, the same reason human review works when it works. But this fix, like the safe chain, was something they actually ran. The dangerous web remained a prediction.

And the paper is thin where it matters. One family of AI model, three blunt bias settings, some trials repeated only twice. The authors say so plainly. The numbers are preliminary; what lingers is the question they pry open. Pipelines where AI systems rank and refine each other's work are already humming along inside real companies. The individual parts have been tested. The shape of the wiring connecting them has not, and whether it sits in the safe regime or the runaway one depends on a property no one is currently bothering to measure.