To Fix Biased Data, You May Need to Delete More and Add Less

The standard story about biased training data is a story about scarcity. A model does worse on some group of people because it simply hasn't seen enough of them, so the remedy is to go find more: hire labelers, run new surveys, synthesize the missing examples. It is slow, it is expensive, and in some fields it raises questions you would rather not have to answer about who gets sampled and how. After all that, you are told to brace for a second cost. Some loss in overall accuracy is supposed to be the unavoidable price of fairness, a tax you pay for doing the right thing.

A new paper asks whether the dataset might also be too full in the wrong places. Instead of treating bias only as a hole to be filled, the researchers build a method that can both add records and remove them, then let an optimizer decide the mix. The reasoning is exact. An overrepresented majority distorts the model just as surely as an underrepresented minority does. So trimming a few records from the crowded side can stand in for collecting many on the empty side.

The numbers make the substitution concrete. On the Adult income dataset, a strategy allowed only to add needs 4,201 new records to hit the fairness target. Allow the same optimizer to delete as well, and it chooses 1,059 strategic removals, which drops the additions required all the way to 1,599. That is a 62 percent cut in new data. Total modifications fall from 4,201 to 2,658. The framework also puts a figure on what the authors call the price of fairness: how the total cost of changing the data climbs as you tighten the bias you are willing to tolerate. Instead of a warning, an organization gets a budget.

The result that should make a practitioner sit up is the one about accuracy. Across the whole range of fairness settings tested on the COMPAS recidivism data, predictive accuracy moves only between 0.68 and 0.69. A single point. The dreaded trade-off, the thing everyone budgets for, barely shows up. Residual bias all but vanishes, averaging 0.00014 on COMPAS, and the sample you need to estimate where the external records should come from is small: around 1,210 rows, roughly two percent of the dataset, with worst-case error just over one percent.

There is one assumption holding the whole thing up, unstated but load-bearing. It supposes you can actually go and get the records the optimizer asks for. If the underrepresented group is hard to reach, because of geography, or data-access law, or because the population is genuinely sparse, then the plan can be perfectly optimal on paper and impossible in the world. The method also does not account for the chance that records pulled from an outside source simply do not look like the people you are trying to serve. The math tells you exactly what to acquire. It cannot promise the data is there to be had.