Better at Finding You, No Better at Fixing Its Mistakes

The state can match your records across agencies before the month ends. Ask it to correct the file, and the same machinery has no answer.

Reading settings

The state can now match your records across agencies, predict your eligibility changes before you report them, and flag the account before the month ends. Ask it to correct the mistake in your file, and the same machinery has no answer. It treats the record as authoritative because the system produced it. The correction route runs through the office that made the error, and the contested entry stays live while you prove otherwise. The identification half and the correction half run on the same infrastructure, and only one of them improved.

The incomplete measure

Modernization is usually told as a story of expanding institutional capacity: more legibility, more records, more coordination, more prediction, more enforcement. Census systems, passports, statistics, insurance tables, personnel files, credit records, databases, sensors, and machine learning all increase the ability to represent and act on populations. The histories are written as the growth of that ability, and the growth is real.

The measure is incomplete in a specific way. Alongside the administrative capacity to know, classify, decide, and enforce sits a corrective capacity, the ability to detect, hear, reverse, and repair. They are separate axes, and building the first doesn’t require building the second.

A state can become dramatically better at identifying people while remaining terrible at correcting mistaken identities. A hospital can accumulate vastly more patient data while making contested records harder to amend. An employer can become more precise about worker performance while making its classifications harder to contest. The two capacities don’t have to grow together, and nothing in building the first builds the second along the way.

Diagram
Cutting her payment versus letting her fix the record
An agency can gain the power to match records and cut a benefit without giving the woman any way to see that the register still lists her ex at her address, dispute it and stay paid. Which of the four boxes it lands in decides what that power is worth.
View source
%% title: Cutting her payment versus letting her fix the record
%% caption: An agency can gain the power to match records and cut a benefit without giving the woman any way to see that the register still lists her ex at her address, dispute it and stay paid. Which of the four boxes it lands in decides what that power is worth.
flowchart TB
  classDef system stroke-width:1.2px;
  classDef gate stroke-width:1.6px;
  classDef repair stroke-width:2.4px,font-weight:bold;
  classDef failure stroke-width:2.2px,stroke-dasharray:6 3;
  A{"Can the agency match records<br/>and cut her payment?"}:::gate
  A -- yes --> B{"Can she see the record,<br/>dispute it, get it reversed?"}:::gate
  A -- no --> C{"Can she see the record,<br/>dispute it, get it reversed?"}:::gate
  B -- yes --> E["Capable and corrigible:<br/>she sees the ex listed,<br/>stays paid while it is checked"]:::repair
  B -- no --> F["Capable and unanswerable:<br/>payment drops without notice,<br/>the ex stays on the register"]:::failure
  C -- yes --> G["Small and answerable:<br/>a paper form where<br/>she states her own facts"]:::system
  C -- no --> H["Weak and unreachable:<br/>no records to link,<br/>freedom by accident"]:::system

The two curves

So a society can become more capable and less corrigible at the same time. That is a stronger claim than saying technology sometimes causes harm. It says the capacity to act and the capacity to be corrected can move in opposite directions as a normal outcome of development rather than as a malfunction. More organized power raises the price of being wrong about somebody, and only the second curve says anything about who gets to be right.1

Measured on the first curve alone, the unanswerable machine looks like progress. It knows more, decides faster, and predicts with more accuracy. The second curve asks whether the people being represented gained any matching ability to contest how they are represented. Sometimes they did, and those cases are the constitutional history worth studying. Usually they did not, and the gap between the curves is where the burden lands.2

Rights as correction machinery

The second axis changes what rights look like. They are usually described as moral achievements or protections against arbitrary rulers. Read against the two capacities, they are machinery that lets a person’s own experience push back against the record kept about her.

An appeal right says the classification is final for action and final for nothing else. A hearing says institutional knowledge can be contested by the person it describes. Discovery says those in authority must show the evidence they acted on. A right to amend a record says the database is not the final authority on the person it describes. Judicial review says the institution acting doesn’t get the last word on whether it acted correctly.3

Seen that way, constitutional development is partly the history of turning “the system is wrong about me” from a complaint into an act that changes something. The rights that matter most carry the error upstream, from the person who lives with it to the rule that produced it. A right that exists on paper but costs six months, lost wages, and expert counsel to use changes nothing, so an honest count of corrective capacity includes what each right costs to use.4

When the form disappears

The same reading applies to a reform worth supporting. Automatic eligibility, pre-filled forms and data shared between agencies take paperwork off the applicant and put it on the institution, where it belongs.5 They also raise administrative capacity, and they can lower corrective capacity at the same time. The paper form was a burden, and it was also the one place where a person stated her own facts. When the form disappears, the facts about her are settled in records other agencies assembled for other purposes, and those records decide her case without her ever seeing them.

James C. Scott described what happens when a state’s simplified records become the facts it acts on.6 Take a benefit that renews itself from payroll and population data. One month the payment drops, because the register still lists a former partner at her address, so the state has, for benefit purposes, moved her ex back in. No form she signed contains the error, and none could have caught it. She can no longer make a mistake about herself. Instead a mistake is made about her without notice, and she has to work backward from the consequence to find the record that caused it.

Removing friction is only half a reform. The other half keeps the record answerable before anyone acts on it. Show people what the system believes about them and which agency supplied each fact. Make correction a matter of minutes, available before the decision instead of months after it. Treat a disputed fact as unsettled: continue the benefit on the last undisputed basis while the agency that owns the record confirms it.7 An institution that can verify a disputed fact quickly loses little by pausing, and one that cannot has learned something about the record it was about to act on.

Measured on the first curve, the benefit that renews itself is a plain gain. Measured on the second, it depends on whether the woman whose payment dropped can see the record, dispute it, and keep being paid while she does. Both curves have to rise, and the second decides whether the first was worth building.

Notes

1

Cheap computation eroding the protections that once came from what administrations could not do: Each Score Was Fair. The Rejection Wasn’t..

2

Where the burden lands when the curves diverge, account by account: Change the Denominator and the Success Disappears; the distribution of the unmodeled remainder: The Rule Works. She Doesn’t Fit..

3

The stages a validated finding must clear to change anything, restitution among them: After the finding lands. The appeal as the period, and what the default decides while it runs: Winning Your Appeal Can Still Cost You Everything.

4

The learning, compliance, and psychological costs that decide whether a nominally available right is available at all: You Were Free to Choose. The ladder of depths a correction has to climb: How a Failure Repeats Tells You What’s Broken.

5

Pamela Herd and Donald P. Moynihan, Administrative Burden: Policymaking by Other Means (Russell Sage Foundation, 2018). On why universal provision removes the eligibility facts there are to get wrong: Give Everyone the Benefit and There’s No One to Investigate.

6

James C. Scott, Seeing Like a State: How Certain Schemes to Improve the Human Condition Have Failed (Yale University Press, 1998). On records that lag the life they describe: Records Reviewed on a Calendar Are Always Late.

7

A correction that has to be requested by letter, months later, from an agency the person must first identify is a paper right: Who Can Survive an Error Is the New Class Line. On the default that binds while a dispute is pending: Pending Is a No Nobody Signed.

Continue reading

Related essays

Next routes

This essay belongs to the Conditional authority pattern; its topic, guide and toolkit are one step away.

New essays by email

One letter a week: that week’s new essays, and one tool to use.

New essays by email

One letter a week: that week’s new essays, and one tool to use.