In the Toyota Production System, any assembly line worker who detects a problem can pull the andon cord. In Toyota’s own description, the operator “can stop the line by pulling the stop cord themselves.” The pull lights the andon board, which calls the person in charge to the problem.1
Call this stopping power.
The silent failure
Automated and administrative governance took the cord out. When a system starts producing clustered errors, misclassifying claims, flagging transactions, withholding services people depend on, the people living with those errors have no legal means to halt it. The errors get filed as noise, edge cases or user error. The machine keeps running, the efficiency numbers keep looking good, and the harm lands in the crumple zone—the layer of people who absorb what a formal model cannot hold.
Australia’s Robodebt scheme, which raised welfare debts by averaging annual income across fortnights, ran this way for years.2 In 2017 a member of the Administrative Appeals Tribunal ruled five times that averaged income could not establish a debt. Those first-tier decisions were private, the department never appealed them, and the scheme kept raising debts on averaging alone until 19 November 2019. Eight days later, with the government conceding that the method was unlawful, the Federal Court made orders by consent in Amato v Commonwealth.3 The errors had clustered where someone could see them. Nobody who saw them could stop the line.
The administrative andon cord
The administrative andon cord gives frontline workers and affected people a legal power to pause an automated or procedural system when they see failures clustering. Management can’t file the halt as a review period and carry on. The system is built to obey it.
Three conditions make the cord real. The person who pulls it has to be protected from professional, economic and social retaliation, because if reporting a defect is treated as insubordination the cord will never be pulled. The system can’t resume until an independent review has found and fixed the cause of the halt. And the right has to rest in statute or contract, beyond the discretion of the people who built the system.
In practice this means statutory rights for caseworkers, nurses and other frontline staff to freeze automated enforcement, such as eviction filings or debt collection, once errors start to cluster.
Who decides that errors are clustering
Deciding when errors cluster is the design problem. Appeals Test the Clerk, Never the Rule sets the threshold at which accumulated exceptions stop being individual variances, and Feedback Without Standing Fixes Only the Cases It Finds asks who may assemble the cluster. The cord adds a reason the threshold has to be written before the system runs. An Audit That Can’t Stop Anything Is Theater holds that an unconfirmed challenge changes nothing about a rule’s authority to proceed, and a single report from a caseworker or a claimant is unconfirmed. A threshold fixed in advance, and counted by someone other than the office running the system, turns those reports into a temporary halt without confirming any one of them, because the operators accepted that condition before the first case. The halt lasts until the independent review settles the cause. A threshold set afterwards gets set wherever the current error rate happens to sit, and any fixed number will still be too high for some failures and easy to game for others. Robodebt had the count already, in the tribunal’s own decisions. What it lacked was anyone obliged to add them up and able to act on the total.
After the stop
A halt settles little if the claimant still has to prove the system wrong, without the rules, data or logs that produced the decision. So the halt should move the burden. Call it evidentiary inversion. Once the cord is pulled, the institution loses its presumption of competence for that function. It must open its logs, decision rules and case records to an independent reviewer, show that the system worked as intended, and pay for the inquiry, with nothing charged to the claimant.
The law already has pieces of this. Res ipsa loquitur lets a court infer negligence when an accident is the kind that does not normally happen without it and the cause was under the defendant’s control. The burden of proof stays where it was, yet the doctrine lets an injured person reach a jury without explaining a mechanism they couldn’t see. Goldberg v. Kelly (1970) held that a state must offer a hearing before it cuts off welfare benefits.4 Article 22 of the GDPR restricts decisions based solely on automated processing that have legal or similarly significant effects, and where such decisions are allowed it gives people the right to human intervention and to contest them.5 None of these goes as far as a halt that holds until the institution proves its system sound. They show that where the evidence sits on one side, the law already leans the burden toward the side that holds it.
Without a cord to pull, people like the Robodebt tribunal member who ruled five times against averaging can see a system fail and still have no way to stop it.
Notes
Toyota Motor Corporation, “Toyota Production System,” https://global.toyota/en/company/vision-and-philosophy/production-system/.
What the scheme did to the people it misread while they appealed: Winning Your Appeal Can Still Cost You Everything.
Tribunal decisions: Canberra Times, “’Like reading your own obituary’: leading robodebt critic reacts to royal commission report” (July 2023), https://canberratimes.com.au/story/8265616/like-reading-your-own-obituary-leading-robodebt-critic-reacts-to-royal-commission-report. The halt and the concession: Victoria Legal Aid, “Explainer – Deanna Amato’s robo-debt case” (27 November 2019), https://www.legalaid.vic.gov.au/explainer-deanna-amatos-robo-debt-case, which dates the end of debts raised on averaging alone to 19 November 2019 and the government’s written concession to 25 November, and reports the Federal Court’s consent orders in Amato v Commonwealth on 27 November. See also Royal Commission into the Robodebt Scheme, Report (July 2023), https://robodebt.royalcommission.gov.au/.
Goldberg v. Kelly, 397 U.S. 254 (1970).
Regulation (EU) 2016/679 (General Data Protection Regulation), Article 22.