Lineage

What this archive owes, and to whom

A framework about who absorbs the cost of an arrangement should be able to say plainly where it got its own materials. This page is that accounting.

The name

Madeleine Clare Elish, “Moral Crumple Zones: Cautionary Tales in Human-Robot Interaction”, Engaging Science, Technology, and Society 5 (2019).

Elish named the pattern in which responsibility for a failure lands on the human closest to an automated system — the operator, the driver, the person on shift — even where that person had little practical control over what the system did. The car's crumple zone is engineered to absorb an impact so the occupant survives; her argument is that in a highly automated system the human comes to occupy that position for moral and legal force.

This archive takes the term outside human-machine interaction and applies it to institutional arrangements generally: not only who is blamed when an automated system fails, but whose unmeasured labor keeps an arrangement looking like it works. The extension is the part that is mine. The name and the image are hers.

The wider debt

  • Lisanne Bainbridge, “Ironies of Automation”, Automatica 19, no. 6 (1983).

    The founding observation that automating the easy part of a job leaves humans with the harder residue and fewer chances to stay practiced at it. Every argument here about atrophied capacity is downstream of this paper.

  • Diane Vaughan, The Challenger Launch Decision, University of Chicago Press (1996).

    Normalization of deviance: how an organization comes to accept a widening gap between what it says it requires and what it actually tolerates, one reasonable-looking step at a time.

  • Sidney Dekker, Drift into Failure, Ashgate (2011).

    That catastrophe in complex systems is usually the end of a slow drift rather than the result of a broken part — and that the drift is composed of locally sensible decisions.

  • Erik Hollnagel, Safety-I and Safety-II, Ashgate (2014).

    Work-as-imagined against work-as-done: systems succeed because people continuously adapt around them, which means a clean record is not by itself evidence that the design is sound.

  • Jan Kulveit and colleagues, “Gradual Disempowerment”, (2025).

    That human influence can erode without anyone seeking power — through incremental displacement of human labor and judgement rather than a decisive act. The nearest existing account of the trajectory this archive describes.

Work-to-rule

No single author to credit, but the debt is real. For more than a century, organized labor has demonstrated that following a written procedure exactly — withholding the informal judgement and unrecorded repair that normally fill its gaps — is enough to stop an operation. That is the empirical proof, long predating any of this, that formal specifications describe only part of the work that keeps a system running.