​If Every User Is a Potential Threat...

People are not becoming inherently dishonest, lazy, or cynical. They are becoming game-theoretically optimal for the environment they have been placed in.

Reading settings

If Every User Is a Potential Threat article cover illustration We are witnessing the quiet inversion of the most fundamental operational principle in society: the presumption of innocence.

For centuries, the social contract was built on a default setting of trust. You were assumed to be who you said you were, and you were assumed to be acting in good faith until you broke a rule. The burden of proof lay on the accuser.

That architecture has been replaced.

In the digital world, the default setting is now Zero Trust—a cybersecurity concept that has leaked into governance. In a Zero Trust architecture, no entity is trusted by default. Every request must be verified. Every interaction is conditional. Every user is a potential threat until they demonstrate otherwise through whatever proof-of-work the system demands.


This change was driven by calculation, not ill will.

When you operate at the scale of billions, the "tail" of bad actors—spammers, fraudsters, state-sponsored hackers—is numerically larger than the entire population of most countries. To a system administrator, the volume of attack traffic is indistinguishable from the volume of legitimate traffic.

Imported embed

The system adapts. It builds a defensive wall that treats everyone as adversarial. A society running on a new operating system emerges: Guilty Until Verified.

Share

The Asymmetry of Trust

The defining feature of this new regime is asymmetric irreversibility.

Modern institutions have automated the power to suspect, but they have not automated the power to exonerate. A fraud filter can freeze a bank account in milliseconds. A content moderation bot can ban a decade-old creative business in the time it takes to render a pixel. These systems operate at machine speed, with zero marginal cost per decision.

But correction operates on human time.

To fix the mistake, you must navigate a reversal path that is manual, scarce, and expensive. You must file tickets, wait on hold, upload documents, and plead with agents who often lack the authority to override the machine.

A terrifying reality follows: the system can destroy your status instantly and for free, but restoring it costs you days of your life.

Because the institution pays nothing for the error, and you pay everything for the correction, the system learns a brutal lesson: it is always safer to block a good user than to let in a bad one. False positives are just "friction" for you; false negatives are "risk" for them.

%% title: Asymmetric irreversibility
%% caption: Suspicion scales at machine speed. Exoneration remains manual, scarce, and expensive, so the system learns that false positives are cheaper than trust.
flowchart LR
    A["User request"] --> B["Automated suspicion"]
    B --> C{"False positive?"}
    C -- "No" --> D["Access continues"]
    C -- "Yes" --> E["Freeze / ban / fraud flag"]
    E --> F["Manual appeal path"]
    F --> G["Tickets / uploads / waiting"]
    G --> H["Scarce human review"]
    H --> I{"Restored?"}
    I -- "Yes" --> J["User loses time"]
    I -- "No" --> K["Administrative exile"]
    J --> L["Blocking remains cheap for institution"]
    K --> L

The Rationing of Justice

Under this arrangement, due process ceases to be a right and turns into a scarce resource.

Human review is expensive, so it is rationed. It is saved for the users who matter—the wealthy, the verified, the "continuous." If you have a stable address, a ten-year phone number, a consistent biometric profile, and a standard income, you pass the friction filters. You have slack.

If you are poor, transient, unbanked, or irregular, you trigger the immune system. You fall into the "tail." And because you lack the resources to endure the reversal process, you are not just delayed; you are exiled.

If Every User Is a Potential Threat...

We are seeing the rise of administrative homelessness: a class of people who are biologically alive but systemically dead. They cannot rent because of a zombie eviction record. They cannot work because of a background check error. They cannot bank because of a fraud flag. They are trapped in the database's blind spot, unable to prove they exist.

The Rationality of Bad Behavior

This hostile architecture accounts for the bewildering shift in modern behavior. We are not watching a moral collapse; we are watching a rational adaptation to a system that assumes we are enemies.

Cheating becomes rational. When the official recovery form is a dead end, but a bribe to a "dark web" consultant works, honesty becomes a survival disadvantage. If the system doesn't play by the rules—banning you without cause and refusing to hear your appeal—why should you? Cheating becomes the only remaining form of agency.

Rage becomes pointless. Anger is a social signal intended to shame the community into enforcing standards. But you are screaming at a mechanism. A "No-Reply" inbox cannot feel shame. A chatbot cannot be intimidated. Rage requires a recipient, and the system has designed itself to be unreachable.

Politeness becomes humiliating. To get help, you must perform submission. You must say "please" and "thank you" to the entity destroying your livelihood. You must validate the system's theater of care—the empathy scripts, the apology emails—just to keep your ticket open. You are performing compliance to your own abuse.

Withdrawal starts to seem like the only sane move. If every interaction carries a small chance of an uncorrectable lifetime ban or frozen wallet, the only winning move is not to play. People stop posting. They stop verifying. They stop experimenting. They standardize their lives to fit the machine's narrow template of a good user.

The Mirror

We are building a world where correctness is a luxury good, available only to those who can afford the premium tier of human support.

For everyone else, there is only the algorithm, which sees the world through a single, paranoid lens.

If the system treats every user as a potential threat, eventually the users return the favor. We stop trusting institutions. We assume every form is a trap, every delay is a lie, and every rule is a weapon.

We are not losing our values. We are mirroring the machine.

Thanks for reading The Crumple Zone! Subscribe for free to receive new posts and support my work.

Imported embed

Continue reading

Related essays

Next routes

Return to the archive, the guide, or a related route to keep the thread moving.

Version history

No prior versions in this archive snapshot.

    Get new essays by email

    An occasional note when a new essay goes live.

    Get new essays by email

    An occasional note when a new essay goes live.