← @bgSponge

Leviathan Risk — Owen Cotton-Barratt

Summary

Owen Cotton-Barratt adds leviathan risk beside scheming AIs and human power-grabs as collectives gain AI leverage.

  1. Leviathan risk is a third AI-risk bucket.

    It sits beside rogue agents and human coups as collective agents gaining power.

    I'm particularly wanting to look at the case of collective agents.

  2. Epistemic infrastructure wakes collectives.

    AI that runs sensing and decision pipelines can make firms and states more agentic.

  3. Humans may hand over authority under pressure.

    The path need not be a single villain; institutional gravity can demand deference.

    But how I think that with AGI, these things may become much more like coherent agents than they have been historically.

  4. Escape hatches sit between anarchy and tyranny.

    Narrow-corridor thinking asks how to keep liberty when leviathans strengthen.

    I think this can happen at all kinds of different scales.

Read the original ↗Save to your Sponge

Summarized with Sponge. Quotes are the author’s own words.

More from @bg

All readings →