← @bgSponge

Fences, not Sandboxes

Summary

Steve Yegge reports that a 50-agent Fable cluster building Wyvern grew Wheelhouse into a constitutional legal system: offices, case law, and enforcement patterns such as fences.

  1. Govern agents by law, not containment.

    Capable models should be coordinated with written rules and enforcement machinery rather than sandboxes that ration context and scope.

    It's a future where AIs are governed by laws, not by programs that try to contain and control them.

    Humanity has only one mature technology for coordinating mortal, replaceable strangers via text — namely, law.

  2. Today's models still have grade-school judgment.

    Fable codes at a high level but still makes at least one terrible overnight decision; current sandboxing fits that maturity, not next year's cheaper Fable-tier workforce.

  3. Wheelhouse became a legal system.

    Asking Fable to ship faster produced 450 legal artifacts, a constitution, case law, and roles that outlive interchangeable amnesiac agents.

  4. A fence is a polite refusal.

    It turns the wrong actor away for missing paperwork or policy, like a Molly Guard; it is not a sandbox that can stop a determined superintelligence.

    a fence is any mechanism that turns you away if you aren't supposed to be there.

  5. Institutional law has to grow in place.

    Capturing thousands of conflicting tribal decisions takes months to years, and the resulting ivy-like intelligence is unique to a domain.

    You can't rip ivy off someone's wall and stick it on someone else's.

Read the original ↗Save to your Sponge

Summarized with Sponge. Quotes are the author’s own words.

More from @bg

All readings →