← @bgSponge

Extropia's Children, Chapter 1: The Wunderkind

Summary

Jon Evans traces Eliezer Yudkowsky's evolution from a teenage Extropian mailing list member to the architect of the rationalist movement and AI risk discourse via his prolific, theoretical output.

  1. Extropian mailing lists birthed tech celebrities.

    A tiny community of hundreds included future luminaries like Julian Assange, Nick Bostrom, and Bitcoin's godfathers, acting as a concentrated village of influence.

    It's as if a single tiny village was the hometown of a dozen different celebrities.

  2. Yudkowsky prioritizes theory over implementation.

    Despite high intelligence, he follows a pattern of producing massive design notes and essays without shipping actual software or compilers.

    Eliezer is an extreme case of "Smart but doesn't Get Things Done."

  3. The Singularity shifted his worldview.

    His early optimism that superintelligence would be ethical underwent a phase change, leading him to view AI as a catastrophic existential threat.

    how he went from “building a superintelligent AI is the immediate and most important goal for all humanity” to “building a superintelligent AI is a

  4. Rationalism emerged from epistemological shock.

    Through his 'Sequences,' Yudkowsky developed a framework for overcoming cognitive biases, eventually seeding the LessWrong community.

    focus more on “how best to think,” “how to overcome your unconscious biases

  5. Fanfiction drove massive cultural reach.

    The 660,000-word 'Harry Potter and the Methods of Rationality' achieved mainstream recognition and was translated into twelve languages.

    Despite its enormous length it was hugely successful.

Highlights

  • extreme intelligence doesn't inoculate you against being wrong; it just makes you wrong in more interesting ways.

  • a theological belief masquerading as a technological one

  • He was sure it would happen by 2020.

  • I don't have time to be a teenager,

Read the original ↗Save to your Sponge

Summarized with Sponge. Quotes are the author’s own words.

More from @bg

All readings →