← @bgSponge

Anil Seth (@anilkseth) on X

Summary

Anil Seth argues that consciousness likely requires biological life processes, challenging the assumption of computational functionalism which posits that any sufficiently complex computation can produce conscious experience.

  1. Computational functionalism is an unproven assumption.

    Most AI consciousness debates assume computations of the right kind suffice for experience, but Seth argues a brain's identity is inseparable from its physical substrate.

    a brain is not the kind of thing for which one can easily separate what it is from what it does

  2. Life processes drive conscious experience.

    Seth supports biological naturalism by viewing the brain as a prediction machine tasked with maintaining the body and itself through autopoiesis.

    It is the processes of life that matter

  3. Carbon is not a requirement.

    The author rejects carbon chauvinism, suggesting that while life is necessary, the specific chemical makeup of carbon is not inherently magical.

  4. AI consciousness illusions are dangerous.

    Seth warns that AI may create cognitively impenetrable illusions of consciousness, which creates different ethical worries than actual artificial consciousness.

    illusions of consciousness in AI may be cognitively impenetrable

  5. Intelligence does not imply consciousness.

    Human biases like anthropomorphism lead people to conflate high-level intelligence with the subjective experience of being conscious.

Highlights

  • I show how we are led astray by built-in biases of anthropocentrism, human exceptionalism, and anthropomorphism.

  • But I am not a carbon chauvinist. It is the processes of life that matter, not anything magical or neo-vitalist about carbon.

  • Key point: illusions of consciousness in AI may be cognitively impenetrable

Read the original ↗Save to your Sponge

Summarized with Sponge. Quotes are the author’s own words.

More from @bg

All readings →