← @bgSponge

Small Models Have Arrived

Summary

Calvin French-Owen argues that small, fast models have crossed a cost-quality threshold that unlocks consumer AI.

  1. Cheap models crossed a consumer threshold.

    Luna keeps research-thread bills in the tens of cents and a personalized news eval near $0.10, versus about $1 on Sonnet-class models.

  2. Token cost, not taste, blocked consumer AI.

    The old consumer playbook assumed cheap-to-run websites; per-request inference blew up the capital needed before ads.

    There's a straightforward answer: token costs.

    But looking at luna, the results are pretty decent, and the average cost is ~$0.10.

  3. Keep frontier models for IQ-180 work.

    French-Owen still reaches for Fable 5 and 5.6 Sol for coding, and expects frontier demand to keep compounding in engineering and discovery.

  4. Most company work is token-spewer work.

    Peter Reinhardt's claim that about 95% of operator work is responsiveness, not genius, is the demand curve cheap models can fill.

    Peter mentioned that ~95% of the work he does falls into bucket 2.

  5. Harnesses and permissions still missing.

    Fast/cheap/good-enough models need new harnesses, prompt-injection safety, roles, and permissions before they can run a business.

    Most of the "human tokens" at companies today are spent this way — hiring skews heavily toward the fast/cheap/good-enough archetype.

Read the original ↗Save to your Sponge

Summarized with Sponge. Quotes are the author’s own words.

More from @bg

All readings →