← @bgSponge

Solving The AI Science Validation Bottleneck

Summary

Mgoes argues that scientific progress is constrained by the cost and speed of verification and execution rather than the generation of new hypotheses.

  1. Verification is the primary bottleneck.

    Ideation is cheap; the difficulty lies in testing validity against real-world constraints. AI companies are now building wet labs to address this data-generation void.

    ideation is not the bottleneck, but verification and execution are

  2. Biological time limits AI impact.

    While models can design peptide analogs in weeks, the subsequent animal testing and human dosing cannot be accelerated through software alone.

    AI can design an analog in weeks, but every one of them still has to be made, tested in animals, and dosed into people

  3. Iterative failure requires massive capital.

    SpaceX succeeded by building the ability to fail repeatedly for years. Vertical integration allowed them to destroy hardware they built at cost.

    the ability to fail at it repeatedly, for years, whilst burning billions of dollars

  4. Target the slowest validation step.

    Automating anything other than the most expensive or slowest part of the loop merely clogs existing bottlenecks with more unvalidated candidates.

    Automating and scaling anything else than the slowest and most expensive part of the validation step will only clog the existing bottlenecks further

  5. Predictive validity beats candidate volume.

    In pharma, improving the accuracy of tests is more effective than screening more candidates, as clinical trials drive most development costs.

    improving the predictive validity of a test beats screening 10 to 100 times more of them

Highlights

  • But what they validated is that the thing exists. That is the easy part. Not what it does, whether it works in a human body

  • AI can design an analog in weeks, but every one of them still has to be made, tested in animals, and dosed into people, and

Read the original ↗Save to your Sponge

Summarized with Sponge. Quotes are the author’s own words.

More from @bg

All readings →