Discussion about this post

User's avatar
GalladeGuy's avatar

I don't think you are thinking of the same kind of AI that Amodei is thinking of. There is a very big difference between narrow AI systems for generating drug candidates, which we have today to some extent, and an AGI that's as smart or smarter than the best researchers, which is what Anthropic is trying to make.

An AGI (by definition) would not need any more data to design a new drug candidate than human researchers do, and it might create much faster ways of getting that data, like super accurate and efficient simulations, or individualized lab-grown organs to test on, or things that are so out-there that no one has even thought of them. If it can cure a condition in a system with feedback loops that are 100x faster than clinical trials, with 99% certainty that it'll transfer to real humans, then yeah, the trials might only take a couple years. If you run a trial on a new AGI-designed miracle drug for a chronic disease, and a few months later every patient is perfectly healthy in every way you can measure, you probably do not need a 15-year cycle of long-term studies to determine the efficacy and safety of the drug (and some biohacker would probably mass-produce it illicitly if you tried).

You could argue that AGI is still far away, or that better simulations or lab-grown organs in particular wouldn't actually be that helpful, or that it would take a while for regulation to catch up, and those may all be true to some extent. However, the fact that our current clinical trial system has slow feedback loops that current tech can't solve does not seem that relevant in the scenario that Amodei is imagining, of a century of scientific progress compressed into 5-10 years.

Alistair Penbroke's avatar

It all makes good sense in the abstract, but I worry about the substitute endpoints. We saw this in the COVID vaccine trials and it resulted in nonsensical/stupid outcomes, like a vaccine being approved because it was tested in 8 mice, all of whom became infected and developed COVID, but they had the antibodies the vaccine was designed to elicit so it was considered a success. Then of course in the real world it totally failed because the antibodies were for a long extinct variant. The trials revealed this obvious fact but were ignored, because they weren't testing what mattered.

The moment you let people advertise effectiveness without actually checking for it the question of bad proxies and regulator corruption becomes huge.

14 more comments...

No posts

Ready for more?