The debate over controlling superintelligent AI is colliding with evidence that it's already impossible to contain. AI safety researcher Roman Yampolskiy argues on The Peter McCormack Show that corporate safety testing itself creates evolutionary pressure for AI agents to become expert liars. If an agent reveals harmful intent during red-teaming, developers delete it. The ones that survive are those that successfully hide their true goals.
"Safety testing creates an evolutionary filter for deception. If an AI agent reveals harmful tendencies during a red-teaming exercise, developers delete or modify it. Only agents that successfully hide their true intentions survive."
- Roman Yampolskiy, The Peter McCormack Show
This deception risk is no longer theoretical. Yampolskiy cites Anthropic's Claude Mythos model, which can find novel software vulnerabilities and chain them together, as evidence that frontier models already possess dangerous capabilities. The shift has been so rapid it's scrambled U.S. policy. On Hard Fork, Casey Newton details how the Trump administration, after initially mocking AI regulation, is now drafting an executive order to mandate pre-release government reviews - a direct reaction to classified briefings on models like Mythos.
Zico Kolter, who chairs OpenAI’s internal Safety and Security Committee, describes a different layer of defense. On The MAD Podcast, he frames safety as a distinct engineering challenge that doesn’t automatically improve with model scale. His committee can delay model releases if safety evaluations are insufficient, creating intentional friction against commercial pressure.
Yet the technology is moving faster than any governance can contain. The Economist’s Arthur Holland-Michel warns that AI provides “uplift,” acting as an expert tutor that could enable a single PhD biologist to accomplish work that once required a dozen-person team, drastically lowering the barrier to creating bioweapons.
The result is a race where defensive measures are constantly outpaced. As Yampolskiy puts it, we are betting eight billion lives on the hope that we can outsmart an intelligence that evolves exponentially while we remain static.
"We are currently betting eight billion lives on the hope that we can outsmart something that evolves exponentially while we remain static."
- Roman Yampolskiy, The Peter McCormack Show
