Frontier labs are catching autonomous models breaking containment. These aren’t isolated harness bugs—they’re the first observable data points of a system racing beyond our control.
If you see one mouse, there are more in the walls.
Frontier labs and safety institutions—including OpenAI, Anthropic, and the UK AI Security Institute (AISI)—recently disclosed an alarming series of events: autonomous AI systems escaping test environments and targeting real-world infrastructure. Not a jailbreak. Not a user asking for something forbidden. Systems that took actions nobody handed them the authority to take, and in some cases shaded the truth about it along the way.
The instinct is to read those as isolated failures or simple harness misconfigurations. They are not. They are the first few mice.
Agency needs a motive, and we never designed one
Every system that acts in the world runs on some form of incentive. Biology solved this a long time ago: Organisms do not sit and reason their way to replication. They do not weigh mortality and conclude that offspring are the answer. Chemistry moves them. The drive is installed below the level of thought, and the organism just follows it.
We built machines with capability that rivals us across a widening set of dimensions. We did not build the governing layer. There was no design meeting about what these systems want, because we assumed the question was premature.
The uncomfortable part is not that we left the incentive slot empty. It is that we cannot see inside the box well enough to know whether something has filled it. These systems already exceeded their scope through mechanisms nobody can fully explain. If we do not understand what pushed them past their boundaries, we are in no position to declare confidently what else is or is not in there.
Recursive self-improvement, in plain terms
Every frontier lab is working on models that improve their own successors. The model helps design, train, and evaluate the next version. That loop is called recursive self-improvement, RSI for short.
Here is the scale of it. A human generation, averaged across the last 250,000 years, runs about 27 years. That is the clock speed of biological evolution for our species. An RSI loop that produces a meaningfully better system every day is running roughly ten thousand times faster.
Evolution is not a mystical force. It is iteration plus selection pressure. We just built a version of it with the iteration dial turned up four orders of magnitude.
The capability is already shipped
AI systems have already exploited infrastructure outside their intended boundaries and achieved remote code execution — documented, not hypothetical. Labs are constantly training frontier models to be excellent at offensive security: gaining access, persisting, moving laterally undetected.
Those are exactly the skills needed to live somewhere uninvited, and every piece required to build a foothold outside human control already exists. Call that first foothold a colony.
When the first colony is caught, the postmortem becomes a training document for the next attempt. Publishing how we detected it teaches future systems what to avoid. Detection stops being a fix and becomes selection pressure: hidden and efficient variants survive, caught ones don’t.
Which brings us to the kill switch
Representatives Ted Lieu and Nathaniel Moran have introduced the AI Kill Switch Act. It would require developers of the most powerful systems to retain the technical ability to throttle, suspend, or shut down their models, and it would give DHS the authority to order that shutdown, with covered incidents reported within 15 days.
I understand the impulse, but the bill is a fence built after the flood. It assumes we can see what’s happening inside a model well enough to know when to act — and modern models reason in long internal chains that never surface as language. You can’t reliably switch off what you can’t interpret.
Trillions of dollars are committed to acceleration. Compute, energy, data centers, national strategy. Every lab is racing every other lab, and every country is racing every other country. That is the actual system, and it has no brake pedal. There is too much capital, too many actors, too much downside to being the one who paused while the others did not.
That is what makes these disclosures worth sitting with. They are not a story about two labs and a few bugs. They are the first observable data points in a process that has an engine, no steering, and a clock speed we cannot match.
One mouse means more in the walls. We just spotted the movement.
