AI is entering the laboratory before it has learned to run the control room
Seventeen countries have endorsed autonomous AI experimentation in science as a former OpenAI safety lead calls for nuclear- and aviation-grade operating discipline. The next bottleneck is the high-reliability institution around the model: redundant controls, independent stop authority and time to interpret weak signals before discovery outruns containment.
LEAD SUMMARY — ANALYSIS. AI is being invited to design experiments, operate instruments and open new lines of scientific inquiry. But the institution around it is still organised like a software company: ship, observe, repair, repeat.
On 4 October, the United States and 16 other countries endorsed the Kyoto Vision, calling for wider access to AI, scientific data, computing infrastructure and experimental facilities, including autonomous experimentation at scale. A day earlier, David Robinson, who led safety-report writing for major OpenAI launches, said he had resigned because frontier labs need the redundancy and operating discipline of nuclear power and aviation rather than reliance on trial and error.