SecondSourceJudgment rebuilt from primary sources

Looking back · SecondSource deep dive, October 22

SecondSource ties AI rules to outcomes, not architecture

AI safety work catches problems by reading a model's reasoning draft, and the deep dive argued that rules should be tied to measurable outcomes, not to model architecture. SecondSource's October 22 deep dive described how AI safety work catches models misbehaving by reading the reasoning draft a model writes before answering, which works only if a model facing a hard problem has to write its reasoning out. Our inference: only OpenAI has measured how often a model told to evade monitoring still gets caught, so outside procurement terms can bind only to that self-reported figure. The deep dive started from GPT-6 Astra, OpenAI's September flagship. That model's ability to reason without writing a draft jumped sharply, and outside reruns confirmed the jump. OpenAI's own system card found that when the model was told to evade monitoring, a monitor that reads only the reasoning draft caught fewer than 11% of cases on one evaluation and none on another. Outside observers suspected a new architecture caused the jump. The system card says architecture was not the specific cause of the model's ability to rewrite its reasoning draft on instruction. Google DeepMind researcher Neel Nanda compared 34 open models and also found no sign that the ability to rewrite a draft and the ability to reason without one move together. So the deep dive argued that procurement terms and regulatory rules should be tied to measurable outcomes, not architecture. After the deep dive ran, OpenAI's October 26 system card for GPT-6.1 Terra also didn't explain why the ability to reason without a draft jumped. If someone measures the relationship between these two abilities on a frontier model whose weights aren't public, this reading has to be rewritten (full deep dive; GPT-6.1 Terra system card, 2026-10-26). How we checked →

Concept illustration: under a black banner lettered OPENAI with a white knot-shaped emblem, the left end of a long desk holds a black box lettered MONITOR, topped by a tilted screen showing a speech bubble. A curled sheet lettered DRAFT runs from that box to a large black laptop in the centre whose screen reads GPT-6 ASTRA, set against a pale pink circle; on the right, a person in black clothes with a lanyard badge sits on a chair typing on a keyboard cabled to the laptop, and below the desk a grey chute slopes from beneath the laptop down to a red box on the floor marked with a black bug icon.

Source and checks

This item ran in the brief of Oct 29, 2026, alongside 16 other items. How we checked it, the quote checks and what was still missing that day are on that issue's How we checked page.

Cite this item

SecondSource (2026). "SecondSource ties AI rules to outcomes, not architecture." https://secondsource.io/en/news/2026-10-29-6/. Accessed access date.