SecondSourceAI Industry Insight · Full Archive

Daily Brief SecondSource Morning Brief · September 3, 2026 · Sep 3, 2026

The only way anyone can see what an AI is thinking may be failing, and nobody has the standing to check

This issue was not emailed. An automated pre-send check did not pass, so subscribers did not receive it. The text is archived here unchanged.

At a glance

1. The one AI oversight technique the industry actually runs at scale spent a day being fought over in public, and the two opposing camps agreed on exactly one thing: no institution today can establish who is right.

2. A new model halves the failure rate of agents and cuts invented answers to a tenth. The price is a bill per correct answer that is 1.8 times higher.

3. The same cybersecurity score slid from the priciest tier to the cheapest in seventy-two days, and the access list gating it never moved.

This issue draws on our September 3 research round; the events run from June 22 to September 3, 2026. Last night's sweep put 221 pieces on the reading list, and 26 clickable receipts made it into this issue. This is the email edition; the full edition of this issue is the archive of record.

Today's main line

1. [This week] (events September 1–2) The guardrail that lets anyone see what an AI is thinking got fought over for a day; what is left when the fight ends is that nobody has the standing to check

Reasoning models of the past two years work out an answer before they give it, and they write that working out step by step in language a person can read. The industry calls it chain of thought. Because the reasoning arrives as human language, a safety team can read it, and can aim a second model at it to scan for a model planning something it should not. It is the only oversight technique deployed at scale anywhere in this industry, and the only one that has ever caught anything.

The story arrives in three beats. On September 1, OpenAI's official account announced that its forthcoming model, Astra, "represents a significant advance in cybersecurity capability, reaching the Critical threshold under our Preparedness Framework" (@OpenAI, 09-01). The Preparedness Framework is OpenAI's own risk-grading and deployment-control regime for its models; it is a company policy rather than a law, and no outside body verifies the grade. Critical is the top rung, and it carries a commitment not to deploy until safeguards are in place. Early on September 2, The Information, a subscription technology business publication, reported that Astra uses a breakthrough that could destroy the monitorability of chain of thought, citing a source who said OpenAI is currently "limiting the use of the technique". At 5:30 that morning, OpenAI's chief scientist Jakub Pachocki answered in person, with a number anyone can hold him to: "The depth of the computation graph for our present frontier models, including Astra, is within a factor of two of GPT-4." He also conceded that chain-of-thought monitoring "is fragile and unfortunately trending in a negative direction, for reasons not contingent on architecture changes" (@merettm, 09-02; his title was confirmed publicly in the same thread by OpenAI researcher Noam Brown). Computation-graph depth is roughly how many layers of arithmetic sit inside the model, so a figure that has not exploded means the reasoning has not been relocated somewhere invisible.

Verification: three unaffiliated parties moved separately, and all three point away from the reading that OpenAI got caught. One, the technical read. Sebastian Raschka, a machine-learning educator and the author of Build a Large Language Model (From Scratch), with no commercial stake in either side, took apart the technique the report pointed at: run the same stack of layers twice, keeping the model the same size and nearly doubling the compute. His conclusion was that "reusing layers does not by itself suppress visible chain of thought," and he said outright that the journalist may be describing a different technique or may have misunderstood this one (@rasbt, 09-02). He also named the one worry that survives: more passes could mean the model emits less intermediate reasoning text. His own rebuttal to that is that scaling the model up does the same thing — "we would get the same effect if we were scaling up the model size" — so the worry is not specific to this architecture. Two, the competitor. Jack Lindsey, an interpretability researcher at Anthropic, wrote that "this isn't a dunk on OpenAI -- I have no evidence that OpenAI has allowed CoT monitorability to degrade substantially," and offered a judgment of his own: the white-box approach that skips the text and reads the model's internal activity directly is "unlikely" to "provide as much monitorability as CoT currently provides within a year" (@Jack_W_Lindsey, 09-02). Three, the reporter. The Information's Stephanie Palazzolo said publicly that there is "more nuance here than people are initially getting from the headline" (@steph_palazzolo, 09-02). ⚠️ We have not read The Information's article — it sits behind a paywall — so every description of its contents here reaches you through someone else's account of it. ⚠️ Pachocki's "within a factor of two" is a ratio, not a level. He never said what GPT-4's depth is, and every absolute figure circulating online is somebody's inference.

Judgment update: the point of this item is not that a company did something wrong. It is a public technical dispute, and the hole it exposes. The policy scholar Dean Ball put the argument most plainly: a listed company's financials do not get settled by people shouting at each other on a social platform, they get settled by an auditing profession and audited statements. "It would be like if we argued about what every publicly traded company's financials were by posting hyperventilating on the timeline rather than relying on the institution of auditing and the audited financial statements that institution produces," he wrote (@deanwball, 09-02). Quoting him requires one disclosure: he now works at OpenAI, which he said himself. From the opposite corner, the AI safety researcher Geoffrey Irving asked the obvious question back: "Yes, regulation would be great here, but also...you could just tell someone independent what the architecture is?" (@geoffreyirving, 09-02) The two men prescribe opposite remedies and land in the same place: no independent body has the standing to verify a frontier lab's architecture decisions, which is why a question like this can only be fought out on a social platform. That is the thing we intend to watch for a long time. The question to carry into your own team: if our AI vendor did this exact thing tomorrow, could we check it ourselves? The answer is almost certainly no, and what belongs in the contract is therefore today's work, not next year's. What would prove this wrong: a white-box technique that outperforms chain-of-thought monitoring overall inside a year makes Lindsey's judgment wrong. In the other direction, any frontier vendor publicly admitting that its own chain-of-thought monitorability has degraded substantially turns this risk from a guess into a fact. Verdict date: September 2, 2027, set off Lindsey's "within a year" window and not off any date an institution has committed to.

Investor note: the prevailing story assumes AI safety is something labs can manage internally, and that failures surface. This evidence weakens it. The one guardrail actually in service is called fragile by the side defending it, and a competitor says nothing can replace it for a year. The leading signal to watch is not the next leak. It is whether any lab hands its architecture details to an independent person at all.

2. [This week] (events September 2) The capability nobody could move for years finally moved — and what keeps agents out of production was never intelligence, it is the failure rate

Anthropic released Claude Fable 5.1 on September 1 with its own scores attached: "On Terminal-Bench 4.0, it scores 55.8% against 42.0% for Fable 5" (@claudeai, 09-01). The release is not what you should read today. What matters is what several unaffiliated third parties measured the day after, each on their own.

The first finding is that a slope changed. LlamaIndex builds document parsing and retrieval infrastructure and maintains ParseBench, a parsing benchmark drawn from "2k+ real-world documents across finance, legal, insurance, and more". It measured Fable 5.1 beating the previous generation on tables, content faithfulness, formatting, charts and visual grounding, and wrote the sentence that matters: this is "one of the first frontier models in recent memory where document OCR performance actually improved between model generations!" Before it, "the latest models (Opus 5, 5.6-Sol, 3.7 Flash) have stagnated on visual understanding tasks" (@jerryjliu0, 09-02). An enterprise's real data lives in PDFs, scans, tables and handwritten forms. A model can score as high as it likes on reasoning tests; if it misreads the number in a table, everything downstream of it is wrong. That dimension has barely moved for two years while reasoning raced ahead.

The second finding puts a number on the price. Signal65, an independent technology performance testing outfit, ran its PINNACLE enterprise-workflow benchmark and measured Opus 5 and GPT-5.6 Sol failing 14 workflows in every 100, against 7 for Fable 5.1. Asked something the documents cannot answer, Fable 5.1 invents an answer 0.7% of the time; Opus 5 does it 7.6% of the time. The cost is stated just as plainly: a correct answer from Fable 5.1 costs $2.46 on the full API bill, 1.8 times Opus 5, and 80% of that is the context the agent re-reads at every step, with no setting available to turn it down. At scale, ten thousand correct tasks a month runs about $25,000 on Fable 5.1, $14,000 on Opus 5 and $5,000 on GLM-5.2, the open-weight model from China's Zhipu, run on leased GPU hardware (@Signal_65, 09-02).

Verification: ⚠️ The ParseBench post gives only the summary claim of beating the previous generation "across the board"; the per-metric scores sit behind a shortened link we could not open. ⚠️ The measurer's identity matters more: LlamaIndex is both the benchmark author and a competing vendor, and the same post sells its own product. The bias runs in this item's favour, though, because the commercial interest is in saying frontier models are not good enough. It said the opposite this time. It also said the part that suits it: Fable 5.1 as a document recognition engine "costs 15c a page - which is 10-15x more expensive than our default agentic mode on LlamaParse (which performs similarly)," and that last clause is self-assessment to be discounted. ⚠️ Signal65's revenue model may include vendor-commissioned testing, and we cannot confirm whether this round was. ⚠️ That $5,000 comes from a different population altogether (renting your own GPUs for an open-weight model, against calling an API), and no failure rate for GLM-5.2 was published, so nothing follows about it being cheap and equally good.

Judgment update: the Signal65 argument deserves to survive intact: "The thing that keeps AI agents out of production is not intelligence, it is the failure rate. Every workflow an agent fails is one a person has to catch." At 14 failures per 100, an enterprise keeps human review on everything. At 7 per 100, with invented answers down to a tenth, "review every task" becomes "review the exceptions". We are moving the gate on agent deployment out of the capability column and into the failure-rate and unit-cost column, and this round turned those two into an explicit trade: half the failures, 1.8 times the bill, not both improving at once. Two things follow immediately. If you run document workflows, re-test now, because the dimension that had stalled has moved. But do not use it as your document recognition engine, at 10 to 15 times the price. That 80% has a second layer worth knowing: it is not intrinsic to the model. It is what the software wrapped around the model decides about trimming context, which makes it an engineering problem someone can solve, with no switch available today. What would prove this wrong: a next generation that drops the failure rate and the cost per correct answer together, at which point the trade disappears.

Investor note: the prevailing story assumes stronger models mean agents roll out. This evidence redirects it rather than strengthening or weakening it: the capability gain is real, but what stands in the doorway of production has always been the failure rate and the bill per correct answer, and only one of those changed. Watch for anyone starting to disclose cost per correct answer as a line item. Once that becomes a standard disclosure, every model comparison table has to be redrawn.

Also happened — not verified by us yet

1. A benchmark called FrontierHarness, published September 2, holds the model, the tasks and the runtime fixed and swaps only the software wrapped around the model. The industry calls that layer the harness, and it decides which tools the model can reach, how context gets trimmed, and what happens on a retry. Across nine harnesses and 360 runs: pass rates from 50% to 67%, cost per pass from $1.05 to $18.34, a 17.5-fold spread (@guanlan, 09-02). ⚠️ We are not writing this up as a judgment today, because "the same model" is the controlled variable of the whole experiment and which model it was has not been published. Worth following.

2. The research team at Ramp, an enterprise spend management platform, says 80% of OpenAI's and Anthropic's enterprise revenue comes from 1% of their customers, with that top 1% skewing heavily toward the tech sector and AI products and services. We have not obtained the underlying report, and the data covers only businesses that use Ramp rather than the whole market (@arakharazian, 09-02).

3. Rui Ma, an analyst covering China's technology industry, says close to 40% of new cars sold in China in the first half of 2026 shipped with L2+ or L2++ driving assistance (the first is broadly highway-focused automated driving, the second extends onto city streets), increasingly bundled into the car with no subscription. Her comparison points in the US are Tesla FSD at $99 a month, Ford BlueCruise at $50 and GM Super Cruise at $40. She does not give a source for the 40% (@ruima, 09-02).

4. [This week] (events September 2) Two frontier vendors arrived independently at the same way of handling cybersecurity capability, and the question worth asking today is a different one: Google, Gemini, $0.75 (Google DeepMind's announcement, 09-02). ⚠️ There was room for one line only today; the detail is at the link above.

Chips & semiconductors

[This week] (reported September 2) Broadcom's AI revenue grew 221% year over year, and it publicly guided to a doubling and then another doubling inside two years; the same week, one dataset says the buyers are a very small group. Broadcom designs custom AI accelerators and networking silicon, and it is the main design partner for hyperscalers building their own chips, which makes its revenue a direct proxy for the part of the market that is not buying NVIDIA. Its September 2 results: quarterly revenue of $29.591 billion, up 86% year over year, of which AI semiconductors were $16.7 billion, up 221% year over year and 54% quarter over quarter, with fourth-quarter guidance accelerating to $21.7 billion, up 236% (Broadcom investor relations, 09-02). On the earnings call the chief executive went further, out two years: "we expect AI revenue to double again to approximately $115 billion in fiscal 2027, and double again in fiscal 2028 to 230 billion." ⚠️ We have that line only through an analyst's relay, not from a call transcript (@BenBajarin, 09-02). Carry the boundary the analyst Patrick Moorhead set alongside it: "These results support a heterogeneous AI market in which custom silicon and NVIDIA GPUs can both grow. They do not prove broad NVIDIA displacement." (@PatrickMoorhead, 09-02) Read it with item 2 above: a supply-side outlook of doubling and doubling again landed in the same week as a demand-side reading that eight-tenths of the revenue comes from one percent of the customers. Both can be true at once, and only reading them together shows how narrow the group of buyers holding up that curve might be. One footnote: the stock fell after the release, because fourth-quarter guidance came in slightly under expectations. Markets trade the gap against expectations, not absolute growth.

Model watch

[This week] (published September 2) Somebody pulled apart the weights of a model in live deployment and overturned an assumption the industry uses to save money. First the background: most large models today use a mixture of experts design. Rather than running the whole model for every token, it routes each token to a handful of specialist sub-models, which lets the model be enormous while only a slice of it computes each time. A common cost-saving move is to prune the least important experts, and the usual proxy for importance is how often an expert gets routed to. Alexey Fateev, an independent researcher, ran the deployed GLM-5.3 Flash checkpoint (320B total parameters, 18B active) on four RTX PRO 6000s and measured it directly rather than reading the config file. Two results: first, routing frequency barely tracks an expert's actual importance (Spearman correlation −0.222); second, dropping the least important 2% of experts still changed 64% of output sequences (dropping the most important 2% changed 79%) (@superalesha, 09-02). That is bad news for pruning as a cost-reduction path: the usual ruler measures the wrong thing, and even with the right ruler, the least important slice does not come out painlessly. ⚠️ We hold no record on this researcher's track record, this is a single-source measurement, and nobody has reproduced it.

Product moves

[This week] (published September 2) Cursor now keeps an agent's tool execution entirely inside your own network. The biggest enterprise obstacle to agentic coding tools has always been whether source code and secrets leave the company network. Cursor shipped self-hosted machines on September 2: model inference stays in the cloud, and tool execution moves wholly onto the customer's own machines, with code, build outputs and secrets staying internal while the agent issues tool calls locally. It plugs into a customer's existing sandbox infrastructure (eight named, including AWS Lambda, Cloudflare, Modal, Vercel and E2B) and supports shared machine pools for a team plus idle sleep (Cursor changelog, 09-02). The shift is in the method: this solves the data-boundary problem with architecture instead of contract language. Read with item 2 of today's main line, there are two gates keeping agents out of production — failure rate is one, the data boundary is the other, and this is a structural answer to the second. ⚠️ A pure feature announcement, with no adoption figures and no performance figures, so we pass no judgment on how well it works.

[This week] (published September 2) Gemini 3.8 Flash doubles in price on January 1 next year, and the vendor wrote that on its own launch page. Today it costs $0.75 per million input tokens and $3.75 per million output tokens, and the same page says word for word that this is an introductory price: "Introductory price expires on December 31, 2026. Starting January 1, 2027, $1.50/1M input tokens and $7.50/1M output tokens will apply." (Google's announcement, 09-02) The $0.75 is also not new to 3.8: the official wording is "the same introductory price as 3.7 Flash", so the expiry hits the whole Flash line. Meta's Muse Spark 1.3 also launched that day on a low-price pitch, but its standard rate is $1.25 and $4.25, dearer than Google's at both ends; and the $0.10 per million input tokens "contributor tier" is not paid in money, it is paid by letting Meta take your prompts as training data (Artificial Analysis, 09-02; The Register, 09-02). What to do with this: budget next year's inference at $1.50 and $7.50. The $0.75 applies to the four months left in this year, and a procurement comparison that puts the $0.10 in the same column as everyone else's cash prices has made that column mean nothing. ⚠️ It is the list price that doubles; enterprise contract rates are not public. We did not fetch Meta's own pricing page, so the $1.25 and $4.25 come to us second-hand.

Named commentary

[This week] (published September 2) Zvi Mowshowitz ranks today differently than we do. He has run an AI weekly for years, tracking frontier lab releases and safety questions item by item, with no commercial stake in any lab. On the dispute in item 1 above, his call was "Playing with fire is also my read. The house has not burned down." (@TheZvi, 09-02), which matches where we landed: a dispute, not an incident. But in a separate post he said plainly that "Today still has to be Fable 5.1 Model Card Day though." (@TheZvi, 09-02) He thinks the most important thing today is the item we ranked second, not the item we ranked first. We are leaving our order where it is, for this reason: readings on model capability arrive every week, while "no institution has the standing to verify" is something supporters and opponents said out loud together for the first time this year. The disagreement is worth recording, and you can pick a side yourself.

From the archive

No archive pick this issue. We have used up the older material worth reusing from our own back catalogue — the last pick ran on July 30, and this is the fifteenth consecutive issue with the column empty. We would rather leave it blank than replay an item we have already run.

Sources & accounting

The past 24 hours. Last night wrote 221 pieces of new material onto our reading list: 121 X post digests, 50 academic papers, 39 company and personal blog posts, 5 industry newsletters, 4 company filings, 1 podcast transcript and 1 industry analysis. Nothing was filtered out, so the time this column saved you today is zero. What a person actually finished reading and used as evidence today comes to 28 pieces: 25 of those 121 X digests, and 3 blog posts (Google DeepMind's announcement, Broadcom's investor relations release and Cursor's changelog, all three of which supplied material you can see in this issue). Last night's newsletters include Latent Space and Gary Marcus, and the four company filings were 8-K index pages for Vertiv, Broadcom and Microsoft.

What you are not getting today. Four things. One, The Information's September 2 article, the fuse under item 1, sits behind a paywall, and neither of our two routes reached the text. Two, we did not fetch Meta's own pricing page, so the $1.25 and $4.25 in Product moves come from a third-party testing outfit's account of it; the contributor-tier price at the same layer has three mutually inconsistent figures circulating, and we cannot tell which is official. Three, the per-metric scores behind ParseBench, Signal65's PINNACLE and FrontierHarness all sit behind shortened links we could not open, which leaves item 2 and the first item under "Also happened" with summary claims only — "across the board" and "17.5-fold" cannot be taken apart any further. Four, we read none of the 50 papers, 5 newsletters or 1 transcript that reached the list last night, and two of those newsletters have titles pointing straight at items 1 and 2. So there is no separate academic column this issue, and the real reason is that we did not read them, not that we read them and found nothing.

Older material added back in one pass. Last night's backfill was substantial, and this issue uses none of it — all July and August material, drawn from a different population than the paragraph above, each line paired against last night's new arrivals in the same category: 1,808 academic papers, 891 industry newsletters against last night's 5, 745 company filings against 4, 533 industry analyses against 1, 362 blog posts against 39 last night and the 3 finished today, 351 podcast transcripts, 134 supply-chain intelligence pieces, and 119 X posts against the 519 pulled last night. That comes to 4,943 pieces, dated mostly between 2026-07-01 and 08-30.

Source concentration. The load-bearing sources for the fourth item under "Also happened" and the second item in Product moves concentrate on Google's own pages. Judged by the test of "remove it and the argument collapses", six of the nine sets of material across those two came from Google directly, far above our own one-third warning line. Our handling is written into the verification of that fourth item: name each of the three externally produced readings inside the official release. The two main-line items do not have this problem. Item 1 rests on five unaffiliated directions — the company, an independent publication, a competitor's researcher, an academic teardown and the policy side — and item 2 on four unaffiliated third parties measuring separately.

The sources we track. After de-duplication the roster runs to 529: X 302, podcasts 90, outlets and press rooms 51, personal blogs 48, paper authors 48, newsletters 46, earnings calls 26, keynotes 23, other 15. One person can occupy several channels at once, so the categories add to more than 529. A separate roster of 77 company and institutional blogs (NVIDIA's technical blog, Google Research, Hugging Face and the like) covers organizations rather than people and does not count toward the 529. Representative names: on X, Elon Musk and Andrej Karpathy; in newsletters, Zvi Mowshowitz, Dylan Patel and Ben Thompson; on papers, Percy Liang and Sebastian Raschka; on podcasts, Demis Hassabis and Dario Amodei. Several identically named numbers belong to different populations. On X: 374 accounts actually pulled last night, 519 posts retrieved (all original — retweets and replies both zero), de-duplicated into 121 digest files written onto the reading list, and 302 people on the roster whose main channel is X. Fetch list, fetch volume, digest count and roster headcount are four different populations and cannot be summed. Newsletters work the same way: the 5 that arrived last night is a day's reading, while the 46 on the roster is the total we follow over time. A third ruler is the number signed at the foot of the page. This issue uses 26 external sources in the body: 28 external links in all, minus the two platform home pages in this section, and the only link back to us is the full edition at the top, which does not count. That is a different population again from the 529 on the roster.

This is not a news digest: we hunt each day's AI firehose for the insights that actually matter and the practitioner judgments worth tracking over time, and we show how every item was verified — the point is always "which judgment got harder, and who's been right," never "what happened today."

— SecondSource · generated by our research system · 26 sources · Got a view? Reply and tell us

Written from the same research and judgments as the Traditional Chinese edition; every claim links to a primary document.