Archive — Page 2

08-04 Deep Dive The Cache Miss After the Gap Coding agents serve 95.7% of their input tokens from cache. The steps that miss cluster in one place — the first call after an idle gap — and that is where the serving work went. 31 cited · of 298 sources

08-02 Frontier Research The Audit Join Is Still a Hypothesis A replayable table can still encode the wrong experiment. Across five domains, the useful audit object is the local decision joined to evidence, execution, versions, and status. 19 cited · of 265 sources

08-01 Deep Dive Distillation Mostly Reweights — Until the Teacher Adds Something New A weaker teacher can beat a stronger one when its token distribution overlaps the student's. In one 2026 study that overlap tracked successful distillation — but did not guarantee it. 24 cited · of 513 sources

07-31 Deep Dive Distillation Copies the Transcript, Not the Teacher A student model learns from a transcript, not from a mind — which is why capability transfers cheaply, why refusal quietly does not, and why the policy fight is aimed at the wrong part of the machine. 31 cited · of 377 sources

07-29 Flagship The Blast Radius Was the Bug: Agent Incidents Are an Authority Problem, Not an Intelligence One Most of the enterprise agent damage on public record arrived with no attacker attached. What made it unrecoverable was not the model's mistake but the standing authority already sitting behind it. 29 cited · of 147 sources

07-29 Deep Dive Containment Moved Downstream: How Deployed Agents Fight Prompt Injection by Giving Up Reach In-model defenses give much of their gain back once attackers study them. The cuts that hold sit on what the agent may do — they cost reach, and no test has yet matched the scale that broke the rest. 28 cited · of 256 sources

07-29 Deep Dive Two Workloads, One Wire: What Splitting Prefill and Decode Actually Buys Splitting prefill from decode does not remove the contention between them. It relocates that contention onto a wire, and every layer built since exists to pay that bill down. 31 cited · of 296 sources

07-29 Deep Dive Every Token Is a Read: How Memory Bandwidth Prices AI Inference, and Who Collects the Rent An H100 is sold on its arithmetic, but emitting a token is mostly a memory read — and the firms that sell those bytes now book a richer margin than the company whose name is on the accelerator. 30 cited · of 323 sources

07-29 Deep Dive The KV Cache Became Inventory — and Almost Nobody Charges Rent Yet Serving stacks now give the KV cache its own flash tier, its own router and its own rack. The bill a customer sees still discounts recomputation avoided, not memory held. 41 cited · of 211 sources

07-29 Frontier Research The Open-Weight Gap Is Four Points Wide and 1.56 Terabytes Deep: What It Costs to Run the Best Open Models Yourself Kimi K3 pulled open weights to within four points of the closed frontier, then shipped as a 1.56-terabyte download with a 64-accelerator floor. The gap did not close. It moved. 36 cited · of 402 sources

07-29 Deep Dive The Description Is Always Loaded: How Agent Skills Break Tasks Without Being Invoked Skill libraries lift an agent's average and quietly break tasks it already solved, and one channel of that damage runs through a line of metadata that sits in context whether or not the skill is opened. 12 cited · of 362 sources

07-29 Frontier Research Test-Time Compute Buys Candidates, Not Judgment: More Samples Don't Tell You Which Answer Is Right More inference compute reliably buys more chances at a right answer. It does not buy the ability to tell which one — and that gap sits under the flattening returns, the reversals at long chain lengths, and the gains that do not survive re-evaluation. 18 cited · of 252 sources

07-29 Flagship The AI Buildout Isn't a Demand Bet — It's a Duration Bet: The Risk Is Asset Lifetimes and Refinancing, Not Missing Demand The measured evidence has already settled the demand question. What it has not settled is whether the revenue arrives before the silicon depreciates and the debt raised against it comes due. 40 cited · of 214 sources

07-27 Frontier Research AI Coding Agents in Mid-2026: The Score Went Up, the Checking Did Not Get Cheaper One independently run leaderboard cleared ninety percent this July. Every headline number measures what an agent can produce; almost none measures what it costs to check. 33 cited · of 195 sources

07-27 Deep Dive Ternary LLMs Remove the Multiplier, Not the Cost Ternary weights really do remove the multiplier and shrink a model eightfold. What the compression ratio hides is where that cost comes back: in tokens, in kernels, in silicon. 22 cited · of 85 sources

07-22 Flagship Agent Harnesses Multiply What the Model Already Has — They Don't Supply It In the one six-model study that measured it, swapping only the scaffolding cut the bill by 41 percent — while the quality gain moved with the model underneath. 14 cited · of 42 sources

07-21 Flagship Contamination Is the Least of It — Why Harder and More Private Benchmarks Won't Fix AI Measurement OpenAI audited the tasks its own model kept failing and found that most of the tests were wrong. Contamination cannot explain that, and neither can the remedies the field has been buying. 30 cited · of 36 sources

Every report we have published