Tag
#open-weights
Reports tagged open-weights.
Reports
3 reportsAug 2026
08-01 Deep Dive Distillation Mostly Reweights — Until the Teacher Adds Something New A weaker teacher can beat a stronger one when its token distribution overlaps the student's. In one 2026 study that overlap tracked successful distillation — but did not guarantee it. Jul 2026
07-31 Deep Dive Distillation Copies the Transcript, Not the Teacher A student model learns from a transcript, not from a mind — which is why capability transfers cheaply, why refusal quietly does not, and why the policy fight is aimed at the wrong part of the machine. 07-29 Frontier Research The Open-Weight Gap Is Four Points Wide and 1.56 Terabytes Deep: What It Costs to Run the Best Open Models Yourself Kimi K3 pulled open weights to within four points of the closed frontier, then shipped as a 1.56-terabyte download with a 64-accelerator floor. The gap did not close. It moved.