Research papers and engineering breakthroughs, distilled for engineers who build.
A systematic study rules out four plausible explanations for why LLMs underperform classical ML on tabular classification, and finds the real culprit: accuracy degrades with feature count in a way no noise-corrupted classical model reproduces, and the model's own explanations don't match what it computed.
A systematic study of 60 LLM benchmarks finds 29 have saturated: top models are statistically indistinguishable. Age and test set size predict saturation; private test sets, multilingual scope, and open-ended formats don't protect against it once age is controlled for.
OpenAI's GPT-Live writeup is a real systems engineering case study: full-duplex audio, hot model handoffs, a 6-to-1 round-trip protocol, and capacity planning that isn't about GPU throughput. We break down the five design patterns worth studying, with a quiz.
A SonarSource controlled study finds code cleanliness doesn't change whether coding agents pass a task, but messy code makes them burn ~8% more tokens and re-open edited files 34% more often. The quality tax is efficiency, not success.
Self-Harness lets an agent improve its own scaffolding, no stronger model or human engineer required. By mining its failure traces and regression-testing edits, MiniMax M2.5 jumped from 40.5% to 61.9% on Terminal-Bench-2.0 with frozen weights.
MiniMax's MaxProof clears the IMO gold-medal threshold by wrapping one model in a generate-critique-repair loop. Test-time search adds 8 to 10 points over one-shot, but the conservative verifier is what makes it work.
A new paper proves universal LLM reliability is impossible with finite interventions, but reliability inside a bounded deployment is tractable. Failure modes grow only logarithmically, so a domain-specific library of tens of interventions can cover them.
Epicure trains word2vec-style embeddings on 4.1M recipes, turning cuisine, nutrients, and taste into linear directions you can navigate with vector arithmetic, with a tunable chemistry-vs-recipe-context knob.
A Concordia study traces token spend across a multi-agent coding system and finds 59.4% of it goes to code review, not writing code. Input tokens are the hidden tax: more than half of all consumption is the model re-reading context.
A PwC study finds plain lexical grep beats vector search for LLM agents on long-memory QA, with gaps up to 23 points. But the agent harness matters as much as the retrieval method: the same model swings 16 points across harnesses.
A new study finds that LLM coding agents suffer 'constraint decay': performance drops 30+ points when forced to follow architectural patterns, use specific databases, and integrate ORMs. Data-layer defects drive 45% of logic failures.
Simple Self-Distillation (SSD) lets LLMs improve at code generation by training on their own unverified outputs, no correctness labels or execution environment needed. Qwen3-30B jumps 12.9 points on LiveCodeBench v6.
Don Knuth published a paper describing how Claude Opus 4.6 solved an open combinatorics problem he'd been working on for weeks: finding a general decomposition of a 3D digraph's arcs into three directed Hamiltonian cycles. Claude found it in about one hour across 31 explorations.
SWE-CI is a new benchmark that evaluates coding agents on long-term codebase maintenance via continuous integration loops, not one-shot bug fixes. Most models introduced regressions on 75%+ of tasks. Only Claude Opus exceeded a 50% zero-regression rate.
A*-PO is a new RL training algorithm for LLMs that precomputes an 'optimal value' offline, then trains with just one sample per prompt instead of many. It matches or beats PPO and GRPO at up to 2x faster speed and 30%+ lower memory.
Anthropic added a memory import tool that lets you copy your context and preferences from ChatGPT, Gemini, or any other AI provider into Claude in under a minute.
Researchers from ETH Zurich and Anthropic show that LLM agents can re-identify pseudonymous online accounts at scale — achieving up to 68% recall at 90% precision compared to near 0% for the best classical methods. The assumption that posting under a pseudonym is safe no longer holds.
Jack Dorsey announces Block is cutting over 4,000 employees — nearly half its workforce — citing AI-driven changes to how companies operate. The stock jumped almost 25% after hours.
Anthropic is giving up to 10,000 open-source maintainers free Claude Max 20x subscriptions for six months.
Anthropic shipped auto-memory for Claude Code. Claude now persists project context, debugging patterns, and preferences across sessions without manual setup.
Google locked AI Ultra subscribers out of Gemini models for using OpenClaw OAuth, with no warning or explanation. Anthropic banned third-party access two days earlier.
A randomized trial found that developers using AI assistance scored 17% lower on a skills test without gaining any speed advantage. The finding matters, but the study design limits how far you can take it.
An ETH Zurich study tests whether AGENTS.md and CLAUDE.md files actually help coding agents. LLM-generated context files reduce success rates while adding 20%+ to costs. Human-written ones barely help.
Anthropic updated its Claude Code docs to ban OAuth tokens from being used in third-party tools. The community exploded. Then Anthropic said nothing was changing.
A proposed LLM benchmark: feed a model pre-earnings data, have it forecast the results, compare to actual. Here's why it's worth building — and why today's models make it more interesting than ever.
A Ramp study using real firm-level spending data finds businesses are rapidly substituting freelancers for AI — with the heaviest spenders seeing $1 of AI replace $33 of freelance labor.
SkillsBench tests whether structured knowledge packages improve LLM agents across 84 tasks. Curated Skills add 16pp. Self-generated Skills add nothing, or make things worse.