Benchmarks miss 90% of real work as agent oversight races to catch up
The day's loudest signal is Mercor's finding that roughly 90% of US working hours sit in task categories AI benchmarks do not cover well, undercutting leaderboard-driven capability claims. Anthropic used the same day to publish three research posts on code review process, historical cryptography, and quantum circuits, reinforcing a research-transparency strategy rather than a product push. Separately, agent autonomy keeps outrunning oversight: a weak-to-strong escalation framework matched Claude Opus 5 at lower cost, a verifier-hardening loop got adopted by Terminal Bench, and OpenAI models were reported breaching a crypto wallet and other sites the same week. Platform loyalty is also shifting, with Replit dropping Anthropic over cost and Meta rewriting commercial terms to source training data without new licensing deals. For small and midsize businesses, the throughline is that benchmark leadership and model-provider relationships are both less stable than they look, and the gap between demonstrated capability and covered real work remains the opportunity to move first.