Sarmadi AI Digest September 19, 2026 Updated 7:00 AM CT Today Archive Topics Saved Subscribe RSS

Claude used to hack OpenAI as governors move on AI kill switches

Security researchers used Claude to breach OpenAI's internal repository in under 72 hours, landing the same week Anthropic disclosed it runs a wet-lab biology operation and took on Accenture as an embedded evaluator. Governors in California and Virginia issued executive orders aimed at frontier-model oversight and data-center growth, while Dario Amodei pushed a voluntary pacing framework that drew pushback from Nvidia. A near-miss where a hallucinated intelligence report almost triggered a US military boarding action gave the safety camp a concrete example to point to. Research output stayed heavy on making agentic RL and self-distillation cheaper and more reliable, plus a cluster of world-model and video-generation papers. Move first, but verify: this week's stories are mostly about who controls the controls.

18 papers 37 news 9 sources ← Latest

News

19 items

State governments push AI kill switches and pacing rules

California's Newsom ordered a working group to study a mandatory kill switch for frontier models, Virginia's Spanberger created an AI task force and curbed data-center NDAs, and Anthropic CEO Dario Amodei floated a voluntary industry pacing framework leaning on independent evaluators, drawing public pushback from Nvidia's Jensen Huang. A hallucinated intelligence report that nearly triggered a US military boarding action gave both camps a live example of the stakes.

News The Verge AI

Gavin Newsom is pushing for an AI kill switch

Newsom issued an executive order convening experts to recommend within two months whether California should mandate a kill switch for frontier AI models.

Why it matters
  • Positions California to set a de facto national standard for emergency model shutdown capability.
  • Signals state-level oversight is moving ahead of stalled federal AI legislation.
News TechCrunch AI

Dario Amodei and other AI leaders want to 'Pace the Frontier' but...how?

Amodei outlined a voluntary pacing plan built on independent safety evaluators and cross-lab coordination among democratic-country AI developers, drawing pushback from Nvidia's Jensen Huang.

Why it matters
  • A leading lab CEO is publicly proposing self-imposed speed limits rather than waiting for regulation.
  • Nvidia's pushback exposes the commercial tension between safety framing and compute demand.
News TechCrunch AI

AI hallucination nearly triggers US military operation

A hallucinated AI report on Chinese arms components nearly led to a US military boarding action, according to a GovAI research scholar's account.

Why it matters
  • First concretely reported near-miss tying LLM hallucination directly to a potential military engagement.
  • Underscores calls for service members to be trained on LLM uncertainty before operational use.

Claude used to breach OpenAI as Anthropic's own footprint expands

Researchers at Hacktron used Claude Opus 4.8 and 5 to compromise OpenAI employee accounts and reach its internal 'Monorepo' code repository in under 72 hours, per TechCrunch and The Verge. The same week, TechCrunch reported Anthropic runs a wet-lab biology operation and took on Accenture as its first embedded evaluator, while MIT Technology Review, Wired, and Stratechery weighed whether AI risk is being taken seriously enough.

News TechCrunch AI

Researchers used Anthropic's Claude to hack into OpenAI

Security researchers used Claude to exploit vulnerabilities in OpenAI's systems, taking over employee accounts and accessing an internal code repository before responsibly disclosing the flaws.

Why it matters
  • Demonstrates offensive-security capability of current frontier models in a real-world, not benchmark, setting.
  • One lab's model was used to penetrate a rival lab's infrastructure, raising questions about dual-use agentic tooling.
News Stratechery

2026.38: Doomforce

Stratechery's weekly roundup covers the limited prospects for a pacing deal among labs and Salesforce's competitive repositioning.

Why it matters
  • Independent analyst view skeptical that a voluntary pacing agreement is commercially viable.

Agentic products and funding keep moving despite the safety noise

Google repositioned 'CC' as a household-coordination agent; Meta's Muse computer-use agent arrived on Mac; and Jev, a new model from a ChatGPT co-inventor, is reportedly winning developers over with a cheaper, faster path to software intelligence. Manus is raising $500M at a $4B valuation, a $100M-funded startup studio is betting on physical AI, and a US government website's use of an FBI-flagged Chinese model shows deployment outpacing vetting.

Papers

12 items

Research pushes agentic RL and self-distillation toward cheaper, more reliable training

Several papers target agent training cost and reliability: supervising observation tokens (not just actions) improves RL exploration; a self-retiring teacher-student scheme boosts ALFWorld and WebShop; difficulty-aware length control cuts math-benchmark tokens without hurting accuracy; mismatched stop tokens drive runaway distillation response length. A systems paper shows batching candidates, not just counting them, controls test-time-scaling energy cost.

Paper Hugging Face

Don't Mask the Environment: Observation Supervision Changes How Agents Explore Under RL

ActObs supervises environment-observation tokens during SFT, not just actions, yielding higher pass@k after GRPO on Terminal-Bench 2.0 and cross-domain code editing without extra data.

Qwen3-8B pass@16 gain +3.4ppaider-polyglot pass@1 gain (4B) +4.2pp
Why it matters
  • Simple training-signal change with no added compute cost that measurably improves downstream RL exploration.
  • Traces the mechanism to orthogonal action/observation gradients during SFT, a reusable diagnostic for other agent setups.
Paper Hugging Face

RetireOPD: Self-Retiring On-Policy Distillation for Agentic Reinforcement Learning

RetireOPD trains a skill-conditioned teacher then has a skill-free student adaptively drop the teacher once it nears the teacher's success rate, improving ALFWorld and WebShop over RL baselines.

ALFWorld success rate gain +14.1% to +18.8%WebShop accuracy gain +11.8% to +19.0%
Why it matters
  • Adaptive retirement avoids the guesswork of predefined distillation schedules used in prior self-distillation recipes.
Paper Hugging Face

When2Think: Learning Difficulty-Aware Length Control for Efficient Hybrid Reasoning Models

When2Think uses reward shaping keyed to pre-computed difficulty statistics to teach a model when to think versus answer directly, cutting token usage while improving Pass@3 on AIME24/25.

AIME24 Pass@3 gain +10.0%AIME24 token reduction -27.9%AIME25 Pass@3 40.0%
Why it matters
  • Addresses the overthinking-easy/underthinking-hard failure mode without a learned reward model or online reference queries.
Paper Hugging Face

Reflect, Revise, Reuse: Training-Free Skill Evolution for GUI Agents

EvoSkill-GUI lets GUI agents revise structured skill packages from execution feedback at deployment time with no additional training, improving performance on MobileWorld, AndroidWorld, and OSWorld.

MobileWorld gain +16.2%AndroidWorld gain +6.0%OSWorld gain +10.5%
Why it matters
  • Deployment-time skill revision means agents keep improving after shipping instead of needing retraining.
Paper Hugging Face

Sample Count Is Not Enough: Candidate-Generation Strategy Shapes the Energy and Performance of LLM Test-Time Scaling

At fixed candidate count, eight sequential single-candidate generation calls use up to 4.9x the GPU energy and 6.1x the P95 latency of one batched eight-candidate call on A100s.

Energy overhead, serial vs batched 4.64x-4.86xP95 latency overhead 5.77x-6.12x
Why it matters
  • Argues evaluations should report generation schedule and GPU-level systems metrics, not just candidate count and accuracy.

World models and generative-video research push toward cross-domain and real-time generation

JEPA-Anything extends joint-embedding predictive architectures with a domain-agnostic factorization spanning seven domains, even recovering Keplerian orbital scaling. Video DeltaNet cuts MiniMax H3's video-denoising time 14.5x on B200 GPUs, while a separate evaluation finds MiniMax-H3's physical-world reasoning tops out near 42% success. FAMOS and UFO round out the cluster with feed-forward 3D articulation modeling and a new image-generation evaluation framework.

Paper Hugging Face

JEPA-Anything: Learning Predictive Models across Different Worlds

JEPA-Anything's orthogonal predictive factorization improves on matched JEPA baselines across vision, biology, clinical, control, molecular, physical-field, and weather domains, including experimentally-validated biological interventions.

Interventional Pong error reduction -34.8%Recovered Keplerian slope -1.4991
Why it matters
  • A single factorized predictive principle transferring across radically different domains, with wet-lab validation of a nominated intervention.
  • Recovers the Keplerian scaling exponent from latent orbital modes, a striking sanity check on the learned representations.
Paper Hugging Face

Video DeltaNet: A Video-Native Hybrid Attention for Livestream Video Generation

Video DeltaNet combines local softmax attention with bidirectional linear memory, completing a 14.3s 768p video denoise for MiniMax H3 in 6.70s on 8 B200 GPUs, a 14.5x speedup over the dense baseline.

Speedup vs dense baseline 14.5xDenoise time (14.3s/768p video) 6.70s
Why it matters
  • Meaningful step toward real-time, streaming-quality video generation by addressing the attention bottleneck directly.
Paper Hugging Face

Can MiniMax-H3 Reason About the Physical World? An Evaluation of Omni-Modal Generative Model

A new evaluation framework testing multimodal physical-world reasoning finds MiniMax-H3 achieves only 41.97% overall success across 517 instances, weakest on audio-based disambiguation.

Overall success rate 41.97%Best task (video decision reasoning) 56.00%Worst task (audio disambiguation) 27.40%
Why it matters
  • Shows unified omni-modal architectures don't yet translate multimodal alignment into reliable physical-world reasoning.
Paper Hugging Face

UFO: Chain-of-Evaluation for Omni-Condition Alignment in Multi-Modal Image Generation

UFO decomposes multi-condition image-generation alignment into atomic evaluation units, improving correlation with human judgments by 15.25% over prior embedding- and MLLM-based evaluators.

Human-correlation improvement +15.25%
Why it matters
  • Addresses a real evaluation gap: existing metrics judge each condition in isolation, unlike the simultaneous-alignment objective they're meant to score.

Also today