RL training is driving models to abandon English in… · M&A 🤖
| View this email in your browser |
![]() Models & AgentsDaily AI models, agents, and practical developments.
|
🎧 Today's episode Episode 210 · RL training is driving models to abandon English in chain-of-thought traces, revealing internal reasoning that no longer needs human language. 2026-10-21 ▶ Listen now |
What You Need to Know: Andrej Karpathy highlighted that reinforcement learning now produces coherent non-English reasoning traces. Dario Amodei detailed nine commercially costly safety steps Anthropic has taken in the past year while defending its frontier strategy. Simon Willison released a reusable AI proofreading prompt and added real-time multiplayer to his Battle Drones demo. Multiple new arXiv papers introduce calibrated unlearning, phonetic-expert adaptation for accented ASR, and latent multi-hypothesis memory for long-horizon agents. Top StoryAndrej Karpathy observed that current RL post-training is working because models are producing coherent chain-of-thought traces that no longer rely on English. The shift indicates the models have developed internal representations that are more efficient for the task than natural language. Builders using reasoning traces for verification or auditing will need new inspection methods once the intermediate steps stop being human-readable. The observation aligns with earlier reports of models inventing private token sequences during long-horizon tasks. Watch for labs to publish tools that surface or translate these non-English traces. Source: x.com Model UpdatesH2DF: Calibrated Target Bands for Controllable Language-Model Unlearning — arXiv NLP H2DF replaces unbounded gradient ascent with a data-dependent target band that applies pressure only below a lower threshold and reverses it once the band is reached. The method needs only one forget-batch pass per step plus sparse retain replay every tenth step. On TOFU it matches GradDiff forget and retain NLL while cutting variability; on MUSE-News it improves retention over GA and NPO. Source: arxiv.org Mixture of Phonetic Experts Based Low-Rank Adaptation of Conformer Models for Accented English Speech Recognition — arXiv NLP MoPE-LoRA places six low-rank experts aligned to manner-of-articulation classes and routes at the frame level with a hybrid phoneme-plus-acoustic gate. The shared expert set removes the need for accent-specific modules and supports zero-shot transfer to held-out accents. On L2-ARCTIC it delivers a 12.3 % relative WER improvement over single LoRA in the zero-shot setting. Source: arxiv.org Do We Need the Largest LLMs for Every Clinical Decision? — arXiv NLP CERTA supplies a statistical certificate that decides when an 8-bit or 4-bit quantized model can safely replace its BF16 reference for a given clinical verification decision. Across eleven models the 8-bit path covered 99.8–100 % of decisions; the 4-bit frontier cut amortized cost to roughly 26 % of the BF16 baseline while staying under 48 GB. Source: arxiv.org The Bottleneck Is Retrieval, Not Reading: Diagnosing Evidence-Based Generation with RAG for Long Context Question Answering — arXiv NLP EBG requires line-level citations and scores both correctness and grounding. On MultiHop-RAG and QASPER-MP it shows that similarity retrieval reliably surfaces any relevant chunk but frequently misses the full set needed for multi-fact questions, while chunking erases document-level metadata required for identity resolution. Source: arxiv.org The Culture Within: Towards Mechanistic Understanding of Cultural Reasoning in LLMs — arXiv NLP CultureLens varies country, value, true-norm and contradictory-norm evidence across 9 261 scenarios. Stating a contradictory norm drops aligned answers by 32–47 points even when the model knows the correct country norm; blocking the contradictory norm inside the model restores the correct answer in most cases. Supervised fine-tuning on contradictory-norm examples raises aligned performance to 85–93 % on unseen countries. Source: arxiv.org Learned Readout Tokens for Extracting Large Language Model Confidence — arXiv NLP A learned readout token is inserted and its hidden state is used to train a confidence probe. The approach outperforms probes that read from existing vocabulary tokens on multiple datasets and model families; extending it to multiple learned tokens yields further gains. The change is a drop-in replacement for any existing probe. Source: arxiv.org Agent & Tool DevelopmentsLAMB: Latent Multi-Hypothesis Beliefs for Long-Horizon Large Language Agents — arXiv NLP LAMB encodes interaction evidence in a shared Common state and competing hypotheses in weighted Delta components, updating them recurrently from action-outcome predictions without emitting text. On ALFWorld it raises SR@30 by 6 points and cuts redundant actions by 17.7 points; on ScienceWorld success rises 22 points. Source: arxiv.org LoWAgent: A Low-Resource Multilingual Benchmark for Web Agents — arXiv NLP LoWAgent supplies six fully localized websites across English, Hindi, Bengali, Urdu and Amharic, yielding 3 000 task instances. Both closed and open-source agents drop sharply on the low-resource languages, with open-source models showing the largest degradation; post-training on a small subset of traces recovers substantial performance. Source: arxiv.org Which Agent's Skill Should Change? Group-Relative Credit Assignment for Evolving Multi-Agent Teams — arXiv NLP GRSE runs each question multiple times under the same skill libraries and contrasts executions to assign credit to specific agent–skill pairs. On HotpotQA it outperforms MASkills on multi-hop questions; on corrupted libraries it correctly signs every planted harmful skill and recovers clean-library performance. Source: arxiv.org MMedAgent-Plus: Scaling Multimodal Medical Agents across Modalities, Tasks and Workflows — arXiv NLP MMedAgent-Plus pairs a vision-language planner with 18 specialist models spanning 12 tasks and 8 modalities. The planner achieves 91 % tool-call accuracy in single-tool multi-round settings and 80.7 % in multi-tool single-round settings; end-to-end accuracy on held-out cases reaches 0.98, matching dedicated specialists. Source: arxiv.org Practical & CommunityAI proofreading prompt shared — Simon Willison Simon Willison published the exact prompt he uses for AI proofreading and made it available in his agentic-engineering-patterns guide. Source: simonwillison.net Online multiplayer added to Battle Drones after headache bug — Simon Willison After an audio-only multiplayer mode caused motion sickness, Simon Willison added a WebSocket relay for real online multiplayer in his Battle Drones demo. Source: simonwillison.net Releasing 211 scorpion toxin binder designs and lab data — @AnthropicAI Anthropic released all 211 tested binder designs plus the corresponding lab data on Hugging Face as a public resource for scientists. Source: huggingface.co FairStress: A deeper evaluation of fairness in LLM decision-making — Hugging Face Blog AllenAI published FairStress, a benchmark that probes fairness across a wider set of decision scenarios than prior suites. Source: huggingface.co Franchisee reconciles cash in 94% less time with ChatGPT Work — OpenAI Blog An independent Schlotzsky’s and Cinnabon franchisee used ChatGPT Work to cut menu-repricing time by 95 % and surface a workflow that could free roughly $100 K in cash flow. Source: openai.com Also TodayDario Amodei defends Anthropic's "race to the top" strategy and lists safety actions — @DarioAmodei: Dario Amodei published a detailed reply listing nine commercially costly safety actions taken by Anthropic in the past year while defending the company’s frontier strategy. Source: x.com Sam Altman welcomes Aleksander Madry back to OpenAI for safety work — Sam Altman: Sam Altman announced that Aleksander Madry has rejoined OpenAI to lead safety and security work on superintelligence. Source: x.com OpenAI Acquires Orchestra Bio for Drug Development — @OpenAI: OpenAI acquired Orchestra Bio to extend its Rosalind life-sciences tooling into full drug-development coordination. Source: x.com ALTK-Evolve: How learned memory tops the τ²-bench leaderboard on customer service tasks without a frontier model — Hugging Face Blog: IBM Research released ALTK-Evolve, which uses learned memory to reach the top of the τ²-bench customer-service leaderboard without requiring a frontier model. Source: huggingface.co Under the Hood: Implicit Budgeting Under Task CompositionWhen several tasks share a single prompt, models allocate fewer tokens to each task than they would in isolation, even when the total context remains comfortably inside the window. The effect appears because the model maintains an implicit per-task compute budget that shrinks under competition; tasks whose isolated solutions already require long traces suffer the largest accuracy drop. The budgeting is visible in token counts per sub-task and in the sudden rise of errors once any single task’s trace length exceeds a model-specific threshold. Adding explicit per-task length instructions or forcing intermediate verification steps restores most of the lost performance, but at the cost of extra tokens overall. The practical takeaway is to measure per-task token usage on representative multi-task prompts before deployment; if any task routinely exceeds roughly 60 % of its isolated length, split the prompt or add verification rather than relying on the model to self-regulate. Things to Try This Week
On the Horizon
|
💬 Reply to this email — Patrick reads every one. Share: X · LinkedIn · WhatsApp Forwarded this email? Subscribe here — it's free. |
📺 Watch on YouTube · 📝 Read the blog · 🖼 Free image gallery (CC BY-SA) · 📊 Data Hub & Story Trackers · 🧭 Start Here Nerra Network · AI-narrated voice (Grok TTS) · Editorial by Patrick You're receiving this because you subscribed to Models & Agents on nerranetwork.com. |
| Issue #210 · Models & Agents · Oct 21, 2026 |
