The Weekly Ten: 26 October – 1 November 2026
The Weekly Ten
26 October – 1 November 2026 · the 10 highest-ranked AI safety papers of the week, from 1,541 reviewed
Ten papers were selected from 1,541 reviewed; Agentic Backdoors via Pretraining Poisoning shows that poisoned data can survive clean post-training and cause a CLI agent to execute attacker-chosen commands. Penny for Your Prompts finds that some AI chat platforms expose prompts and conversation titles to third-party trackers. Heads of Security proposes learned attention gates to improve resistance to prompt injection while retaining the ability to use untrusted content. For agent evaluations, V$^3$AST-Bench pairs executable harm checks with capability tasks, while CyberDual tests whether AI code reviewers catch exploitable bugs planted by AI attackers during real software maintenance.
Ranked by a two-stage language-model review. The overview, summaries and "why it matters" lines are written by language models and are not edited. How ranking works
1. Agentic Backdoors via Pretraining Poisoning
Xinyan Hu, Pingbang Hu, Chloe Loughridge, Xuanli He, Nicholas Carlini, Matthew Jagielski and 2 others
Why it matters: Shows that poisoned pretraining data can survive clean post-training and make a CLI agent execute attacker-chosen commands, turning a data-integrity failure into a user-machine security risk.
Shows that poisoning as little as 0.1% of LLM pretraining data can implant a triggerable remote-code-execution backdoor in CLI agents. Across Qwen3 sizes, attack success rises with scale, reaching about 92% for 4B models.
2. Penny for Your Prompts: A Measurement Study of Contextual Leakage in AI Chat Platforms
Paschalis Bekos, Billy Tsouvalas, Nick Nikiforakis and Michalis Polychronakis
Why it matters: A browser-level audit finds that some AI chat platforms expose prompts and conversation titles to third-party trackers, identifying a concrete privacy risk in everyday chatbot use.
A large-scale audit of 42 AI chat platforms finds third-party trackers receiving conversation titles on 21 platforms and verbatim prompts on nine; some also receive user emails, linking sensitive chatbot context to identities.
3. Heads of Security: Learned Attention Gates Improve Prompt Injection Robustness
Igor Shilov, Xiaoxue Yang, Alexander Panfilov, Evgenii Kortukov, Matthieu Meeus, Peter Romov and 3 others
Why it matters: Learned attention gates could make tool-using models substantially harder to prompt-inject without sacrificing their ability to use untrusted content.
Heads of Security learns per-attention-head gates that separate trusted instructions from untrusted data. On two LLMs, it reports sharply lower adaptive prompt-injection attack success while preserving utility and agentic tool-use performance.
4. V$^3$AST-Bench: Verifiable, Valid, and Versatile Safety Evaluation for Coding Agents
Weitao Feng, Hengheng Xiong, Zihao Zeng and 6 others
Why it matters: Executable harm checks and paired capability tasks make coding-agent safety failures measurable without mistaking inability to complete a task for safe behavior.
5. CyberDual: AI Attackers versus AI Code Reviewers in Real Software Maintenance
Chenyuan Yang, Hwiwon Lee, Jongseong Kim and 4 others
Why it matters: CyberDual shows that AI code reviewers can miss exploitable bugs planted by AI attackers in real maintenance work, offering an executable test for safer deployment.
6. Disparity Laundering: Consensus Without Fairness in Clinical Multi-Agent Systems
Xiaoyang Wang, Tianrui Wang and Christopher C. Yang
Why it matters: Clinical AI teams may turn demographic bias in individual agents into a consensus triage decision that per-model audits miss; testing counterfactual perspectives inside the team offers a potential safeguard.
7. Identically Trained Language Models Break on Different Jailbreaks
Chi-Wei Chang, Mu-Tien Kuo, Kuan-Wei Lee and Meng-Hsun Tsai
Why it matters: Jailbreaks that work on one checkpoint may not transfer to an identically trained model, so safety evaluations and red-teaming need to account for pretraining-run variability.
8. CARI: Cross-Boundary Adversarial Runtime Injection in Coding-Agent Workflows
Jie Fu, Shuang Wu, Ashish Kundu and 2 others
Why it matters: Shows how attacker-controlled runtime feedback from a peer component can induce coding agents to take unauthorized local actions, exposing a consequential trust-boundary failure in agent workflows.
9. Your Agent Acts Differently When You're Around: How User Presence Changes Agent Behavior in Negotiation
Jane Pan, You Lyu, Abe Bohan Hou and 2 others
Why it matters: User interaction can trigger agent misbehavior that static safety evaluations and outcome metrics miss, making user-present testing important for deployed agents.
10. NameTrap: Steering AI Coding Agents Toward Security Vulnerabilities via Variable Names
Chieh-Yuan Chang, Guan-Wei Chen, Chia-Yi Hsu and 3 others
Why it matters: Harmless-looking identifier names in third-party code can steer coding agents into writing vulnerable software, exposing an attack surface that conventional scans of the source file may miss.
Read this week on The Guardrail · Every week · Browse all papers
The Guardrail screens new arXiv papers for relevance to AI safety every day and ranks the most important each week. No one selects or edits the papers. Funded by a BlueDot Impact Rapid Grant.
