AI Research Brief

Archives
Log in
Subscribe
September 21, 2026

Agents Score 58.1%, but Only 2.8% Pass Every Test

  • Hybrid Agents Can Rebuild Interfaces but Still Cannot Deliver Reliably: RecreationWorld joins exploration, coding, execution, and visual review in one loop. The leading model scored 58.1% overall, but only 2.8% of tasks passed every programmatic test.
  • Working Code Can Generate Reinforcement Learning Tasks: CodeMidas created 5,545 executable tasks from 3,185 open-source repositories, removing the dependency on issues and commits.
  • Reasoning Gains in Translation Depend on the Context: Benefits vary by language, domain, and model. Longer reasoning does not consistently improve quality, so teams must weigh any gains against added latency and compute.
  • Machine Unlearning Needs Trajectory-Level Audits: A compliant final answer does not prove intermediate reasoning stayed private. A safe refusal also does not prove target knowledge left the model's parameters.
  • Skill Graphs Beat Long, Linear Instructions: GraphSkillEvo makes steps and branches explicit, reducing redundancy and raising average accuracy by 4.01% and 1.76% on two models.

Also Notable

  • MintAct Unifies UI Grounding, Cross-Platform Navigation, and Visual Tool Use: Watch whether general visual agents can reduce the need for separate systems for each scenario.
  • PrismAlign Constrains OCR With Multiple Views and Table Logic: It addresses structural errors separately from semantic hallucinations inside cells.
  • CompAdapt Targets Physical Consistency in Compound Motion: The test is whether tighter motion constraints preserve generation adaptability.
  • PointLAM Combines Local Attention and Mamba for Point-Based 3D Detection: It aims to reduce compute bottlenecks without sacrificing point-cloud geometry.
  • Latent Speech Representations Can Find Query-Relevant Transcript Segments First: Reusing ASR encoders could provide a lighter filtering stage for long-audio processing.
  • OmniVBench Unifies Evaluation for Mixed Reference-Video Controls: It covers more reference types and combined scenarios than existing benchmarks.
  • Cube-Splat Splits 360-Degree Video Into Fixed Cube Views: Consistent optimization extends Gaussian Splatting SLAM to panoramic cameras.
  • Digital Role-Playing Is Moving From Memory Recall to Contextual Behavior: This direction also calls for another look at authenticity in social-media personas.

Read the full edition →

Don't miss what's next. Subscribe to AI Research Brief:
← Newer Semantic Rewrites Shift 23 of 29 Review Metrics Older → 7B Searches the Web, BVB Recovers 53.7% of Facts
Powered by Buttondown, the easiest way to start and grow your newsletter.