Agents Score 58.1%, but Only 2.8% Pass Every Test
- Hybrid Agents Can Rebuild Interfaces but Still Cannot Deliver Reliably: RecreationWorld joins exploration, coding, execution, and visual review in one loop. The leading model scored 58.1% overall, but only 2.8% of tasks passed every programmatic test.
- Working Code Can Generate Reinforcement Learning Tasks: CodeMidas created 5,545 executable tasks from 3,185 open-source repositories, removing the dependency on issues and commits.
- Reasoning Gains in Translation Depend on the Context: Benefits vary by language, domain, and model. Longer reasoning does not consistently improve quality, so teams must weigh any gains against added latency and compute.
- Machine Unlearning Needs Trajectory-Level Audits: A compliant final answer does not prove intermediate reasoning stayed private. A safe refusal also does not prove target knowledge left the model's parameters.
- Skill Graphs Beat Long, Linear Instructions: GraphSkillEvo makes steps and branches explicit, reducing redundancy and raising average accuracy by 4.01% and 1.76% on two models.
Also Notable
- MintAct Unifies UI Grounding, Cross-Platform Navigation, and Visual Tool Use: Watch whether general visual agents can reduce the need for separate systems for each scenario.
- PrismAlign Constrains OCR With Multiple Views and Table Logic: It addresses structural errors separately from semantic hallucinations inside cells.
- CompAdapt Targets Physical Consistency in Compound Motion: The test is whether tighter motion constraints preserve generation adaptability.
- PointLAM Combines Local Attention and Mamba for Point-Based 3D Detection: It aims to reduce compute bottlenecks without sacrificing point-cloud geometry.
- Latent Speech Representations Can Find Query-Relevant Transcript Segments First: Reusing ASR encoders could provide a lighter filtering stage for long-audio processing.
- OmniVBench Unifies Evaluation for Mixed Reference-Video Controls: It covers more reference types and combined scenarios than existing benchmarks.
- Cube-Splat Splits 360-Degree Video Into Fixed Cube Views: Consistent optimization extends Gaussian Splatting SLAM to panoramic cameras.
- Digital Role-Playing Is Moving From Memory Recall to Contextual Behavior: This direction also calls for another look at authenticity in social-media personas.
Don't miss what's next. Subscribe to AI Research Brief: