AI Research Brief

Archives
Log in
Subscribe
October 10, 2026

Token Routing Lifts Decode Throughput by 2.01–64.15x

  • Token-Level Routing Breaks Existing Batching Assumptions First: TokenRouter separates request-level routing logic from asynchronous per-model execution, raising decode throughput by 2.01–64.15x across routing methods, workloads, and model combinations.
  • Practice Worlds May Set the Ceiling for Agent Capabilities: AgentGarten connects verifiable programmatic state with a shared neural renderer through one interface. Its “four rounds versus millions” result compares different learning methods, so it is not a direct sample-efficiency ratio.
  • Mixed-Modality Retrieval Falls Into a V-Shaped Trough: Text representations may receive an inherent scoring advantage, making irrelevant text more damaging than the same amount of irrelevant imagery. Stress-test real modality ratios and noise patterns before launch.

Also Notable

  • Test Cross-Task, Cross-Scene Navigation Without Fine-Tuning — SuperNav assigns understanding and decision-making to a general multimodal model, then delegates movement to specialized tools.
  • Spatial Markers Resolve Which Object to Edit — VibeEdit uses instructions placed on a two-dimensional canvas to identify targets among several similar objects.
  • Poster Generation Moves From Linear Prompts to Spatial Composition — Compo expresses two-dimensional composition through explicit semantic, identity, text, and pixel bindings.
  • The Best of 58 Reasoning-Based Editors Reaches Only 56.6% Accuracy — RISEBench++ covers six reasoning dimensions and 1,000 human-annotated test cases.
  • More Recurrent Transformer Steps Are Not Always Better — InfiLoop preserves reliable intermediate states with recurrence-aware residuals and keeps improving beyond 20,000 effective steps on Sudoku-Extreme.
  • Natural-Text Pruning Calibration Misses Real Decoding Activations — SparseDecoding calibrates for generation and optimizes its SpMV kernel, delivering up to 1.48x end-to-end decoding speedup on an A100.
  • Half the Visual Tokens Retain 99.5% of Performance — V-CoLA redesigns token selection and merging for linear attention, accelerating prefill by 1.86–6.15x.
  • Visual Attention Sinks Change Across Network Depth — The first and last layers repeatedly attend to fixed regions, while middle layers respond to the question. This creates layer-specific intervention points for reducing hallucinations.
  • Turning Off “Thinking Mode” Does Not Stop Explicit Reasoning — Open-ended questions most clearly expose persistent reasoning habits and the tradeoff between concise answers and accuracy.
  • RAG Context Does Not Necessarily Reduce Training-Data Leakage — It lowers exposure for some examples near the memorization threshold, yet can make previously inaccessible samples extractable.
  • Just 197 In-Domain Proteins Can Improve Generation — RefineMix uses out-of-domain data at selected discrete-diffusion timesteps to improve generalization without biasing the sampling distribution.
  • Change Cameras at Deployment Without Explicit 3D Reconstruction — VersaCamVLA compresses any camera set into fixed-size scene tokens, then injects them into a pretrained VLA policy.

Read the full edition →

Don't miss what's next. Subscribe to AI Research Brief:
← Newer Artisan Posts Lowest Collision Rate Across 10+ Representative Models Older → Causal Pretraining Makes Long Robot Context Pay Off
Powered by Buttondown, the easiest way to start and grow your newsletter.