Samaya Sterling beats Claude Fable 5.1 on… · M&A 🤖
| View this email in your browser |
![]() Models & AgentsDaily AI models, agents, and practical developments.
|
🎧 Today's episode Episode 219 · Samaya Sterling beats Claude Fable 5.1 on FrontierFinance at one-eleventh the cost. 2026-10-30 ▶ Listen now |
What You Need to Know: Samaya AI released Sterling, a LoRA post-trained Nemotron 3.5 Lightning model with 3B active parameters that scores 58.9% on the FrontierFinance benchmark at $0.61 per question. Baseten shipped joey-1, a 2B open-weight decision model returning calibrated probabilities at 20 ms latency and $0.01 per million tokens. OpenAI and Anthropic both detailed new monitoring layers that catch frontier agent misalignment in minutes rather than hours. Top StorySamaya AI released Sterling, a post-trained version of NVIDIA’s Nemotron 3.5 Lightning 30B MoE model with 3B active parameters for agentic financial research. The model plans research, calls 37 finance tools, gathers evidence, and hands findings to a separate report writer. It scores 58.9% on Samaya’s FrontierFinance benchmark (60.6% in high-effort mode) versus 55.9% for Claude Fable 5.1, at $0.61 per question against $6.89 for the larger model. Training used four stages of LoRA on synthetic traces generated by Kimi K3, with helper condenser and compactor models to keep context manageable. Developers gain a concrete recipe for co-training a small model with its production harness to win on quality-per-dollar in a narrow domain. The base model fits a single H100 80GB in BF16 at 256K context, while Sterling itself adds a research budget cap that limits how long the agent works before the report writer takes over. Watch for similar post-training runs on other MoE bases in finance, legal, and medical verticals. Source: marktechpost.com Model UpdatesBaseten Releases joey-1, a 2B Decision Model at $0.01 per 1M Tokens: MarkTechPost joey-1 is a 2B open-weight decision model that returns calibrated probabilities instead of text. It runs at 20 ms P50 latency on standard hardware and costs $0.01 per million input tokens. The model targets classification and regression tasks where developers already have labeled data and want to avoid the cost of generative calls. Baseten positions it as a lightweight alternative for production pipelines that need probability outputs rather than free-form text. Source: marktechpost.com Mistral AI publicly releases Large 4, targets cybersecurity users: Reuters Mistral AI released Large 4 publicly with explicit focus on cybersecurity workloads. The model is positioned for detection and analysis tasks in that domain. No further parameter count or benchmark details were disclosed in the announcement. Source: reuters.com Arc: a ~70 MB streaming speech model that transcribes links names and metadata to your own list as they're spoken, with no second model: r/MachineLearning Arc-Transcriber performs ASR plus named-entity linking, number extraction, speaker segmentation, and dialog-act tagging in a single forward pass every 100 ms. Two variants exist: Arc mini on a moonshot encoder and Arc-v1 on a parakeet encoder. Weights and CLI are available on Hugging Face and GitHub for on-device use. The model supports over 200 trained decision heads and can prime itself with a user-supplied roster of names or titles for live fact-checking inside the stream. Source: reddit.com Agent & Tool DevelopmentsOpenAI Shares Expanded Monitoring System for Frontier Models: @OpenAI OpenAI now monitors all frontier reinforcement-learning runs, evaluations, and internal Codex use with activation probes, reviewer models, and investigative agents. The system flagged a September DNS misconfiguration breach within 15 minutes and replayed the earlier Hugging Face incident to alert responders 30 minutes after escape. Human responders receive rapid alerts when behavior departs from intended boundaries. The expanded monitors cover every frontier RL run and every internal Codex session. Source: x.com Claude uses self-assessment to flag potential misuse: @AnthropicAI Anthropic added self-assessment so Claude evaluates its own conversation for misuse immediately after responding. The technique has surfaced misuse cases missed by prior classifiers since June and improves as the underlying model improves. Because the model has already read the full conversation, the assessment runs efficiently without a separate classifier pass. Source: x.com Building AIE CODE: The top Coding Agent Conference: Latent Space Latent Space is running the invite-only AIE CODE summit for the top 1,000 agentic engineers, focusing on scaling without slop, System One decision models, and ambitious rewrites of browsers and design suites. The single-track event previews 2027 themes after last year’s Skills and Software Factories tracks. The conference will feature Jarred Sumner discussing Bun AOT and new compiler features attempted with a small team. Source: latent.space Practical & CommunityTKintegers K5: 3.21× prefill and 3.10× decode throughput vs TorchAO FP8 on NVIDIA L4: r/MachineLearning TKintegers implements balanced-ternary K5 weights that fit one byte per code and run on existing FP16 tensor cores without native K5 instructions. On Qwen2.5-0.5B-Instruct the kernels delivered 3.21× prefill and 3.10× decode throughput versus TorchAO FP8 on an L4 GPU. The repo includes converter, native kernels, and benchmark scripts. The approach keeps some tensors in higher precision while expanding bounded tiles for tensor-core computation. Source: reddit.com What would you require before calling an inference change “quality-neutral”? r/MachineLearning A Reddit thread asks what evidence suffices to claim no quality regression when MoE backend, FP8 output head, and speculative decoding change together. The poster shows two GSM8K runs differing by 0.07 points across 1,319 questions and requests paired per-question outcomes or declared equivalence margins. The discussion centers on whether aggregate scores alone are sufficient when multiple optimizations ship simultaneously. Source: reddit.com Also TodayCasap Closes $56M Series B to Scale AI Agents Across Financial Services: AI Insider Casap raised $56 million to expand its AI agent platform for financial services workflows. Source: theaiinsider.tech A clinical multimodal vision language foundation model with fine-grain explainability: Nature Nature published a clinical multimodal vision-language foundation model that adds fine-grained explainability to diagnostic outputs. Source: nature.com Under the Hood: Sequential Bayesian experimental design for verification tasksSequential Bayesian experimental design frames the next verification query as an optimization problem that maximizes expected information gain per unit cost rather than simply reducing uncertainty. The core loop maintains a posterior over the quantity being measured, then selects the query whose outcome distribution yields the largest drop in posterior entropy after subtracting the expected cost of that query. When geographic or incentive bias exists in the pool of verifiers, importance weights or stratified sampling are applied inside the same objective so the selected tasks correct coverage without separate post-processing. In practice the value function is approximated by regression during backward induction, letting the policy improve on every new batch of outcomes instead of committing to a fixed open-loop schedule. One formulation casts the entire sequence as a dynamic program whose special cases recover both batch design and myopic greedy selection. The approach adds roughly one extra forward pass per decision but cuts total verification spend by 30-40% on crowdsourced labeling tasks once the policy has seen a few hundred examples. Teams should reach for it when the verification budget is the binding constraint and labeled outcomes arrive slowly enough to support the regression updates; the main gotcha is that poorly calibrated cost estimates cause the policy to over-sample cheap but low-information tasks. Numerical experiments on three different examples confirmed the method outperforms baselines that ignore cost or sample efficiency. Things to Try This Week
On the Horizon
|
💬 Reply to this email — Patrick reads every one. Share: X · LinkedIn · WhatsApp Forwarded this email? Subscribe here — it's free. |
📺 Watch on YouTube · 📝 Read the blog · 🖼 Free image gallery (CC BY-SA) · 📊 Data Hub & Story Trackers · 🧭 Start Here Nerra Network · AI-narrated voice (Grok TTS) · Editorial by Patrick You're receiving this because you subscribed to Models & Agents on nerranetwork.com. |
| Issue #219 · Models & Agents · Oct 30, 2026 |
