Zyphra ships ZAYA1-8B, an 8B MoE reasoning model with… · M&A 🤖
 Models & AgentsDaily AI models, agents, and practical developments.
|
🎧 If you only have 10 minutes this week Episode 42 · Zyphra ships ZAYA1-8B, an 8B MoE reasoning model with 760M active parameters that beats much larger open models on math and coding. 2026-05-07 ▶ Listen now |
| > **Zyphra ships ZAYA1-8B, an 8B MoE reasoning model with 760M active parameters that beats much larger open models on math and coding.**
**What You Need to Know:** Zyphra released ZAYA1-8B today, a compact reasoning Mixture-of-Experts model trained entirely on AMD Instinct MI300 hardware and open-sourced under Apache 2.0. It introduces a Markovian RSA test-time compute method that pushes performance close to DeepSeek-V3.2 while surpassing Claude 4.5 Sonnet on HMMT'25. Developers working on local or cost-sensitive reasoning workloads should test its inference efficiency this week.
> **---**
### Top Story
Zyphra released ZAYA1-8B, a reasoning Mixture-of-Experts model with only 760M active parameters that outperforms open-weight models many times its size on math and coding benchmarks. The model closes in on DeepSeek-V3.2 and surpasses Claude 4.5 Sonnet on the HMMT'25 benchmark using its novel Markovian RSA test-time compute method. It was trained end-to-end on AMD Instinct MI300 hardware and released under the Apache 2.0 license, emphasizing high intelligence density in the small-model category. Teams building local agents or edge reasoning tools can now experiment with strong math and coding performance without massive hardware. Watch for community fine-tunes and quantized versions that will likely appear on Hugging Face within days. Source: [marktechpost.com](https://www.marktechpost.com/2026/05/06/zyphra-releases-zaya1-8b-a-reasoning-moe-trained-on-amd-hardware-that-punches-far-above-its-weight-class/)
### Model Updates **NeuralBench: Meta AI** Meta AI open-sourced NeuralBench, a unified framework for benchmarking NeuroAI models across 36 EEG tasks and 94 datasets. It includes NeuralBench-EEG v1.0, the largest open EEG benchmark to date, covering 9,478 subjects and 13,603 hours of brain recordings evaluated under a single interface with 14 deep learning architectures. Researchers working on brain-signal models or multimodal grounding now have a standardized way to compare approaches. Source: [marktechpost.com](https://www.marktechpost.com/2026/05/07/meta-ai-releases-neuralbench-a-unified-open-source-framework-to-benchmark-neuroai-models-across-36-eeg-tasks-and-94-datasets/) **FREIA and APMPO: arXiv** Two new unsupervised and RLVR methods for LLM reasoning appeared on arXiv. FREIA uses Free Energy-Driven Reward and Adaptive Advantage Shaping to improve self-improvement without ground-truth labels, while APMPO introduces Power-Mean Policy Optimization and Feedback-Adaptive Clipping for better alignment with evolving model capabilities. Both show gains on mathematical reasoning benchmarks with small models like DeepSeek-R1-Distill-Qwen-1.5B and Qwen2.5-3B-Instruct. Source: [arxiv.org](https://arxiv.org/abs/2605.04065) ### Agent & Tool Developments **Pay.sh Gateway: Solana and Google Cloud** Solana and Google Cloud launched Pay.sh, a payment gateway designed specifically for AI agents. The system enables agents to handle transactions reliably at scale on the Solana network with Google Cloud infrastructure. Developers building autonomous economic agents can now integrate payments without custom wallet or compliance layers. Source: [Google News](https://news.google.com/rss/articles/CBMijgFBVV95cUxPaEhaSS1rc2NON2ROczNOMTBHU0lKLVJERG1jQy1VRFNOenAxTzBYZy1QN2FrejZmUjBWdDRTY3lVOUo3dEFHRTNTUm9fcjRlQjJjOVBUbGFRcnJMOVRuaVNaOHJ0NHMyWVFYS2d5T3ZrWjJVa2h1QTUtdk9uR2FkT2lJT0Z6djlOOXJSR3pn?oc=5) **Hatch AI Agent: Meta** Meta is developing “Hatch,” an AI agent paired with an Instagram shopping assistant. The project aims to compete directly with Google, Amazon, and TikTok Shop by giving consumers conversational, agent-driven shopping experiences inside Meta’s platforms. Early testers should watch for integration details in upcoming Instagram updates. Source: [Google News](https://news.google.com/rss/articles/CBMiwgFBVV95cUxPc2oyZ2F2ZUZNSlEtZ2ppQ0h0RVhuVmQ2TDByMHlwSTMwdGxINTlHVmFaV0NYNzZ5c0M0RWpsTTBoNjRpTFkxUjBTcHA1OUVPWnlnUTR0X0xJeWhCclpzSmFZWGpWRUNTcHg0WldPNnlxN3hhWndmaGR6M3VXc0hXMzJaSkhwVmtzY19hWnFGT21kaUZIVk5ZR0drLXNBeUlIT0djbkFHNWpUUm1Jb0VmXzIxOV85bHp4VFVIOXFCaUpsQdIBwgFBVV95cUxPc2oyZ2F2ZUZNSlEtZ2ppQ0h0RVhuVmQ2TDByMHlwSTMwdGxINTlHVmFaV0NYNzZ5c0M0RWpsTTBoNjRpTFkxUjBTcHA1OUVPWnlnUTR0X0xJeWhCclpzSmFZWGpWRUNTcHg0WldPNnlxN3hhWndmaGR6M3VXc0hXMzJaSkhwVmtzY19hWnFGT21kaUZIVk5ZR0drLXNBeUlIT0djbkFHNWpUUm1Jb0VmXzIxOV85bHp4VFVIOXFCaUpsQQ?oc=5) ### Practical & Community **robobun GitHub bot: Simon Willison** Simon Willison is live-blogging the Claude w/ Code event in San Francisco while highlighting robobun, the Bun project’s GitHub bot that has now made more contributions to the codebase than its creator Jarred Sumner. The bot demonstrates practical autonomous coding at scale on real open-source projects. Watch the live blog for implementation details and lessons on agentic code contributions. Source: [x.com](https://x.com/simonw/status/2052133374018699373) **Speculative decode combinations: r/LocalLLaMA** Users are discussing how to combine multiple speculative decoding methods (mtp and ngram) inside llama.cpp for agentic coding workloads. The thread notes that ngram excels at verbatim code repetition while mtp helps with novel generation, but current command-line handling activates only one at a time. The linked PR comment thread is the place to track upcoming fixes. Source: [reddit.com](https://www.reddit.com/r/LocalLLaMA/comments/1t63snn/why_llamacpp_cant_combine_speculative_decode/) ### Under the Hood: Combining Speculative Decoding Strategies Everyone talks about speculative decoding as if you simply pick one draft model and get free speed. In practice, different draft methods optimize for entirely different token distributions. Ngram drafts excel when the model is repeating previously seen code or structured output because they can propose long verbatim sequences in a single forward pass. MTP-style drafters instead learn to predict multiple future tokens from the same context, which helps on novel reasoning steps but adds overhead for exact repetition. Running both simultaneously requires careful KV-cache coordination and a merge step that decides which draft tokens to accept; current llama.cpp implementations short-circuit to whichever method is registered first. The latency win from ngram on repetitive agent tool calls can reach 2–3× on edit operations, yet the quality gain from MTP disappears once the model exceeds roughly 30B parameters because the draft model’s own error rate rises. The practical decision is therefore workload-dependent: use ngram alone for heavy code-editing agents and MTP for open-ended reasoning chains, or wait for the upcoming PR that adds a hybrid scheduler. ### Things to Try This Week - Test ZAYA1-8B on math or coding tasks with the Markovian RSA method to see how far an 8B model with 760M active parameters can go on your hardware. - Explore NeuralBench if you work with EEG or brain-signal data — the standardized 94-dataset suite removes the usual preprocessing headaches. - Watch Simon Willison’s live blog from the Claude w/ Code event for concrete examples of agentic coding bots like robobun in production. - Try combining ngram and mtp speculative decoding once the llama.cpp PR lands, especially on agentic edit-heavy workflows. ### On the Horizon - More details expected soon on the DeepMind–Eve Online research partnership focused on complex game environments. - Continued rollout of OpenAI’s Multipath Reliable Connection networking protocol for large-scale AI supercomputers. - Further agent payment and security tooling following today’s Solana/Google Cloud and Palo Alto/Portkey announcements. |
💬 Reply to this email — Patrick reads every one. |
Catch up on more Models & Agents: Nerra Network · AI-narrated voice (Grok TTS) · Editorial by Patrick You're receiving this because you subscribed to Models & Agents on nerranetwork.com. |
| Issue #42 · Models & Agents · May 7, 2026 |
Don't miss what's next. Subscribe to Nerra Network: