🔙 Throwback Thursday for 2025-02-06
Throwback to January 2025: the costly drama of distillation vs. hyperscale AI models!
🙏 And a big thanks to all our sponsors! 🙏
(Scroll to the end…)
One headline for a Thursday Throwback caught my eye.
Techmeme: Stanford and University of Washington AI researchers claim they trained AI reasoning model s1, distilled from a Gemini 2.0 model, for under $50 in cloud compute (Maxwell Zeff/TechCrunch)
By Maxwell Zeff / TechCrunch. View the full context on Techmeme.
Back in the ancient AI times of January 2025, the distillation meme was causing lots of hand wringing but probably cost more than $50 to unseat hyperscaler-size trained models.
Techmeme: The Allen Institute for AI releases Tulu 3 405B, an open source model that it claims outperforms DeepSeek V3 and OpenAI's GPT-4o on certain benchmarks (Kyle Wiggers/TechCrunch)
By Kyle Wiggers / TechCrunch. View the full context on Techmeme.
Note: Some images via Unsplash
Disclosure
I am linking to my disclosure.
Cuthrell Consulting LLCAttn: Jay Cuthrell1903 Live Oak St #92Beaufort, NC 28516-0092
To learn about sponsorship opportunities, contact us. 🤓
This section of the newsletter is meant to fund the services stack that enables readership growth and continue free editions to be published each week.
And now, a word from our sponsors
Note: This pseudo-randomized sponsored portion of the newsletter contains referral links that may financially benefit this newsletter.
NexusTek
NexusTek Secure Al Platform ensures organizations can safely unlock the productivity benefits of generative Al across any platform, while ensuring unmatched data security oversight, administration, and observability.
Buttondown
If you're looking for a great newsletter platform, I use and recommend Buttondown. Our readers can get $9 off your first month of Buttondown.
Linode
If you are looking for a reliable virtual private server with simple cloud billing math, I use and recommend Akamai Linode. Our readers can get a $100, 60-day credit on Akamai Linode.
⚠️ This content is not legal or financial advice. ⚠️