Send me a cool thing you read this week!

https://chatjimmy.ai/ https://taalas.com/the-path-to-ubiquitous-ai/:

"Taalas serves Llama 3.1 8B at 17,000 tokens/second This new Canadian hardware startup just announced their first product - a custom hardware implementation of the Llama 3.1 8B model (from July 2024) that can run at a staggering 17,000 tokens/second.

I was going to include a video of their demo but it's so fast it would look more like a screenshot. You can try it out at chatjimmy.ai.

They describe their Silicon Llama as “aggressively quantized, combining 3-bit and 6-bit parameters.”" - simon wilson's weblog

https://freemocap.org/: This is SO COOL. "We're building a user-friendly framework that connects an array of bleeding edge open-source tools from the computer vision and machine learning communities to accurately record full-body 3D movement of humans, animals, robots, and other objects."

https://aimilios.bearblog.dev/reverse-engineering-sleep-mask/: Claude code hacks sleepmask, finds user's brainwaves. "I recently got a smart sleep mask from Kickstarter. I was not expecting to end up with the ability to read strangers' brainwaves and send them electric impulses in their sleep. But here we are."