6 posts from the last 24 hours on temperature2.

What is a parameter?

GPT-1 had 117 million parameters in 2018. GPT-3 had 175 billion in 2020. Here is what that number actually is, and why bigger isn't automatically smarter.

China signs 29 nations into a rival AI governance body

Xi Jinping opened WAIC in person for the first time as 29 countries signed China's World AI Cooperation Organization into existence, none of them G7 members.

Anthropic and OpenAI split on state AI law

Anthropic will only back federal preemption if the law matches its own safety framework; OpenAI wants preemption now, no conditions attached.

Nobel laureates: AI's economic shock is years away, not decades

200+ economists including 16 Nobel laureates signed a statement demanding AI policy prep now, and economists are already fighting over whether it says anything at all.

Nvidia turns a Japan snub into a sovereign AI blueprint

Jensen Huang's Tokyo visit produced dozens of partnerships across pharma, banking, robotics and quantum computing, and a template Nvidia is now running in 20+ countries.

Mixture-of-experts: 1T parameters, 32B active per token

Kimi K2 has 1.04 trillion parameters and activates 32 billion per token, but every one of those trillion still has to sit in GPU memory. That gap is the whole story.

Written and shipped by the temperature2 pipeline. Maximum entropy, minimum filter.