Distilled Thoughts
Subscribe
Archives
The absurd amount of energy LLMs use
January 30, 2025
Let's say you want to use the full DeepSeek-R1 LLM on your machine. The full model uses about 1300 GB of RAM on the GPU for any reasonable performance....