Summary: A leaked document from a Google researcher suggests that OpenAI and Google's efforts to build the most powerful language models are being rapidly eclipsed by the work happening in the open-source community. While Google's models still hold a slight edge in terms of quality, the gap is closing astonishingly quickly. Open-source models are faster, more customizable, more private, and pound-for-pound more capable. The document explains how much innovation happened in the open-source community following the release of Meta's LLaMA model in March, and how they have solved the scaling problem to the extent that anyone can tinker. The author is extremely bullish on LoRA, a technique that allows models to be fine-tuned in just a few hours of consumer hardware, producing improvements that can then be stacked on top of each other.