Summary: Stability AI has launched an open-source language model called StableLM, which can generate text and code and will power a range of downstream applications. The Alpha version of the model is available in 3 billion and 7 billion parameters, with 15 billion to 65 billion parameter models to follow. StableLM is trained on a new experimental dataset built on The Pile, three times larger with 1.5 trillion tokens of content. The richness of this dataset gives StableLM surprisingly high performance in conversational and coding tasks, despite its small size of 3 to 7 billion parameters. The release of StableLM builds on the company's experience in open-sourcing earlier language models with EleutherAI, a nonprofit research hub.