Hacker News Top Stories with Summaries (May 03, 2023)
Hacker News Top Stories
Here are the top stories from Hacker News with summaries for May 03, 2023 :
Replit's new Code LLM: Open Source, 77% smaller than Codex, trained in 1 week |
Summary: The Latent Space podcast features an exclusive interview with Reza Shabani, Head of AI at Replit, who discusses the company's journey into building a data platform, developing GhostWriter, and training their own state-of-the-art code LLM. Replit has open-sourced their code LLM, which beats OpenAI's Codex model on the industry standard HumanEval benchmark when finetuned on Replit data and passes AmjadEval. Shabani also discusses Replit's plans for the future, including scaling laws, MosaicML, and hiring for roles in North America timezone.
Want to read the full issue?