Cerebras Systems

🚀 Llama 3.1 405B now runs on Cerebras Inference at 969 tok/s, a new world record! Highlights:  • 969 tokens/s – this is frontier AI at instant speed • 12x faster than GPT-4o, 18x faster than Claude, 75x faster than AWS • 128K context length with 16-bit weights • Industry leading time-to-first-token: 240ms This year we pushed Llama 3.1 8B and 70B to over 2,000 tokens/s, but frontier models are still stuck at GPU speed. Not anymore. On Cerebras, Llama 3.1 405B now runs at 969 tokens/s—code, reason, and RAG workflows just got 12-18x faster than closed frontier models. Cerebras Inference for Llama 3.1 405B is in customer trials today with general availability coming in Q1 2025, priced at $6/million tokens (input) and $12/million tokens (output). Frontier AI now runs at instant speed on Cerebras. #Llama #Inference #AI Read more here: https://lnkd.in/g-RGjf9Q

Thank you to Zetta Venture Partners for hosting and giving me the opportunity to give a keynote talk at the #AINative2024 conference! Cerebras Systems now powers the faster frontier model on the planet. Llama 405B at 969 tokens/s. This is GPU impossible performance! To learn more about how Cerebras Systems can enable your next generation AI application, check out https://lnkd.in/guwS5mbV #ai #ml

At the Supercomputer Show this week, Cerebras Systems announced the fastest inference for Llama3.1 405B in the industry, a whopping 969 tokens per second...the interest was overwhelming....thank you to the hundreds of people who visited our booth.

Nothing excites us more than seeing what people are able to build on Cerebras. We are grateful for our partners at #LLNL, Los Alamos National Laboratory and Sandia National Laboratories with whom we get to peer into the future and do the impossible.

From breaking a few world records to a packed happy hour, we couldn't have asked for a better time at #SC24. Thank you for helping us take Cerebras to the next level. We hope to see you all next year! If you missed us at the conference, no problem, you can reach out to us any time: https://lnkd.in/ge74WNtj

#SC24 is a wrap! We kicked off the conference announcing new records in Llama inference and molecular dynamics (our fourth Gordon Bell finalist in a row!) Over the course of the week, Cerebras and the broader community presented five accepted papers and posters powered by our hardware. We also showcased the power of wafer-scale at Argonne Leadership Computing Facility's tutorial on AI accelerator inference, and our recurring BoF on using AI accelerators for HPC applications. A huge thank you to the incredible work done every day by everyone at Cerebras, and all our partners, collaborators, and friends. A special shoutout to Michael James, Sivasankaran Rajamanickam, and their teams at Cerebras Systems and Sandia National Laboratories on their groundbreaking Gordon Bell finalist in molecular dynamics! See everybody next year! #IAmCerebras

"I am excited to join the Cerebras team and help guide this visionary company as it revolutionizes AI compute. Cerebras is uniquely positioned to transform the pace and innovation of AI workloads, and I look forward to contributing to its continued success as it defines the future of computing." Please join us in welcoming Thomas (Tom) Lantzsch to Cerebras Board of Directors to help advance our AI compute leadership. Read more here: https://lnkd.in/gwF_FwPy

The NeurIPS Navigator: A Behind the Scenes Look, Powered by Cerebras Inference ⚡ How do you create RAG app that turns 4,500+ research papers from the 2024 NeurIPS Conference? Dive into how we processed PDFs, created embedding chunks and stored it in on Postgres in a performant way. Created by our Fellow Isaac Tai Read more here: https://bit.ly/4fUOf8m

We are proud to take home the title of Best #AI Product or Technology - Editor's Choice in 2024 HPCwire Readers’ and Editors’ Choice Awards Thank you Cerebras team for your passion and continued hard work! See what we've been up to: cerebras.ai

👏 🏆 🏆 Double the applause please for the winners of TWO 2024 HPCwire  Readers’ and Editors’ Choice Awards 1/2 Winner of Best Use of #HPC in Physical Sciences – Editors’ Choice - Congratulations to the teams from Cerebras, Sandia National Laboratories Lawrence Livermore National Laboratory, Los Alamos National Laboratory and the National Nuclear Security Administration (NNSA) for their incredible breakthrough in the world of molecular dynamics. Read more about their paper: https://lnkd.in/e4WFqh49