Beam

It's been a crazy year! For our last release of 2024, we shipped: ⚒️ 𝐌𝐮𝐥𝐭𝐢-𝐆𝐏𝐔 𝐖𝐨𝐫𝐤𝐞𝐫𝐬 You can now run workloads across multiple GPUs! This lets you run workloads that might not fit on a single GPU. For example, you could run a 13B parameter LLM on 2x A10Gs, which normally would only fit on a single A100-40. ⚡️𝐈𝐧𝐬𝐭𝐚𝐧𝐭𝐥𝐲 𝐖𝐚𝐫𝐦 𝐔𝐩 𝐂𝐨𝐧𝐭𝐚𝐢𝐧𝐞𝐫𝐬 We added a "Run Now" button to the dashboard to instantly invoke an app and warm up the container. 🚢 𝐈𝐦𝐩𝐨𝐫𝐭 𝐋𝐨𝐜𝐚𝐥 𝐃𝐨𝐜𝐤𝐞𝐫𝐟𝐢𝐥𝐞𝐬 We wanted to make it easier to use existing Docker images on Beam. You can now use a Dockerfile that you have locally to create your Beam image. 🔑 𝐏𝐚𝐬𝐬 𝐒𝐞𝐜𝐫𝐞𝐭𝐬 𝐭𝐨 𝐈𝐦𝐚𝐠𝐞 𝐁𝐮𝐢𝐥𝐝𝐬 You can now pass secrets into your image builds, useful for accessing private repos or running build steps that require credentials of some kind. 𝐀𝐧𝐝 𝐰𝐞'𝐯𝐞 𝐠𝐨𝐭 𝐬𝐨𝐦𝐞 𝐚𝐦𝐚𝐳𝐢𝐧𝐠 𝐧𝐞𝐰 𝐟𝐞𝐚𝐭𝐮𝐫𝐞𝐬 𝐜𝐨𝐦𝐢𝐧𝐠 𝐢𝐧 𝐉𝐚𝐧𝐮𝐚𝐫𝐲.  It's been an excited year, and we can't wait to ship more stuff for you in 2025. Happy New Year!

✨ Launch Week, Day 5️⃣ It's the final day of MEGA LAUNCH WEEK! Today we're shipping a CLI for our self-hosted users to manage their Beam cluster. At Beam, we run a globally distributed cloud, with a lot of GPUs. We're constantly adding hardware to keep up with demand. And if you self-host Beam, you'll have access to the same tools we use to add GPU capacity internally. For more details on the new CLI (and a breakdown of how we add GPU capacity), make sure to check out our blog! Link below 👇

Launch Week, Day 4️⃣ Today we're launching our Javascript SDK. This makes it even easier to integrate Beam into your next.js or React apps. With the Javascript SDK, you can... ✅ Invoke deployed apps ✅ Open realtime websocket connections ✅ Retrieve the status of a running task ✅ Cancel tasks The SDK makes it easy to do all of these things without having to write any boilerplate! More details in our blog post, linked below 👇

It's Day 3 of our Mega Launch Week, and we're shipping our biggest feature of the week. Today we're releasing Beam Bots. It's a new bot framework with sandboxed compute and concurrency built-in. We get it, you've seen hundreds of agent frameworks. But this one is different. Using Beam Bots, you can... ✅ Build research analysts to lookup 1,000s of companies ✅ Deploy automated customer support agents that can multi-task ✅ Run any agent task on a GPU-backed container ✅ Execute untrusted agent code in sandboxed compute environments Bots are available today, and you can start building right away. We'll link to the documentation in the comments below 👇

Launch Week, Day 2 It's Day 2 in our MEGA LAUNCH WEEK with Supabase, PropelAuth, Magic Patterns, Jamsocket, and more. Today we're releasing realtime apps ✨ By using realtime, you can: ✅ Deploy serverless websockets with SSL ✅ Handle hundreds of concurrent requests ✅ Built interactivity into your apps Customers are already using realtime to deploy realtime transcription apps with OpenAI Whisper, streaming LLM responses with Mistral AI models, and much more!

🎁 Launch Week, Day 1️⃣ Welcome to the first launch in our first-ever launch week! Today we're releasing our new vLLM engine. We've built the vLLM serving engine directly into the Beam SDK: ✅ Run vLLM models on the cloud with one command ✅ Deploy vLLM inference endpoints ✅ Scale out to 100s of GPUs ✅ Automatic scale-to-zero vLLM is available in the Beam SDK today, and you can check out our docs for an end-to-end tutorial (link in comments)

⚡️ Realtime serverless backends, made easy We just made it a lot easier to build real-time apps on Beam Just add a @realtime decorator to your Python code and you'll get... 🔐 SSL-terminated websocket URL 🎛️ Job concurrency 🚀 GPU support 🌎 Globally distributed file storage Give it a try 👉 https://lnkd.in/ebPEUkSy

Changelog, July 11, 2024 📊 Show historical containers running over time 🎛️ List available GPUs in the CLI 🔢 Versioned URLs 🎨 LoRA Deployment Guide Read more here: https://lnkd.in/eQaz8KQV

Changelog, June 24, 2024 🎛️ Autoscale by queue depth in V2 🗂️ Move files in volumes with the CLI 🔐 Login to CLI with `beam login` 🍻 Install CLI binary with Homebrew 🌠 Generate pre-signed URLs from PIL images Read more here: https://lnkd.in/gJcVgvu6

Changelog, June 14, 2024 ☁️ Self-host Beam on Crusoe 🔐 CLI to Manage Secrets 🌠 Improved Workflow for Saving Files Read more here: https://lnkd.in/eFa4NDyh