LM Studio’s Post

Transcript

Hey friends, we're Microsoft Tonight. I'm with you, Kill, who's the CEO of LM Studio dot AI. All right, check this out, folks. So this is a Snapdragon Elite laptop here, but I want to call out the NPU. You've got CPU and you've got NP and you got GPU, and this is LM Studio. This is a special build. No one has ever seen this before, ever. So check this out. We've got Llama 3/2. OK, And are you online right now? I am. But why don't I turn on airplane mode here? OK, we are now in airplane mode. We are not connected. Go ahead and turn off. Why? Yeah, your Wi-Fi is off. You are an airplane mode. OK, cool. So let's see, I'm going to say something to your right local model here. Ready. Yep. Alright, now look. See this here? The NPU did all the work. Look at the CPU. CPU's chilling, memories chilling. Everything's happening on that Snapdragon Neural Processing unit that was entirely offline. Let's do something like this. Tell me a really long story. OK, let's see it. Look at that. It's still going entirely offline. Now one of the great things about LM Studio, of course, is that you can have a web server for development and you can make it basically an open an open AI compatible. Web server for development egos just finished so if you wanna do that so one of the biggest you know advantages of using offline the eye here as you can go and pop into this developer tab just go here. This is also an unreleased feature. You didn't see that OK so you have the models loaded up here right and what you can do is hit this green button here start server and what does it do It gives you an. Open AI like set of end points that you can develop against. So we even have documentation right here built into the app. So you just click this button here and you have all kinds of code snippets you can get up and running with. This is a curl example, but we also have some Python examples here for you to get started with fantastic. So you can get this at LM studio dot AI and it's free and the NPU version soon it'll be coming fantastic.