LM Studio

Over the weekend, I had an amazing opportunity to participate in the On-Device AI Builders Hackathon by LM Studio, Qualcomm Snapdragon, ONNX Runtime, and Microsoft here at NYU Tandon School of Engineering. The hackathon brought together 20 teams who would push the limits of local AI on Snapdragon PCs, and I am very excited to share that our team won! Our project was a local legal document analyzer, built to identify risks and analyze contracts efficiently—all on-device with the help of LM Studio APIs and the Snapdragon X Elite processor with a dedicated NPU. It was exhilarating to bring an idea to life with cutting-edge tech while working alongside brilliant minds. The event was packed with hands-on collaboration with engineers from Qualcomm, Microsoft, and LM Studio. To top it off, winning means future opportunities with these amazing companies and, yes, we get to keep the Snapdragon laptops we hacked on! 💻 I never imagined myself not just participating in a hackathon but also winning one—and this experience has been nothing short of inspiring. It’s a reminder that stepping out of your comfort zone can lead to incredible growth and unexpected wins. Thank you to the organizers, mentors, judges, and my incredible teammates. This is just the beginning, and I’m excited to see where this journey leads! 🚀 #Hackathon #AI #OnDeviceAI #Innovation #Grateful #LearningExperience

The future of local llm builders in NYC is bright. Hackers up and early at the LM Studio hackathon @ NYU Tandon School of Engineering. This is who you are competing with.

Happy Friday: Llama 3.3 70B from Meta was just released! Notable: Matches the performance of the much larger Llama 3.2 405B 🚀 🤩 Get it in LM Studio: https://lnkd.in/eahDnwXf

🚨 Attention AI Developers! 🚨 Join Qualcomm, Microsoft, and LM Studio for an AI hackathon in NYC this weekend at New York University. Your mission, if you choose to accept it, will be to build an edge AI application using LM Studio and ONNX that runs on a Snapdragon X Elite laptop. The best part? You get to keep the laptop! The Luma link to register is in the quoted post. Hope to see you there, it's sure to be an amazing time!

Hello ~builders~ if you're into local AI and making cool stuff, LM Studio is hosting a hackathon on Dec 7-8 at NYU 🛠️👾 We’re looking for cracked teams (or solo devs ready to team up) to build on-device AI apps using Snapdragon hardware. But here's the twist: if you complete the app, you keep the laptop 😱🤝 There's room for 20 teams and spots are limited (you get to keep the laptop, not sure if you remember), so sign up now 💻🏃🏻🏃🏽♀️🏃🏻🏃🏽♀️ https://lu.ma/41hfiu79

📣🦇🗽 NYC LLM hackers, this is your bat signal We're hosting a builders-only on-device AI hackathon in NYC. There's room for 20 cracked teams. You get to keep the device. - Local AI on device - Windows on ARM (Snapdragon) - 🗓️ Dec 7 - 8 @ NYU Sign up using the luma link: https://lu.ma/41hfiu79 ONNX Runtime Qualcomm Microsoft Developer

WOW check this out it’s LMStudio.ai running ENTIRELY locally on an NPU from Qualcomm

Meta Llama 3.2 running on NPU 👀 We’ve been working closely with the ONNX Runtime team + Qualcomm to bring NPU support to LM Studio! H/t to Matthew Clayton and Natalie Kershaw for pulling this off in record time. Thanks Manoj Khilnani Devang Aggarwal Manish Sirdeshmukh for the partnership. In the picture: Snapdragon NPU doing the hard work during a session demo at Microsoft Ignite in Chicago this evening. It’s currently an engineering build, and the team is working to get ready it for release soon, stay tuned.

🤯 It’s crazy what you can achieve with a MacBook, LM Studio and Apple MLX running Mistral AI Pixtral while on a plane!!!

Huge news for local coding LLMs 🚀: Qwen 2.5 Coder 0.5B, 1.5B, 3B, 14B, and 32B are here! The 32B version scores higher than GPT-4o on Aider's code editing benchmark. Get it from the model page: https://lnkd.in/ey6ZCXFy Congrats to Junyang Lin and the rest of the Qwen team!