PyTorch’s Post

My first real post on substack. How to solve an annoying error on Windows when using CTranslate2 and pytorch at the same time. Useful for me to remember in the future and hopefully useful for some of you! #substack #softwaredevelopment #deeplearning #dependencies

Open source model weights are critically important for transparent AI research and the future of humanity. Closed source AI has more inherent risks, including with safety and alignment for obvious reasons. And it’s all made possible by, built with and using open source - each macbook os is based on oss netbsd, most ai/ml code is written in oss c/python, hosted on oss gnu/linux vms/containers using oss k8s and oss docker, code compiled with oss compilers, running oss llm/fm models etc.

Will you be with us in San Francisco for PyTorch Conference from September 18-19? This is your chance to meet & exchange ideas with fellow AI innovators & PyTorch trailblazers and shape the world of open source. Be there! Register by July 12 & save US$250: https://hubs.la/Q02ByhdZ0. #PyTorchConf #PyTorch #PyTorchFoundation #AI #MachineLearning #ML #DeepLearning #OpenSource #OpenSourceSoftware #OpenSourceDevelopment #OpenSourceCommunity #OSS #LinuxFoundation #events #linux #software

🔥 Elevate Your Deep Learning Game with CUDA and cuDNN! 🚀 Ready to turbocharge your machine learning workflows? Dive into my latest blog where we demystify CUDA and cuDNN installation for blazing-fast performance. Unlock the Power: Step-by-step guide for CUDA and cuDNN setup Seamless integration for GPU-accelerated computing Don't miss out on the speed and efficiency gains! Read now. #cuda #deeplearning #generatieveai #llm #windows11 #python #tensorflow #gpu #nvidia

TorchChat is a new Ollama wannabe from the folks behind PyTorch, the machine-learning library. TorchChat allows you to download and run LLMs locally. In my latest blog, I show you how to set it up and see how it performs. https://lnkd.in/eAJ5YA4c

Arm Compiler for Linux 24.04 is now available, offering improvements on SPECcpu(r)2017. We're also release Arm Performance Libraries 24.04, with a new Random Number Generator, useful for #ML in #PyTorch.

Arm Performance Libraries now has RNGs!  See how great these are are for #ML in #PyTorch and many more performance improvements in both ArmPL and ACfL by reading more on our 24.04 blog.

Open Source Solutions Advance with torchchat PyTorch has introduced torchchat, a new library designed to accelerate local large language model (LLM) inference, on various devices including laptops, desktops, and mobile phones. The library supports running models like Llama 3 and 3.1 efficiently across different environments. Torchchat offers Python, C++, and mobile implementations, providing a REST API, desktop-friendly binaries, and on-device inference capabilities. It showcases impressive performance metrics for Llama 3 8B Instruct model across different hardware configurations, including Apple M1 Max, Linux x86 with CUDA, and mobile devices. The tool aims to empower developers to run LLMs locally on constrained devices, opening up new possibilities for generative AI applications. https://lnkd.in/gXGYVjuC

We're thrilled to announce 2️⃣ mini-summits @ #PyTorchConf, taking place in San Francisco from September 18-19! Deep dive into these info-packed events covering DL Compiler & Fine Tuning, both critical technology areas covered by community experts. 📑 Get all the deets: https://hubs.la/Q02L6VXz0. 🔭 Explore the full schedule: https://hubs.la/Q02L6F_c0. 💻 Register for the event: https://hubs.la/Q02L6FbH0. #PyTorch #PyTorchFoundation #AI #MachineLearning #ML #DeepLearning #OpenSource #OpenSourceSoftware #OpenSourceDevelopment #OpenSourceCommunity #OSS #LinuxFoundation #events #linux #SoftwareSupplyChainNews

I recently participated in the Data Structures and Algorithms Workshop conducted by Vimal Daga Sir at Linux World. This enriching experience not only deepened my understanding of core DSA concepts but also enhanced my problem-solving skills. A big thank you to Vimal Daga Sir for his insightful guidance and for making complex concepts so approachable. I'm looking forward to applying these learnings to real-world challenges and further sharpening my technical skills. #Achievement #DataStructures #Algorithms #LearningJourney #LinuxWorld #VimalDaga #SkillDevelopment