d-Matrix

🔴 Welcome to a new world! Today, d-Matrix introduces Corsair, the first-of-its-kind AI compute platform. 60,000 tokens/sec at 1 ms/token latency for Llama3 8B in a single server, 30,000 tokens/sec at 2 ms/token latency for Llama3 70B in a single rack.  Corsair shines with ultra-low latency batched throughput! Ideal for tomorrow’s use cases where models will “think” more. Supercharging reasoning, agents and video generation. Celebrated with a toast at SC'24. Onwards and upwards! #dmatrix #corsair

Apparently, we are HOT 🚀    Thank you to CRN's Dylan Martin for naming d-Matrix to ‘The 10 Hottest Semiconductor Startups Of 2024’   We smash the memory bandwidth barrier for generative Al inference workloads with our novel Digital In-Memory Compute Architecture (DIMC). Now sampling with customers. Check it out here: https://lnkd.in/gQK86sbW #CRN #semiconductor #dmatrix

What an incredible week at #SC24 in Atlanta!      We sat down with John Furrier to extract the signal from the all the innovation around AI infrastructure and Gen AI at SiliconANGLE & theCUBE to close out the show. In twenty minutes, our CEO & Founder Sid Sheth delves into the trends in AI that are demanding a new architecture and breaks down inference.     AI has to be fast. d-Matrix’s new Corsair is built specifically for that as modern workflows and Gen AI demand real-time, multi-user interactive reasoning. Based on our unique memory-compute integration, we deliver multi-user low latency batched inference throughput for highly interactive AI.  30,000 tokens/sec at 2 ms/token & latency for Llama3 70B in a single rack + 60,000 tokens/sec at 1 ms/token latency for Llama3 8B in a single server.     With d-Matrix Corsair, we are making AI attainable for the enterprises, finally.  #dMatrix #AI #Inference https://lnkd.in/gZbZ645f 

That's a wrap. A successful launch. A successful show. And lots of time spent meeting customers in Atlanta's #SC24. We are delighted to bring the first AI Inference computing platform with blazing fast interactive performance and efficiency! See you in St. Louis in #SC25... #dmatrix #AI

We had the back stage view of Sid Sheth sitting down and talking d-Matrix's new architecture with the one and only John Furrier of SiliconANGLE & theCUBE while at #SC24. Got to talk AI inference chips, and how reasoning and inference are changing the infrastructure we all use .. and how d-Matrix is focused on delivering efficient AI with low latency, batched throughput solutions. We've been doing it quietly for a while but now it's available to enterprises, datacenters and on-prem. Interview out soon! #AI #Inference #hardware

Showing off the first d-Matrix Corsair inference server at #SC24! 60,000 tokens/sec at 1 ms/token latency for Llama3 8B in a single server. Ultra-low latency batched inference throughput for highly interactive LLMs, reasoning agents, and video generation. What will you create? #dmatrix #SC24

🎵 Start Spreading the News ... 🎵  d-Matrix's new Corsair just made its debut in Times Square!  From stealth mode to the big screen we are rolling out our revolutionary new AI inference computing platform, built on four industry-changing firsts. Proud moment for all of us at d-Matrix! Excited for our first customer deployment. Stay tuned.   Nasdaq #Itshowtime #dmatrix

Thank you to The Associated Press - Barbara Ortutay, Jeff Chiu & Matt O'Brien for going "Under The Hood" with d-Matrix right before launching our new Corsair designed for AI inference. Happy to have you crawling through our lab before go-live! "... once trained, a generative AI tool still needs chips to do the work — such as when you ask a chatbot to compose a document or generate an image. That’s where inferencing comes in. A trained AI model must take in new information and make inferences from what it already knows to produce a response. GPUs can do that work, too. But it can be a bit like taking a sledgehammer to crack a nut. “With training, you’re doing a lot heavier, a lot more work. With inferencing, that’s a lighter weight,” said Forrester analyst Alvin Nguyen." Awesome writeup. https://lnkd.in/g6KunHA7

🔴 Welcome to a new world! Today, d-Matrix introduces Corsair, the first-of-its-kind AI compute platform. 60,000 tokens/sec at 1 ms/token latency for Llama3 8B in a single server, 30,000 tokens/sec at 2 ms/token latency for Llama3 70B in a single rack.  Corsair shines with ultra-low latency batched throughput! Ideal for tomorrow’s use cases where models will “think” more. Supercharging reasoning, agents and video generation. Celebrated with a toast at SC'24. Onwards and upwards! #dmatrix #corsair

It's getting close. In 3 days we take the covers off the world’s most efficient platform built from the ground up for #AI inference at scale. Join us in Atlanta to celebrate d-Matrix's new Corsair at #SC24. 🚀