Brian Rinaldi’s Post

While developing Gen AI based application, it is important to design the telemetry, logging and observability component of the solution also. In the below recording, I show how bedrock and cloud watch can be integrated https://lnkd.in/gC4mSPir

We discuss our motivations for writing 'The Value Flywheel Effect,' and our insights on navigating the cloud transformation journey, highlighting the importance of collaboration, upskilling & luck in overcoming challenges. Watch our latest episode now: https://lnkd.in/eZcEaAXv

We had a great #kubecon EU 2024, the excitement around DRA was unparalleled with GenAI use cases bringing next wave of changes on the Kubernetes platform. We want to work with the community for such enhancements and make AI workloads as the first class citizens on top of Kubernetes. If you would like to know our experimental learnings on using DRA please refer to our talks: Unleashing the Power of DRA (Dynamic Resource Allocation) for Just-in-Time GPU Slicing : https://lnkd.in/eefA3Hwh Best Practices for LLM Serving with DRA: https://lnkd.in/e8dTdFdp #kubernetes #GenAI #cloud #HPC #resourcemanagement #lavieenparis 

"Achievement unlocked! 🚀 Finished Analyze Images with the Cloud Vision API, diving deep into image analysis and machine learning. Can’t wait to apply these skills to create innovative visual solutions! #VisionAPI #ImageRecognition #AIForGood"

K8s + ML = Kubeflow! This CNCF project makes #artificialintelligence and #machinelearning simple, portable, and scalable. If you have struggled with managing workflows or scaling your models, this might be what you need. Check it out and consider contributing: kubeflow .org Oh, and don’t miss the Kubeflow Summit, a co-located event happening just before KubeCon EU 2025! 👉 https://lnkd.in/e-qcehwp Cloud Native Computing Foundation (CNCF)

🌧 #CloudCosts and #CloudOperations don't have to be shady. 🌞Shine some light on managing / optimizing your cloud footprint for cost & performance with Apptio, an IBM Company & IBM Turbonomic. Check out the webinar recording below where we dive into a holistic approach for #FinOps. #Apptio #Cloudability #Turbonomic #CFM #TBM #Cloudmigration #IBM #AWS #GCP #Azure

Game changer? Llama 3.1 405B is now running on Cerebras! – 969 tokens/s, frontier AI now runs at instant speed – 12x faster than GPT-4o, 18x Claude, 12x fastest GPU cloud – 128K context length, 16-bit weights – Industry’s fastest time-to-first token @ 240ms https://lnkd.in/e5zuEnM7

We encountered challenges when deploying the self-hosted service of DeepFashion.us, but omniedge appears to be a great solution. For AI developers using various types of GPUs—cloud, edge, serverless, and lab—who need seamless connectivity, omniedge's service simplifies everything.

KEDA released Scaling Modifiers a month ago, and it’s a game changer for managing AI workloads in the cloud. For anyone who hasn’t used it yet, KEDA is a Kubernetes plugin that lets you autoscale your workloads based on arbitrary events or metrics. AI workloads have pretty sharp corners and properly scaling them requires this type of flexibility. We’ve been trying out scaling modifiers on some of our workloads and have found some pretty slick use cases that engineering teams should consider: 1) Automatically kick off model retraining, only when its validation drifts and GPUs are available 2) Scale model replicas based on token latency, not response latency 3) Hot swap in cheaper models at high traffic, to cap costs while maintaining throughput My full write-up on this is at https://lnkd.in/gy8NZShe

Check out Smart Context (aka Fuzzy Completion) in action using GPT! Now this is exciting and a great boost to linguist productivity. For the technically interested, see example below. Here, on the left side, we see Smart Context from GPT in the second match. Note how well GPT respects the terminology coming from the Fuzzy Match (83%) and provides a fluent, terminologically consistent translation. This is putting AI to good use in linguistics. Come to the webinar if you have time! It will also be recorded and provided via XTM On Demand later. #ai #responsibleAI #meetXTM XTM International