Deepchecks

🚀 The upcoming Deepchecks event is "𝐇𝐚𝐧𝐝𝐬-𝐎𝐧 𝐖𝐨𝐫𝐤𝐬𝐡𝐨𝐩: 𝐄𝐯𝐚𝐥𝐮𝐚𝐭𝐢𝐧𝐠 𝐋𝐋𝐌 𝐀𝐩𝐩𝐬 𝐰𝐢𝐭𝐡 𝐃𝐞𝐞𝐩𝐜𝐡𝐞𝐜𝐤𝐬 𝐚𝐧𝐝 𝐒𝐚𝐠𝐞𝐌𝐚𝐤𝐞𝐫 𝐀𝐈". In this session, Philip Tannor (CEO & Co-Founder, Deepchecks) and Noam Bressler (VP R&D, Deepchecks) will lead a hands-on workshop about evaluating LLM apps with Deepchecks and integration with SageMaker AI. 🔥 We will cover the methodologies and best practices for evaluating LLM systems — from initial proof-of-concept experiments to production-grade evaluation & monitoring. 📆 𝐃𝐚𝐭𝐞 & 𝐓𝐢𝐦𝐞: January 30th, 2025 | 08:00 AM PST 👉 𝐑𝐞𝐠𝐢𝐬𝐭𝐞𝐫 𝐡𝐞𝐫𝐞: https://lnkd.in/dMQfmBny Amazon Web Services (AWS) #LLMs #LLMOps #AI #GenAI #MLOps #Evals #GPT

Large Language Models (LLMs) are transforming industries, but optimizing their performance can be complex. In this post, we dive into practical strategies to fine-tune and monitor LLMs effectively, ensuring they deliver reliable and efficient results. Whether you're integrating LLMs into your products or refining their use in research, this guide is packed with actionable insights to help you get the most out of these powerful tools. #AI #LLM #MachineLearning #Deepchecks #TechInnovation

📊 Understanding Feature Importance in Machine Learning Ever wondered how machine learning models make decisions? Knowing which features contribute most to a model's predictions is key to improving performance and ensuring transparency. In our latest blog post, we explore feature importance methods in machine learning. From SHAP to Permutation Importance, learn how these tools can give you actionable insights into your models. #MachineLearning #DataScience #AI #FeatureEngineering #Explainability

𝐖𝐡𝐚𝐭 𝐝𝐨𝐞𝐬 𝐭𝐡𝐞 𝐀𝐈 𝐥𝐚𝐧𝐝𝐬𝐜𝐚𝐩𝐞 𝐥𝐨𝐨𝐤 𝐥𝐢𝐤𝐞 𝐢𝐧 2025? 🚀 Our CEO, Philip, recently shared his thoughts and insights on the evolving AI landscape in an interview with EP&T. 📺 In the conversation, Philip emphasized the critical role of LLM evaluation and highlighted how ensuring accuracy, reliability, and fairness in these models will be a defining factor for success in 2025. 📆 🔏 He also highlighted the privacy-first solutions for data protection and the crucial role of regulation in responsible AI governance. Read the full article here: https://lnkd.in/dxctBfs6 #AI #GenAI #MLOps #LLMs #LLMOps #ResponsibleAI

We just published a new blog post diving into LLM Evaluation Frameworks—covering the essential steps and components to evaluate large language models effectively. 🤖✨ Whether you're working on fine-tuning, deployment, or performance optimization, this guide provides actionable insights to help you assess and improve your LLMs. #AI #LLM #MachineLearning #DataScience #Deepchecks

🚀 Earlier this month, we announced a major update -- that Deepchecks LLM Evaluation is now natively available in the Amazon Web Services (AWS) environment (SageMaker AI). This was huge for us. I’ve had countless conversations with various teams this year about their LLM evaluation needs. The biggest headache for them is to 𝐨𝐧𝐛𝐨𝐚𝐫𝐝 𝐨𝐧 𝐭𝐡𝐞 3𝐫𝐝 𝐩𝐚𝐫𝐭𝐲 𝐚𝐧𝐝 𝐝𝐚𝐭𝐚 𝐩𝐫𝐢𝐯𝐚𝐜𝐲 𝐢𝐬𝐬𝐮𝐞𝐬. 🔐 Making Deepchecks available within AWS was a lot of work, but Kudos to Shir, Noam, and the whole Deepchecks team for making it happen. 👏 The key benefits are: > Data Locality within your AWS account. > No Infrastructure Management. SageMaker AI handles setup, upgrades, and scaling. > Zero-Time Procurement Process.  > No Security Questionnaires or Architecture Discussions. ✅ Companies building LLM apps can use their existing AWS credits to get a fully managed, on-prem version of Deepchecks LLM Evaluation. 𝐓𝐨 𝐠𝐞𝐭 𝐬𝐭𝐚𝐫𝐭𝐞𝐝 𝐨𝐫 𝐫𝐞𝐪𝐮𝐞𝐬𝐭 𝐚𝐜𝐜𝐞𝐬𝐬: https://lnkd.in/dSk2rrFb Or feel free to reach out to me on LinkedIn or via email. 😊 Swami Sivasubramanian, Ankur Mehrotra, Guy Maidan, Mair Hasco, Thomas Zerbach, Sai Kumar Devulapalli, Jia You, Sumit Thakur, Gwen Chen, Eric Raúl Peña, Vineet Sharma, Rafe Gándola #LLMs #AWS #LLMEvaluation #GenAI LLMOps Space

Conversational AI vs. Generative AI: What's the Difference? These two AI domains reshape industries, but their roles and applications vary. Our latest blog explores the key differences, real-world use cases, and how to choose the right solution. #AI #ConversationalAI #GenerativeAI #Deepchecks

🎉 Announcing New Strategic Partnership with Amazon Web Services (AWS)! During the re:Invent keynote today, AWS just announced one of SageMaker's biggest releases to date: SageMaker Partner AI Apps. And we’re proud to be one of their core partners.🔥 Deepchecks is now deeply integrated into Amazon SageMaker AI and Amazon SageMaker Unified Studio. 🧠 🚀 Read more about the announcement here: https://lnkd.in/eJWR6SgJ #LLMs #GenAI #LLMOps #Deepchecks #AWS #reInvent #Amazon

🚀 I’m extremely excited to finally announce a 𝐦𝐞𝐠𝐚-𝐜𝐨𝐥𝐥𝐚𝐛𝐨𝐫𝐚𝐭𝐢𝐨𝐧 between Amazon Web Services (AWS) (!) and Deepchecks around LLM Evaluation. 🕑 This was announced 𝐚 𝐟𝐞𝐰 𝐦𝐢𝐧𝐮𝐭𝐞𝐬 𝐚𝐠𝐨 during the AWS #reInvent keynote, as part of their announcement about their newest feature - 𝐒𝐚𝐠𝐞𝐌𝐚𝐤𝐞𝐫 𝐏𝐚𝐫𝐭𝐧𝐞𝐫 𝐀𝐈 𝐀𝐩𝐩𝐬. 🧠 Essentially, Deepchecks is now available 𝐧𝐚𝐭𝐢𝐯𝐞𝐥𝐲 𝐰𝐢𝐭𝐡𝐢𝐧 𝐒𝐚𝐠𝐞𝐌𝐚𝐤𝐞𝐫 - so companies building LLM Apps can use their existing AWS credits to get a fully managed, on-prem, version of Deepchecks LLM Evaluation. 🔥Over the last few months, our teams have collaborated closely to address the challenges in building robust LLM applications within AWS. By combining Deepchecks' expertise in LLM evaluation with Amazon SageMaker AI, we're enabling teams and enterprises to build a best-in-class LLMOps stack 𝐰𝐢𝐭𝐡𝐨𝐮𝐭 𝐰𝐨𝐫𝐫𝐲𝐢𝐧𝐠 𝐚𝐛𝐨𝐮𝐭 𝐝𝐚𝐭𝐚 𝐬𝐞𝐜𝐮𝐫𝐢𝐭𝐲, 𝐩𝐫𝐨𝐜𝐮𝐫𝐞𝐦𝐞𝐧𝐭, 𝐨𝐫 𝐈𝐓/ 𝐃𝐞𝐯𝐎𝐩𝐬 𝐫𝐞𝐬𝐨𝐮𝐫𝐜𝐞𝐬. Here's why this is a big deal: ✅ Data Locality within your AWS account, guaranteed by AWS. ✅ No Security Questionnaires or Architecture Discussions—AWS takes full responsibility. ✅ Zero-Time Procurement Process. Tools can be acquired with your AWS budget, including unused AWS credits. ✅ No Infrastructure Management. SageMaker AI handles setup, upgrades, and scaling. Here’s the detailed blog I wrote about the partnership: https://lnkd.in/dwGmdQBg 🏁To get started, you can either search for Deepchecks within Amazon SageMaker AI or Amazon SageMaker Unified Studio, or reach out via LinkedIn or email me at philip@deepchecks.com #Deepchecks #LLMs #AWS #reInvent #SageMaker 👏 Huge kudos to Swami Sivasubramanian Ankur Mehrotra Guy Maidan Mair Hasco Kelly Garcia Thomas Zerbach Sai Kumar Devulapalli Jia You Sumit Thakur Gwen Chen Sumit Thakur Eric Raúl Peña Vineet Sharma Rafe Gándola and many others, along with my amazing team at Deepchecks, that made this possible!