Hawkdive’s Post

Go batch or go home. ☁️⚡️💻 https://go.aws/3ZcMgaD #AmazonBedrock Batch Inference is now generally available in all #AWS regions. Use batch inference to run multiple inference requests asynchronously & improve the performance of model inference on large datasets. Amazon Bedrock offers select foundation models for batch inference at 50% of on-demand inference pricing.

I always believed a smaller, faster and laser focused models are the way to go to meet the costing, latency and sustainable inferencing… here we go one of the top model provider Anthropic joining hands with Amazon Web Services (AWS) make this a reality. Model distillation is a paradigm shift in a way how you look at models today. #aws #awsreinvent2024 #awspartners #amazonbedrock #anthropic #claude

We've started optimizing Claude models to run on Amazon Web Services (AWS) Trainium2—their most advanced AI chip. It's already bearing fruit: Our first release is a faster version of Claude 3.5 Haiku in Amazon Bedrock. We’re also introducing Amazon Bedrock Model Distillation. In distillation, a "teacher" (Claude 3.5 Sonnet) transfers knowledge to a "student" (Claude 3 Haiku), helping the “student” run more sophisticated tasks at a fraction of the cost. In addition to offering a faster version on Trainium2, we're lowering the base price of Claude 3.5 Haiku across all platforms. The faster Claude 3.5 Haiku and model distillation are available in preview today in Amazon Bedrock: https://lnkd.in/eYbnXEm4

Using Amazon Bedrock Model Distillation, you can transfer knowledge, for a specific use-case, from a teacher model to a smaller, faster, cost-efficient student model. Distilled models are up to 500% faster and up to 75% less expensive than original models, with less than 2% accuracy loss for use cases like RAG !

Follow this hands-on discussion to learn how to build multimodal RAG applications on Amazon Web Services (AWS) using Amazon Bedrock Github: https://lnkd.in/gaWcuRFa

https://lnkd.in/gzfSeyyR AWS unveiled a portfolio of Nova AI models that it plans to make available alongside an expanding portfolio of AI models hosted on the Amazon Bedrock service. #aimodels #aws #processors #trainium3

Amazon Web Services (AWS) new Nova family of foundational models and new latency-optimized inference on Amazon Bedrock are home runs for AWS partners. “We’re really excited about the Nova models because there’s a massive opportunity there,” said Randall Hunt, CTO at Caylent. Launched at AWS #reInvent 2024 this week, Amazon Nova #FMs are a new generation of #AImodels aimed at delivering intelligence and industry leading price performance on #AmazonBedrock. One new feature that will help drive AI and GenAI adoption for Amazon Bedrock and new Nova models is AWS’ new latency-optimized inference for FMs in Amazon Bedrock. Here's what #AWS partners need to know: https://lnkd.in/gxXWXMRb

#Amazon #Bedrock now offers batch inference on data that is stored in an S3 bucket in general availability across all supported #AWS regions. Key benefits for customers: • 50% off on-demand inference pricing for select foundation models • Improved performance for large dataset processing • Asynchronous processing of multiple inference requests Ideal for #model #evaluation, #experimentation, and #RAG #knowledge #bases creation with most jobs completing within 24 hours. https://lnkd.in/d4MGhTUZ #GenerativeAI #CloudComputing #AmazonBedrock #Cloud

Excited to share our new partnership with Amazon Web Services (AWS)! ❤️ Today, in the AWS re:Invent keynote, Swami Sivasubramanian announced their newest feature -- SageMaker Partner AI Apps. Deepchecks is one of the core parts of this launch, deeply integrated into Amazon SageMaker AI and Amazon SageMaker Unified Studio. ✅ By combining Deepchecks' expertise in LLM evaluation with Amazon SageMaker AI, we're enabling teams and enterprises to build a best-in-class LLMOps stack without worrying about data security or procurement. 🏁To get started, you can either search for Deepchecks within Amazon SageMaker AI or Amazon SageMaker Unified Studio, or reach out to us. ❤️ Huge kudos to Philip Tannor, Shir Chorev & the whole Deepchecks team! #LLMs #LLMOps #AWS #reInvent #SageMaker #Deepchecks LLMOps Space

Speed, flexibility and efficiency are all top priorities when it comes to choosing the right #AI tools. 🛠️ Excited to share that #AWS Amazon Bedrock just added a new update that will help users across all three of these areas. Bedrock now includes an automating cross-region inference routing feature that will manage inference routing requests during traffic spikes in AI workloads. 🚦 As a result, developers will no longer have to spend time and effort predicting demand fluctuations and can better focus on enhancing reliability, performance and efficiency. #ChrisOnCloud #AWS #Amazon #cloud #cloudcomputing #genai #generativeai #mlops #aiml #machinelearning #moreLLMs #LLMchoice #AWSbedrock #Sagemaker Read more from InfoWorld here: