Cohere For AI

Don't forget to check out Nico Messikommer's session on "Data-driven Feature Tracking for Event Cameras with and without Frames" tomorrow, January 14th! Learn more: https://lnkd.in/dpTEXJ-g

We named the Aya movement before we had any idea *just how much* endurance and resourcefulness it would take to challenge how research is traditionally done 💪 Through it all, this symbol has been a lodestar for our work - when it gets tough, we channel the fern and grow anyway.

Be sure to check out Yuntian Deng on January 18th as he will deliver a talk titled "Implicit Chain-of-Thought: Internalizing Reasoning in Language Models." Thanks to Vin Ahluwalia for organizing this exciting talk 🥳 Learn more: https://lnkd.in/gJ38436D

Aya Expanse is built on years of multilingual research at C4AI. Let's take a closer look at multilingual arbitrage🔍 This technique enables strategic distillation from a pool of models where any individual teacher model may only be strong in a small set of languages or domains. Our paper on multilingual arbitrage breaks down how optimizing data pools can accelerate progress in multilingual AI.

Tomorrow, January 10th, Andrei Panferov will present to our open science community a session on "Pushing the Limits of Large Language Model Quantization via the Linearity Theorem." 🗓️ Learn more and add this event to your calendar: https://lnkd.in/gwdeeQEe

From the BIRDS(Beginners in Research Driven Studies) group of Cohere Open Science Community, we're thrilled to announce our new LLM Cohort! 🎉 🚀 This isn't just another learning program; it's a hands-on, collaborative research initiative designed to push the boundaries of what's possible with Large Language Models in multilingual, long-context settings 💡 📚 We'll be diving deep into two exciting tracks: 🔬 Track 1: Multilingual Long Context - Enhancing Processing with Advanced Techniques 🤖 Led by: Mayank Bhaskar and Madhava Prasath 🎯 Focus: Exploring cutting-edge methods like RoPE(Rotatory Positional Embedding), NoPE(No Position Encoding), LongROPE, SSMs(State Space Models), and Hybrid Transformer-SSM models to overcome long-context challenges in multilingual NLP, enhancing scalability, efficiency, and the ability to process extended sequences while addressing limitations of traditional Transformers. 🧠 Challenge: Develop a novel method to integrate SSMs with Transformers, optimizing for long-context multilingual understanding. Demonstrate superior performance over RoPE, NoPE, and LongRoPE on synthetic tasks, emphasizing generalization to sequences exceeding training lengths and minimal computational overhead. 🔬 Track 2: Evaluating Multilingual Long Context Generation and Reasoning 🤖 Led by: Guneet Singh Kohli and Shivalika Singh 🎯 Focus: Build a benchmark to assess ability of multilingual LLMs to handle long context tasks involving complex reasoning. 🧠 Challenge: How do we ensure accurate, contextually relevant responses across languages for Long Context Tasks? Evaluating capabilities of existing LLMs for such tasks and coming up with a data creation pipeline to build a Multilingual Long Context Benchmark. Why Join? 💼 Gain practical research experience: Work on a real-world project from start to finish. 🤝 Collaborate with experts: Learn from and alongside experienced researchers. 🌐 Shape the future of LLMs: Contribute to advancements in a rapidly evolving field. 📅 Kick-off Call: Join us this Friday, January 10th at 10:00 am PT for a detailed overview of the cohort and to meet the track leads! Register your interest and fill out this form to create an account in Cohere For AI Discord server - 🔗 https://lnkd.in/gx5p_Ybn Once you have your account created on the Cohere For AI Discord and you would like to be a part of the LLM Cohort, please sign up here - 📝 https://lnkd.in/gscRupZa 2025 is shaping up to be a year of groundbreaking research and let's embark on this exciting journey of discovery together! ✨ #LLMs #MultilingualAI #LongContext #AIResearch #CohereForAI #C4AI #BIRDS #MachineLearning #DeepLearning #NLP #SSM #HybridModels

私たちの世界をつなぐ 🇯🇵 🌎 ✨Aya Expanse✨を紹介できることを誇りに思う WhatsAppで試してみる: +14313028498 https://wa.me/14313028498

Mark your calendars for January 17th when Rohan Jain presents "Winning Tickets from Random Initialization: Aligning Masks for Sparse Training" Special thanks to Sree Harsha Nelaturu and Anier Velasco Sotomayor for organizing this event 🥳 Learn more: https://lnkd.in/gqH-_tJx

Don't forget to check out our event tomorrow with Zhenrui Yue hosted by our community-led Geo Regional Asia Group! Learn more: https://lnkd.in/gKFz4Wjb

Flashback to Jan 2023 - we hosted a launch call in our open science community inviting collaborators to join us in developing an open-source multilingual model and dataset. 🌎 The excitement was palpable. ✨ Little did we know - we were at the beginning of the journey of Aya.