KX

In Michaela Woods' recent tutorial, she shares how to load, partition and analyze large Parquet datasets using kdb+. Handling large datasets is crucial for data engineers, and Michaela demonstrates a streamlined approach that optimizes workflows, eliminates latency issues, and reduces complexities. By following her tutorial, you will learn how to: 🧠 Load Parquet files into kdb+ with arrowkdb 🧠 Query kdb+ data with q and Python (PyKX) Watch the full tutorial here: https://lnkd.in/eR8MYr-5 You can also find a breakdown of this topic in her latest article: https://lnkd.in/e8-ZVdCW #KX #kdb+ #DataProcessing #arrowkdb #Parquet #DataQuery

Ever spent hours debugging your app, only to realize it’s not your code—it’s the data? Bad data can cause chaos: inaccurate financial reports, endless false alerts in surveillance systems, or misaligned trend analyses. Check out the latest blog from Data Intellect's ARK series, which emphasizes the hidden challenges of data quality and why getting it right is mission-critical. Key takeaways include: 𝐃𝐚𝐭𝐚 𝐬𝐭𝐫𝐮𝐜𝐭𝐮𝐫𝐞 𝐦𝐚𝐭𝐭𝐞𝐫𝐬: Field names, data types, and precision can vary wildly across systems. Standardization isn’t easy, but it’s essential. 𝐂𝐨𝐦𝐩𝐥𝐞𝐭𝐞𝐧𝐞𝐬𝐬 𝐢𝐬 𝐤𝐞𝐲: Missing or incomplete data can wreak havoc. Including metadata in flat files or validating record counts can help avoid costly errors. 𝐃𝐨𝐜𝐮𝐦𝐞𝐧𝐭𝐚𝐭𝐢𝐨𝐧 𝐢𝐬 𝐧𝐨𝐧-𝐧𝐞𝐠𝐨𝐭𝐢𝐚𝐛𝐥𝐞: Up-to-date, clear documentation saves time, supports compliance, and ensures everyone speaks the same data language. Read the blog here: https://lnkd.in/eEqMFtGv What’s the biggest data quality challenge you’ve faced? Let’s discuss in the comments! #KX #DataIntellect #ARK9 #DataQuality #DataStructure

Behind every successful AI initiative lies a strong data foundation, yet navigating the complexities of data often proves to be the most challenging part of the journey. We want to hear from you: What’s the biggest data roadblock your organization faces when deploying AI? Vote in our poll and join the conversation about how businesses are tackling these challenges to unlock AI’s full potential. Let’s share insights and solutions as we head into 2025! #KX #NYE #2025Predictions #AIPredictions #AIReady

There's been a lot of skepticism around AI implementation within Capital Markets, but we believe there is a path forward. Our Data Scientist, Ryan Siegler, sheds light on how to address common concerns so that AI adoption can occur efficiently and safely. In his post, he shared four common concerns that lead to GenAI skepticism: 💭 Reliability & accuracy 💭 Privacy 💭 Explainability 💭 Bias While offering ways to promote AI-positive thinking: 🧠 Education to understand all areas of AI 🧠 Keeping human's integral to AI 🧠 Starting off small, but thinking big 🧠 Involving yourself with the right team environment To our friends in Capital Markets, we'd like to hear from you! What other concerns are hindering AI adoption efforts? Ryan's full perspective can be found here: https://lnkd.in/e8bAj7PZ #KX #AI #AIForward #MachineLearning #AIEthics

In his latest blog, AI Developer Advocate Michael Ryaboy dives into how temporal similarity search (TSS)—integrated within KDB.AI—enables quants to detect patterns efficiently and at scale, without the need for complex machine learning algorithms. Here’s what Michael demonstrates: ✅ Generating and normalizing 10 million synthetic random walk data points ✅ Using TSS to match patterns in market data in real-time ✅ Defining and creating tables in KDB.AI for transformed and non-transformed searches ✅ Exploring use cases for quants, from backtesting strategies to setting up real-time alerts Check out the full blog for a step-by-step walkthrough of TSS in action: https://lnkd.in/e4WPTJHb #KX #AI #TSS #TemporalSimilaritySearch #SyntheticData #PatternMatching #MarketData

Happy Holidays from the entire KX team! ❄️ Wishing you a joyful and safe holiday season. Thank you to our customers, partners, and followers for being part of our journey in 2024 – here’s to a bright and exciting year ahead! #KX #HappyHolidays

KX Data Scientist Ryan Siegler recently shared his expertise in a Q&A with Roberto V. Zicari for ODBMS.org, exploring all things GenAI, Large Language Models and Vector Databases. Dive into the interview to discover: 💡 Key lessons learned optimizing Retrieval Augmented Generation (RAG) and Vector Database performance 💡Why Multimodal AI is shaping the future of AI advancements 💡The pivotal role of KDB.AI in powering hybrid and real-time GenAI applications 💡How vector databases are tackling challenges like high-dimensional embeddings and TCO Read the full Q&A here: https://lnkd.in/eFcpV5GK #LLMs #VectorDatabases #AI #KX #AIReady #GenAI #KDB.AI #DataQuality

Our CEO, Ashok Reddy, sat down with Conor Hoekstra to discuss KX’s new direction, as well as the challenges and opportunities ahead, on the latest episode of The Array Cast. In the episode, Ashok shares insights on KX’s transformation into a standalone software company, our growth into new industries, the evolving role of q as a foundational technology and more. 🎙️Tune in to hear his vision for KX’s future and insights into the evolving data landscape: https://lnkd.in/eeuy2fuA #KX #ArrayCast #CapMarkets #AIReady #GenAI #DataIntegration #KXCon

Data streaming solutions are transforming industries with real-time insights, but implementing them comes with challenges. 💡 Our CEO Ashok Reddy recently weighed in for Forbes, highlighting the critical mistake of focusing solely on speed or latency. He explains why real-time insights require simultaneous processing and analysis to ensure data integrity and scalability. 👉 Explore Ashok’s perspective and insights from other industry leaders on building smarter data streaming solutions: https://lnkd.in/eEtUEnjX #KX #Forbes #DataStreaming #DataPitfalls #AIReady #Data

🚀 This November, KX brought together global leaders at our Capital Markets Summits in New York and London to explore how AI and cutting-edge data analytics are reshaping the industry. From unlocking new value with machine learning to the role of AI Factories in driving innovation, our CEO Ashok Reddy delves into his top five takeaways from these insightful discussions. #KX #ArtificialIntelligence #DataAnalytics #CapitalMarkets #FinTech #MachineLearning #FinancialServices