RisingWave’s Post

📅 Fact about Apache Iceberg: Apache Iceberg supports time travel! You can query historical versions of your dataset by specifying a timestamp or snapshot. This makes debugging, audits, and reproducibility easier than ever. Get Your Verified Data Lakehouse Associate Badge Today: https://lnkd.in/gnh-CDb5 #DataLakes #TimeTravel #ApacheIceberg

Apache XTable (Incubating) and Delta Lake UniForm both offer support for all three open table formats: Apache Hudi, Delta Lake, and Apache Iceberg. Users need more interop and fewer data silos. XTable and UniForm provide users with the freedom to choose the right format for the right use case. Read the blog from Kyle Weller of Onehouse and Jonathan Brito of Databricks: https://lnkd.in/echrzTV3 #onehouse #dataengineering #nolockin #datalakehouse  #apachehudi #apachextable #opensource 

🚀 Ready to supercharge your Apache Iceberg queries and perfect Iceberg for your most demanding analytics workloads? Watch and discover the tips and strategies shared by our StarRocks community users! To access the full video: https://lnkd.in/gRVWeTnS #DataAnalytics #DataEngineering #DataLakeAnalytics #DataLake #DataLakeHouse

Elevate your Apache Flink expertise at our Deep Dive Masterclass, Oct 21-22! Explore 'From Data to Intelligence' and 'Flink SQL Origins and Future' with industry leaders. https://lnkd.in/dqY-4JA7 #FlinkForward #ApacheFlink #Berlin #ApacheFlinkCDC #streaminglakehouse #datastreaming #datalakehouse #streamhouse #SQL #BigData Organized by Ververica | Original creators of Apache Flink®

New Dremio Video on Youtube: Quick Answers - What is the Apache Iceberg REST Catalog? ---------------------- ** Watch Video Here: https://lnkd.in/exVVeXDr ** Get Started With Dremio: https://lnkd.in/gPri3SAQ ** Try Dremio on your Laptop: https://lnkd.in/eVxUfhxk ----------------------- #DataEngineering #DataAnalytics #DataScience #DataLake #DataLakehouse #DataVirtualization #DataMesh #BigData

New Data Video: #3 – What is Apache Iceberg? ---------------------------------- ** Watch Here: https://lnkd.in/eEqvNyzk ** Intro to Data Playlist: https://lnkd.in/eP9RxwcF ----------------------------------- #DataEngineering #DataAnalytics #DataScience #DataLake #DataLakehouse #BigData

Want to unlock the power of Apache #Flink? 🚀 Understanding data lineage is the key to seamless debugging, compliance, and performance optimization. Colten Pilgreen’s guide on Flink’s #JobGraph and #StateManagement breaks it all down in a way that’s easy to apply. Check it out! 📖 Read the article: https://lnkd.in/dARtGQg2 Curious how this can improve your data pipelines? Let’s chat about your specific challenges and solutions. 🤝 Need a demo? https://lnkd.in/gq2JbHap OR Signup and test it for yourself for free ▶ https://lnkd.in/g3hvEkSY #ApacheFlink #DataLineage #DataObservability #Datorios

Struggling to track data flow in your Apache #Flink pipelines? 🛠️ Colten Pilgreen simplifies #datalineage concepts, giving you practical insights into #JobGraph and #StateManagement. These tips can seriously enhance your debugging, compliance, and performance efforts. 👉 Read more here: https://lnkd.in/dARtGQg2 Looking for tailored guidance? Let’s set up a quick discovery call! 💡 ➡ https://lnkd.in/gq2JbHap #ApacheFlink #DataLineage #TechTalks #Datorios

Lakehouse table formats such as Apache Hudi, Iceberg & Delta Lake are not too different. They are a ‘metadata layer’ on top of data files such as #Parquet. The only diffeence is how these formats handle & organize the metadata. ✅ Hudi takes a timeline-based approach with indexing ✅ Delta uses a JSON based transaction log ✅ Iceberg has metadata file, manifest file & manifest lists They also share certain similarities in metadata. For example, things like partition Info, file statistics, schema & transaction information. Apache XTable takes advantage of these aspects and allows onni directional translation from one source format to another. Check out how to get started with creating your first interoperable table: https://lnkd.in/gHMBQeqV ⭐️ GitHub: https://lnkd.in/geVGqRvE #dataengineering #softwareengineering

🌊 Looking to speed up your Apache Iceberg queries and fine-tune Iceberg for your demanding analytics workloads? Discover tips and strategies from successful Iceberg users within the StarRocks community. To watch the full video: https://lnkd.in/guvh3SXi #DataAnalytics #DataEngineering #DataLakeAnalytics #DataLake #DataLakeHouse