dltHub hat dies direkt geteilt
This Wednesday I was at Elia Group/50Hertz Transmission GmbH Devcon '24 What I learned is that a cross org data mesh is required for Europe's energy transition. Read more: https://lnkd.in/e25GNUDu
Since 2017, the number of Python users has been increasing by millions annually. The vast majority of these people leverage Python as a tool to solve problems at work. Our mission is to make them autonomous when they create and use data in their organizations. For this end, we are building an open source Python library called data load tool (dlt). Our users use dlt in their Python scripts to turn messy, unstructured data into regularly updated datasets. It empowers them to create highly scalable, easy to maintain, straightforward to deploy data pipelines without having to wait for help from a data engineer. We are dedicated to keeping dlt an open source project surrounded by a vibrant, engaged community. To make this sustainable, dltHub stewards dlt while also offering additional software and services that generate revenue (similar to what GitHub does with Git). dltHub is based in Berlin and New York City. It was founded by data and machine learning veterans. We are backed by Dig Ventures and many technical founders from companies such as Hugging Face, Instana, Matillion, Miro, and Rasa.
Externer Link zu dltHub
Berlin, DE
dltHub hat dies direkt geteilt
This Wednesday I was at Elia Group/50Hertz Transmission GmbH Devcon '24 What I learned is that a cross org data mesh is required for Europe's energy transition. Read more: https://lnkd.in/e25GNUDu
dltHub hat dies direkt geteilt
It's been a while since I wrote a connector but after seeing the great work Adrian Brudaru and his team at dltHub I decided to give it a try I figured if it was worth my time to do it for a very cheap and low-volume connector, it would be worth doing it for higher volume, more expensive connectors in the future. It was both an excruciating and enjoyable experience! Forgot how annoying building connectors can be. Best part? Deployment in Orchestra was a breeze. Can check out the article in comments below #dataingestion #dataengineering #analytics #orchestra
dltHub hat dies direkt geteilt
Yesterday we had a pleasure to join dltHub meetup. It was quite a long evening with a number of interesting talks. Our favourite: "Accelerating privacy-enhancing data processing" by Florian Stefan from Flatiron Health. The highlight was, of course, the announcement of dlt+ product launch and roadmap presented by dltHub's CTO Marcin Rudolf. We are looking forward to testing it! Many thanks to the organisers & hosts: dltHub, DataTalksClub and the speakers: Matthaus Krzykowski, Douglas Zickuhr, Ajit Gupta, Florian Stefan, Abhishek Choudhary, Alexey Grigorev, Simon Rosenberger (Bumm), Serhii Sokolenko, Adrian Brudaru.
Are you using dlt? show of hands! well if you like dlt, you will love dlt+ for those of you building data platforms at scale, with requirements like portability, decentralisation, and developer efficiency, dlt+ is a platform-building tool much like dlt is a pipeline building tool We are currently accepting pilot users, sign up to our waiting list here: https://lnkd.in/e-M7YwCw
dltHub hat dies direkt geteilt
Exciting news! Our Staff Data Engineer Ajit Gupta recently presented at the dltHub conference Berlin, delivering a fantastic talk on Forto's Data Journey and how DLT helped with ingesting unstructured MongoDB data. His presentation captured the evolution and impact of our data initiatives, showcasing the progress we’ve made as a team and a company. Great job Ajit Gupta 🎉 Matthaus Krzykowski and Marcin Rudolf congratulation on the Product Launch! It's great to see you listening to and supporting open source community 💪 And personally integrating with DLT was as seamless as ever
dltHub hat dies direkt geteilt
Our partners at Untitled Data Company helped us build the REST API source. So it was only natural that they talk about how to use it. Check out this Data Talks Club OSS Spotlight on dlt's REST API source. https://lnkd.in/ebuK8vMp
dltHub hat dies direkt geteilt
Interested in how to use Dagster Labs with dlt? Alex Chisholm demonstrates in this youtube video: https://lnkd.in/eh5PiWWf
dltHub hat dies direkt geteilt
dlt on serverless strikes again Cut your Fivetran cost 10.000x with dlt and github actions.
Freelance Data Engineer | Python, dlt contributor, Airbyte, dbt, GCP | Cutting costs and improving data quality
Check out how we integrated data from Oracle NetSuite for $0.20/month. Even in 2024 it can make big sense to build instead of buy. We invested some time into research and built with robust and extensible open-source tools instead of buying vendor solutions. Learn more: https://lnkd.in/g2ihgVqD
Dieser Inhalt ist hier nicht verfügbar.
Mit der LinkedIn App können Sie auf diese und weitere Inhalte zugreifen.
dlt on serverless strikes again Cut your Fivetran cost 10.000x with dlt and github actions.
Freelance Data Engineer | Python, dlt contributor, Airbyte, dbt, GCP | Cutting costs and improving data quality
Check out how we integrated data from Oracle NetSuite for $0.20/month. Even in 2024 it can make big sense to build instead of buy. We invested some time into research and built with robust and extensible open-source tools instead of buying vendor solutions. Learn more: https://lnkd.in/g2ihgVqD
Dieser Inhalt ist hier nicht verfügbar.
Mit der LinkedIn App können Sie auf diese und weitere Inhalte zugreifen.
Ever wondered how fast these tools are? We have a benchmark :)
Our colleague Aman Gupta wrote a blog post benchmarking OSS EL tools, check it out!