Horst Mundt’s Post

View profile for Horst Mundt, graphic

Director Field Engineering at Databricks

Apache Spark’s new Python Data Source API simplifies data ingestion from custom sources. Now, data engineers can efficiently integrate a broader array of data sources and sinks into their Spark pipelines. "The fact that we can now build, test, and surface reusable Spark data sources across the org will help our teams move faster and have more confidence in their work." - Bryce Bartmann, Chief Digital Technology Advisor, Shell

Simplify Data Ingestion With the New Python Data Source API

Simplify Data Ingestion With the New Python Data Source API

databricks.com

To view or add a comment, sign in

Explore topics