Paresh Nana’s Post

View profile for Paresh Nana, graphic

Field Engineering Leader - Specialist Solution Architects (SSA) team

Apache Spark’s new Python Data Source API simplifies data ingestion from custom sources. Now, data engineers can efficiently integrate a broader array of data sources and sinks into their Spark pipelines. "The fact that we can now build, test, and surface reusable Spark data sources across the org will help our teams move faster and have more confidence in their work." - Bryce Bartmann, Chief Digital Technology Advisor, Shell

Simplify Data Ingestion With the New Python Data Source API

Simplify Data Ingestion With the New Python Data Source API

databricks.com

To view or add a comment, sign in

Explore topics