7 ms·
Author here: that’s exactly what I was trying to communicate but you said it better :)
by mwc360 2y ago
Author here: that’s exactly what I was trying to communicate but you said it better :)
- cmdlineluser 2y agoThere is a Spark API[1] being built using their Relational API[2]. Progress is being tracked on Github Discussions[3]. [1]: https://duckdb.org/docs/api/python/spark_api.html https://duckdb.org/docs/api/python/spark_api.html [2]: https://duckdb.org/docs/api/python/relational_api.html https://duckdb.org/docs/api/python/relational_api.html [3]: https://github.com/duckdb/duckdb/discussions/14525 https://github.com/duckdb/duckdb/discussions/14525
- mwc360 2y agoVery cool! This seems like fantastic functionality and would make it super easy to migrate small Spark workloads to DuckDB :)