6 ms·
How do you query your iceberg tables? We are looking into moving away from Bigquery and Starrocks [1] looks like a good option. [1] https://www.starrocks.io/ h
by volderette 2y ago
How do you query your iceberg tables? We are looking into moving away from Bigquery and Starrocks [1] looks like a good option.
[1] https://www.starrocks.io/ https://www.starrocks.io/
- jl6 2y agoWhy away from bigquery? Just wondering if it’s a cost thing.
- volderette 2y agoYes, mainly driven by cost. BigQuery is really unpredictable when dashboards with filters are being used intensively by users. We don’t want to limit our users in their data exploration.
- mritchie712 2y agoright now, starrocks or trino are likely your best options, but all the major query engines (clickhouse, snowflake, databricks, even duckdb) are improving their support too.
- czwief 2y agoStarburst (full disclosure: I work there) provides a query engine (trino under the hood) with Iceberg support [1] -- worth checking out. [1] https://www.starburst.io/platform/icehouse/ https://www.starburst.io/platform/icehouse/
- adesh_nalpet 2y agoCommon opensource options (other than Spark and Flink): 1. Dremio: https://www.dremio.com/ https://www.dremio.com/ 2. Trino: https://trino.io/ https://trino.io/ 3. Iceberg Java API: https://iceberg.apache.org/docs/1.6.1/api/ https://iceberg.apache.org/docs/1.6.1/api/
- macqm 2y agoTrino is pretty good (open source presto). https://trino.io/ https://trino.io/