6 ms·

Seems bad for Snowflake? Iceberg is a big part of Snowflake's data lake offering, and I assumed it was a Snowflake-originated OSS project until this announcemen

by Pils 2y ago

Seems bad for Snowflake? Iceberg is a big part of Snowflake's data lake offering, and I assumed it was a Snowflake-originated OSS project until this announcement (all Snowflake products have snow related names).

chimerasaurus 2y ago
Disclaimer - I am James on this[1] blog. Yesterday we announced Polaris specifically so (1) customers don't get locked into a catalog; (2) people know Snowflake works with AWS, Azure, Confluent, etc. 1: https://www.snowflake.com/blog/introducing-polaris-catalog/ https://www.snowflake.com/blog/introducing-polaris-catalog/
- zwaps 2y ago
  Awfully many coming soons in that article
  - chimerasaurus 2y ago
    No doubt. Ask my team how thrilled I am whenever we say "coming soon." Narrator: It made him die inside.
- seahckr 2y ago
  This [1] says Snowflake was also bidding to buy Tabular. [1] https://www.cnbc.com/2024/06/04/databricks-is-buying-data-optimization-startup-tabular.html https://www.cnbc.com/2024/06/04/databricks-is-buying-data-op...
jetru 2y ago
Iceberg is not Snowflake originated, it was built by folks at Netflix - the same folks who built Tabular. But yes, this is definitely bad for Snowflake, Databricks can position itself as a very strong competitor with this move and moving more towards Iceberg.
- indoordin0saur 2y ago
  So this makes it sound like a positive thing for Iceberg as a format. Others seem to be suggesting that DataBricks will be working to undermine the format in favor of their older Delta Lake format but that seems overly cynical.
  - jetru 2y ago
    Yea, in theory, the way its stated, it would be a plus for the industry and Iceberg consolidation. How it will actually play out, who knows?
    - indoordin0saur 2y ago
      My guess is Data Bricks saw the popularity of Iceberg and realized that they were starting to look a little irrelevant still trying to promote their competing Delta Lake format. Have an Iceberg lakehouse? Well then Databricks just didn't seem very relevant to you. With their purchase of Tabular they're given some legitimacy when they start marketing their products as being iceberg compatible. This doesn't signal to me that Iceberg is going to be harmed in the near or medium term.

by Pils 2y ago

chimerasaurus 2y ago

Disclaimer - I am James on this[1] blog. Yesterday we announced Polaris specifically so (1) customers don't get locked into a catalog; (2) people know Snowflake works with AWS, Azure, Confluent, etc. 1: https://www.snowflake.com/blog/introducing-polaris-catalog/ https://www.snowflake.com/blog/introducing-polaris-catalog/

zwaps 2y ago
Awfully many coming soons in that article
- chimerasaurus 2y ago
  No doubt. Ask my team how thrilled I am whenever we say "coming soon." Narrator: It made him die inside.
seahckr 2y ago
This [1] says Snowflake was also bidding to buy Tabular. [1] https://www.cnbc.com/2024/06/04/databricks-is-buying-data-optimization-startup-tabular.html https://www.cnbc.com/2024/06/04/databricks-is-buying-data-op...

jetru 2y ago

Iceberg is not Snowflake originated, it was built by folks at Netflix - the same folks who built Tabular. But yes, this is definitely bad for Snowflake, Databricks can position itself as a very strong competitor with this move and moving more towards Iceberg.

indoordin0saur 2y ago
So this makes it sound like a positive thing for Iceberg as a format. Others seem to be suggesting that DataBricks will be working to undermine the format in favor of their older Delta Lake format but that seems overly cynical.
- jetru 2y ago
  Yea, in theory, the way its stated, it would be a plus for the industry and Iceberg consolidation. How it will actually play out, who knows?
  - indoordin0saur 2y ago
    My guess is Data Bricks saw the popularity of Iceberg and realized that they were starting to look a little irrelevant still trying to promote their competing Delta Lake format. Have an Iceberg lakehouse? Well then Databricks just didn't seem very relevant to you. With their purchase of Tabular they're given some legitimacy when they start marketing their products as being iceberg compatible. This doesn't signal to me that Iceberg is going to be harmed in the near or medium term.