7 ms·
This is really nice though looking at the code - a lot of the postgres types are missing as well a lot of the newer parquet logical types - but this is a great
by inglor 11mo ago
This is really nice though looking at the code - a lot of the postgres types are missing as well a lot of the newer parquet logical types - but this is a great start and a nice use of FDW.
- inglor 11mo agoAlso, any planned support for more catalogs?
- pgguru 11mo agoI think we have recently merged (or are getting ready to merge) REST catalog support, so that will open some things up in this department.
- pgguru 11mo agoHi, what types are you expecting to see that aren't supported? I believe we had support for most/all builtin postgres types.
- inglor 11mo agoPostgres has like 300+ types but mostly stuff like decimals should work the same way it does with Postgres (with the edge cases like NaN existing in Postgres but not parquets accordingly)
- mslot 11mo agoIn principle, Postgres has an infinite number of possible types :). pg_lake maps types into their Parquet equivalent and otherwise stores as text representation, there are a few limitations like very large numerics. https://github.com/Snowflake-Labs/pg_lake/blob/main/docs/iceberg-tables.md#iceberg-table-options https://github.com/Snowflake-Labs/pg_lake/blob/main/docs/ice...