5 ms·
Doesn't it depend on database size? at least I heard somewhere online that column based is not really worth implementing if your regular tables have less than 1
by i_like_waiting 4y ago
Doesn't it depend on database size? at least I heard somewhere online that column based is not really worth implementing if your regular tables have less than 10M rows.
So for small DWH, I am just using PostgreSQL
- kjeetgill 4y agoI mean, if it's small I wouldn't really call it DWH.
- greggyb 4y agoThe term "data warehouse" is commonly used to define two different things: 1. The database where all business data for a wide swath of a company's operational groups relevant to reporting and analytics lands. 2. A specific type of database appliance/platform that is optimized for holding the type of data described above, which product is typically multi-node and often based around columnar storage of data. More recently these also emphasize ingesting or providing transparent access to to unstructured data (typically with functionality to push down queries to big data stores or other external data sources). The first is an observation about use cases and is agnostic to technology. The second is a specific type of product that fills the use case of large instances of the first.
- kjeetgill 4y agoThat's a good perspective on it, thanks. I'm absolutely guilty of seeing the term it through the lens of the technical solution rather than the problem class.
- edmundsauto 4y agoPostgres -> Citus is a great path for a v0 -> v1 data warehouse as it scales.