8 ms·
The snapshots feature should handle the slowly changing dimensions. But are you saying it's not flexible enough for certain edge cases?
by antruok 5y ago
The snapshots feature should handle the slowly changing dimensions. But are you saying it's not flexible enough for certain edge cases?
- andygrd 5y agoYeah, dbt snapshots do a row hash and update if anything in the row changes. We had a source table that had a bunch of daily changing timestamps, e.g. "load date", that we needed to ignore, and focus on a business key. Dbt was an utter torment to try get this going. Ended up building a more elegant framework without it.
- antruok 5y agoSo apparently the check_cols parameter didn't help either? I'm trying to learn about the critical pain points of dbt, and this case seems interesting.