sahil_singla

6 ms·

1.
by sahil_singla 2y ago
Would love to see how you’re doing warehouse optimization. Is there a demo video I can look at?
2.
by sahil_singla 2y ago
Yeah, kind of. Though I'm not exactly sure how their product works, I saw from the landing page that it's broadly focused on query optimization. We've done a lot of experimentation with query optimizations, both with and with
3.
by sahil_singla 2y ago
That resonates with what we have heard from our customers.
4.
by sahil_singla 2y ago
Our belief is that building a good optimization tool is not aligned with Snowflake's interests. Instead they seem to be more focused on enabling new use cases and workloads for their customers (their AI push, for example, with Cortex).
5.
by sahil_singla 2y ago
We are different from Keebo in the way we approach warehouse optimization. Keebo seems to dynamically change the size of a warehouse - we have found that to be somewhat risky, especially when it's downsizing. Performance can take a big
6.
by sahil_singla 2y ago
They are more focused on query optimizations whereas we do warehouse optimizations. We are inclined towards warehouse optimizations due to it being completely hands-off.
7.
by sahil_singla 2y ago
+1. We came to a similar conclusion when we were working on this idea.
8.
by sahil_singla 2y ago
We optimize warehouse sizes for a dbt project as a whole. Users can set a maximum project runtime as one of the parameters for experimentation. The optimization honors this max runtime while tuning warehouse sizes for individual models.
9.
by sahil_singla 2y ago
No AI yet - all algorithms are deterministic under the hood. Although we are considering tinkering with LLMs for query optimization, as part of our roadmap.
10.
Launch HN: Baselit (YC W23) – Automatically Reduce Snowflake Costs
48 points by sahil_singla 2y ago|30 comments
11.
Snowflake FinOps Center: Control and Monitor Costs with a Free Streamlit App(app.snowflake.com)
4 points by sahil_singla 3y ago|0 comments
12.
Pruning – The Holy Grail of Snowflake Optimization(medium.com)
1 points by sahil_singla 3y ago|0 comments
13.
Identify and remediate failing workloads on Snowflake(medium.com)
1 points by sahil_singla 3y ago|0 comments
14.
Analyzing and reducing storage costs in Snowflake(medium.com)
4 points by sahil_singla 3y ago|0 comments
15.
Calculate Cost per Query in Snowflake(medium.com)
2 points by sahil_singla 3y ago|0 comments