dangoldin

5 ms·

1.
Snowflake vs. Databricks Showdown(select.dev)
2 points by dangoldin 5mo ago|0 comments
2.
by dangoldin 9mo ago
I led the engineering team of a large adtech company (TripleLift - order of hundreds of billions of events/day) and we evolved from self hosting Kafka, to paying a vendor (Instacluster), to migrating to RedPanda. RedPanda was a huge wi
3.
by dangoldin 10mo ago
Twing.AI | AI/Full-Stack Engineer & Forward Deployed Engineer | Remote (US-friendly timezones) or NYC | Full-time or Part-time We’re a lean (4 people, 3 of which are engineers), bootstrapped team building a private-equity automatio
4.
by dangoldin 11mo ago
I worked at an adtech company where we invested a bit in HA across AZ + regions. Lo and behold there was an AWS outage and we stayed up. Too bad our customers didn't and we still took the revenue hit. Lesson here is that your approach
5.
The Theoretical Limitations of Embedding-Based Retrieval(alphaxiv.org)
2 points by dangoldin 1y ago|0 comments
6.
by dangoldin 1y ago
I'd reach out to your former manager that you got along with and ask for their advice. Seems you had a good rapport and they know the company dynamics.
7.
Apache Iceberg in Modern Data Architectures: A Comprehensive Report(blog.twingdata.com)
1 points by dangoldin 1y ago|0 comments
8.
Sizing Big Data Workloads: Key Numbers to Know(blog.twingdata.com)
1 points by dangoldin 1y ago|0 comments
9.
Handling Personal Data Deletion in AdTech Data Systems(blog.twingdata.com)
3 points by dangoldin 1y ago|0 comments
10.
Building for AWS Marketplace(blog.twingdata.com)
1 points by dangoldin 1y ago|0 comments
11.
Building a Snowflake Native App(blog.twingdata.com)
2 points by dangoldin 1y ago|2 comments
12.
Make API Data Engineering Fun with DuckDB(blog.twingdata.com)
1 points by dangoldin 1y ago|0 comments
13.
Extracts, PDTs, and Embedded DBs: How BI Tools Shape Data Warehouse Economics(blog.twingdata.com)
2 points by dangoldin 1y ago|0 comments
14.
Data Warehouse Is a Hammer – But Not Everything Is a Nail(blog.twingdata.com)
2 points by dangoldin 1y ago|0 comments
15.
Warehouse Pricing: Snowflake(blog.twingdata.com)
1 points by dangoldin 2y ago|0 comments
16.
The three Snowflake queries big data doesn't want you to know about(blog.twingdata.com)
3 points by dangoldin 2y ago|0 comments
17.
The Cost of BigQuery(blog.twingdata.com)
1 points by dangoldin 2y ago|0 comments
18.
Redshift Serverless Pricing: A Comprehensive Overview(blog.twingdata.com)
1 points by dangoldin 2y ago|0 comments
19.
Exploring Redshift's Approach to Query Hashing(blog.twingdata.com)
2 points by dangoldin 2y ago|0 comments
20.
by dangoldin 2y ago
I'm sure you've heard of SQLMesh but that seems like a potential fit. Or is it still too heavy handed?
21.
by dangoldin 2y ago
Yea - definitely. Just not ideal and something that needs to be built out, tested, etc.
22.
by dangoldin 2y ago
Problem is that often you also end up relying on GitHub for CI/CD so not as easy of a change. Imagine GH being down and you need to deploy a hotfix. How do you handle that? Especially, if you followed best practices and set up a system
23.
Start Tracking Your Unit Costs to Avoid Surprise Cloud Bills(blog.twingdata.com)
1 points by dangoldin 2y ago|0 comments
24.
by dangoldin 2y ago
Yea - the idea is that Snowflake will generate these after a query runs in order to help you look at multiple runs of the same query. So imagine you run a query that's "select a from b where c = 1" and you want to find all ex
25.
Same Query, Different Hash: Snowflake's query hashing blind spots(blog.twingdata.com)
3 points by dangoldin 2y ago|3 comments
26.
by dangoldin 2y ago
Really cool stuff and a nice introduction but curious how much modern compilers do for you already. Especially if you shift to the JIT world - what ends up being the difference between code where people optimize for this vs write in a style
27.
Oracle Is Shutting Down Its Ad Business(adweek.com)
2 points by dangoldin 2y ago|0 comments
28.
The End of Software(docs.google.com)
1 points by dangoldin 2y ago|0 comments
29.
Handling Truncated Insert Queries Using Regex and ChatGPT(blog.twingdata.com)
3 points by dangoldin 2y ago|0 comments
30.
by dangoldin 2y ago
Yea - I get that argument but these days it's just hard to do infra as true FOSS with the hyperscalers and current cloud economics. There is a community license and and the code is visible. Not saying it's ideal but Redpanda is fu

More ›