kzh_

6 ms·

1.
We cut Spark compute costs by 44% with AI and Datadog Jobs Monitoring(datadoghq.com)
3 points by kzh_ 4mo ago|0 comments
2.
Datadog acquires AI-powered data observability startup Metaplane(techcrunch.com)
6 points by kzh_ 1y ago|0 comments
3.
Snowflake Invests in Metaplane for Deep, End-to-End Observability(snowflake.com)
2 points by kzh_ 2y ago|0 comments
4.
Column-Level Lineage: An Adventure in SQL Parsing(metaplane.dev)
2 points by kzh_ 3y ago|0 comments
5.
Data Test Previews in Pull Requests(metaplane.dev)
2 points by kzh_ 4y ago|0 comments
6.
Yet another post on Data Contracts – Part 1(davidsj.substack.com)
1 points by kzh_ 4y ago|0 comments
7.
Cataloging Data Catalogs(seattledataguy.substack.com)
2 points by kzh_ 4y ago|0 comments
8.
Accio Firebolt(davidsj.substack.com)
1 points by kzh_ 4y ago|0 comments
9.
Schema modelling framework for decentralised domain-driven ownership of data(github.com)
1 points by kzh_ 4y ago|1 comments
10.
Data Vault Techniques on Snowflake: Point-in-Time Constructs and Join Trees(snowflake.com)
2 points by kzh_ 4y ago|0 comments
11.
One of the Oldest Rodeos in America Is in New Jersey(nytimes.com)
2 points by kzh_ 4y ago|0 comments
12.
What Is the Langlands Program?(quantamagazine.org)
2 points by kzh_ 4y ago|0 comments
13.
The Unparalleled Genius of John von Neumann(privatdozent.co)
5 points by kzh_ 4y ago|0 comments
14.
by kzh_ 4y ago
Wade gave a memorable talk during our YC batch. When asked how he ran Zapier remotely, which was unusual at the time, he said something along the lines of "When I want to talk with the team, I open Slack. When I want to file a support
15.
by kzh_ 4y ago
+1 on existing log viewers being particularly well suited for text over non-textual assets. My experience here is limited but I believe Grafana has a dynamic image plugin if you store a link to an asset in blob storage or Base64 encode it.
16.
by kzh_ 4y ago
Thanks for reading! Including examples is a great point, because otherwise the article can be kind of abstract, especially because each person has a different mental model of data. I'll add some later on. Maybe thermodynamics is a hamm
17.
by kzh_ 4y ago
OP here, I only try to write and share things that I find personally interesting, so if it came across as marketing fluff that was the opposite of what I was aiming for :/. But I do appreciate you reading the whole thing. FWIW I also t
18.
by kzh_ 4y ago
OP here, I posted this a few days ago and was surprised to see it on the front page this morning. Not sure why it says I submitted 4 hours ago when I wasn’t awake, maybe the second-chance pool ( https://news.ycombinator.com/i
19.
The four pillars of data observability: metrics, metadata, lineage, and logs(metaplane.dev)
155 points by kzh_ 4y ago|27 comments
20.
by kzh_ 5y ago
Not yet, but eventually! We’re focused on data in warehouses and transactional DBs right now, just to limit the amount of integrations we need to build to start. We definitely plan to integrate with application sources like Google Analytics
21.
by kzh_ 5y ago
Our customers think of BigEye, Anomalo, and Monte Carlo very similarly (needing to go through a sales process, spending quite a bit of money), so this answer to a previous question about Monte Carlo might be useful: https://news.
22.
by kzh_ 5y ago
Integrating with Microsoft SQL Server is definitely on our roadmap in the coming months. If you're up to discuss your use case, please reach out to team@metaplane.dev because we’d love to explore building this integration for you!
23.
by kzh_ 5y ago
Amazing how many companies use dbt + Snowflake right? Such a different world from 2014… Good idea, we actually do have a dbt integration that pulls in lineage and job metadata from your dbt manifests: https://docs.metaplane.dev&#
24.
by kzh_ 5y ago
Thanks, and definitely! We're making a big push in the coming months to keep building out our downstream BI integrations. The Superset API is quite nice so we're looking forward to working with it.
25.
by kzh_ 5y ago
Good question! Both Datafold and Atlan support data monitoring as a secondary feature, but have different main focuses: Datafold is primarily known for their Data Diff regression testing that simulates the result of a PR on your data within
26.
by kzh_ 5y ago
Nice work! Love the support for merging profiles together and also profiling unstructured data. I could’ve used this all of the time back in research days, instead of having to do the profiling by hand and from scratch every time. We defini
27.
by kzh_ 5y ago
Haha you're definitely not alone — this happened so much we ended up getting http://meatplane.com . Maybe we'll consider a rebrand in the near future :)
28.
by kzh_ 5y ago
Thanks Ian — our earlier conversations definitely helped shape our thinking about this space!
29.
by kzh_ 5y ago
The main difference is how we get into the hands of data teams. To use Monte Carlo you’ll need to book a demo with their sales team to see the product, go through an implementation process, and potentially pay as much for a data monitoring
30.
by kzh_ 5y ago
Great question! While right now we are focused on our cloud native application, we do plan on supporting an on-prem version for companies that require hosting themselves. The reason our customers haven’t required this is because we’ve tried

More ›