carlineng

6 ms·

1.
The DuckLake Manifesto: SQL as a Lakehouse Format(ducklake.select)
6 points by carlineng 1y ago|1 comments
2.
by carlineng 1y ago
This is really a question of economics. The biggest organizations with the most ability to hire engineers have need for technologies that can solve their existing problems in incremental ways, and thus we end up with horrible technologies l
3.
Escaping SQL's Legacy: Malloy and the Era of AI-Powered Analytics(carlineng.com)
2 points by carlineng 1y ago|0 comments
4.
by carlineng 1y ago
Not yet, but I believe the DataCouncil staff recorded it and will post it to their YouTube channel sometime in the next few weeks: https://www.youtube.com/@DataCouncil/videos
5.
by carlineng 1y ago
I just watched the author of this feature and blog post give a talk at the DataCouncil conference in Oakland, and it is obvious what a huge amount of craft, ingenuity, and care went into building it. Congratulations to Hamilton and the Moth
6.
by carlineng 2y ago
I agree 100% that this needs to be more of a thing. For data engineers building data pipelines, queries are like functions, and table schemas are like types. There needs to be a way to write a query that runs on an abstract interface, rathe
7.
Reusability in Data Engineering: Holy Grail or Fool's Errand?(carlineng.com)
2 points by carlineng 2y ago|0 comments
8.
Why TPC is not enough: an Analysis of the Amazon Redshift Fleet [pdf](assets.amazon.science)
2 points by carlineng 2y ago|0 comments
9.
Building a custom DAG orchestration system for experimentation(geteppo.com)
1 points by carlineng 2y ago|0 comments
10.
Data viz is hierarchical – if only our data tools agreed(docs.malloydata.dev)
2 points by carlineng 3y ago|0 comments
11.
Browse and research NYC council meetings quickly and easily(citymeetings.nyc)
2 points by carlineng 3y ago|0 comments
12.
by carlineng 3y ago
The argument is more than that -- namely that in addition to having sophisticated AI, Google also controls the OS (Android) and hardware (Pixel). Being able to integrate best-in-class AI at every level of the stack is a tremendous advantage
13.
Beyond YAML: Why Semantic Layers Need Real Programming Languages(malloydata.github.io)
3 points by carlineng 3y ago|0 comments
14.
Drawing Bump Charts in Malloy(malloydata.github.io)
1 points by carlineng 3y ago|0 comments
15.
Malloy and Jupyter Notebooks: Advanced Data Science Needs Trustworthy Metrics(malloydata.github.io)
3 points by carlineng 3y ago|0 comments
16.
by carlineng 3y ago
My favorite discussion of this topic is from David Beazley: https://www.youtube.com/watch?v=5C6sv7-eTKg He does a wonderful job of taking very dense mathematical notation and explaining it in ways that anyone can understand
17.
The Data Modeling Divide(carlineng.com)
7 points by carlineng 3y ago|0 comments
18.
BI by Another Name(benn.substack.com)
2 points by carlineng 3y ago|0 comments
19.
by carlineng 3y ago
My understanding of Cube is that iterating on the data model requires the user to (1) write SQL to develop a metric (2) edit YAML or JS config to incorporate the new metric (3) issue API request to Cube server and (4) compare results to raw
20.
by carlineng 3y ago
Thanks for the kind words! Admittedly, a lot of the stuff you're asking about is still a work in progress, and we don't have good answers for it all just yet. The upside of that is you have the potential to influence which directi
21.
by carlineng 3y ago
Glad you asked! It is certainly usable for writing apps. We publish an npm package, and the Malloy VSCode extension [0] is one such example of an app built on top of it. There's also a demo of a toy CLI app that showcases the simplest
22.
What Happened to the Semantic Layer?(carlineng.com)
3 points by carlineng 3y ago|6 comments
23.
by carlineng 3y ago
Semantic layers, also known as metrics layers or “headless BI”, have become a popular topic in the online data community in recent years. For all the hype, the idea hasn't seen much traction. In this blog post, I hypothesize why not, a
24.
by carlineng 3y ago
I've written quite a bit about a new query language called Malloy: https://carlineng.com/?postid=malloy-intro#blog It's a semantic layer with an integrated query language that makes a ton of improvements on SQL. F
25.
Exploring the TPC-DS Benchmark Queries with Malloy(carlineng.com)
2 points by carlineng 4y ago|0 comments
26.
by carlineng 4y ago
Would love to! How do I get in touch? My contact info is in my profile.
27.
by carlineng 4y ago
I'd wager you're right. All the "boring" stuff that's actually very complicated/difficult, and without which no large enterprise will adopt a technology.
28.
by carlineng 4y ago
MotherDuck has been making the rounds with a big funding announcement [1], and a lot of posts like this one. As a life-long data industry person, I agree with nearly all of what Jordan and Ryan are saying. It all tracks with my personal exp
29.
SQL, Malloy, and the Art of the Renaissance(carlineng.com)
1 points by carlineng 4y ago|0 comments
30.
by carlineng 4y ago
> I had a student storm out of my class [1] because I was teaching relational databases instead of web3. Wow... that exchange is surreal. I wonder if it was some kind of fraternity prank or troll job? [1] https://www.youtube.c

More ›