captaintobs

7 ms·

1.
by captaintobs 3mo ago
i spent 8k and get close to a 2-3x slower sonnet. running 2x spark deep seek v4 flash
2.
5x speedup of sqlglot (pure Python SQL parser) with mypyc(fivetran.com)
2 points by captaintobs 5mo ago|0 comments
3.
by captaintobs 5mo ago
18xx, hardcore economic train games. Think war games with money.
4.
by captaintobs 2y ago
They're using it for data transformation.They're long time dbt users, but are switching to SQLMesh because it's extremely efficient, provides a better development experience, and can help them become warehouse agnostic.
5.
by captaintobs 2y ago
There are many teams using SQLMesh in production. Fivetran, Harness, Hopper, Pitchbook to name a few. You can read some case studies here https://tobikodata.com/harness.html or join Slack to meet with folks to learn more ab
6.
by captaintobs 2y ago
Thanks! Yes, it's a much requested feature but it's difficult to get right!
7.
Dbt – Incremental but Incomplete(tobikodata.com)
67 points by captaintobs 2y ago|18 comments
8.
Dbt or SQLMesh(kestra.io)
2 points by captaintobs 3y ago|0 comments
9.
A Primer on SQLGlot's Abstract Syntax Tree(github.com)
3 points by captaintobs 3y ago|0 comments
10.
How to build a thriving open-source community(tobikodata.com)
2 points by captaintobs 3y ago|0 comments
11.
by captaintobs 3y ago
Why is this faster than the stdlib? What does it do to achieve better performance?
12.
by captaintobs 3y ago
Very cool work!
13.
We Need Even Greater Expectations When Testing Data(tobikodata.com)
2 points by captaintobs 3y ago|0 comments
14.
by captaintobs 3y ago
It's mostly affecting the amount of AI content I have to wade through these news aggregators...
15.
by captaintobs 3y ago
There's a lot of hype with ruff, but I've been doing fine with black and autoflake. I have a pretty sizeable project and have never thought to myself it's problematic because it's slow.
16.
by captaintobs 3y ago
We used both svb and first republic!
17.
Correctly Loading Incremental Data at Scale(tobikodata.com)
1 points by captaintobs 3y ago|0 comments
18.
Ask HN: Is YouTube Down for You?
1 points by captaintobs 3y ago|1 comments
19.
by captaintobs 3y ago
This is a garbage/sensationalist/click bait article. They source blind conversations.
20.
by captaintobs 3y ago
Monorepos at scale only really works if you have the tooling and infra to support it. Otherwise, you're going to be miserable with slow builds, pushes, pulls, impossible merge conflicts.
21.
by captaintobs 3y ago
It's fun having the ritual of grinding coffee. Maybe I can't tell the difference but I enjoy it!
22.
by captaintobs 3y ago
This and Astral (ruff) are similar. “hot” python frameworks, but unclear how they’ll monetize.
23.
Throwing lots of data at DuckDB and Athena(fet.dev)
3 points by captaintobs 3y ago|2 comments
24.
by captaintobs 3y ago
It's surprising how these rash decisions are made with seemingly little thought. You'd think someone so successful would be logical... I guess it's optional.
25.
by captaintobs 3y ago
The real challenge is can a GPT deliver a product to a PM / Executive who doesn't know what they want??
26.
by captaintobs 3y ago
Go and rust aren't going to help you as data engineer. Data Engineering is dominated by python, sql, java, and scala. Writing a pipeline in those languages isn't particularly great unless you have very specific reasons for it beca
27.
by captaintobs 3y ago
In general removing the gil will make things slower because you need to make sure things are safe. If most code out there is single threaded, removing the gil may not really have a benefit.
28.
by captaintobs 3y ago
Why is this linking to a random markdown page?
29.
by captaintobs 3y ago
Ahh the big company reorg. Executives need to somehow look busy, gaining alignment etc etc...
30.
by captaintobs 3y ago
It's really depressing to see the world crumble like this. It's not just twitter, but look at what's happening in Florida.

More ›