malisper

6 ms·

1.
by malisper 5d ago
> I watched an interview that Casey Muratori did with Tyler Cloutier (SpacetimeDB founder and spokesperson) [1]. One of the points that Tyler is that, given modern CPU architecture with cache lines, a distributed database needs to fan ou
2.
by malisper 15d ago
Most of the work I've done with pgrust hasn't had issues with Fable. The only time I've had issues is when building a fuzz tester to find bugs
3.
by malisper 24d ago
Eval would count as JIT compilation though[0] [0] https://www.sbcl.org/manual/#compiler-only-implementation
4.
by malisper 24d ago
Author here. Let me know if you have any questions about the post or about pgrust.
5.
by malisper 24d ago
> There's no rarity of JITs, it's just that LLVM (and other frameworks) are often used Except that using LLVM has high latency limitting it's applicability. Postgres just disabled LLVM by default because of this[0]. [0] h
6.
by malisper 26d ago
> This person doesn't understand how to make efficient code The author is one of the most knowledgeable people about performance there is
7.
JIT Compiling Code in 5μs(malisper.me)
3 points by malisper 27d ago|0 comments
8.
by malisper 28d ago
You still get a physical piece of paper that looks like a check; it's just not a valid check.
9.
by malisper 1mo ago
We've fixed the issue on our development branch. We've only been working with the default collation so when you try a different one it causes an issue
10.
by malisper 1mo ago
How so? Window functions work exactly the same way. Postgres processes them one row at a time, and you can batch them the same way as you would with sum. Window functions do make parallel queries more difficult, but that's a different
11.
by malisper 1mo ago
> You’re cosplaying as someone who could build a database. > In reality you yourself could never build Postgres or Redis or any other database. > You’re not skilled enough or knowledgeable enough and you’re not willing to put the t
12.
by malisper 1mo ago
Can you file an issue? We know there are bugs and the work we're doing with formal verification and fuzz testing is to go through all the code and make sure all of it behaves identically to Postgres
13.
by malisper 1mo ago
We don't expose the priorities right now, but we have the priorities decay over time. That way faster queries get prioritized over long running queries. That should achieve the behavior you're looking for.
14.
by malisper 1mo ago
Can you file an issue? Our big focus over the next few weeks is to eliminate these issues and that's why we're our formal verification and fuzz testing work
15.
by malisper 1mo ago
Yes. Email me and Jason at malis@pgrust.com and jason@pgrust.com
16.
by malisper 1mo ago
I'm certain pgrust can find a long term home somewhere
17.
by malisper 1mo ago
Thanks!
18.
by malisper 1mo ago
What do you mean by native TTL? Would that be when rows are automatically deleted if they aren't touched after a certain period of time?
19.
by malisper 1mo ago
^For context, this is Greg Smith, the author of Postgres 9.0 High Performance[0]. That book was my first introduction to Postgres [0] https://www.amazon.com/dp/184951030X
20.
by malisper 1mo ago
> My understanding is that they used c2rust, and then told the LLM/Agents to make the code more idiomatic rust, while also using the PG test suite as a feedback mechanism. This is correct > and thus a fork, and should thus have t
21.
by malisper 1mo ago
It absolutely can be embedded. The bigger enabler is replacing the process-per-connection model with a thread-per-connection model. Projects like pglite[0] had to give up concurrency because of it. We also support compiling to wasm so you c
22.
by malisper 1mo ago
> I am very disappointed to see the direction: It is moving from a "interesting attempt to recreate system software" to "building flashy but useless demo" What makes you say this is a useless demo? I can't count
23.
by malisper 1mo ago
One of the new features we recently built is "test mode". This brings cloning a template db from 100ms down to <10ms making it much better for tests. If you're interested in trying it out, please reach out to me at malis@p
24.
by malisper 1mo ago
Me and Jason, the two people working on the project
25.
by malisper 1mo ago
We disabled parallelism in the blog post for demonstration purposes. The 300x slower refers to the clickbench numbers[0] where parallelism is enabled [0] https://benchmark.clickhouse.com/#system=+liH|pgrs|gQ&type=-...
26.
by malisper 1mo ago
I would probably dig into the reasons for the differences in the benefit on the test machine and in prod I had an issue like this for optimizing pgrust. I had an optimization that showed no impact on my test machine (c8g.4xl) and showed a 2
27.
by malisper 1mo ago
It's a reference to the prompt that found a counterexample to the Dinitz-Garg-Goemans conjecture > "do a breakthrough and find a structured counterexample"
28.
by malisper 1mo ago
> A question on 20s postgresql time - It does not look like you are accounting for reading data from disk I choose the data size so that it would fit in memory on the machine I was testing on. fwiw, there's still a ton of overhead P
29.
by malisper 1mo ago
I want to build the best database possible. While Postgres is great, there are a lot of core issues that have been around for over a decade. We're working hard to get pgrust production-ready, and it will definitely be production-ready
30.
by malisper 1mo ago
I'll need to write up how the scheduler works at some point, but it's heavily based on these papers[0][1]. It solves two different problems. First, it lets us throttle resource-intensive queries. Second, it enables work stealing.

More ›