rastignack

6 ms·

1.
by rastignack 1mo ago
Yes for this particular use case it might help (no per-application aggregated temp file limit though). Also my grid workloads generate thousands of threads running queries with lots of small updates (job queues, calculation results..). I wi
2.
by rastignack 1mo ago
Interesting. It would need some work to handle all the workloads I’ve faced where you have two applications with different priorities (ie oltp or grid workloads and analytics). In those cases you want to make sure that BI users do not inte
3.
by rastignack 1mo ago
I would be interested about a more detailed architecture overview of the io scheduler (like this: https://www.scylladb.com/2021/04/06/scyllas-new-io-scheduler... ) and the thread scheduler. PostgreSQL has his
4.
by rastignack 2mo ago
And why it should be done upstream with a thread pool model and an internal scheduler as MS SQL server does.
5.
by rastignack 3mo ago
The thing is you are going to be comoditized on this too. And it’s going to be faster to migrate off your database with AI. You are going to need to have a plan.
6.
by rastignack 3mo ago
I hope it could be used in the future to export pg_dump formated exports to s3. One would be able to trigger maintenance jobs via simple lambda functions whose duration is capped.
7.
by rastignack 4mo ago
And if you write to a bytes buffer?
8.
by rastignack 5mo ago
Just monitor it and you’re done. I’ve delivered and maintained hundreds of pg instances and never faced this issue. There is so much literature about it that at some point no one even slightly skilled will face it.
9.
by rastignack 10mo ago
I have tens of clusters to maintain. Quite an advertisement for ECS!
10.
by rastignack 11mo ago
Is there now a way to avoid double buffering and use direct IO in postgresql ? Has anybody seriously benchmarked this ? I don’t think io uring would make a difference with this setting but I’m curious, as it’s the default for oracle and syb
11.
by rastignack 1y ago
Remember to turn off autoplay on Twitter.
12.
by rastignack 1y ago
How about acknowledging you’ve been too sharp with words, apologizing, and attempting to move forward ? I know other people in the kernel do the same mistake as you frequently do on mailing lists. But two wrongs do not make a right.
13.
by rastignack 1y ago
Some distributions do release hotfixes before they reach mainline kernel. If you expect end users to compile Linus’ kernel head, why couldn’t they compile your branch though ? They get timely fixes.
14.
by rastignack 1y ago
Maybe then you should have considered this file system as truly experimental and expected your end users to make frequent backups. And advertise it as such. You could also have some kind of dkms bleeding edge module for your users to test f
15.
by rastignack 1y ago
Maybe the FS was upstreamed too soon, causing your development velocity and the high expectations you have for your end users to be at odd with the well entrenched workflows of Linux maintainers. In any case as a Linux user, I want to thank
16.
by rastignack 1y ago
Mr Torvalds has already said “we’re done”. And Mr Overstreet’s behavior is still unprofessional. I think this thread is really insightful to teach highly skilled individuals that people skills are as important as technical proficiency. I ha
17.
Bcachefs to be removed from mainline Linux kernel(lore.kernel.org)
30 points by rastignack 1y ago|32 comments
18.
by rastignack 1y ago
One does not justify a wrong by another wrong. It’s a classic sophism. I do not live in the US but did see some truly shocking and illegal behaviors at gay prides and drag themed events. So I’m just waiting to get more information. So my po
19.
by rastignack 1y ago
Nowadays a lot of people script in python
20.
by rastignack 1y ago
I’ll finish it this summer, hopefully.
21.
by rastignack 1y ago
I don’t think channels and goroutines suck. For example their usage in golang’s ssh server implementation is eminently readable. And performant enough. Engineers ship with them, and do not care if there’s a purer system elsewhere.
22.
by rastignack 1y ago
I wrote a simple ssh server in zig to learn the language in my spare time. The new design makes the event loop / io much easier to reason about. Thanks Andy
23.
The Pg_tde Extension Is Now Ready for Production(percona.com)
2 points by rastignack 1y ago|0 comments
24.
by rastignack 1y ago
Would the sync.Pool trick mentionned here: https://hypermode.com/blog/introducing-ristretto-high-perf-g... help ? It’s lossy but might be a good compromise.
25.
by rastignack 1y ago
Austin Clements at it again…
26.
by rastignack 1y ago
In rust with some C code, ok. How is the DER format parsed for example ? Regarding crypto operations, I know as of now for rust projects assembly is a must to have constant time guarantees. Maybe there could be a way with intrinsics and a c
27.
by rastignack 1y ago
Is not rustls a mix of c++, assembly and rust ? I think it’s not a good indication of the success of the language.
28.
by rastignack 1y ago
At $WORK, we are within the range of 2 billion rows per day on one of our apps. We do have beefy hardware and ultra fast SSD storage though.
29.
by rastignack 1y ago
It’s not about religion. PostgreSQL devs do make money right ? Despite RDS.
30.
by rastignack 1y ago
It’s good to know it. I live in a heavily regulated workplace and our data usage is constantly monitored. Good to know a totally offline tool is being considered. Thanks for the great tool BTW.

More ›