adastral

5 ms·

1.
I've operated petabyte-scale ClickHouse clusters for 5 years(tinybird.co)
243 points by adastral 11d ago|89 comments
2.
by adastral 2mo ago
How do you cope with distributed transactions? (I'm not sure if you support them?) I know that Citus has a `citus_create_restore_point()` (or so) function that, when called, guarantees that no 2PC commits are in flight and creates a WA
3.
Pg_hardstorage: PostgreSQL Backup, Done Right(github.com)
5 points by adastral 3mo ago|0 comments
4.
RawTree(rawtree.com)
3 points by adastral 3mo ago|0 comments
5.
We moved our growth analytics back into Tinybird(tinybird.co)
3 points by adastral 3mo ago|0 comments
6.
Key Joins (SQL Proposal)(keyjoin.org)
2 points by adastral 4mo ago|0 comments
7.
by adastral 1y ago
PostgresTV livestreams "vibe coding" 1h sessions implementing small PostgreSQL features with Cursor (mostly claude-4-sonnet model) every week, by experienced PostgreSQL contributors. [0] is their latest stream. I personally have n
8.
Git-worktree – Manage multiple working trees(git-scm.com)
8 points by adastral 1y ago|0 comments
9.
Benchmarking Is Hard, Sometimes(vondra.me)
2 points by adastral 1y ago|0 comments
10.
Decomposing Transactional Systems(transactional.blog)
18 points by adastral 1y ago|0 comments
11.
Dynamically estimating and scaling Postgres' working set size (2024)(neon.tech)
2 points by adastral 2y ago|0 comments
12.
by adastral 2y ago
> I default to a headless browser Headless browsers consume orders of magnitude more resources, and execute far more requests (e.g. fetching images) than a common webscraping job would require. Having run webscraping at scale myself, the
13.
AWS CloudWatch and AWS OpenSearch launch an integrated analytics experience(aws.amazon.com)
2 points by adastral 2y ago|0 comments
14.
by adastral 2y ago
From https://www.codeofhonor.com/blog/the-starcraft-path-finding-... > whenever harvesters are on their way to get minerals, or when they’re on the way back carrying those minerals, they ignore collisions with other
15.
by adastral 2y ago
Not sure if this is what the above comment means by "atomic", but a shortcoming of Postgres' JSON support is that it will have to rewrite an entire JSON object every time a part of it gets updated, no matter how many keys the
16.
by adastral 3y ago
Around ten heavily-updated (50-400k updated rows/min) tables ranging between 500M and 5B rows, with a couple tables over 40B rows each (5TB each IIRC).
17.
by adastral 3y ago
I see they don't mention Citus ( https://github.com/citusdata/citus ), which is already a fairly mature native Postgres extension. From the details given in the article, it sounds like they just reimplemented it. I
18.
by adastral 3y ago
> they'll be encrypted Since some months (years?) ago, WhatsApp lets you set up your own encryption password for the DB backup. I set one up and used https://github.com/ElDavoo/wa-crypt-tools to get access to t