jashmatthews

25 ms·

1.
by jashmatthews 2mo ago
If it works for you it’s great but the RDS EBS limitations are real enough… AWS built Aurora and for RDS a new 3 node topology using local SSDs for writes and EBS only for the data directly.
2.
by jashmatthews 1y ago
Most companies can afford not to give a shit until they hit SOC2 or GDPR compliance and then suddenly orphaned data is a giant liability.
3.
by jashmatthews 1y ago
Does vacuum not release free pages at the end of an index file in the same way it does for the heap?
4.
by jashmatthews 1y ago
> hybrid OLAP+OLTP .... in Postgres this pattern requires careful planning to avoid falling afoul of max_standby_streaming_delay for example This is a really gnarly problem at scale I've rarely seen anyone else bring up. Either you
5.
by jashmatthews 1y ago
Make friends with lawyers.
6.
by jashmatthews 1y ago
Purely vibes but as a Kiwi I feel like Number 8 Wire mentality has been dead for at least 20 years now.
7.
by jashmatthews 1y ago
Symbols have been GCed since CRuby 2.2 https://bugs.ruby-lang.org/issues/9634
8.
by jashmatthews 1y ago
Can we demonstrate them doing that? Absolutely. Will they fail to do it in practice once they poison their own context hallucinating libraries or functions that don’t exist? Absolutely. That’s the tricky part of working with agents.
9.
by jashmatthews 1y ago
Hallucinations are now plausibly wrong which is in some ways harder to deal with. GPT4.1 still generates Rust with imaginary crates and says “your tests passed, we can now move on” to a completely failed test run.
10.
by jashmatthews 1y ago
The USA hasn’t managed to completely impose their idea of intellectual property on everyone yet. Some countries you can’t sign away authorship even if you can commercial rights.
11.
by jashmatthews 1y ago
Yeah the older Pilot Sport tyres wore out quickly. I had PS4 before and now PS5 and they are wearing at something like half to a third as fast? Very happy. Only slightly less grip in cold weather.
12.
by jashmatthews 1y ago
My understanding is the way Aurora DSQL distributes data widely makes bulk writes extremely slow/expensive. So no COPY, INSERT with >3k rows, TRUNCATE etc
13.
by jashmatthews 1y ago
Hey Lev! I've been looking into PgDog for sharding a 40TB Postgres database atm vs building something ourselves. This could be a good opportunity to collaborate because what we need is something more like Vitess for PostgreSQL. The sca
14.
by jashmatthews 1y ago
Exactly that. It's an arms race between companies that offer a large number of residential IPs as proxies and companies that run unauthenticated web services trying not to die from denial of service. https://brightdata.com&#
15.
by jashmatthews 1y ago
It’s simple high throughput queries that often bite you with the PG query planner.
16.
by jashmatthews 1y ago
AWS claims 10x lower latency but I haven't personally checked.
17.
by jashmatthews 1y ago
While technologically cool the app is bullshit. 90% accurate isn't accurate enough for the job and it's effectively making shit up. Are you eating a 10% calorie deficit or a 10% calorie surplus? Cal AI can't tell you. Not pos
18.
by jashmatthews 1y ago
If you round up great engineering orgs that ship impactful stuff more of them don't use JIRA than do. Linear, Basecamp, Asana, Monday etc. My experience is by the time an org gets hundreds of priorities and can't effectively deleg
19.
by jashmatthews 2y ago
Intelligence is kinda unnecessary at this point. A Tiktok VP already admitted to a UK parliament select committee that they used to harshly moderate anything the Chinese government found sensitive Q90 - John Nicolson: It may happen elsewhe
20.
by jashmatthews 2y ago
When humans learn and copy too closely we call that plagiarism. If an LLM does it how should we deal with that?
21.
by jashmatthews 2y ago
Clustered tables and sequential keys have their own downsides though like lock contention on the "last" page.
22.
by jashmatthews 2y ago
There are a bunch that offer strong consistency e.g. Cloud Spanner and DynamoDB.
23.
by jashmatthews 2y ago
It look like a decline but these are relative numbers right? The whole industry exploded in size over this time period.
24.
by jashmatthews 2y ago
Competitive pressure on SaaS companies and startups is much higher now and while there are tons of people are building client wrappers and other much more exciting stuff in Ruby none of its getting extracted, polished and open-sourced becau
25.
by jashmatthews 2y ago
Best to just forget about it and listen on a connection not using pooling. https://jpcamara.com/2023/04/12/pgbouncer-is-useful.html#lis...
26.
by jashmatthews 2y ago
Yeah the ULID/UUIDs which can be be partitioned by time in this way are AWESOME for these use cases.
27.
by jashmatthews 2y ago
It's far from trivial. Autoanalyze doesn't work on partitioned tables, only on the partitions themselves. Partitioning a busy job queue table is a nightmare in itself.
28.
by jashmatthews 2y ago
By the time you need append-only job statuses it's better to move to a dedicated queue. Append-only statuses help but they also make the polling query a lot more expensive. Deleting older rows is a nightmare at scale. It leaves holes i
29.
by jashmatthews 2y ago
Do you mean like the consumer for the first phase enqueues a job for the second phase?
30.
by jashmatthews 2y ago
Transactional Outbox solves this. You use a table like in the first example but instead of actually doing the ElasticSearch update the Outbox table is piped into the dedicated queue.

More ›