jjirsa

5 ms·

1.
by jjirsa 26d ago
Feels like a thread for me I’ve run more Cassandra than anyone on the planet. Also more FoundationDB. And more Postgres than I can count. Likely 3 orders of magnitude more than you. 1. Any db at that scale requires a team. Thousands of core
2.
by jjirsa 7mo ago
> Waymo is now completing 450,000 weekly driverless rides across six cities, with a peer-reviewed study showing statistically significantly lower crash rates than human drivers across 56.7 million rider-only miles. When Waymo’s vehicles
3.
by jjirsa 2y ago
Congrats datastax folks. Happy for you.
4.
by jjirsa 2y ago
Youre not far off, just use your original sentence and acknowledge that Scylla isn’t the OSS here, its the company that came in, forked a volunteer driven project, and tried to pretend its theirs: > Or more often companies with money com
5.
by jjirsa 2y ago
> Copycat is a bit of a stretch here imho, considering it's in different language, and even the general architecture. But I agree they are very compatible on the protocol level, which they used as an advantage as people don't n
6.
by jjirsa 2y ago
> I would say it's opposite. No one contributes to open source and the developers have to make money on the side to work on the project You missed the important part of his sentence: > All those open source copycat projects, usin
7.
by jjirsa 2y ago
Remarkable to me that ctrl-f, "Sourceforge" had 3 hits on this page. Would have expected a dozen.
8.
by jjirsa 3y ago
Some companies have both massive files and a massive number of files
9.
by jjirsa 3y ago
> I do wish they just contributed to nickel or something else though rather than doing their NIH as usual. They’re contributing to a ton of OSS that’s NIH: https://opensource.apple.com/projects/ K8s, spark, cassandr
10.
by jjirsa 3y ago
Yes! Congrats Phil!
11.
by jjirsa 3y ago
Regrettably the folks who have been using it for years aren’t going to be give a lot of specifics, but generation of k8s yaml / jsonnet in particular was exceptionally common. One example from the other thread: > My team migrated se
12.
by jjirsa 3y ago
Congrats Apple folks who worked on this, I know it’s been a long time coming
13.
by jjirsa 3y ago
Cassandra’s jepsen is over 10 years old now. That database spent 3-4 years primarily focused on correctness from 2018-2022. The industry moves fast, our memories are slow. But there are millions of instances of cassandra in production acros
14.
by jjirsa 3y ago
It’s disappointing to me that the technologist desire to experiment with new DBs continually puts naive customers at correctness and durability risk they don’t (won’t) understand.
15.
by jjirsa 4y ago
> Apple's underlying economics haven't changed, so they have not had any reason to over-hire in the first place. The bloomberg article has a visual showing revenue-per-employee going up from 1.17M/employee (2017-2019) to 2
16.
by jjirsa 4y ago
Tell me you’ve never run infrastructure at scale without telling me you’ve never run infrastructure at scale.
17.
by jjirsa 4y ago
Just wanted to say thanks for understanding how hard this is. It's a fun sub-thread to read. As I mentioned elsewhere, I'll see if I can get permission to talk publicly about the actual numbers.
18.
by jjirsa 4y ago
I'll see if we can get permission to discuss this publicly.
19.
by jjirsa 4y ago
Cassandra is very good when all of these are true: - You're willing to give up some common SQL-isms for leaderless, multi-dc, high-availability - You're going to grow to need more than one machine taking writes - if you can fit on
20.
by jjirsa 4y ago
> I think Cassandra - certainly inter alia - simply sits at a level of complexity which is beyond the comprehension of any one human being I think there are a handful of humans that actually get it. But it is a true handful, not more tha
21.
by jjirsa 5y ago
The cardinal rule of databases: http://www.dbms2.com/2013/03/18/dbms-development-marklogic-h... Ignoring that leads to long postmortems about how your embedded db failed in a way you didn’t expect: https:&#x
22.
by jjirsa 5y ago
Targeting for home invasion Targeting for extortion Targeting in general
23.
by jjirsa 5y ago
The “extraordinarily difficult to do very well” part gets ignored here by most people DocuSign’s feature list is huge. It’s not just overlaying a signature on a doc. It’s a massive and complex app that most people will ignore or trivialize,
24.
by jjirsa 5y ago
I don’t think anyone avoiding talking about single threaded bottlenecks. The main one that matters is on sstable streaming during bootstrap, and the zero copy streaming was directly to address that. There’s not really any single threaded pi
25.
by jjirsa 5y ago
Your options for scylla are AGPL or pay scylla. Nobody risks AGPL in prod so people running it are probably paying scylla.
26.
by jjirsa 5y ago
Modern Cassandra is more like Dict[SortedList[Row]], where the row is basically a SQL row just like you’d expect in any SQL database
27.
by jjirsa 5y ago
Something something bigtable
28.
by jjirsa 5y ago
The "reduced latencies" really reduces down to performance, where tps was a first order proxy for performance. The ease of maintenance, similarly, is sold as easier due to reduced node count, which is perhaps an extension of perfo
29.
by jjirsa 5y ago
SQL-like query pattern on top of bigtable-like distribution. e.g. you're willing to model your reads such that you dont need joins, and your sorting/scanning is based on the idea that you cluster data together, sorted in order you
30.
by jjirsa 5y ago
> then asking the machine for a whole bucketful of data, which should be a superset of what you're actually looking for. For something like a user's transactions you'll want to have basically everything there at once, so l

More ›