galeaspablo

5 ms·

1.
How much glycogen is stored in a runner's liver?(runningwritings.com)
2 points by galeaspablo 8mo ago|0 comments
2.
by galeaspablo 1y ago
Let’s separate two advantages in the average case with Kafka. 1. Sequential IO when reading from disk. 2. Use of disk cache (instead of reading from disk) when re-reading recently read events. #2 helps when you have many consumer groups rea
3.
by galeaspablo 1y ago
No problem. :) Yes, order needs to be known. So no, it’s not possible to do O(w+h) with streams partitioned by key. Unless, of course you use a supplementary index, but then you might as well not use the streams storage at all and store the
4.
by galeaspablo 1y ago
Option 1, but after so many years banging our heads against the wall reasoning about this, we hoped someone would eventually give us a queue that supports arbitrary causal dependency graphs. We thought about building it ourselves, because w
5.
by galeaspablo 1y ago
Great intuition. Exactly right. More details in one of my other comments, here: https://news.ycombinator.com/item?id=43796688
6.
by galeaspablo 1y ago
Great follow up question, thank you. I could talk about this "topic" for days, so I appreciate the opportunity to expand. :) Let's imagine ourselves as a couple of engineers at Acme Foreign Exchange House. We'd like to t
7.
by galeaspablo 1y ago
Apologies, we've been so deep into this problem that we take our slang for granted :) A graphical representation might be worth a thousand words, keeping in mind it's just one example. Imagine you're traversing the following.
8.
by galeaspablo 1y ago
Some input from previously working on a superset of this problem. And being in a similar position. Mature projects have too much bureacracy, and even spending time talking to you = opportunity cost. So making a case for why you're goin
9.
by galeaspablo 1y ago
Right on, great question. Some examples: Example Option 1 You give up on the guarantees across partition keys (bank accounts), and you accept that balances will not reflect a causally consistent state of the past. E.g., Bob deposits 100, Bo
10.
by galeaspablo 1y ago
That's correct. And keep in mind that you might have new consumers starting from the beginning come into play, so you have to permanently retain the indexes. And yes, O(n log n ) is not bad at all. Sorted database indexes (whether SQL,
11.
by galeaspablo 1y ago
Disclosure (given this is from Confluent): I'm ex MSK (Managed Streaming for Kafka at AWS) and my current company was competing with Confluent before we pivoted. Yup, this is one more example, just like Pulsar. There are definitely gre
12.
by galeaspablo 1y ago
It is useful, but it is not generally applicable. Given an arbitrary causality graph between n messages, it would be ideal if you could consume your messages in topological order. And that you could do so in O(n log n). No queuing system in
13.
by galeaspablo 1y ago
Agreed. The head of line problem is worth solving for certain use cases. But today, all streaming systems (or workarounds) with per message key acknowledgements incur O(n^2) costs in either computation, bandwidth, or storage per n messages.
14.
by galeaspablo 2y ago
Thanks for posting the NPR source. I read about the anesthesia case from VOX, and they claimed the opposite, namely that there would be no additional costs for the patients https://www.vox.com/policy/390031/anthem
15.
Why your AI generated abstract was rejected for NDC Oslo [video](youtube.com)
1 points by galeaspablo 2y ago|0 comments
16.
by galeaspablo 2y ago
Good leadership is spot on! Agreed. The cynic part of me sees incentives that discourage mature leadership styles. Leaders tend to be impatient and think of this quarter’s OKRs as opposed to the business’ long term financial health. In othe
17.
by galeaspablo 2y ago
Many engineers don’t truly care about the correctness issue, until it’s too late. Similar to security. Or they care but don’t bother checking whether what they’re doing is correct. For example, in my field, where microservices/actors&#
18.
by galeaspablo 2y ago
If anything, even if he’s aware, I’d say it’s pretty much in line with the spirit. Albeit, I can’t speak for Tim O’Reilly, but just like I don’t expect to become a billionaire from writing an open source framework, I don’t go around crediti
19.
by galeaspablo 2y ago
I can’t help but read this under the lens of my own experiences. For me open source is really about capturing less than I create, much like it’s written in the article. Heck, I’m a founder and we haven’t open sourced our product because we
20.
Cycle Helmet Safety(imperial.ac.uk)
2 points by galeaspablo 2y ago|0 comments
21.
CrowdStrike investigated over breach of fiduciary duties(scott-scott.com)
36 points by galeaspablo 2y ago|0 comments
22.
Kubernetes – Ingress vs. Load Balancers(blog.gpkb.org)
3 points by galeaspablo 2y ago|0 comments
23.
by galeaspablo 2y ago
Yes, for operational use cases. Eg event driven microservices communication. Keeping in mind we replace the sink as well, which allows us to do cool things such as https://ambar.cloud/blog/optimal-consumption-with-adapt
24.
by galeaspablo 2y ago
Hey Denis, I haven’t run into you before. But hi, this is Luis, Ambar’s founder. Nice to meet a fellow data streamer. When I started writing Ambar I thought streaming from a database was a solved problem. But in operational use cases where
25.
by galeaspablo 2y ago
We use Kafka under the hood. We stream instead of poll. We used to work at the Kafka team in AWS :) Our thesis is that a big blocker is the PhD the whole team needs in Kafka. For example, if you want to set up an API similar to Ambar with t
26.
by galeaspablo 2y ago
Disclosure: this post is from my colleague. A: You have managed vendors that simplify Kafka, such as MSK, Confluent, and Redpanda. And other software like Pulsar. But we believe the solution to the time sink exposed in the article lies one
27.
Pterosaurs were originally tiny tree climbers(phys.org)
2 points by galeaspablo 2y ago|0 comments
28.
Kafka Is Costing You Years of Engineering Time(ambar.cloud)
3 points by galeaspablo 2y ago|10 comments
29.
Show HN: PGT-Proxy – A PostgreSQL Proxy in 277 Lines of Rust(github.com)
10 points by galeaspablo 2y ago|0 comments
30.
Stonehenge's Altar Stone origins reveal advanced ancient Britain(phys.org)
1 points by galeaspablo 2y ago|1 comments

More ›