EffCompute

6 ms·

1.
by EffCompute 5mo ago
Rochus, your point about LLVM and the 'upper bound' of C optimization is a bit of a bitter pill for systems engineers. In my own work, I often hit that wall where I'm trying to express high-level data intent (like vector simi
2.
by EffCompute 5mo ago
That benchmark is a great data point, thanks for sharing. The performance parity with unoptimized GCC makes sense, given how much heavy lifting modern LLVM/GCC backends do for C++. Your approach with Micron and the 'language level
3.
by EffCompute 5mo ago
It's refreshing to see Oberon getting some love on the Pi. There’s a certain 'engineering elegance' in the Wirthian school of thought that we’ve largely lost in modern systems. While working on a C++ vector engine optimized f
4.
by EffCompute 5mo ago
I think EnPissant has a point regarding the overhead. Mapping semantic dependencies at the patch layer sounds great in theory, but the computational cost of resolving those graphs in a repository with thousands of changes is non-trivial. In
5.
by EffCompute 5mo ago
I really agree with jandrewrogers' point about the insularity of the database domain. While working on a custom C++ engine to handle 10M vectors in minimal RAM, I’ve noticed that many 'mainstream' concurrency patterns simply
6.
by EffCompute 6mo ago
One thing I'm trying to better understand is where the real limits are. At this point it feels like the bottleneck is less about raw compute and more about how efficiently data is represented and accessed on the GPU. Curious if others
7.
by EffCompute 6mo ago
Not yet — it's still a personal prototype and I'm actively experimenting with different approaches and optimizations. I’m trying to better understand the limits of what’s possible on consumer hardware before deciding how to packag
8.
by EffCompute 6mo ago
Quick update: I've been iterating on the approach and managed to push the coarse search further. Currently seeing ~100M vectors scanned in ~10ms on a single RTX 3090 (binary stage only). Still experimenting with trade-offs between spee
9.
70M vectors searched in 48ms on a single consumer GPU –results you won't believe
1 points by EffCompute 6mo ago|4 comments