kingcauchy

6 ms·

1.
A Search-and-Inference Database from Scratch in Pure Zig(antfly.io)
19 points by kingcauchy 2d ago|4 comments
2.
by kingcauchy 3mo ago
I wonder if we'll see a new sort of "role" in the training (user, system, assistant) for unstrusted sources, I'm a little surprised we haven't already. In fact it would probably make sense to have an arbitrary numbe
3.
by kingcauchy 3mo ago
How much of the apology was written by Claude? How much of the release note process was written by Claude? Will they have better prompts going forward to make sure Claude doesn't write upsetting things into the release notes for devs l
4.
by kingcauchy 3mo ago
« Trust us, we’re doing this for the good of humanity » (fills pockets with stock value and externalities from data center polloution) « No seriously trust us , at least we’re not Sam Altman » Update: « Oh and we’re the only ones who will s
5.
by kingcauchy 3mo ago
It's also hard to imagine them not doing this with any of the products they're building. "You can't use Claude to build an agent because that competes with Claude Code, you can't use Claude to build a design tool be
6.
by kingcauchy 3mo ago
"We won't use this product to spy or build weapons but you'll have to trust us, but we're also going to intentionally lie to you when you break our terms of service but trust us."
7.
by kingcauchy 3mo ago
The silently never telling you is so insidious on top of it being ridiculous given how they trained the model in the first place. We do distributed model training for embedder/reranker models and I'd deeply resonate that this arti
8.
by kingcauchy 4mo ago
I work with you so I'm bias but I think this is neat.
9.
by kingcauchy 6mo ago
Thanks for the feedback! In regards to contention, the answer is definitely dependent on how you host. We've had a lot of experience running different ML workloads and from an SRE perspective we knew you'd need a variety of differ
10.
by kingcauchy 6mo ago
I'd be super interested to here more about what you all do in this space, currently Antfly (and Termite) doesn't handle custom content types explicitly because we've mostly focused on supporting the "classic" ones (
11.
by kingcauchy 6mo ago
https://github.com/antflydb/antfly/pull/8 Upon another look it looks like we were actually missing the pause lock for the backfill operation too during a shard split though, I also went ahead and added it to
12.
by kingcauchy 6mo ago
I guessed that neo4j gets this question a lot so I went to see if they had a good blog post and this one is pretty good https://neo4j.com/blog/cypher-and-gql/10-things-you-can-do-w...
13.
by kingcauchy 6mo ago
Possibly, Amazon and Google also made the ability for smaller startup based DB companies to go that route with things like ValKey and OpenSearch. LLMs have made it super easy to transpile the ideas into whatever programming language you ple
14.
by kingcauchy 6mo ago
Nope! Awesome you’re poking around though. I’m currently working on deterministic simulation testing and a feature set to allow pausing of index backfills but it’s not fully implemented yet, stay tuned!
15.
by kingcauchy 6mo ago
Great question! I think the fundamentally hard problem with distributed systems (at least for me!) comes down to the complicated distributed state machines you have to manage rather than the memory management problems. I think async rust ge
16.
by kingcauchy 6mo ago
Fascinating! We settled on Quic with Protobuf because it was more performant in our testing than the gRPC when coupled with the backoff, failure cases (node startup ordering server/client connections), and to not be coupled with the gR
17.
by kingcauchy 6mo ago
I've added a specific example for that using the go-sdk https://github.com/antflydb/antfly/pull/5 here!
18.
by kingcauchy 6mo ago
I can't speak for everyone, knowledge graphs are the "new hotness" of the ai space (RAG and MCP are seeing a lull in their hype cycles I guess). But I've used graphs professionally for a long time to connect relationship
19.
by kingcauchy 6mo ago
There's some examples in the quickstart on the website but I'll add an explicit e2e example case for that too. Otherwise the tests for that are a little lower level in the code! I'll add the RSF (merging of the two lists) exa
20.
by kingcauchy 6mo ago
Thanks! Fixed that up!
21.
by kingcauchy 6mo ago
Oh thanks for the 404 on the verify link (I abstracted out the auth OIDC for cross domain login and must have missed a path). Yes good call, I tried to start that on the website with a react-flows based architectural flow chart a little bit
22.
by kingcauchy 6mo ago
Definitely open to working with you on supporting even better tooling for this as I imagine many different "styles" of migration will be necessary. The number 1 supported migration path for users though is one of my personal favor
23.
by kingcauchy 6mo ago
Yes we do use SIMD heavily! https://github.com/ajroetker/go-highway I also added SME support for Darwin for most algorithms. We use it in the full-text index, all over the vector indexes and heavily for the ml inferenc
24.
by kingcauchy 6mo ago
Not strictly google but microsoft/bing too, here's the top ones from my notes: https://arxiv.org/abs/2410.14452 spfresh, https://arxiv.org/abs/2111.08566 spann, https://arxiv.
25.
by kingcauchy 6mo ago
I built this for myself because I hated running a large ElasticSearch instance at work and wanted something that would autoscale and something that allowed for reindexing data. I also had a lot of experience running a large BigTable/El
26.
by kingcauchy 6mo ago
Thanks for the awesome questions!! Exactly the use case I built it for! I wanted a world where you could build your indexes and the query planner could just be smart enough to use them in a single query. I've not quite nailed down the
27.
Show HN: Antfly: Distributed, Multimodal Search and Memory and Graphs in Go(github.com)
107 points by kingcauchy 6mo ago|40 comments
28.
Show HN: Go-CoreML – Go Bindings for Apple's CoreML with Neural Engine Support(github.com)
6 points by kingcauchy 8mo ago|0 comments
29.
Show HN: Go-Highway – Portable SIMD for Go(github.com)
29 points by kingcauchy 9mo ago|2 comments