Y
HN Search
Hacker News Search
new
|
comments
|
top
|
jobs
zxt_tzx
searching Neon…
1.
▲
2.
▲
3.
▲
4.
▲
5.
▲
6.
▲
7 ms
·
1.
▲
Open sourcing SemHub, a semantic search tool for GitHub (by popular demand)
(github.com)
2 points
by
zxt_tzx
1y ago
|
1 comments
2.
▲
by
zxt_tzx
1y ago
My previous HN post ( https://news.ycombinator.com/item?id=43299659 ) got some traction, and several folks reached out asking for the source code, so here it is! Rumor has it a certain dedicated vector database provider (whos
3.
▲
by
zxt_tzx
2y ago
Thank you for the comment, compared to you I have only touched the bare surface of this quite complex domain, would love to get more of your input! > building HNSW indices in Postgres is still extremely slow (even with parallel index bui
4.
▲
by
zxt_tzx
2y ago
I'm glad you found it helpful :)
5.
▲
by
zxt_tzx
2y ago
> And overall, the fewer people use CF (or another provider of their size) the better. I understand your sentiment, but I vehemently disagree. The cloud provider space has rapidly become an oligopoly and CloudFlare is one of the few new
6.
▲
by
zxt_tzx
2y ago
After this failed experience with SemHub, I am actually thinking of building something like this, for open source maintainers like you are definitely the ICP! (nuqs seems really cool btw, storing state in the URL param is definitely the way
7.
▲
by
zxt_tzx
2y ago
Thanks for sharing! Do you have more details to share, e.g. did you just have a vector db, or did you have a main db as well? In my research, Qdrant was also the top contender and I even created an account with them, but the need to sync tw
8.
▲
by
zxt_tzx
2y ago
Ah I was doing semantic search of GitHub _issues_, not the actual code on GitHub. For code search, I have used grep.app, which works reasonably well
9.
▲
by
zxt_tzx
2y ago
> There’s so much complexity that comes with keeping your vector db in sync with you main db (especially once you start filtering with metadata) Ohh do you speak from experience? I know I will likely never do this, but curious how did yo
10.
▲
by
zxt_tzx
2y ago
oh wow that's super cool, I tried it and it's very fast indeed. thanks for sharing! will spend more time to understand how it's implemented
11.
▲
by
zxt_tzx
2y ago
Thanks for the feedback, to be honest, my own experience is actually very similar to yours. The original pain point probably only exists for small minority of open source maintainers who manage multiple repos and actually search across them
12.
▲
by
zxt_tzx
2y ago
> Have you looked into chunking (breaking input into smaller chunks and doing vector search on the chunks)? Ohh I had not seriously considered this until reading this. I could have multiple embeddings per issue and search across those em
13.
▲
by
zxt_tzx
2y ago
> it's weird you consider this a failure. you spent a few months and learned how to work with embedding models to build an efficient search. the fact that your search works well is a successful outcome. Thank you for your encouragem
14.
▲
by
zxt_tzx
2y ago
Ohh apologies, I think there was a bug that led to the Internal Server Error, please try again, I _think_ it should be working now! > I think a project like yours is going to be helpful to OSS library maintainers to see which features ar
15.
▲
by
zxt_tzx
2y ago
Totally fair point. Thanks for taking the time to read through it! I guess I didn't want to use a VPS and then have to switch to something else if the product really worked, but I guess that rhymes with premature optimization. Some oth
16.
▲
by
zxt_tzx
2y ago
Author here. Over the last few months, I have built and launched a free semantic search tool for GitHub called SemHub ( https://semhub.dev/ ). In this blog post, I share what I’ve learned and why I’ve failed, so that other bu
17.
▲
Long Read: Lessons from Building Semantic Search for GitHub and Why I Failed
(tzx.notion.site)
146 points
by
zxt_tzx
2y ago
|
51 comments
18.
▲
Show HN: Issues search on GitHub sucks, that's why I built SemHub
(semhub.dev)
1 points
by
zxt_tzx
2y ago
|
0 comments
19.
▲
AI agents are local first clients
(sunilpai.dev)
1 points
by
zxt_tzx
2y ago
|
0 comments
20.
▲
Show HN: I built SemHub to perform semantic search on GitHub issues
(semhub.dev)
2 points
by
zxt_tzx
2y ago
|
0 comments
21.
▲
by
zxt_tzx
2y ago
It's always a little dubious when modern people pretend to have high confidence about the behaviors of long-dead people to serve their modern purposes. (Another example: oh you're an INFJ, just like Moses from the Bible!)
22.
▲
by
zxt_tzx
2y ago
I met one of the founders of Coder.com, he's a really cool dude. It's a pity that it is a product aimed more at enterprises than individual developers, else it would have far more developer mindshare. Unlike, say, GitHub Codespace
23.
▲
by
zxt_tzx
2y ago
Mildly interesting that the author runs a media relations company in SF. On the one hand, I am sympathetic to the general perspective of the original article. On the other hand, that the same person is writing “hit pieces” and running a med
24.
▲
by
zxt_tzx
2y ago
Interesting stuff. We use MemoryDB as the underlying service for BullMQ, a NodeJS queue that’s built on top of Redis. We trade off a bit of speed and cost (MemoryDB costs more than Elasticache) for persistence and BullMQ’s many features, wh
25.
▲
What every JavaScript developer should know about Unicode
(dmitripavlutin.com)
1 points
by
zxt_tzx
3y ago
|
0 comments
26.
▲
by
zxt_tzx
3y ago
I was inspired by Hey.com’s screener feature but I didn’t want to move my existing Gmail accounts, so I created one for myself: https://app.inboxhero.org/ The idea is first-time senders will be moved out of your inbox and y
27.
▲
by
zxt_tzx
3y ago
Hey, I have only just started to use it. My colleagues swear by it, which is how I've found out about it in the first place. I think there's no magic and we'll still have to resolve merge conflicts on our own, but my sense is
28.
▲
Ask HN: Has anyone done the Gmail CASA Tier 2 assessment?
6 points
by
zxt_tzx
3y ago
|
0 comments
29.
▲
by
zxt_tzx
3y ago
I think Git itself is probably too entrenched to be displaced by now, but I recently came across Graphite ( https://graphite.dev/ ) and, while it’s all still Git under the hood, it abstracts away many of the common pain point
30.
▲
Linear cofounder explains system architecture to enable collaborative editing
(twitter.com)
2 points
by
zxt_tzx
3y ago
|
0 comments
More ›