Y
HN Search
Hacker News Search
new
|
comments
|
top
|
jobs
evanhu_
searching Neon…
1.
▲
2.
▲
3.
▲
4.
▲
5.
▲
6.
▲
9 ms
·
1.
▲
Show HN: Transpose Spotify audio and isolate vocals/instruments in realtime
(github.com)
1 points
by
evanhu_
24d ago
|
0 comments
2.
▲
Show HN: Transposify–change Spotify song key from your menubar for singing
(github.com)
2 points
by
evanhu_
4mo ago
|
0 comments
3.
▲
by
evanhu_
5mo ago
I don't use that one!
4.
▲
The new grads are not okay
(blog.evan.hu)
4 points
by
evanhu_
5mo ago
|
2 comments
5.
▲
by
evanhu_
3y ago
Thank you so much, yes I will have that up soon as well
6.
▲
by
evanhu_
3y ago
I did try that at first, it was hard to parse through the HTML code and organize into logical sections (authors, references, abstract) and then clean up the text to prepare it optimally for chunking and embedding. Once I found GROBID I just
7.
▲
by
evanhu_
3y ago
There is a cache! You hit a new PDF but at least you will not have to wait for that one again ;)
8.
▲
by
evanhu_
3y ago
Definitely I'll move to the LaTeX source code instead of a PDF backend since that allows better support for non textual data that gets poorly scraped by GROBID. That is a really cool development I didn't know about, also theres h
9.
▲
by
evanhu_
3y ago
Oops sorry for the miscommunication, actually you don't need to enter an API key for now. Feel free to just try it out!
10.
▲
by
evanhu_
3y ago
Thank you :). I updated the README to have some more explanation of the steps. The chunking algorithm chunks by logical section (intro, abstract, authors, etc.) and also utilizes recursive subdivision chunking (chunk at 512 characters, then
11.
▲
by
evanhu_
3y ago
Thank you! Thanks for pointing that out, since the underlying RAG is rather naive (simple embedding cosine similarity lookup, as opposed to knowledge graph / advanced techniques), I opted to embed both "small" (512 character
12.
▲
by
evanhu_
3y ago
Yes! I'll set up talk2biorxiv.org very soon as it would be simple to port over. I also plan on making the underlying research PDF RAG framework available as an independent module
13.
▲
by
evanhu_
3y ago
I spent forever looking at various PDF parsing solutions like Unstructured, and eventually stumbled across GROBID, which was an absolute perfect fit since it's entirely made for scientific papers and has header/section level segme
14.
▲
Show HN: Talk to any ArXiv paper just by changing the URL
(github.com)
194 points
by
evanhu_
3y ago
|
73 comments
15.
▲
by
evanhu_
5y ago
I'm super impressed with what you've managed to create, do you have any further plans with this project? I'm curious now that it's finished and documented to such an extent will you try to bring it publicity and actual u