5 ms·
At first blush, it is a really persuasive compromise between full-on LLM inference and boring old fuzzy history search! I really like it, this flavor of specia
by mpalmer 12d ago
At first blush, it is a really persuasive compromise between full-on LLM inference and boring old fuzzy history search!
I really like it, this flavor of specialization gives the user a win on privacy and speed. Seems like the right idea for such a tool.