Y
HN Search
Hacker News Search
new
|
comments
|
top
|
jobs
reexpressionist
searching Neon…
1.
▲
2.
▲
3.
▲
4.
▲
5.
▲
6.
▲
9 ms
·
1.
▲
by
reexpressionist
3y ago
This type of behavior (and related) would primarily only be an issue with unconstrained generative models. If you're the one deploying the model, or a downstream consumer, once trained, the neural network can be reexpressed (via an exo
2.
▲
by
reexpressionist
3y ago
I believe we have two rather different settings in mind. My statement assumes the enterprise use-case, where having a verifier is required. (In this context, I'm also assuming the approach of constraining against the observed data.) In
3.
▲
by
reexpressionist
3y ago
The alternative approach is to start with a small[er] model, but derive reliable uncertainty estimates, only moving to a larger model if necessary (i.e., if the probability of the predictions is lower than needed for the task). And I agree
4.
▲
by
reexpressionist
3y ago
If the end goal is document classification and/or semantic search, the Reexpress Fast I model (3.2 billion parameters) is a good choice. The key is that it produces reliable uncertainty estimates (for classification), so you know if yo
5.
▲
Efficient LLM fine-tuning for classification on Mac
(github.com)
1 points
by
reexpressionist
3y ago
|
1 comments
6.
▲
by
reexpressionist
3y ago
TL;DR: Reexpress makes it really easy (and inexpensive) to fine-tune a large language model (LLM) for typical document classification tasks. All of the processing happens on your Mac and you also get the indispensable additional advantages
7.
▲
How to locally run a semantic search with representations fine-tuned on your Mac
(github.com)
1 points
by
reexpressionist
3y ago
|
0 comments
8.
▲
Show HN: On-device, no-code LLMs with guardrails (for Apple Silicon)
(re.express)
2 points
by
reexpressionist
3y ago
|
0 comments
9.
▲
by
reexpressionist
3y ago
Important essay and points. I want to mention that there exist now practical technical approaches that can be used to create trustworthy AI...and such approaches can be run on local models, as this comment suggests. > "[...] [AI] wi
10.
▲
by
reexpressionist
3y ago
Ditto. This is the most sophisticated viz of parameters I've seen...and it's also an interactive, step-through tutorial!
11.
▲
by
reexpressionist
3y ago
"As with most software development, modern AI work is all about knowing your tools and when it's appropriate to use them." 100% agree. Ditto with just using the easiest to access models as initial proof-of-concept/dev&#x
12.
▲
by
reexpressionist
3y ago
I like the analogy to a router and local Mixture of Experts; that's basically how I see things going, as well. (Also, agreed that Huggingface has really gone far in making it possible to build such systems across many models.) There&#x