sandkoan

10 ms·

1.
by sandkoan 1y ago
DeepMind.
2.
by sandkoan 2y ago
See https://musiccontrolnet.github.io/web/
3.
by sandkoan 2y ago
sudo !!
4.
by sandkoan 3y ago
Ilya says this here: https://www.youtube.com/watch?v=AKMuA_TVz3A
5.
New Funding from Andreessen Horowitz(quorablog.quora.com)
5 points by sandkoan 3y ago|1 comments
6.
by sandkoan 3y ago
For anyone else interested, the paper he's referring to is "The Reversal Curse": https://arxiv.org/abs/2309.12288 .
7.
by sandkoan 3y ago
For anyone who's curious, the paper in question, entitled, "Lost in the Middle: How Language Models Use Long Contexts" ( https://arxiv.org/abs/2307.03172 )
8.
by sandkoan 3y ago
This is part of what we're doing at Automorphic. Building shareable, stackable adapters that you can compose like lego bricks.
9.
by sandkoan 3y ago
This is what we did at Trex ( https://github.com/automorphic-ai/trex ). The tricky part is doing it quickly and efficiently.
10.
by sandkoan 3y ago
Also using a similar method: https://github.com/automorphic-ai/trex Playground: https://automorphic.ai/playground
11.
by sandkoan 3y ago
Relevant: Built this which generalizes to arbitrary regex patterns / context free grammars with 100% adherence and is model-agnostic — https://news.ycombinator.com/item?id=36750083
12.
by sandkoan 3y ago
Yeah, then it seems we agree. I was just pointing out that it's not necessary to finetune OSS models to behave like OpenAI functions if you're able to do something similar to what we did (no tuning involved!).
13.
by sandkoan 3y ago
Ahh, no, the value of this isn't as much the model as it is the infrastructure enabling structure enforcement.
14.
Can you beat our firewall?(automorphic.ai)
2 points by sandkoan 3y ago|0 comments
15.
by sandkoan 3y ago
https://news.ycombinator.com/item?id=36752991
16.
by sandkoan 3y ago
You wouldn't actually want to, because you'd be losing generalizability, and it's a lot of unnecessary work. I think approach #1 outlined above is the better (more cost- and time-efficient) technique—where a pretrained model
17.
by sandkoan 3y ago
Ahh, I've been meaning to try FLARE—was it a marked improvement over traditional RAG?
18.
by sandkoan 3y ago
Thanks for the reminder—done!
19.
by sandkoan 3y ago
This is model agnostic, actually—any model on HuggingFace is compatible. So if someone wanted to run this with their own model, they could.
20.
by sandkoan 3y ago
Custom LLM—hence the self-hostability.
21.
by sandkoan 3y ago
Costs add up surprisingly quickly. A quote-colon-space-quote combo alone is four tokens wasted. Now scale that up....
22.
by sandkoan 3y ago
https://news.ycombinator.com/item?id=36753254 Does this help clarify?
23.
by sandkoan 3y ago
The prompt is given to our model as a guiding aid (a suggestion), and the cfg is used to constrain the model to generate only tokens that abide by the schema (an enforcement). That's how we ensure only valid outputs at text generation
24.
by sandkoan 3y ago
We have folks playing around with it mostly through the playground / raw HTTP endpoints as opposed to the Python API. And we've got some batch jobs running, which adds further traffic.
25.
by sandkoan 3y ago
Problems with OpenAI: 1) You're wasting GPT tokens on outputting JSON instead of meaningful information. 2) GPT functions won't, with absolute, 100% certainty, return JSON in the schema you want. In 1% to 3% of cases it hallucinat
26.
by sandkoan 3y ago
We enable conforming to arbitrary context free grammars in addition to regex patterns, and have a bunch of speed optimizations, as well. Though it may not seem too fast right now on account of the hundreds of simultaneous requests we'r
27.
by sandkoan 3y ago
Ahh, that—due to compute limitations we're forced to run a very small model that isn't as capable of converting 5'8" to inches. The larger model is, though.
28.
Anything Can Be a Weekend Hack(blog.govindgnana.com)
2 points by sandkoan 3y ago|0 comments
29.
Show HN: Structured output from LLMs without reprompting(automorphic.ai)
174 points by sandkoan 3y ago|54 comments
30.
Words: The Programming Language for Ideas(readymag.com)
2 points by sandkoan 3y ago|0 comments

More ›