btwillard

9 ms·

1.
by btwillard 2y ago
I hope that person is paying you for this positive PR spin!
2.
by btwillard 2y ago
As others here are saying, the rules are the same for everyone in that anyone can effectively buy their freedom (even if only gradually over time). The practical difference is that most people can't afford it.
3.
How fast can grammar-structured LLM generation be?(blog.dottxt.co)
2 points by btwillard 2y ago|0 comments
4.
Show HN: VLLM with JSON Guided Generation(outlines-dev.github.io)
11 points by btwillard 3y ago|3 comments
5.
by btwillard 3y ago
Obviously it depends on exactly what those opinions will end up being. It's hard to dispel the idea that every other big company isn't trying to find a way to do exactly the same things as the other big players, just somewhere el
6.
by btwillard 3y ago
OpenAI function calling provides a means of producing valid JSON from a function signature, or a simplified version of a JSON schema definition; however, it has two big downsides: 1. it doesn't work with open-source models, and 2. som
7.
Show HN: An open-source alternative to OpenAI function calling(outlines-dev.github.io)
4 points by btwillard 3y ago|1 comments
8.
by btwillard 3y ago
In my experience, that's always been the standard among Vim--and even some Emacs--users.
9.
by btwillard 3y ago
We've considered it, but I haven't started any work on it. Feel free to create an issue to track the status, if only to find out who else might be interested and/or working on it.
10.
by btwillard 3y ago
We provide this in https://github.com/outlines-dev/outlines .
11.
by btwillard 3y ago
Our project Outlines provides JSON output in a near optimal way that also works for all types of pre-trained transformer-based LLMs: https://github.com/outlines-dev/outlines Our approach also extends to EBNF grammars a
12.
by btwillard 3y ago
In case anyone is wondering, this is essentially a few complaints about the basic transpilation/source-to-source approach taken by Cython and then some promotion for Rust. It unfortunately mixes some general C/C++ complaints in t
13.
by btwillard 3y ago
We also had an implementation of grammar-driven guidance around the same time: https://github.com/normal-computing/outlines/pull/131 . I imagine many others did as well, given all the papers we found on the s
14.
by btwillard 3y ago
FYI: We've had grammar constraints available in Outlines for a while, but not using the FSM and indexing approach that makes the regex case so fast. My open PR only adds that.
15.
by btwillard 3y ago
Ha, yeah, in a distant, but really fun, past!
16.
by btwillard 3y ago
The underlying approach can improve the performance of anything that requires the set of non-zero probability tokens at each step, and anything that needs to continue matching/parsing from a previous state.
17.
by btwillard 3y ago
Yeah, and our addition to all that is to almost completely remove the cost of determining the next valid tokens on each step.
18.
by btwillard 3y ago
With our indexing approach, it only costs a dictionary lookup to get the next valid tokens during each sampling step, so very little latency.
19.
by btwillard 3y ago
> It means I have exceptionally high confidence that this will be the biggest thing to hit the economy, society and markets in the last hundred years for good and ill. How does having ADHD and/or Asperger's mean that? Are you
20.
by btwillard 4y ago
We're working on some of the DSL-related parts of this in https://github.com/aesara-devs
21.
by btwillard 4y ago
It sounds like you're saying you want to hire people who weren't laid off? If so, what's the reasoning behind this?
22.
by btwillard 4y ago
Eh, Steve!?
23.
by btwillard 4y ago
Not a complete replacement, but very cool and related: https://github.com/webyrd/Barliman
24.
by btwillard 4y ago
> Arxiv's submission policy says: "Submissions to arXiv should be topical and refereeable scientific contributions that follow accepted standards of scholarly communication." ( https://arxiv.org/help/su
25.
by btwillard 4y ago
Do you think he's trying to poison the minds of young mathematicians? At the very least, you're raising ArXiV and YouTube to a standard they openly do not meet. Also, did you raise these points to him and he denied your evidence&#
26.
by btwillard 4y ago
> It is bad practice to post incorrect results and not retract them when this is pointed out. And it's good practice to take shots at people whenever you see their name? Also, no, there's no "practice" that says you c
27.
by btwillard 4y ago
> He has continued to update the paper (as recently as last year), it has not been retracted, and he appears to maintain the proof is correct on his YouTube channel. You know that ArXiV and YouTube aren't considered "journals&q
28.
by btwillard 4y ago
> It's not the discussion that makes you a crank. It's publishing a paper claiming you have solved something that you haven't even begun to understand. It's bypassing peer review. It's ignoring all the literature
29.
by btwillard 4y ago
It's odd that people can't work on something in which they're interested and talk about it publicly without being labeled a "crank". Sorry, there's nothing holy about the Riemann Hypothesis; anyone can add thei
30.
by btwillard 5y ago
It's a pretty big investment, but there's a sit/stand/lay workstation here: https://altwork.com/

More ›