Y
HN Search
Hacker News Search
new
|
comments
|
top
|
jobs
peer0
searching Neon…
1.
▲
2.
▲
3.
▲
4.
▲
5.
▲
6.
▲
6 ms
·
1.
▲
by
peer0
4mo ago
https://github.com/ggml-org/llama.cpp/blob/master/grammars/R... llama.cpp supports grammar limiting using either GBNF or json schema (It just translate it to GBNF behind the scenes I think). So I h
2.
▲
by
peer0
4mo ago
This seems similar to what I done using llama.cpp's "Grammar constrained generation" for my local agents. But using that instead of catching and retrying it is just literally impossible for the LLM to generate something that