Y
HN Search
Hacker News Search
new
|
comments
|
top
|
jobs
beadw
searching Neon…
1.
▲
2.
▲
3.
▲
4.
▲
5.
▲
6.
▲
6 ms
·
1.
▲
Synaxi-predict: I'm trying to predict token cost before it happens
(github.com)
1 points
by
beadw
3mo ago
|
1 comments
2.
▲
by
beadw
3mo ago
Hey folks. Keen to hear your thoughts on this. I’m have been working with agent orchestration patterns for a while now and cost optimisation in general. I thought it would be cool if you could see what the cost of a task would be with diffe
3.
▲
by
beadw
3mo ago
I think you’re spot on. In my experience people confuse a models ability to solve some benchmark as a sign of its usefulness. Token throughput is often just as important from my personal usage. I am excited for more diffusion models to see