be7a

30 ms·

1.
TokenSpeed: A Speed-of-Light LLM Inference Engine for Agentic Workloads(lightseek.org)
2 points by be7a 4mo ago|0 comments
2.
by be7a 5mo ago
Users get two completions for their prompt and rank them. From this you can then use Bradley-Terry to get Elo scores per model.
3.
by be7a 5mo ago
242 Elo points clear of the next best model and 93% win rate against random models (96% against nano banana) while Gemini 3.1 (second best) sits at 67%. That’s quite the leap.
4.
System Card: Claude Mythos Preview [pdf](www-cdn.anthropic.com)
848 points by be7a 5mo ago|658 comments
5.
by be7a 1y ago
The biggest takeaway is that they claim SOTA for multi-modal stuff even ahead of proprietary models and still released it as open-weights. My first tests suggest this might actually be true, will continue testing. Wow
6.
by be7a 1y ago
Super interesting that they moved away from their specialized, Lean-based system from last year to a more general-purpose LLM + RL approach. I would suspect this likely leads to improved performance even outside of math competitions. It’ll
7.
by be7a 1y ago
The rate limits apply only to the Gemini API. There is also Vertex from GCP, which offers the same models (and even more, such as Claude) at the same pricing, but with much higher rate limits (basically none, as long as they don't need
8.
by be7a 2y ago
Have you checked out https://github.com/prefix-dev/pixi ? It's built by the folks who developed Mamba (a faster Conda implementation). It supports PyPI dependencies using UV, offers first-class support for multi-en
9.
Crossing the uncanny valley of conversational voice(sesame.com)
15 points by be7a 2y ago|0 comments
10.
Prompt-Visual Engineering for GPT4V(twitter.com)
2 points by be7a 3y ago|0 comments
11.
by be7a 3y ago
Mastermind intrigued me in the same way as the author some time ago, and I've used it as a standard problem when trying out new computational frameworks/methods ever since. Here is my Rust version with multi-threading, SIMD, WASM