5 ms·
Didn't know the "Highest scoring EU model" has a low bar, lower than Qwen3.8-27B, but still congratulations on the milestone, hopefully next iterations will get
by throwaw12 14d ago
Didn't know the "Highest scoring EU model" has a low bar, lower than Qwen3.8-27B, but still congratulations on the milestone, hopefully next iterations will get better from here
- Schlagbohrer 14d agoIt is surprising given how many parameters it has that it scores so low. But, hopefully this will build up domestic talent and understanding and let Europe compete on the world stage with this.
- nicman23 14d agoi mean qwen3.8 is a technical marvel
- walrus01 14d ago3.8-flash-next quantized in a "large" Q4 that just fits in 128GB RAM even more so, in how close it can get to state of the art in a number of benchmarks. Or a large Q8 version of it that fits in under 190GB. Competing against things that are closed weights/opaque information about the model and might very well be 600B+ in size.
- nicman23 14d agoit "fits" in 64 ram with mmap. granted it runs at 15 tk/s with a 9070xt but it runs
- walrus01 14d agoRight, I meant "fits" in the sense of I can load the whole thing into some combination of system RAM and GPU at llama-server launch. 15 tk/s isn't useless if you can give it big tasks to do overnight, or like ask it to do something and check back 3-4 hours later.
- nicman23 13d agoyeah specially if you have it do some long task that also has to wait for ie compilation anyways