rs38

7 ms·

1.
by rs38 1mo ago
pretty sure this exists already...
2.
by rs38 2mo ago
404?
3.
by rs38 2mo ago
is there a realistic way to distill 2 consumer hardware friendly models with max ~200B and ~20B? Qwen did it, but would it be possible for 3rd parties (unsloth etc)?
4.
by rs38 3mo ago
wanna chime in, recently tried vLLM to consume a NVFP4 Gemma4 safetensor model and see how the batching can show up in nice t/s numbers. it's slow to start, it's Linux only, it doesn't like WSL much, ended up with either
5.
by rs38 4mo ago
my latest experiments with local LLM (mistral coder variations) fitting in older 6 GB GTX1060 were disappointing as long as you try to hook Copilot (CLI or VScode) to it and are used to provide a lot tooling. this seems to bloat initial pro
6.
by rs38 5mo ago
both 5.4 were best bang (-mini even more as I found it usually same well performing!!!) for the buck before. Now they face cost reality it seems.
7.
by rs38 5mo ago
e.g. if on an annual plan? 0x will be gone, but there are okay 1x and 0.3x models left. I am pretty much curious how the early may test invoicing will look like. current setup of tools etc. is way too chatty eats up 1+M token per PRU easily
8.
by rs38 10mo ago
not sure how much resources it took from my WinARM Win11 as store app, but it's buggy in either release or beta since months as it loses network connectivity after some time...
9.
by rs38 10mo ago
I think it's more Dave that "sucks"...click baiting titles, no need to and ever and ever repeating that he was at MS. He should do Podcasts as there is no value in videos only speaking (feels like 1.5x btw)
10.
by rs38 2y ago
Stackoverflow usage down to 10%
11.
by rs38 2y ago
at least the naming implies factor ~20 less :)
12.
by rs38 2y ago
this paper is going through mass media meanwhile as it alledgely shows how Skynet started to take over...
13.
by rs38 3y ago
found my glasses and there is a candidate AVX optimized to 1 GB/s
14.
by rs38 3y ago
do I need glasses, or not a single c#/.net implementation?
15.
by rs38 6y ago
nice one: https://www.youtube.com/watch?v=ejA0wKTRHH4 Presentation shown to new Mercedes salsman in the late 1980s and early 90s. Covers lots of sales tips and techniques to help put the customer in the driver's seat o
16.
by rs38 10y ago
great!