randomgermanguy

6 ms·

1.
by randomgermanguy 9d ago
But a better model almost always comes with a better dollar-per-task-accomplished ratio, compared to worse models. So not only outpriced, outperformed, but also outregulated. Idk i wish there was some bright light in the future, but i dont
2.
by randomgermanguy 22d ago
When was FOSS apolitical ?
3.
by randomgermanguy 5mo ago
Definitely something in this realm, they call the models "preview" at a bunch of different points in the paper. What im really hoping is for a double-punch like with V3 -> R1
4.
by randomgermanguy 5mo ago
> "can I get my coding work actually done today" vs. "this can do customer support chat" I think you need to define "can get coding work done" for this to make sense. Ive been using GPT-3 back-then for basic
5.
by randomgermanguy 5mo ago
I mean its almost halve a year, i think that counts ?
6.
by randomgermanguy 5mo ago
Only comparing on SOTA scores (ignoring price etc.) is like choosing your daily-driver by looking at who makes the fastest sports-car...
7.
by randomgermanguy 5mo ago
If you found a rare 9000 card with 200+ GB of VRAM, sure
8.
by randomgermanguy 5mo ago
I think the general question is if they'll release it at all, haven't yet read anything stating that they would
9.
by randomgermanguy 6mo ago
One can see the impact of this cultural-wave on people above ~40 pretty heavily. Hand-in-hand with the whole "Atomkraft ? Nein Danke" campaign. ( https://en.wikipedia.org/wiki/Nuclear_Power%3F_No_Thanks )
10.
by randomgermanguy 6mo ago
The major selling point of the tinyboxes is that you're able to run them in your office without any hassle. I used to own a Dell Poweredge for my home-office, but those fans even on minimal setting kept me up at night
11.
by randomgermanguy 6mo ago
Yes, but in practice land-ownership is only zero sum in places like Europe where every square-kilometer has 300 years of documented ownership etc, or other high-density areas. The Asia, Africa & the Americas have so much unused space th
12.
by randomgermanguy 6mo ago
I think the author might argue, that simply becoming more efficient at creating a rent-seeking mechanism is not beneficial. No matter how well motivated you are to improve your zero-sum game skills, it's still zero-sum. Or something li
13.
by randomgermanguy 6mo ago
You can already buy A100/H100s on eBay. While it might not ever be economical to run these at home (cost of electricity), but it's plenty fun.
14.
Optimizing a Rust Thread-Pool (Part 1/?)(jakobsachs.blog)
2 points by randomgermanguy 7mo ago|0 comments
15.
by randomgermanguy 7mo ago
Cool idea, but kinda sad that it has to go through a cloud-provider. I feel like there's a possibility with an accelerator-board (Coral TPU or something), to make this into a totally local thing maybe? The longer-waiting time is surel
16.
InferenceX v2: Nvidia Blackwell vs AMD vs. Hopper – SemiAnalysis(newsletter.semianalysis.com)
4 points by randomgermanguy 7mo ago|0 comments
17.
The tiny corp – Nvidia is a Software Company(consensus-hongkong.coindesk.com)
1 points by randomgermanguy 7mo ago|0 comments
18.
by randomgermanguy 8mo ago
why would I believe a random account with 1k followers ?
19.
by randomgermanguy 10mo ago
The fact that I have to give them an email for details just feels immediately like a B2B-scam. Hope they can figure out software, but what im seeing isn't super-promising
20.
by randomgermanguy 10mo ago
I started using https://github.com/kushalpandya/Petrichor a while ago. Though design is more akin to the default Apple Music app than WinAmp.
21.
by randomgermanguy 10mo ago
Always love seeing a new BMC talk
22.
by randomgermanguy 10mo ago
Made my eyes glaze over only slightly faster than trying to listen to the real Zizek. Well done!
23.
by randomgermanguy 10mo ago
I guess the question is if it's like the crypto-bubble, where theres no real value left in the end (haven't heard of a good use for those ASICs). Or more like the dot-com bubble where fiber-cable installed is still valuable with
24.
by randomgermanguy 10mo ago
Alright fair enough. I dont think this is relevant to the main-point, but it's definitely something I wasn't aware of. I would've thought it might have an impact on like O(100)th token in some negligible way, but glad to lea
25.
by randomgermanguy 10mo ago
Okay yes, but would you really say that the main part of non-determinism in LLM-usage stems from this ? No its obviously the topk sampling. I don't think my tech-lead was trying to suggest the floating-point error/non-associativi
26.
by randomgermanguy 10mo ago
Topk sampling with temp = 0 should be pretty much deterministic (ignoring floating-point errors)
27.
by randomgermanguy 10mo ago
Oh actually yeah that's true. You have correctly out-nitpicked my nitpick lol. But at that point i feel like we are getting close to "everything that isn't a perfect Turing-machine is somewhat-stochastic" ;) Edit: someon
28.
by randomgermanguy 10mo ago
Less then 100 people all-in-all.
29.
by randomgermanguy 10mo ago
Not a joke. I'm still a student, like half a year away from finishing my masters, so switching jobs at this point feels bit risky/early? Maybe im wrong though
30.
by randomgermanguy 10mo ago
Okay thanks for saving my sanity somewhat. And also just to nitpick/joke: > More accurately, it is neural networks which are more "stochastic" with their predictions and decisions <...> I would defend NNs to not even

More ›