nodja

8 ms·

1.
by nodja 3d ago
Same reason they go into low margin with the PS4/PS5 and other projects. Market penetration.
2.
by nodja 4d ago
Youtube allows you to AB test with up to 3 titles and thumbnails.
3.
by nodja 1mo ago
The whole site looks like and reads like AI slop. The outcomes also don't make any sense and don't feel rigorously tested (no, having claude test for you doesn't count as rigorous).
4.
by nodja 1mo ago
I'm the same way, I have a very low/sporadic usage of any subscription I've tried. I now just use openrouter with DS4 pro/flash. It also gets rid of usage anxiety where I would try to justify the $20/month by forcin
5.
by nodja 2mo ago
The way I think about it is that it's unreasonable for a compute graph with a static number of operations to be able to answer both y=a*10 and something like y=((((x+x)*(x+1))/((2*x)+2))+((x*(x+3))/(x+3))-((x*x)/(x+1))+(
6.
by nodja 2mo ago
I'm not a heavy user of agentic coding, but still use them quite a bit for some automation here and there. I've been going around shopping all the ~$10 subscriptions and I finally settled on openrouter + ds4 pro. The more intensiv
7.
by nodja 2mo ago
Yes, the whole list will always sum to 1 (100%) because there's lots of more sampling parameters. top_p, top_k and temperature are just the ones that affect output the most. Most parameters do math around assuming the list sums to 1 an
8.
by nodja 2mo ago
The posted answers are either behind a paywall or very obtuse so I'll just explain. I'll assume you know what tokens are. A models output is not a single token, but a list with the probability for all the tokens that it knows, so
9.
by nodja 2mo ago
Yup, it's the main reason I don't use LM studio more. I only use it to try out new models/quants, then use llama.cpp directly to host them. LM Studio also doesn't do stuff like audio input and often has bugs that pure ll
10.
by nodja 2mo ago
It doesn't matter until it does. If the chinese government decides that open weight model releases are no longer allowed, that's a lot of companies that can't release new models. Same with the US government, etc. Having diver
11.
by nodja 2mo ago
This hasn't been tested in court. But there's a high chance that model weights are not copyrightable, only the code to generate them is. Cloud models are usually protected by trade secret laws, leaking them would get you in troubl
12.
by nodja 2mo ago
Yes. Having 4 names are quite common in Portugal, specially in certain areas. The names are usually structured like this: G1 G2 FM FF G1 and G2 are given names. Usually 2 "first names" that you see in english, but there's com
13.
by nodja 2mo ago
> but I don't see any historical analogues. The losers are quickly forgotten. Palm, Blackberry, AOL, MySpace. Yahoo, etc. Software gets replaced all the time too, you even listed one and didn't realize. 15 years ago you'd
14.
by nodja 2mo ago
Same here, first try I tried asking from the main studio page, and it didn't catch the comment at all despite being the latest comment. When asking specifically from the video, it did fool the AI somewhat[1], but no link. I tried chang
15.
by nodja 3mo ago
That's only correct for specific models and not what parent was referring to. Stable Diffusion 3, an open weights model, was laughed at at release for not being able to even generate a woman laying in grass. The community attributed th
16.
by nodja 3mo ago
Last thing you want a model to do is hallucinate a tool call and it's outputs...
17.
by nodja 3mo ago
Pipeline parallelism. Instead of splitting layers by row/column. You split at the layer edges. So instead of having this huge bottleneck of bandwidth you only need to transfer about 4KB per token when changing devices on a model like Q
18.
by nodja 3mo ago
I wonder if this move will backfire on them. All the fabs are focusing on HBM and leaving DDR behind, if one of the big frontier labs folds all the memory fabs will be left holding a big bag of HBM memory. They won't have any other cho
19.
by nodja 4mo ago
Not OP but if I had a couple RTX 6000 I'd throw them at decompiling bloodborne to play on PC without emulation.
20.
by nodja 4mo ago
When a cyclist is leading a pack and pushing themselves against the air resistance for half the race, do you expect that cyclist to win, or one of the ones behind that's been taking it easy in the slipstream? It's a race metaphor
21.
by nodja 4mo ago
GP here, leading and winning are different things in the race context/metaphor. In foot/cycling races there's often a pack leader, that leader is often not the winner of the race, all they're doing is taking the brunt of
22.
by nodja 4mo ago
If they got there by tiring themselves out more than the other team, yes.
23.
by nodja 4mo ago
No, the US is _leading_ the AI race, but the race isn't over. What's the point of leading the race for 90% of it, if they're gonna slip on their own sweat and fall down by the end? In non metaphorical terms, what's the p
24.
by nodja 5mo ago
If I'm understanding this right, this presupposes that the models were pre-trained on unfiltered data like with the "floor" models, so when comparing between the "retail" and uncensored models they will obviously no
25.
by nodja 5mo ago
> speculative decoding which, generally speaking, is not the same quality as serving the model without it. I've never heard of ANY speculative decoding that wasn't lossless. If it was lossy it'd be called something else. T
26.
by nodja 5mo ago
That will depend on the model, but they'll hit compute limits before a typical GPU in almost all cases. Macs will still benefit a speedup from this, just not one as big as the one reported.
27.
by nodja 5mo ago
Same reason why prompt processing is faster than text generation. When you already know the tokens ahead of time you can calculate the probabilities of all tokens batched together, incurring significant bandwidth savings. This won't wo
28.
by nodja 5mo ago
Official sites make things worse on purpose after getting any sort of traction because they can't stop chasing profits. I don't watch sports, but my father watches soccer. He really only cares about 1 team and the national games f
29.
by nodja 5mo ago
Not parent but I can guess from watching mostly from the sidelines. They introduced a 1M context model semi-transparently without realizing the effects it would have, then refused to "make it right' to the customer which is a trai
30.
by nodja 5mo ago
You misunderstood. Instead of asking the model: "Here's this codebase, report any vulnerability." you ask. "Here's this codebase, report any vulnerability in module\main.c". The model can still explore referenc

More ›