5 ms·
Other than the specific phrases like load-bearing etc, I find the biggest tell of all just to be repetition. Every damn Claude article does the “tell ‘em what
by JSR_FDED 24d ago
Other than the specific phrases like load-bearing etc, I find the biggest tell of all just to be repetition.
Every damn Claude article does the “tell ‘em what you’re going to tell ‘em, tell ‘em, tell ‘em what you told ‘em” routine.
- BoredomIsFun 24d agoStiff, repetive style is often a result of very small, less than 0.5 sampling temperature, very small top-k, very high min-p etc. Most of "normies" (wrt to /r/localllama and /r/sillytavernai) never tweak the samplers.
- weird-eye-issue 24d agoYou must not be doing much real work with these models, otherwise you would know that with the latest Claude models you can't even adjust the temperature or top p/k The real way to actually get a good output has always been in the prompt, not these parameters
- BoredomIsFun 24d ago> You must not be doing much real work with these models, otherwise you would know that with the latest Claude models you can't even adjust the temperature or top p/k No, I do not. Good for me I guess. > The real way to actually get a good output has always been in the prompt, not these parameters What an absurd claim.
- weird-eye-issue 23d agoHave fun toying around with your local models and leave the real work to the rest of us buddy
- BoredomIsFun 23d agoHave fun using web-interfaces for overpriced US models while I am getting my work done with Chinese models for a fraction of price on openrouter using API. Besides, when using API I am sure all American models, including Claude honour sampling settings.
- weird-eye-issue 23d agoNo, they don't. That's the whole point. I've spent several hundred thousand dollars in API costs in the last few years to power my app, I think I know what I'm talking about. Nobody besides you is talking about web interfaces Meanwhile you clearly have zero clue what you are talking about because a simple Google search would show you otherwise but that must be too difficult for you
- BoredomIsFun 23d ago> I've spent several hundred thousand dollars in API costs in the last few years to power my app Which is kinda sad, if you've used Anthropic products, because you could get comparable performance from cheaper models for vast majority of tasks. > No, they don't. That's the whole point. Bad for them; do not use Anthropic then. Besides "the whole point" of conversation you have interrupted is that "low temperature and tight sampling produces stiff boring cliche prose" - which is truism, as those settings control the entropy of the output. And it is utterly irrelevant frankly if one has access to the Claude sampler through API or not; as Anthropic has apparently locked the sampler at very conservative temperature (probably as low as 0.2), there is no way to squeeze god prose out of it, as the logits have been severely messed up wrt to the actual word distribution in standard English.
- weird-eye-issue 23d agoYou are dumber than a rock
- BoredomIsFun 23d agoYou are dumber thanme
- Der_Einzige 24d agoWrong: https://gist.github.com/Hellisotherpeople/71ba712f9f899adcb08b94bce20d5397 https://gist.github.com/Hellisotherpeople/71ba712f9f899adcb0...
- weird-eye-issue 23d agoNice slop
- BoredomIsFun 23d agoYou are flaunting your inability/unwillingness to use sampler settings.
- weird-eye-issue 23d agoWhat? They aren't even available for the new Claude models which we use extensively so I think that should tell you something. I've made over $6 million with my AI app in the last few years without worrying about temperature and other parameters. What have you done?
- BoredomIsFun 23d ago> I've made over $6 million with my AI app in the last few years Oh, wow. > without worrying about temperature and other parameters. Tells a lot about you.