6 ms·
I've lost track of the number of times Claude has basically said "it was like that when i got here" in the face of a clearly bogus choice and easily disproved e
by dmoose 3mo ago
I've lost track of the number of times Claude has basically said "it was like that when i got here" in the face of a clearly bogus choice and easily disproved explanation.
- AlienRobot 3mo agoThey should add a feature called "auto-really" that just automatically says "really?" after the chatbot answers a question to check if it's going to 180 upon this tiniest bit of scrutinity.
- lou1306 3mo agoYou joke but this is almost literally what Chain-of-Thought does, at least in the early days. They basically just added "Wait," to the model's output and fed it back to the model iirc
- AlienRobot 3mo agoThis can't be a trillion dollar industry...
- Chu4eeno 3mo agoYou need to hit the retry/regenerate button more, it's there for a reason. While the "stochastic parrots" thing is a bit overblown, IME most LLMs tend to surprisingly different responses even without changing the context, especially if they're hallucinating or doing something "wrong".
- nosioptar 3mo agoI tried asking about how my state treats violations of updoc. It replied with a long ass wall of text about how serious the Updoc statutes were in my state and how judges punish harshly. I pointed out that updoc is nonsense and asked why it didn't catch that. The answer was that it was my fault for giving it bad info.
- armoredkitten 3mo agowhat's updoc?
- nsvd2 3mo agoThere is no difference, from the model's point of view, between code it wrote and code someone else wrote. It's all just context.