5 ms·
Yeah and it's degraded significantly since then. Older llms were still mostly language focused and had a lot of latent knowledge about things like writing style
by Bolwin 1mo ago
Yeah and it's degraded significantly since then. Older llms were still mostly language focused and had a lot of latent knowledge about things like writing styles. Now it's crowded out in favor of agenetic work, programming etc.
- conception 1mo agoI’m surprised no one has distilled a 4o model yet that’s really good at prose. No money from enterprise users I suppose.
- gwern 1mo agoNo, the latent knowledge is larger than ever, as verified by many benchmarks (and instances like people being shocked by truesight of obscure forum posters). This is 100% a chatbot personality/alignment/post-training thing.
- HWR_14 1mo ago> truesight of obscure forum posters What does this mean?
- bloqs 1mo agoIt's almost like a claudeism
- Smaug123 1mo agoGwern, who posted that comment, is one of the early popularisers of the term. Janus used it in at least 2023, and Gwern in at least early 2024. If anything, you probably have the causation backwards: Claude talks like a LessWrong poster.
- mathgeek 1mo agoTruesight is a spell in D&D that allows you to see the true being behind an illusion or other deception.
- gwern 1mo agoStylometry on steroids: https://gwern.net/doc/statistics/stylometry/truesight/index https://gwern.net/doc/statistics/stylometry/truesight/index