6 ms·
Not just RLHF but also RLVR, and isn't that the litter lesson though? My sense of the Sutton Dwarkesh interview was that he was calling out that he didn't mean
by snthpy 2mo ago
Not just RLHF but also RLVR, and isn't that the litter lesson though?
My sense of the Sutton Dwarkesh interview was that he was calling out that he didn't mean just longer datasets, but rather learning through exploration and that's exactly RL.
- andai 2mo agoThey just need more contact with reality. That's what RL is right? Contact with narrow subsets of reality.