5 ms·
It's because Fable is just synthetic RL tasks + scale. The secret has been out for awhile now.
by extr 1mo ago
It's because Fable is just synthetic RL tasks + scale. The secret has been out for awhile now.
- causal 1mo agoDoes not explain timing
- extr 1mo agokeep in mind fable = mythos which as been "done" since february. so the gap is not 2 months, it's more like - techniques probably started "working" in late 2025, now are trickling down to 2nd tier labs 9 months later.
- causal 1mo agoYeah that would make more sense, it's probably a tight community and word gets around when something starts working.
- tintor 1mo agoMaybe because frontier labs buy the same RL tasks from task producer companies.
- behnamoh 1mo agoWho are these task producers? Are you saying that Anthropic, et al delegate the RL part to third party companies that do it for pretty much every other AI company as well?
- ardivekar 1mo agoTuring, etc. And yes.
- adastra22 1mo agoThere are companies that will pay you $$$ for technical challenges that stump frontier models. I’ve met these people. They make good money.
- mike_hearn 1mo agoYes they're called RL gym companies and there's a whole ecosystem of them. You hardly hear about them because their only customers are AI labs and RLVR is where the improvements are coming from at the frontier right now. Note that RLVR is incredibly compute expensive but it's CPU as much as GPU.
- guywithahat 1mo agoYes it does, it just means all the companies come out with similar models around the same time. If what they were doing was completely novel, it would take a long time to repeat. As it is now each company releases a new model every few months, and every couple years the "leading" company changes.
- lossolo 1mo agoThis is basically the answer, they generate A LOT of synthetic task rollouts in parallel, then use RL on the resulting reward signals to improve the model. Add scale to this and you have a Fable class model.