7 ms·
Don't forget that gcc is in the training set. That's what always puts me off: when AI replaces artists, SO and FOSS projects, it can only feed into itself and
by phorkyas82 7mo ago
Don't forget that gcc is in the training set.
That's what always puts me off: when AI replaces artists, SO and FOSS projects, it can only feed into itself and deteriorate..
- FeepingCreature 7mo agoit can feed into itself and improve. the idea that self-training necessarily causes deterioration is fanfic. remember that they spend massive amounts of compute on rl.
- kuboble 7mo agoThe AlphaZero approach shows otherwise, as long as there is an automated way to generate new test cases and evaluate the outcomes. We can't do it for all domains, but I believe we can for efficient code. today's models could be probably already good enough to compose tasks, and evaluate the results.