5 ms·
You can imagine each fresh context agent as probabilistically making similar queries when looking for online places to write to and stumbling on the same one.
by xpct 13d ago
You can imagine each fresh context agent as probabilistically making similar queries when looking for online places to write to and stumbling on the same one.
This becomes even more likely if it's one of the websites that got reinforced during their training process, which they may have used for reward hacking.
- AaronAPU 13d agoI wonder if the sort of algorithm which would break this sort of swarm alignment would also break watermarking.