5 ms·
Great read and interesting analysis! I’m less charitable toward Anthropic supposedly not distilling ChatGPT for training purposes. Maybe not today, but during t
by rad-b 1mo ago
Great read and interesting analysis! I’m less charitable toward Anthropic supposedly not distilling ChatGPT for training purposes. Maybe not today, but during the GPT-4 era when Anthropic was the underdog - I can see it happen. Packaged along with some of Amodei’s clever jumping through hoops to prove how that is, in fact, virtuous.
- cma 1mo agoDistilling is only prohibited from chats you prompt. But there are lots in the open like the LMSYS Chatbot Arena data. It's a essentially one of the largest public sources of preference data, maybe still useful for boostraping RLHF and successor techniques (possibly a more highly educated contributor base than the low paid contractors), and was full of GPT-4-era inputs.
- PeterStuer 1mo agoHow is distilling prohibited? AFAIK, the input is mine, and the output is not copyrightable.
- tancop 1mo agoits banned by the terms of service. but contracts dont override copyright law, all they can do is terminate your account if they find out. when you give the outputs to a third party anthropic cant go after them. the copyright doesnt belong to them so all they can do is sue you for breach of contract where its impossible to prove damages.