5 ms·
I think you may be underestimating how difficult a text search over their data is. They may have to build new mechanisms to do this. And what you really want is
by vlovich123 8d ago
I think you may be underestimating how difficult a text search over their data is. They may have to build new mechanisms to do this. And what you really want is also an attribution of how much of a contribution a given corpus made which is a much harder question to answer; a single appearance of a chat probably has very little impact on the inference performance at this time unless it’s been explicitly preferenced somehow
- Catloafdev 8d agoI don't think anyone really cares about 'the measured impact the data had on the exact result' - a question which is fundamentally difficult to answer accurately in the first place - but rather whether the data was used in training at all - which as Tristan described, was extensive, beyond simply a 'single chat.' Can you explain the difficulty in engineering a search apparatus over a corpus of text data? Actually searching through it may not be easy, sure, but it's work that's doable, and creating an index is relatively trivial.
- JoshTriplett 8d ago> Can you explain the difficulty in engineering a search apparatus over a corpus of text data? My guess: "If we ever imply that's possible, people might start asking questions about all the other work we've ripped off, so the official answer is that it's impossible".
- dd8601fn 8d agoIf they literally can’t audit training data for a given model, they shouldn’t be operating.
- JumpCrisscross 8d ago> If they literally can’t audit training data for a given model, they shouldn’t be operating They can operate. They shouldn’t be claiming credit for discovering anything.