7 ms·
What would happen if they mass distilled one of the really large local models like GLM 700b or deepseek 1.6t?
by plufz 3mo ago
What would happen if they mass distilled one of the really large local models like GLM 700b or deepseek 1.6t?
- grim_io 3mo agoAt that point you might as well just host them yourself.
- sajithdilshan 3mo agoThat's not how the innovation works
- weezing 3mo agoInnovation is teaching your model on stolen data from literally everywhere but other models.
- kelipso 3mo agoInnovation is a pretty neutral concept. It doesn’t care about things like “what if my model learns from other models” as opposed to “what if my model learns from data I painfully curated” if the model progresses the same.
- sulam 3mo agoThose already exist.