6 ms·
> with AI-generated content excluded from pre-training. > without distillation from third-party models sounds like zero unless they are lying.
by ertgbnm 4mo ago
> with AI-generated content excluded from pre-training.
> without distillation from third-party models
sounds like zero unless they are lying.
- zamalek 4mo ago> with AI-generated content excluded from pre-training. Though this is largely impossible these days, unless they pre-trained on pre-AI era data.
- stymaar 4mo agoThat could be. Just use pre-training for language understanding and let the post-training on synthetic data do the heavy lifting.
- deleted 4mo ago[deleted]
- saghm 4mo ago"how many of those shapes are rectangles?" "sounds like zero unless they are squares" Adding "unless" to a statement makes it vacuous if the latter clause is weaker than the first clause. I find it hard to believe that a company willing to violate licenses would have scruples about lying about it.
- chongli 4mo agoAdding "unless" to a statement makes it vacuous if the latter clause is weaker than the first clause I think that's the point. "How do I say they're lying without outright saying they're lying?" It's a common rhetorical trick.
- Leynos 4mo agoOr the speaker is just not in the mood to argue with someone whose response will be, "you trust anything Microsoft say?"
- rocqua 4mo agoNot vacuous, but tautological. Which is different, because tautologies can actually be quite directly informative. Whereas vacuous truths tend to be oblique. Also, “Microsoft is lying” is not a logically stronger statement, because they might be lying about something other than whether they distilled or trained on AI output.