6 ms·
How exactly does distilling a censored model produce an uncensored model?
by nitros 7mo ago
How exactly does distilling a censored model produce an uncensored model?
- nebezb 7mo agoIt doesn't. Anthropic are, as usual, sounding an alarm to pull the ladder up from behind them.
- ncb9094 7mo agoit technically can. there are patterns that emerge which manifest with no "safegurads" during training
- janalsncm 7mo agoFirst of all this is not technically distillation, it is more imitation learning. Second, you could do something like asking Claude to create 1 million prompt, offensive response, non offensive response triplets. Then train a model with DPO to prefer the offensive responses.