6 ms·

That's not how it works. Llama and Llama 2's raw model is not "censored". Their fine tunes often are, either explicitly, like Facebook's own chat fine tune of l

That's not how it works. Llama and Llama 2's raw model is not "censored". Their fine tunes often are, either explicitly, like Facebook's own chat fine tune of llama 2, or inadvertently, because they trained with data derived from chatGPT, and chatGPT is "censored". When models are "uncensored", people are just tweaking the data used for fine tuning and training the raw models on it again.

TechBro8615 3y ago
> because they trained with data derived from chatGPT Can you expand on this (genuinely curious)? Did Facebook use ChatGPT during the fine-tuning process for llama, or are you referring to independent developers doing their own fine-tuning of the models?
- cosmojg 3y ago
  Yes, much of the dataset was simply copied and pasted from the inputs/outputs of other chatbots.
  - __loam 3y ago
    Incredibly bad practice lol
    - zacmps 3y ago
      Not really, it's a whole field (model stealing).
- stu2b50 3y ago
  The community fine tunes. I doubt Facebook used chatgpt.