6 ms·

Isn't ChatGPT a 165B parameter model?

• sanxiyn 3y ago
  No. OpenAI haven't disclosed parameter count of GPT-3.5 or GPT-4, which are models used by ChatGPT. You may be thinking of GPT-3, which is indeed a 175B parameter model.
  • levesque 3y ago
    Ah, interesting. Thought GPT-3.5 had the same structure as GPT-3, for some reason. GPT-4 would obviously be different.
    • MacsHeadroom 3y ago
      GPT-3.5 is likely a finetuned Curie 13B using output from the full size GPT-3 175B.