4 ms·

I'm not sure, I've tried looking it up and couldn't find an official answer. But that site says GPT3 is 175b and GPT4 is 170 trillion. That's insane if true Ed

by nperez 3y ago

I'm not sure, I've tried looking it up and couldn't find an official answer. But that site says GPT3 is 175b and GPT4 is 170 trillion. That's insane if true Edit: and this one says 1.7, idk https://levelup.gitconnected.com/gpt-4-parameters-explained-everything-you-need-to-know-e210c20576ca https://levelup.gitconnected.com/gpt-4-parameters-explained-... Haven't used chatgpt in a bit, but looks like the free tier is GPT3 still, so 175b may be correct if OP isn't a subscriber

johntiger1 3y ago
I was testing on GPT3.5-Turbo, the free tier.
- nperez 3y ago
  Ah, 175b it is then. That's actually kind of encouraging that an open source trillion+ param model isn't needed to get there. A 180b Falcon model very recently came out https://huggingface.co/tiiuae/falcon-180B https://huggingface.co/tiiuae/falcon-180B A finetune of this might be competitive, but I haven't tried it.
- nickthegreek 3y ago
  That should be in your article.