9 ms·

3.5-turbo might be 20B, not 10x larger https://www.reddit.com/r/LocalLLaMA/comments/17jrj82/new_microsoft_codediffusion_paper_suggests_gpt35/ https://www.reddi

• moffkalast 3y ago
  Hmm right, the ~300B figure may have been for the non-turbo 3.5
• orbital-decay 3y ago
  Let's see... the linked arXiv article has been withdrawn by the author with the following comment: > Contains inappropriately sourced conjecture of OpenAI's ChatGPT parameter count from this http URL, a citation which was omitted. The authors do not have direct knowledge or verification of this information, and relied solely on this article, which may lead to public confusion The URL in question: https://www.forbes.com/sites/forbestechcouncil/2023/02/17/is-bigger-better-why-the-chatgpt-vs-gpt-3-vs-gpt-4-battle-is-just-a-family-chat/?sh=2f28c9335b65 https://www.forbes.com/sites/forbestechcouncil/2023/02/17/is... This article was written by Aleks Farseev, the CEO of SoMonitor.ai, who makes the claim with no source or explanation: > ChatGPT is not just smaller (20 billion vs. 175 billion parameters) and therefore faster than GPT-3