9 ms·
gpt-4 was indeed trained on gpt-3 instruct series (davinci, specifically). gpt-4 was never a newly trained model
by saliagato 2y ago
gpt-4 was indeed trained on gpt-3 instruct series (davinci, specifically). gpt-4 was never a newly trained model
- whimsicalism 2y agowhat are you talking about? you are wrong, for the record
- fooker 2y agoThey have pretty much admitted that GPT4 is a bunch of 3.5s in a trenchcoat.
- whimsicalism 2y agoThey have not. You probably read "MoE" and some pop article about what that means without having any clue.
- matsemann 2y agoIf you know better it would be nice of you to provide the correct information, and not just refute things.
- whimsicalism 2y agogpt-4 is a sparse MoE model with ~1.2T params. this is all public knowledge and immediately precludes the two previous commentators assertions