5 ms·
> Pretraining a GPT 4-class model from raw data requires trillions of tokens and millions of dollars in compute, And millions of documents authored by people t
by wgj 3y ago
> Pretraining a GPT 4-class model from raw data requires trillions of tokens and millions of dollars in compute,
And millions of documents authored by people that weren't compensated.
The difference is consolidating all of that value into a single company.
- smegger001 3y agoAnd they largely put their work online for free where anyone can read it not expecteing any kind of direct compensation by the reader.