26 ms·
And the hidden, trial and error runs tweaking the hyperparams. guaranteed, it cost >$5000 in training runs alone.
by subygan 2mo ago
And the hidden, trial and error runs tweaking the hyperparams. guaranteed, it cost >$5000 in training runs alone.
- gHA5 2mo agoI always wonder how often people in charge of massive compute tasks like LLM pre-training have messed up some detail that invalidates or fails to persist the results and only realise afterwards.
- jzilinskis 2mo agoNope, that was the total cost
- DonsDiscountGas 2mo agoNot to mention the labor cost.