5 ms·
We are talking about models of the flash size, 100s of billions of parameters, don't listen to the media, size does matter
by desterothx 9d ago
We are talking about models of the flash size, 100s of billions of parameters, don't listen to the media, size does matter
- EagnaIonat 9d agoI was just pointing out your claim that you can't get a response in 3 seconds. If I had asked the model just for the code it was under a second. Local models are good enough that it's not an issue. But keep changing the goalposts if it makes you happy.