5 ms·
12B, though. What about 1.2T?
by nmca 5y ago
12B, though. What about 1.2T?
- lstmemery 5y agoYou need to scale the amount of data to take advantage of the increase in parameters. I'm not sure where we would find another 100 GitHubs worth of data.