7 ms·
the point seems to be making a small binary to run language model. How useful is that? From a functional perspective, I guess not very but the model can be impr
by bippihippi1 2y ago
the point seems to be making a small binary to run language model.
How useful is that?
From a functional perspective, I guess not very but the model can be improved.
From a performance / cost perspective, also not very because most of the cost is in training the model and small binary isn't necessarily indicative of quick.
I guess it's just kind of interesting that it doesn't take that much code to run the model.