5 ms·
You can use it for things like classifying documents, spam detection and detecting certain events, etc. You're right that it's not strong enough for coding but
by snek_case 1mo ago
You can use it for things like classifying documents, spam detection and detecting certain events, etc. You're right that it's not strong enough for coding but it can still be quite good for question answering and such. Or even simple things like converting documents from one format to another.
And yeah, for NPCs, this model and their other A1B model can fit inside of a game and run at a decent speed on CPU-only. It would probably be workable for game characters.