6 ms·
What models would you recommend for basic classification if you don't need a 24B parameter one?
by pheeney 2y ago
What models would you recommend for basic classification if you don't need a 24B parameter one?
- elorant 2y agoI’m using Llama-3 8B to classify html files. It’s surprisingly good, and I run it on an RTX 4060 Ti at 8-bit quantization. No complains so far.
- josh-sematic 2y agoYou might find this comparison chart helpful: https://www.airtrain.ai/blog/how-15-top-llms-perform-on-classification-accuracy-vs-cost-breakdown https://www.airtrain.ai/blog/how-15-top-llms-perform-on-clas... Note: from October; also I work at Airtrain
- Beretta_Vexee 2y agoThere's no alternative to testing with your own data. The majority of our data is in French, and our benchmarks differ greatly from public benchmarks generally based on English documents.