6 ms·
FWIW -- Granite r2 small is a 30M model, still small enough to run on CPU, and a good baseline for fine tunes.
by jbellis 2mo ago
FWIW -- Granite r2 small is a 30M model, still small enough to run on CPU, and a good baseline for fine tunes.
- soycaporal 2mo agoawesome, noted, looking for capable teacher models to distill other architectures
- jbellis 2mo agovoyage 4 nano is sota at the next size up and if you really want the best teacher models it's probably the voyage commercial APIs