6 ms·
Good point! I thought you meant splitting them and then doing inference with some kind of learned router while keeping all the split models loaded at once. What
by bigmadshoe 2mo ago
Good point! I thought you meant splitting them and then doing inference with some kind of learned router while keeping all the split models loaded at once. What you're suggesting is pretty sensible.