7 ms·
Fewer parameters at inference time makes a massive difference in cost for batch jobs, assuming vram usage is the same
by sa-code 2y ago
Fewer parameters at inference time makes a massive difference in cost for batch jobs, assuming vram usage is the same