5 ms·
It’s 27b active params vs 13b active params, so you’d expect it to be 2x more expensive when serving multiple users
by tipsytoad 29d ago
It’s 27b active params vs 13b active params, so you’d expect it to be 2x more expensive when serving multiple users