8 ms·
This is a huge unlock for on-device inference. The download time of larger models makes local inference unusable for non-technical users.
by aazo11 1y ago
This is a huge unlock for on-device inference. The download time of larger models makes local inference unusable for non-technical users.