6 ms·
NVFP4 would buy them a huge increase in capacity but I think it would be noticeable.
by selectodude 7d ago
NVFP4 would buy them a huge increase in capacity but I think it would be noticeable.
- Caracas288 7d agoWhy doesn't someone just try to measure this next time!?
- embedding-shape 7d agoCan't really measure without being sure you aren't being messed around with, when it's a remote platform. Stupidly easy to detect when people run such benchmarks/tests against you as well.