6 ms·did you run inference with vllm?by segmondy 13d agodid you run inference with vllm?srcreigh 13d agoNo, I don't own any of this hardware, im just summarizing what I could find by reading others posted benchmarks