7 ms·
No reason other than their Q4 model working reasonably well and fast on my CPU laptop. Should work with any ONNX VLM model
by mrkn1 3mo ago
No reason other than their Q4 model working reasonably well and fast on my CPU laptop. Should work with any ONNX VLM model