5 ms·
Another llama.cpp and mistral.rs? If it support vision models then fine, I will try it. EDIT: Looks like no L3.2 11B yet.
by vietvu 2y ago
Another llama.cpp and mistral.rs? If it support vision models then fine, I will try it.
EDIT: Looks like no L3.2 11B yet.
- littlestymaar 2y agoIt supports the PHI 3.5 vision model since yesterday actually. I think a 11B model would be way too slow in its current shape though.