6 ms·
Does it say anywhere which model it’s using? I see references to vLLM in the GitHub but not which actual model (Llama, Mistral, etc.) or if they have a custom
by slipheen 8mo ago
Does it say anywhere which model it’s using?
I see references to vLLM in the GitHub but not which actual model (Llama, Mistral, etc.) or if they have a custom fine tune, or you give your own huggingface link?