7 ms·
I really like Inkbot! Are you working on a new version? How about one from Yi 34B?
by thecal 3y ago
I really like Inkbot! Are you working on a new version? How about one from Yi 34B?
- Tostino 3y agoYeah, I will be soon. I was busy adding `chat template` support to vLLM recently, so the model (and any others that implement it properly) will work seamlessly with a clone of the OpenAI chat/completions endpoint. https://github.com/vllm-project/vllm/pull/1756 https://github.com/vllm-project/vllm/pull/1756 Now that I have that out of the way, back to model training ;).
- thecal 3y agoVery cool, looking forward to it!