6 ms·
Thank you for trying it :) I just added the 27B support 1 hour ago. Let me check and try to fix it. All other models should work as expected but if you have iss
by stfurkan 2mo ago
Thank you for trying it :) I just added the 27B support 1 hour ago. Let me check and try to fix it. All other models should work as expected but if you have issues with them too, I can take a look.
- stfurkan 2mo agoHi again :) I updated the engine and 27B model should work in the demo[1]. We can still consider it as experimental but I am trying to make it better and efficient. 1. https://stfurkan.github.io/bitgpu/examples/chat.html https://stfurkan.github.io/bitgpu/examples/chat.html