8 ms·

I haven't tried it, but colibri is meant to allow running GLM 5.2 the 744B model in 32GB by using prefetches and streaming from fast SSDs. https://github.com/J

I haven't tried it, but colibri is meant to allow running GLM 5.2 the 744B model in 32GB by using prefetches and streaming from fast SSDs. https://github.com/JustVugg/colibri https://github.com/JustVugg/colibri

kcb 2mo ago
Terrible performance on $20,000 worth of GPUs.