5 ms·
Experimental Falcon inference via ggml (so on CPU): https://github.com/cmp-nct/ggllm.cpp https://github.com/cmp-nct/ggllm.cpp It has problems but it does work
by orost 3y ago
Experimental Falcon inference via ggml (so on CPU): https://github.com/cmp-nct/ggllm.cpp https://github.com/cmp-nct/ggllm.cpp
It has problems but it does work