6 ms·
Due to nuances of how data is split across the various model files, the implementation involved some non-trivial steps in order for everything to be allocated c
by v64 4y ago
Due to nuances of how data is split across the various model files, the implementation involved some non-trivial steps in order for everything to be allocated correctly. The changes are here [1].
[1] https://github.com/ggerganov/llama.cpp/commit/5b8023d935401072b73b63ea995aaae040d57b87 https://github.com/ggerganov/llama.cpp/commit/5b8023d9354010...