5 ms·
Can I run the llm on a ssh server and use it with this plugin?
by looofooo 3y ago
Can I run the llm on a ssh server and use it with this plugin?
- jart 3y agoI don't see why not. You'd probably just change this code: (with-local-quit (call-process "wizardcoder-python-34b-v1.0.Q5_K_M.llamafile" nil (list (current-buffer) nil) t "--prompt-cache" cash "--prompt-cache-all" "--silent-prompt" "--temp" "0" "-c" "1024" "-ngl" "35" "-r" "```" "-r" "\n}" "-f" hist)) To be something like this instead: (with-local-quit (call-process "ssh" hist (list (current-buffer) nil) t "hostname" "wizardcoder-python-34b-v1.0.Q5_K_M.llamafile" "--prompt-cache" cash "--prompt-cache-all" "--silent-prompt" "--temp" "0" "-c" "1024" "-ngl" "35" "-r" "```" "-r" "\n}" "-f" "/dev/stdin")) I'd also change `cash` to replace '/' with '_' and prefix it with "/tmp/" so remote collective caching just works.