8 ms·Things such as AirLLM, or good old llama.cpp.by Macuyiko 7mo agoThings such as AirLLM, or good old llama.cpp.