sglang is also worth mentioning. Fills a similar role as vLLM, but with less fiddling at the knobs to get a working setup For a GUI experience that also serves

sglang is also worth mentioning. Fills a similar role as vLLM, but with less fiddling at the knobs to get a working setup For a GUI experience that also serves an OpenAI-compatible API, Unsloth studio or LM Studio is probably the way to go