7 ms·
How is this k8s alternative when the homepage is focusing about running LLM models and AI content in containers rather than being for all workloads? Maybe it’s
by abusaidm 2y ago
How is this k8s alternative when the homepage is focusing about running LLM models and AI content in containers rather than being for all workloads?
Maybe it’s k8s alternative for AI/LLM!
- cheptsov 2y agoHi, I’m one of the contributors to dstack! Yes, you’re absolutely right—the title is a bit off. It should be "K8S for AI Teams Only." And yes, there is a lot of focus on LLMs specifically. If you have any other feedback, please share it!
- abusaidm 2y agoI think framing it as being able to run LLMs with ease and portability across machines and hardware is an amazing sell. Most guides are very technical and detailed that it’s a barrier for many to self host.