Unheard3610

8 ms·

1. 1.▲
   by Unheard3610 11mo ago

   Follow on, great question (separately from John) can it run on Vulkan? He was saying he has a hard time finding stuff that doesn’t only run on CUDA or ROCm and sees this as a huge opportunity
2. 2.▲
   by Unheard3610 11mo ago

   Yeah! Or maybe the GPU rental and lab market? (At least those that aren’t already fully hyperscaler captured?) like we were chatting about John?
3. 3.▲
   by Unheard3610 1y ago

   but wait, why should I do this for my first home grown orchestration instead of something else? Like, if I want to set up a local LLM running on my old laptop for some kind of RAG on all my hard drives why is this best? Or if I want agentic