5 ms·
Follow on, great question (separately from John) can it run on Vulkan? He was saying he has a hard time finding stuff that doesn’t only run on CUDA or ROCm and
by Unheard3610 1y ago
Follow on, great question (separately from John) can it run on Vulkan?
He was saying he has a hard time finding stuff that doesn’t only run on CUDA or ROCm and sees this as a huge opportunity
- rgthelen 11mo agoYes! Vulcan support is in dev (will be in the next versioned release, probably tomorrow). You can pull down the repo and run a few easy commands to get inference up and running. https://docs.llamafarm.dev/docs/models#lemonade-runtime https://docs.llamafarm.dev/docs/models#lemonade-runtime