5 ms·
Are you using a local Whisper? If yes, what do you use for inference, candle/ort?
by yehors 1y ago
Are you using a local Whisper? If yes, what do you use for inference, candle/ort?
- lukaesch 1y agoNot local. Inference is the only part not written in Rust so far. I am using Replicate to run docker images with a pipeline based on faster-whipser, VAD, pyannote and a custom LLM enhancement flow. Thanks for sharing candle/ort. Interesting to see the WASM in-browser opportunities