7 ms·
You don't happen to know a whisper solution that combines diarization with live audio transcription, do you?
by Morizero 1y ago
You don't happen to know a whisper solution that combines diarization with live audio transcription, do you?
- kmfrk 1y agoProper diarization still remains a white whale for me, unfortunately. Last I looked into it, the main options required API access to external services, which put me off. I think it was pyannotate.audio[1]. [1]: https://github.com/pyannote/pyannote-audio https://github.com/pyannote/pyannote-audio
- peterleiser 1y agoI used diarization in https://github.com/jhj0517/Whisper-WebUI https://github.com/jhj0517/Whisper-WebUI last night and once it downloads the model from HuggingFace it runs offline (it claims).
- jduckles 1y agoWhipserX's diarization is great imo: whisperx input.mp3 --language en --diarize --output_format vtt --model large-v2 Works a treat for Zoom interviews. Diarization is sometimes a bit off, but generally its correct.
- Morizero 1y ago> input.mp3 Thanks but I'm looking for live diarization.
- peterleiser 1y agoCheck out https://github.com/jhj0517/Whisper-WebUI https://github.com/jhj0517/Whisper-WebUI I ran it last night using docker and it worked extremely well. You need a HuggingFace read-only API token for the Diarization. I found that the web UI ignored the token, but worked fine when I added it to docker compose as an environment variable.