4 ms·
Knowing when to speak is actually a prediction task in itself. See eg https://arxiv.org/abs/2010.10874 https://arxiv.org/abs/2010.10874 Would be indeed great t
by pyryt 3y ago
Knowing when to speak is actually a prediction task in itself. See eg https://arxiv.org/abs/2010.10874 https://arxiv.org/abs/2010.10874
Would be indeed great to get something like this integrated with whisper, LLM and TTS
- stiffler01 3y agoYes, this is something we want to look into in more detail, really appreciate sharing the research.
- zachthewf 3y agoHard for me to imagine that this could be solved in text space. I think the prediction task needs to be done on the audio.
- stiffler01 3y agoWe thought about doing this in Whisper itself, since its already working in the audio space.