7 ms·

Gemini live has been able to do this for over a year now. I can just activate it on my phone and it really works surprisingly well, especially the interruption.

Gemini live has been able to do this for over a year now. I can just activate it on my phone and it really works surprisingly well, especially the interruption. I've tested it with my 95 year old Dutch grandmother and it switched seamlessly between English and Dutch with her and handled her poor hearing very well, including her asking for repetition. I'm a little surprised by how much OAI is playing catch up here.

scosman 2mo ago
ChatGPT has had this for over a year too. This is a better model.
davedx 2mo ago
Is gemini live the same app I have on my oneplus 15? I don't think that's full duplex?
- spongebobstoes 2mo ago
  it is not full duplex. I think this GPT-Live thing is the first full duplex speech to speech model
  - rryan 2mo ago
    ehh, no? definitely not. https://kyutai.org/blog/2024-07-03-meet-moshi/ https://kyutai.org/blog/2024-07-03-meet-moshi/
TaupeRanger 2mo ago
What do you mean? OpenAI has had a real-time voice model since August of last year. This is a new model with better performance.
thewebguyd 2mo ago
Gemini live is also pretty decent at computer vision stuff too. I've used it while working on my bike & car a few times, with my phone camera and it'll circle/highlight specific screws and parts. You can set your phone up on a tripod and it'll walk you through complete repairs for things.
- ZeroCool2u 2mo ago
  I used it for double checking some stuff while helping my friend build his PC! I had it in tight spaces and it helped me verify some details around which nvme slot to use first.
BeetleB 2mo ago
One thing Simon pointed out: Usually live voice models are not as capable as the frontier ones. What makes this one special is that it can delegate the task to a frontier model while talking to you.
HDThoreaun 2mo ago
Well Google has been working on voice assistants for years now on android. It makes sense that they had a head start
kkotak 2mo ago
Exactly! I've been using Gemini Live for a while now and have been able to converse quite fluently. Maybe it's the long think functionality that's a differentiator here from OAI, which I'd be surprised if Gemini doesn't come out with of their own this year.

scosman 2mo ago

ChatGPT has had this for over a year too. This is a better model.

davedx 2mo ago

Is gemini live the same app I have on my oneplus 15? I don't think that's full duplex?

spongebobstoes 2mo ago
it is not full duplex. I think this GPT-Live thing is the first full duplex speech to speech model
- rryan 2mo ago
  ehh, no? definitely not. https://kyutai.org/blog/2024-07-03-meet-moshi/ https://kyutai.org/blog/2024-07-03-meet-moshi/

TaupeRanger 2mo ago

What do you mean? OpenAI has had a real-time voice model since August of last year. This is a new model with better performance.

thewebguyd 2mo ago

Gemini live is also pretty decent at computer vision stuff too. I've used it while working on my bike & car a few times, with my phone camera and it'll circle/highlight specific screws and parts. You can set your phone up on a tripod and it'll walk you through complete repairs for things.

ZeroCool2u 2mo ago
I used it for double checking some stuff while helping my friend build his PC! I had it in tight spaces and it helped me verify some details around which nvme slot to use first.

BeetleB 2mo ago

One thing Simon pointed out: Usually live voice models are not as capable as the frontier ones. What makes this one special is that it can delegate the task to a frontier model while talking to you.

HDThoreaun 2mo ago

Well Google has been working on voice assistants for years now on android. It makes sense that they had a head start

kkotak 2mo ago

Exactly! I've been using Gemini Live for a while now and have been able to converse quite fluently. Maybe it's the long think functionality that's a differentiator here from OAI, which I'd be surprised if Gemini doesn't come out with of their own this year.