6 ms·

You know English doesn't work like that. The word you're saying only becomes clear with the surrounding context. Eg, 'there' vs 'their'.

dostick 2mo ago
Model should be able to understand where logical sentence ends, to stop buffering, and optionally rewrite some of the test that has already been output.
- samplifier 2mo ago
  IIRC that is exactly how Dragon Naturally speaking did it decades ago.
nilslindemann 2mo ago
It may be interesting to have it immediately insert the words, even if they are wrong, and when a sentence is finished, replace what has been written with the final corrected sentence.
- atonse 2mo ago
  Google released this awkwardly named app called edge eloquent recently that does exactly that. In fact, it cleans up the entire paragraph that you just said, and even if you have meandering thoughts, it cleans those up too. Actually, this above statement was fully dictated with iOS and it added all the punctuation automatically, so I think that iOS is also doing some of this natively. In fact, I’m on the iOS 27 beta and it seems to be doing an even better job of correcting itself and correcting earlier words and adding punctuation too.
  - remuskaos 2mo ago
    This sounds fantastic, but I'm utterly surprised that Google, of all companies, only releases this for macOS and iOS, but not Android.
    - atonse 2mo ago
      It’s an awkward app and the whole interaction just feels weird and kind of slapdash. I think it is meant to be a prototype. But in this day and age it’s easy enough to at least write the iOS and Android versions. But maybe not dealing with the play store.
  - mft_ 2mo ago
    I tried this on my Mac soon after launch and it was consuming a significant amount of processor cycles even just sitting idle in the menu bar. (From memory, ~20% of an M1 Max.) It may have been an early issue but with no obvious way to interact and report the issue and, eh, Google’s general attitude around customer satisfaction, I just gave up and deleted it again.
- deleted 2mo ago
  [deleted]
- abdullahkhalids 2mo ago
  In fact, a few apps I have tried do exactly this inside the app themselves. There is a live textual field that displays whatever the model thinks, and this display constantly goes back and fixes earlier words. So I know it's possible. I just want to integrate this with the paste-at-cursor feature that these apps have. I imagine the app would have to create a virtual keyboard and use backspace or arrow keys to go back and change things.
atonse 2mo ago
But this is still possible to do if you track the whole run of text. You could replace all of it each time so it LOOKS like it’s streaming but earlier words also change. I’m hoping the streaming models do this eventually. I believe the built-in iOS dictation already does this.
- kristiandupont 2mo ago
  What would be the benefit of this, besides from looking cool?
  - knowknowledge 2mo ago
    In iOS this means you can edit the text as it’s being transcribed. For example, I want to dictate a todo list and after each item I can hit enter to go to the next line.
    - yorwba 2mo ago
      Do the parts before you hit enter still get updated if later context indicates you said something else?
  - atonse 2mo ago
    More accuracy. Like others have said, homonyms (their, they're, there) is easier to determine once you have more context. So then you may need to go back a couple words and update them. Same with punctuation, you could determine that a comma belonged in a certain place once you have enough words.
    - kristiandupont 2mo ago
      Oh certainly, I was asking what the benefit would be to the opposite!
PhilippGille 2mo ago
Handy already supports streaming transcription models, and you can see the words in the small Handy pop-up while you are talking. So in general this definitely works. Handy is just missing the feature to insert these streamed words into the app where the cursor is.
- regularfry 2mo ago
  I suspect the hard bit is that it sometimes needs to back up and redo, and that's an interface they haven't got figured out. I'm fairly sure I remember Dragon Naturally Speaking doing it in Word years ago though, so the interfaces should be there.

dostick 2mo ago

Model should be able to understand where logical sentence ends, to stop buffering, and optionally rewrite some of the test that has already been output.

samplifier 2mo ago
IIRC that is exactly how Dragon Naturally speaking did it decades ago.

nilslindemann 2mo ago

It may be interesting to have it immediately insert the words, even if they are wrong, and when a sentence is finished, replace what has been written with the final corrected sentence.

atonse 2mo ago
Google released this awkwardly named app called edge eloquent recently that does exactly that. In fact, it cleans up the entire paragraph that you just said, and even if you have meandering thoughts, it cleans those up too. Actually, this above statement was fully dictated with iOS and it added all the punctuation automatically, so I think that iOS is also doing some of this natively. In fact, I’m on the iOS 27 beta and it seems to be doing an even better job of correcting itself and correcting earlier words and adding punctuation too.
- remuskaos 2mo ago
  This sounds fantastic, but I'm utterly surprised that Google, of all companies, only releases this for macOS and iOS, but not Android.
  - atonse 2mo ago
    It’s an awkward app and the whole interaction just feels weird and kind of slapdash. I think it is meant to be a prototype. But in this day and age it’s easy enough to at least write the iOS and Android versions. But maybe not dealing with the play store.
- mft_ 2mo ago
  I tried this on my Mac soon after launch and it was consuming a significant amount of processor cycles even just sitting idle in the menu bar. (From memory, ~20% of an M1 Max.) It may have been an early issue but with no obvious way to interact and report the issue and, eh, Google’s general attitude around customer satisfaction, I just gave up and deleted it again.
deleted 2mo ago
[deleted]
abdullahkhalids 2mo ago
In fact, a few apps I have tried do exactly this inside the app themselves. There is a live textual field that displays whatever the model thinks, and this display constantly goes back and fixes earlier words. So I know it's possible. I just want to integrate this with the paste-at-cursor feature that these apps have. I imagine the app would have to create a virtual keyboard and use backspace or arrow keys to go back and change things.

atonse 2mo ago

But this is still possible to do if you track the whole run of text. You could replace all of it each time so it LOOKS like it’s streaming but earlier words also change. I’m hoping the streaming models do this eventually. I believe the built-in iOS dictation already does this.

kristiandupont 2mo ago
What would be the benefit of this, besides from looking cool?
- knowknowledge 2mo ago
  In iOS this means you can edit the text as it’s being transcribed. For example, I want to dictate a todo list and after each item I can hit enter to go to the next line.
  - yorwba 2mo ago
    Do the parts before you hit enter still get updated if later context indicates you said something else?
- atonse 2mo ago
  More accuracy. Like others have said, homonyms (their, they're, there) is easier to determine once you have more context. So then you may need to go back a couple words and update them. Same with punctuation, you could determine that a comma belonged in a certain place once you have enough words.
  - kristiandupont 2mo ago
    Oh certainly, I was asking what the benefit would be to the opposite!

PhilippGille 2mo ago

Handy already supports streaming transcription models, and you can see the words in the small Handy pop-up while you are talking. So in general this definitely works. Handy is just missing the feature to insert these streamed words into the app where the cursor is.

regularfry 2mo ago
I suspect the hard bit is that it sometimes needs to back up and redo, and that's an interface they haven't got figured out. I'm fairly sure I remember Dragon Naturally Speaking doing it in Word years ago though, so the interfaces should be there.