11 ms·

> Note: Relies on Apple Silicon, and configured to only produce Apple Silicon builds. Just curious, what is relying on apple silicon?

by nmjohn 3y ago

jasonjmcghee 3y ago
Full disclosure, I haven’t tested it on Intel, but I don’t think it will not be able to keep up with taking screenshots, generating ffmpeg videos, and doing OCR that often and will drain your battery very quickly. But if you / someone can get it to be efficient enough, awesome!
- kevincox 3y ago
  I think you underestimate computers. Taking 2fps screen recordings is a trivial task. Doing OCR may be slightly more work but at 2fps I doubt it is an issue. Worse case you could tune the OCR frequency based on the computer's abilities.
  - frfl 3y ago
    You're confusing 2fps with 1-screenshot-every-2-seconds (or 0.5fps), what the README actually says). I wouldn't be surprised if the battery issue is problematic, likely will result in at least some kind of battery life reduction, but perhaps not 30 or 50% at 0.5fps. I haven't looked into the code, but if you're running ffmpeg, then battery life will likely take a hit depending on what exactly you're doing. Video encoding _can be_ heavy on the CPU/GPU.
    - kevincox 3y ago
      That makes it even less work. Running ffmpeg is just video encoding, I don't think a 0.5fps video would be a huge issue. Lots of people work plugged in most of the time. I don't see why one would want to gatekeep to keep them from using it.
      - beardedwizard 3y ago
        What gate keeping? I just see a valid correction to your misstatement and your reaction reads like a defensive Karen wrote it.
        kevincox 3y ago
        Not supporting a platform just because it may cause it may cause battery drain which may not even matter to plugged in users seems like gatekeeping.
        0xDEADFED5 3y ago
        it's literally an open source MIT licensed hobby project. fork it and improve it and share here. complaining about it is kinda rude.
        jasonjmcghee 3y ago
        I don’t have an Intel Mac to test on- but you can absolutely just clone it and swap the config to Intel
        frfl 3y ago
        I have to agree. If you're interested in supporting Intel(x86/64), it's open source, and you sound like you have the hardware to add support for and test on Intel.
        beardedwizard 3y ago
        Not supporting? The commenter simply said it may cause battery drain. It is a discussion on the topic (both sides based purely on conjecture), and a relevant one. You disagreeing does not mean others are "gate keeping". Stop trying to weaponize trendy language and white knight this thread.
        kevincox 3y ago
        The original README was claiming that relies on Apple Silicon and that they have configured builds to exclude other Apple platforms. I see it has been greatly softened now to "Only tested on Apple Silicon, and the release is Apple Silicon" which I think is quite reasonable. I have no problem with not supporting a platform because you have no interest or any other reason, but previously it was quite proud to not support it which is different.
    - deleted 3y ago
      [deleted]
- philipswood 3y ago
  I haven't looked this codebase yet, but a screenshot every few seconds isn't a noticeable slowdown on most machines. At such slow rates you don't need to create video - you just keep the individual images. OCR doesn't need to be real-time, but can be done in batch mode or when the machine is idle.
- v3ss0n 3y ago
  I had been doing that with opensource Linksys ip cameras since 2010 and they only have like 180mhz and 32MB RAM. What are you thinking about?
pedalpete 3y ago
This is also what I was wondering. The demo is showing recording a web-browser, and I'm wondering if that is all it is doing. If so, wouldn't that mean creating a browser plug-in would make this possible on any platform? I also don't understand the chatGPT component, and what it is trying to tell him. Though I'm sure if you just threw the URL and the screenshot to chatGPT, you could ask it questions about that source. I'm not sure how useful this is tbh, or how I would use it. I'm not saying it isn't useful, just that I'm not sure how I would use it, or why it is useful.
- Bombinator 3y ago
  > The demo is showing recording a web-browser He said it's not recording but taking a screenshot every 2 seconds and I assume it's not just for a browser but all text on the desktop. > I also don't understand the chatGPT component You give it context from the "recording" and it answers questions you give it with that context info.

> Note: Relies on Apple Silicon, and configured to only produce Apple Silicon builds. Just curious, what is relying on apple silicon?

by nmjohn 3y ago

> Note: Relies on Apple Silicon, and configured to only produce Apple Silicon builds. Just curious, what is relying on apple silicon?

jasonjmcghee 3y ago

Full disclosure, I haven’t tested it on Intel, but I don’t think it will not be able to keep up with taking screenshots, generating ffmpeg videos, and doing OCR that often and will drain your battery very quickly. But if you / someone can get it to be efficient enough, awesome!

kevincox 3y ago
I think you underestimate computers. Taking 2fps screen recordings is a trivial task. Doing OCR may be slightly more work but at 2fps I doubt it is an issue. Worse case you could tune the OCR frequency based on the computer's abilities.
- frfl 3y ago
  You're confusing 2fps with 1-screenshot-every-2-seconds (or 0.5fps), what the README actually says). I wouldn't be surprised if the battery issue is problematic, likely will result in at least some kind of battery life reduction, but perhaps not 30 or 50% at 0.5fps. I haven't looked into the code, but if you're running ffmpeg, then battery life will likely take a hit depending on what exactly you're doing. Video encoding _can be_ heavy on the CPU/GPU.
  - kevincox 3y ago
    That makes it even less work. Running ffmpeg is just video encoding, I don't think a 0.5fps video would be a huge issue. Lots of people work plugged in most of the time. I don't see why one would want to gatekeep to keep them from using it.
    - beardedwizard 3y ago
      What gate keeping? I just see a valid correction to your misstatement and your reaction reads like a defensive Karen wrote it.
      - kevincox 3y ago
        Not supporting a platform just because it may cause it may cause battery drain which may not even matter to plugged in users seems like gatekeeping.
        0xDEADFED5 3y ago
        it's literally an open source MIT licensed hobby project. fork it and improve it and share here. complaining about it is kinda rude.
        jasonjmcghee 3y ago
        I don’t have an Intel Mac to test on- but you can absolutely just clone it and swap the config to Intel
        frfl 3y ago
        I have to agree. If you're interested in supporting Intel(x86/64), it's open source, and you sound like you have the hardware to add support for and test on Intel.
        beardedwizard 3y ago
        Not supporting? The commenter simply said it may cause battery drain. It is a discussion on the topic (both sides based purely on conjecture), and a relevant one. You disagreeing does not mean others are "gate keeping". Stop trying to weaponize trendy language and white knight this thread.
        kevincox 3y ago
        The original README was claiming that relies on Apple Silicon and that they have configured builds to exclude other Apple platforms. I see it has been greatly softened now to "Only tested on Apple Silicon, and the release is Apple Silicon" which I think is quite reasonable. I have no problem with not supporting a platform because you have no interest or any other reason, but previously it was quite proud to not support it which is different.
  - deleted 3y ago
    [deleted]
philipswood 3y ago
I haven't looked this codebase yet, but a screenshot every few seconds isn't a noticeable slowdown on most machines. At such slow rates you don't need to create video - you just keep the individual images. OCR doesn't need to be real-time, but can be done in batch mode or when the machine is idle.
v3ss0n 3y ago
I had been doing that with opensource Linksys ip cameras since 2010 and they only have like 180mhz and 32MB RAM. What are you thinking about?

pedalpete 3y ago

This is also what I was wondering. The demo is showing recording a web-browser, and I'm wondering if that is all it is doing. If so, wouldn't that mean creating a browser plug-in would make this possible on any platform? I also don't understand the chatGPT component, and what it is trying to tell him. Though I'm sure if you just threw the URL and the screenshot to chatGPT, you could ask it questions about that source. I'm not sure how useful this is tbh, or how I would use it. I'm not saying it isn't useful, just that I'm not sure how I would use it, or why it is useful.

Bombinator 3y ago
> The demo is showing recording a web-browser He said it's not recording but taking a screenshot every 2 seconds and I assume it's not just for a browser but all text on the desktop. > I also don't understand the chatGPT component You give it context from the "recording" and it answers questions you give it with that context info.