17 ms·
Thank you for letting me know, this information is crucial. The CPU-only compatibility of transformers.js might make it too slow for text-heavy websites. I will
by klavinski 3y ago
Thank you for letting me know, this information is crucial. The CPU-only compatibility of transformers.js might make it too slow for text-heavy websites. I will immediately study a way to throttle it.
However, the Chrome web store review might take some time to allow the update.
- replete 3y agohttps://github.com/0hq/WebGPT https://github.com/0hq/WebGPT
- luke-stanley 3y agoI assume a lot of processing is happening in a per tab context, I wonder how easy a queue would work in the browser? An optional local self-hosted server script might help.
- klavinski 3y agoActually, a tab only sends its content to a unique offscreen document[0], and because of the single-threaded nature of JS, it works as a queue. So, you are right, throttling might be feasible without too much hurdle. [0] https://developer.chrome.com/docs/extensions/reference/offscreen/ https://developer.chrome.com/docs/extensions/reference/offsc...