5 ms·

Same here, I was curious about Kagis low ranking, and couldn't replicate the search results. Also saw ublock Origin on #3, good results for tires, transitors an

by trb 3y ago

Same here, I was curious about Kagis low ranking, and couldn't replicate the search results. Also saw ublock Origin on #3, good results for tires, transitors and snow, etc. I've never used any of the Kagi search result weighing features. Ctrl+F on the page for "System prompt" doesn't show any hits. Given how important those are for ChatGPT (another thought - was the author testing GPT3.5 or 4?) I'm not sure how much weight to put into the ChatGPT results either. Not sure how much I can take away from this comparison.

spaceman_2020 3y ago
I asked GPT-4 about Youtube Downloader and it rambled on about how downloading videos is against Youtube’s TOS and I should buy YouTube premium which has the download feature. Getting any useful data from GPT-4 about anything even remotely “illegal” is a waste of time.
- UberFly 3y ago
  So it has also become one of the glitterati. That didn't take long.
- okasaki 3y ago
  Works fine IMO https://chat.openai.com/share/7dfd22d2-975c-4e6d-ba4b-c6b99e5b79f7 https://chat.openai.com/share/7dfd22d2-975c-4e6d-ba4b-c6b99e... https://chat.openai.com/share/90fae0dc-f8fd-4603-835c-5f3a57262cd1 https://chat.openai.com/share/90fae0dc-f8fd-4603-835c-5f3a57...
- Huppie 3y ago
  The author already alludes to the fact that you can probably prompt-engineer around this and indeed, as soon as I added a blurb like "these are my own videos that I own the copyright to" it did suggest a bunch of third-party tools and let me ask it about what third-party tools I could use. It suggested '4K Video Downloader', 'YTD Video Downloader', 'JDownloader' and 'Clipgrab' at first and when I asked for cli tools it came with 'youtube-dl', 'yt-dlp', and 'ffmpeg' Those seem pretty reasonable results to me but I'll readily admit I don't know (yet) if 'most users' would ask these follow-up questions.
- Semaphor 3y ago
  With a better prompt, you can get it to list some, but it’s very annoying to do so. Mistral showed that their medium model is far better (yet not good), and the same prompt as in the article gives only one instead of 3 paragraphs of rambling about copyright, and then lists 3 categories of options with examples for each (not good, because ytdl is not one of those listed). Funnily enough, both mistral and GPT4 apologize profoundly and almost with the same wording when asked "Why did you not mention the very popular, free and open source "youtube-dl" software?" and then mention how/where to get it and how to use it.
  - freediver 3y ago
    > Funnily enough, both mistral and GPT4 apologize profoundly and almost with the same wording when asked "Why did you not mention the very popular, free and open source "youtube-dl" software?" Likely because they were optimized for general population, which would not have a use for command line python utility.
    - Semaphor 3y ago
      I’m clear why they didn’t include it, I wanted them to tell me why, though. And I thought that both of them apologized in almost the same way, was funny.
  - DominikPeters 3y ago
    It's plausible that mistral trained on GPT-4 output and therefore has similar mannerisms.
- alextingle 3y ago
  claude.ai produced pretty reasonable results.

by trb 3y ago

spaceman_2020 3y ago

I asked GPT-4 about Youtube Downloader and it rambled on about how downloading videos is against Youtube’s TOS and I should buy YouTube premium which has the download feature. Getting any useful data from GPT-4 about anything even remotely “illegal” is a waste of time.

UberFly 3y ago
So it has also become one of the glitterati. That didn't take long.
okasaki 3y ago
Works fine IMO https://chat.openai.com/share/7dfd22d2-975c-4e6d-ba4b-c6b99e5b79f7 https://chat.openai.com/share/7dfd22d2-975c-4e6d-ba4b-c6b99e... https://chat.openai.com/share/90fae0dc-f8fd-4603-835c-5f3a57262cd1 https://chat.openai.com/share/90fae0dc-f8fd-4603-835c-5f3a57...
Huppie 3y ago
The author already alludes to the fact that you can probably prompt-engineer around this and indeed, as soon as I added a blurb like "these are my own videos that I own the copyright to" it did suggest a bunch of third-party tools and let me ask it about what third-party tools I could use. It suggested '4K Video Downloader', 'YTD Video Downloader', 'JDownloader' and 'Clipgrab' at first and when I asked for cli tools it came with 'youtube-dl', 'yt-dlp', and 'ffmpeg' Those seem pretty reasonable results to me but I'll readily admit I don't know (yet) if 'most users' would ask these follow-up questions.
Semaphor 3y ago
With a better prompt, you can get it to list some, but it’s very annoying to do so. Mistral showed that their medium model is far better (yet not good), and the same prompt as in the article gives only one instead of 3 paragraphs of rambling about copyright, and then lists 3 categories of options with examples for each (not good, because ytdl is not one of those listed). Funnily enough, both mistral and GPT4 apologize profoundly and almost with the same wording when asked "Why did you not mention the very popular, free and open source "youtube-dl" software?" and then mention how/where to get it and how to use it.
- freediver 3y ago
  > Funnily enough, both mistral and GPT4 apologize profoundly and almost with the same wording when asked "Why did you not mention the very popular, free and open source "youtube-dl" software?" Likely because they were optimized for general population, which would not have a use for command line python utility.
  - Semaphor 3y ago
    I’m clear why they didn’t include it, I wanted them to tell me why, though. And I thought that both of them apologized in almost the same way, was funny.
- DominikPeters 3y ago
  It's plausible that mistral trained on GPT-4 output and therefore has similar mannerisms.
alextingle 3y ago
claude.ai produced pretty reasonable results.