6 ms·
While scrapping Google follows robots.txt file rules
by psydvl 4y ago
While scrapping Google follows robots.txt file rules
- megous 4y agohttps://www.youtube.com/robots.txt https://www.youtube.com/robots.txt Looks like scraping is allowed then, if your robot is named "Mediapartners-Google*" And you can name your robot whatever you like (there's no legally enforced nor defacto registry), so my robot: "Mediapartners-Google-im-cleary-not-a-member-of/1.0" Can legally scrape anything on google's youtube. Perfect.