5 ms·

I wonder if these bots would respect robots.txt files for the ads?

• Semaphor 4y ago
  Well, you’d have to get Google to host those robots.txt as the ads are running iframed on their servers ;)