4 ms·Google doesn't either, they just don't index the paths written in robots.txt but bots still hit them.by 9HZZRfNlpR 6y agoGoogle doesn't either, they just don't index the paths written in robots.txt but bots still hit them.