5 ms·We need an analogue of 'robots.txt' for the real world.by senki 16y agoWe need an analogue of 'robots.txt' for the real world.