5 ms·
Show HN: Robots.txt generator for blocking AI crawlers
- kazinator 2y agoIt's incredible that the author of this is not aware that robots.txt is widely ignored. How more useful tool would be something that generates a piece of web server config to actually block bots.