Try: https://www.google.com/killer-robots.txt https://www.google.com/killer-robots.txt Discussion: https://news.ycombinator.com/item?id=7988924 https://news.yc

Try: https://www.google.com/killer-robots.txt https://www.google.com/killer-robots.txt Discussion: https://news.ycombinator.com/item?id=7988924 https://news.ycombinator.com/item?id=7988924 and https://news.ycombinator.com/item?id=7979909 https://news.ycombinator.com/item?id=7979909