So I decided to google around and I think TikTok does ignore robots.txt. A few posts from around: - https://www.reddit.com/r/flask/comments/161fqml/what_to_do_

So I decided to google around and I think TikTok does ignore robots.txt. A few posts from around: - https://www.reddit.com/r/flask/comments/161fqml/what_to_do_about_bytespider/ https://www.reddit.com/r/flask/comments/161fqml/what_to_do_a... - https://www.reddit.com/r/sysadmin/comments/1ahhzdg/has_anyone_noticed_odd_bytedance_web_crawler/ https://www.reddit.com/r/sysadmin/comments/1ahhzdg/has_anyon...