6 ms·
I think they work off of current robots.txt so if you purchase a domain name update the robots.txt to not allow archive.org they delete the entire history. Whi
by FireBringer 13y ago
I think they work off of current robots.txt so if you purchase a domain name update the robots.txt to not allow archive.org they delete the entire history.
Which sucks in an archival perspective.
- JoshTriplett 13y agoYeah, they really ought to work from the version of robots.txt archived along with a given snapshot. If the legal owner of the content wants it taken down, they can submit an explicit request for that.