5 ms·

> Archive.org is great; especially their archive of abandonware old games (MS-DOS, older console ROMs), some of which can be played online. See: https://archiv

> Archive.org is great; especially their archive of abandonware old games (MS-DOS, older console ROMs), some of which can be played online. See: https://archive.org/details/softwarelibrary_msdos_games https://archive.org/details/softwarelibrary_msdos_games > But don't find yourself actually needing to get in touch with a human there. I have a friend that inadvertently doxxed themself on a website they own; they removed the pages, added a robots.txt to disallow crawling and is trying for months to reach someone over there to just get that data removed from The Wayback Machine, to no avail. That sucks. I've always been able to get a hold of a human the few times I emailed them - but nothing due to something like this. > Perhaps archive.org doesn't have a lot of staff or they simply don't care but I imagine these kinds of things happen often enough that they should at least have an automated process in place (and continuing to crawl a website that specifically forbids it through the standard robots.txt is a bit icky). Also, FYI they stopped honoring robots.txt directives: https://teleread.org/2017/04/24/the-internet-archive-will-soon-stop-honoring-robots-txt-files/ https://teleread.org/2017/04/24/the-internet-archive-will-so... — so if you're a webmaster that would like to exclude your website from the internet archive, you'll have to email them directly to make that request.

LocalH 5y ago
>Also, FYI they stopped honoring robots.txt directives: https://teleread.org/2017/04/24/the-internet-archive-will-so https://teleread.org/2017/04/24/the-internet-archive-will-so... — so if you're a webmaster that would like to exclude your website from the internet archive, you'll have to email them directly to make that request. Good. It shouldn't be as simple as "put a robots.txt on your domain" to erase the entire publicly archived history of any sites ever hosted under that domain. This happened a lot when domains would expire.

LocalH 5y ago

>Also, FYI they stopped honoring robots.txt directives: https://teleread.org/2017/04/24/the-internet-archive-will-so https://teleread.org/2017/04/24/the-internet-archive-will-so... — so if you're a webmaster that would like to exclude your website from the internet archive, you'll have to email them directly to make that request. Good. It shouldn't be as simple as "put a robots.txt on your domain" to erase the entire publicly archived history of any sites ever hosted under that domain. This happened a lot when domains would expire.