8 ms·
That stuff is really easy. And you may convince them to join you after all, like YouTube and the media companies they parasite off of.
by vesterr 18y ago
That stuff is really easy.
And you may convince them to join you after all, like YouTube and the media companies they parasite off of.
- nuggien 18y agoI didn't say it was hard. It's also very easy to differentiate between a crawler and a user. But they don't even have to do that. Blocking the entire AWS ip range isn't hard either. I doubt any craigslist users browse the site through AWS :)