5 ms·
No. robots.txt is not something that is defined and enforced by the law. Just because someone came up with some 'recommendation' like robots.txt does not mean t
by RobSm 5y ago
No. robots.txt is not something that is defined and enforced by the law. Just because someone came up with some 'recommendation' like robots.txt does not mean this is the law
- LamaOfRuin 5y agoAs a matter of fact, robots.txt is a well understood expression of intent which is legally meaningful in a lot of contexts.
- shukantpal 5y ago> Legal? Yes. Parasitic behavior? Also yes. You failed to make a meaningful counterpoint; the legal/ethical distinction was made clear in the parent post.