7 ms·
Yes. RFC 3986, sections 6.2.2.2 and 6.2.3.
by jfr 16y ago
Yes. RFC 3986, sections 6.2.2.2 and 6.2.3.
- nostrademons 16y agoI think you got the wrong RFC number: http://tools.ietf.org/rfc/rfc3938.txt http://tools.ietf.org/rfc/rfc3938.txt No mention of robots.txt, nor a section 6.
- jfr 16y agoSorry, the correct number was 3986. RFC 3986 - Uniform Resource Identifier (URI): Generic Syntax