5 ms·
Would a robots.txt not be more appropriate?
by alexfromapex 7mo ago
Would a robots.txt not be more appropriate?
- xd1936 7mo agohttps://annas-archive.li/robots.txt https://annas-archive.li/robots.txt https://annas-archive.li/llms.txt https://annas-archive.li/llms.txt robots.txt is a machine-parsed standard with defined syntax. llms.txt is a proposal for a more nebulous set of text instructions, in Markdown. https://llmstxt.org/ https://llmstxt.org/