5 ms·
Major web disputes like the Perplexity/Cloudflare clash over AI crawlers, OpenAI’s lawsuit with NYT, or Anthropic’s Claude facing publisher data concerns show t
by jithinraj 1y ago
Major web disputes like the Perplexity/Cloudflare clash over AI crawlers, OpenAI’s lawsuit with NYT, or Anthropic’s Claude facing publisher data concerns show that the “rules of access” for the web are more contested than ever.
Should these rules be set by individual publishers, infrastructure providers, AI companies, open standards, or by community consensus?
What would your ideal solution look like? Who should decide? What’s broken today?
Context:
• Perplexity: https://www.perplexity.ai/hub/blog/agents-or-bots-making-sense-of-ai-on-the-open-web https://www.perplexity.ai/hub/blog/agents-or-bots-making-sen...
• Cloudflare: https://blog.cloudflare.com/perplexity-is-using-stealth-undeclared-crawlers-to-evade-website-no-crawl-directives https://blog.cloudflare.com/perplexity-is-using-stealth-unde...