8 ms·
Are you talking about Cloudflare? The default seems indeed to be to block AI crawlers when you set up a new site with them.
by DanOpcode 1y ago
Are you talking about Cloudflare? The default seems indeed to be to block AI crawlers when you set up a new site with them.