iranu

7 ms·

1. 1.▲
   by iranu 6mo ago

   Thanks for the comment, great question. Quick clarification: the AI agent writes the config once and is out of the loop after that. You run crawls yourself or via cron. So the "auto-regenerate and silently get wrong data" scenario
2. 2.▲
   by iranu 6mo ago

   Honestly, it feels like cloudflare bullying other sites into using their anti-bot services. great business model by charging owners and devs at the same time. Using AI per page to parse content. its reckless.
3. 3.▲
   by iranu 7mo ago

   Hi HN, I built this. It's been in production across 500+ websites. We're a research group that studies online communications. We needed to scrape hundreds of sites regularly — news, blogs, forums, policy orgs — and maint
4. 4.▲
   Show HN: ScrapAI – We scrape 500 sites. AI runs once per site, not per page(github.com)

   3 points by iranu 7mo ago|3 comments