8 ms·

Tales - a block tolerant web scraper that runs on top of aws and rackspace

• rachelbythebay 14y ago
  >> Tales is design to scrape the web continuously, even when the domain being scraped blocks the scraper server ip; it goes around this problem by fail-overing to a new node (server). And people wonder why the AWS machines get filtered.
  • calufa 14y ago
    this is why jcoulds will be supported soon.
    • rachelbythebay 14y ago
      And people will wonder why the jclouds machines get filtered. It's not the "where". It's the "what".
      • calufa 14y ago
        I am just enabling. For me it's not the "what". Its the "who".