4 ms·
Well, our scrapers take about 2-3 days to complete a loop, so it is indeed possible for you to find dead links here and there...It shouldn't be a large percenta
by kapgoals 14y ago
Well, our scrapers take about 2-3 days to complete a loop, so it is indeed possible for you to find dead links here and there...It shouldn't be a large percentage though.
Fortunately, we will have API's from two major source sites within the next few weeks, and that should greatly reduce our dependence on scraping.