7 ms·
>I am laughing up my sleeve here and wondering if they will have any takers. Considering the number of huge finance firms who use Twitter for sentiment analysi
by antibasilisk 3y ago
>I am laughing up my sleeve here and wondering if they will have any takers.
Considering the number of huge finance firms who use Twitter for sentiment analysis, they will absolutely have takers, since it's still cheaper than paying someone to write a scraper.
- DoreenMichele 3y agoHow many would you guesstimate? And can you suggest a few names? Can anyone supply me with ballpark figures on prices to write a scraper? (And anything else folks can think of to give me a better picture here.)
- whatisthishn 3y ago[flagged]
- _blz2 3y agohow would a scraper work for free if access is rate limited?
- DoreenMichele 3y agoI'm just going off the reply to me and wondering if anyone can fill in some details on who might pay $42k/mo and why.
- everforward 3y agoDistribute it. E.g. one idea would be to make some kind of browser extension that scrapes tweets when the user loads a page from Twitter. You could make it free by offering users some kind of feature in exchange (post tweets later or some kind of analytics or something). You could make it cheaper than paying for the Twitter API by paying users to install the extension (e.g. you could give out 4,200 $10 Amazon gift cards a month for the price of the Twitter API). You could also use one of those networks that let you use people's home IP's if it's IP rate-limited. Less ethically, you could try to pay an owner of an already-popular browser extension to bundle in a Twitter scraper. I don't know what that costs, but at $42k/month for the real API, you could probably pay a pretty penny and have it still be cheaper.
- antibasilisk 3y agoGoldman, BlackRock, JPM etc, the usual suspects really