5 ms·
0 for 10 on some startups (large and small, YC and not) that came to mind. It's easy to scrape YC startups from https://www.ycombinator.com/companies https://w
by tlb 3mo ago
0 for 10 on some startups (large and small, YC and not) that came to mind.
It's easy to scrape YC startups from https://www.ycombinator.com/companies https://www.ycombinator.com/companies. Scrape that and a dozen other investors' portfolio pages and you'll have a useful fraction of startups.
- shpran 3mo agoSounds good! its just I used up most of my API key limits in development, and I'm keeping some so I can run improvement pipelines or fix errors, so il batch the YC companies day by day, there's 5000 companies, so il do about 800 each day for 5-6 days.
- notpushkin 3mo agoWait, why would you use (tokens?) on a routine scrape job? Just make a generic parser (vibe-coded or by hand, I don’t think it'll be that hard), then run it across the company list. Or are you talking about some other API?
- shpran 3mo agono scraping the yc startups is easy, I've already done that, its just writing and researching the actual profiles uses an internal tool (built into the website,I can trigger it from an admin dashboard) which uses tokens.
- smallnix 3mo agoCreate placeholder pages and backfill any extended LLM generated stuff. Either after first request of a page or simply queued.
- deepspace 3mo agoSame here. I work with a lot of startups, some of them very prominent and none of them are listed.