5 ms·
I've been building something similar for my own purposes. Basically, I use Calibre's "Fetch News" functionality to get epubs of all the news sources I trust, an
by abound 2mo ago
I've been building something similar for my own purposes. Basically, I use Calibre's "Fetch News" functionality to get epubs of all the news sources I trust, and then once a month (interval is configurable), I run a pipeline over all of it (some LLM magic, partly local partly API) to dedupe and rank stories, then compile it into an actual honest-to-goodness newspaper (using Typst for layout and stuff), then read that at my leisure.
- kristerv 2mo agoThe what now. But not all sources have epubs, right? Is there any one that you're missing now?
- advisedwang 2mo agoCalibre has a feature that will fetch a rss feed or (IIRC) scrape a site and make an epub from it.
- deleted 2mo ago[deleted]
- imhoguy 2mo agoepub is ZIP with HTML+CSS+images+some metadata.
- abound 2mo agoNope! Every source I care about either has an RSS feed, or I've been able to make a custom recipe [1] to handle things like auth for paid sites and whatnot. [1] https://manual.calibre-ebook.com/glossary.html#term-recipe https://manual.calibre-ebook.com/glossary.html#term-recipe
- sheesdev 2mo agoThis sounds really interesting and something I'd love to try. Do you have more details on how someone else can utilise this?
- abound 2mo agoNot yet, but I'll see if I can publish the basics for it this week.
- jonathanlb 2mo agoI ran a similar personal project where weekly I scraped a country's news stories across curated sources using Brave News API and used an LLM to dedupe and cluster stories. This got expensive fast, so I'm wondering what your approach is to keep costs down across what I imagine is a lot of volume, i.e., one months' worth of stories across several sources.