6 ms·
Interesting as I was researching this recently and certainly not impressed with the quality of the Readability implementations in various languages. Although Re
by tmpfs 1y ago
Interesting as I was researching this recently and certainly not impressed with the quality of the Readability implementations in various languages. Although Readability.js was clearly the best, it being Javascript didn't suit my project.
In the end I found the python trifatura library to extract the best quality content with accurate meta data.
You might want to compare your implementation to trifatura to see if there is room for improvement.
- fabmilo 1y agoreference to the library: https://trafilatura.readthedocs.io/en/latest/ https://trafilatura.readthedocs.io/en/latest/ for the curious: Trafilatura means "extrusion" in Italian. | This method creates a porous surface that distinguishes pasta trafilata for its extraordinary way of holding the sauce. search maccheroni trafilati vs maccheroni lisci :) (btw I think you meant trafilatura not trifatura)
- thm 1y agoBeen using it since day one but development has stalled quite a bit since 2.0.0.
- acrophobic 1y ago> ...it being Javascript didn't suit my project. If you're using Go, I maintain Go ports of Readability[0] and Trafilatura[1]. They're actively maintained, and for Trafilatura, the extraction performance is comparable to the Python version. [0]: https://github.com/go-shiori/go-readability https://github.com/go-shiori/go-readability [1]: https://github.com/markusmobius/go-trafilatura https://github.com/markusmobius/go-trafilatura
- breadchris 1y agothis is what i came here to see, thanks!
- derekperkins 1y agoWe've been active users of go-trafilatura and love it
- winddude 1y agoIt's a bit old, but I bench marked a number of the web extraction tools years ago, https://github.com/Nootka-io/wee-benchmarking-tool https://github.com/Nootka-io/wee-benchmarking-tool, resiliparse-plain was my clear winner at the time.