thalissonvs

5 ms·

1.
Show HN: Pydoll, a type-safe asyncio lib for evading bot detection(pydoll.tech)
4 points by thalissonvs 11mo ago|0 comments
2.
Beyond User-Agent: A Guide to TLS, HTTP/2, Canvas, and Behavioral Fingerprinting(pydoll.tech)
2 points by thalissonvs 11mo ago|1 comments
3.
by thalissonvs 11mo ago
Author here. I've been working on pydoll, an open-source (Python/async) web automation library. While building it, I kept hitting a wall against sophisticated anti-bot systems. This sent me down a deep rabbit hole to understand ho
4.
by thalissonvs 1y ago
I'm not actually bypassing the captcha with reverse engineering or anything like that, much less integrating with external services. I just made the library look like a real user by eliminating some things that selenium, puppeteer and
5.
by thalissonvs 1y ago
CDP itself is not detectable. It turns out that other libraries like puppeteer and playwright often leave obvious traces, like create contexts with common prefixes, defining attributes in the navigator property. I did a clean implementation
6.
by thalissonvs 1y ago
you can check the official documentation, there's a section 'Deep Dive'
7.
by thalissonvs 1y ago
cool, left a star :)
8.
by thalissonvs 1y ago
I don't think it's similar. The library has many other features that Selenium doesn't have. It has few dependencies, which makes installation faster, allows scraping multiple tabs simultaneously because it’s async, and has a
9.
by thalissonvs 1y ago
Well, it really depends on the user; there are many cases where this can be useful. Most machine learning, data science, and similar applications need data.
10.
Show HN: PyDoll – Async Python scraping engine with native CAPTCHA bypass(github.com)
136 points by thalissonvs 1y ago|39 comments
11.
Pydoll: Async Web Automation in Python(github.com)
3 points by thalissonvs 2y ago|1 comments
12.
by thalissonvs 2y ago
Pydoll is an innovative Python library that's redefining Chromium browser automation! Unlike other solutions, Pydoll completely eliminates the need for webdrivers, providing a much more fluid and reliable automation experience. Zero W