6 ms·
You could also use headless selenium under the hood and pipe to the model the entire Dom of the document after the JavaScript was loaded. Of course it would mak
by 098799 1y ago
You could also use headless selenium under the hood and pipe to the model the entire Dom of the document after the JavaScript was loaded. Of course it would make it much slower but also would amend the main worry people have which is many websites will flat out not show anything in the initial GET request.
- busssard 1y agocan you flesh this out a tiny bit? because for indy-crawlers the javascript rendering is the main problem.
- 098799 1y agoHere's a sketch: https://chatgpt.com/share/68640b97-9a48-8007-a27c-fdf85ff41200 https://chatgpt.com/share/68640b97-9a48-8007-a27c-fdf85ff412... -- selenium drives your actual browser under the hood.