joe_91

10 ms·

1.
by joe_91 8mo ago
Same.... I'll install it in a few months when all the major security bugs have been found and patched!
2.
by joe_91 8mo ago
Tell that to the thousands of apps/sides out there which rely on scraped data ;) (Including all search engines/LLMs/price comparison sites etc)
3.
by joe_91 8mo ago
True, but also need to know the basics well of what constitutes good code and how it should scale vs just working code. Too many people relying on LLMs to produce stuff which just about works but give users a terrible experience as it bearl
4.
by joe_91 8mo ago
Nice concept. I've definitely seen this play out in practice. A lot of sites aren't impossible to scrape, but they're steadily getting more expensive. We're having to lean more on residential proxies, headless browsers e
5.
by joe_91 1y ago
Actually as someone who is over 225lbs and only going up in weight monthly I don't think its fair to presume things about others like that.... As another commenter said - its simple, not easy...
6.
by joe_91 1y ago
Until they find out that there are unintended side effects... Better off just exercising and eating as clean as you can!
7.
by joe_91 1y ago
Instead of focusing solely on the "market boom" and technological advancements, we should be having a serious conversation about the societal implications and the long-term sustainability of this scraping free-for-all. The "h
8.
Madrid built its metro cheaply(worksinprogress.co)
1 points by joe_91 2y ago|2 comments
9.
by joe_91 2y ago
If only the rest of the western world could do this imagine how much better it could be to live in large cities...
10.
by joe_91 3y ago
Looks great! I've had the same issue as you with many projects - so many people leave the marketing till the end so don't beat yourself up about it now. (Hopefully you will have learned a lesson haha!) Lets look at what you could
11.
How to Bypass Cloudflare in 2022(scrapeops.io)
4 points by joe_91 4y ago|0 comments
12.
Is Web Scraping Ethical?(scrapeops.io)
2 points by joe_91 4y ago|1 comments
13.
by joe_91 4y ago
Meetup really could be a 10x better platform. As someone who's run a group on it having to pay to then put in the work to run a group on top of that is just crazy. They could have monetised the platform in so many other different ways
14.
by joe_91 4y ago
Travel between countries in Europe is improving every year too. Next week I'll be traveling from Bordeaux to Berlin (over 1,600km) - it's faster than the car (16 hours by car vs 12 hours by train), and cheaper than flying, in the
15.
by joe_91 4y ago
I doubt many website owners feel they have an ethical responsibility to provide public APIs to their data so people wouldn't scrape their content. It is up to them what they want to do with it. I just feel like the whole thing is a chi
16.
by joe_91 4y ago
What does one get for actually being nice and being an "ethical web scraper"? I don't see many people bothering to be honest, developers who are out there scraping are mostly just doing a job, they want to be done as quick as
17.
by joe_91 5y ago
My only thought on their refunding process is that maybe they don't have a simple way to just click one button to refund everyone for that specific campaign? We should probably not assume bad intent on their part!
18.
by joe_91 5y ago
HN also has moderators who can step in when things look like they're getting out of control which really helps. Or in some cases just point people to the rules and tell them to stop causing flamewars or get out. It really makes a diffe
19.
by joe_91 5y ago
I think it's interesting how they justify giving 1 million of the donation proceeds to the Organisers but then decide that the rest just doesn't make the cut. It would be nice if they provided some evidence showing the organisers
20.
by joe_91 5y ago
This is where a decentralised fundraising platform would come in handy :)
21.
GoFundMe Statement on the Freedom Convoy 2022 Fundraiser(medium.com)
38 points by joe_91 5y ago|27 comments
22.
by joe_91 5y ago
Madness that they haven't gotten back to your access request in 6 months! Why even bother having the API there - so much value can be added by people building on top of YouTube and other large sites, its a shame that most of these larg
23.
by joe_91 5y ago
That looks like a great resource! How often is the data set "updated"? I'd imagine most people's use cases need data which can change from day to day or week to week but I do think that this is fantastic if I was to have
24.
by joe_91 5y ago
Haha I love that people forget how google/bing are out there scraping everything and anyone who scrapes anything for any other reason is a "bad guy". You can get around some web scraping blockers by just setting your user age
25.
by joe_91 5y ago
I'm scraping about 30 sites for work at the moment, but have a few that are using Cloudflare which has been a b*tch to deal with. Tried numerous libraries and different proxy providers, but reliability is patchy. Previous fixes like h
26.
by joe_91 5y ago
It's unfortunate but most of the time people tend to imitate what the people in their social/peer group are doing. That's partly why parents want their kids going to good schools - they'll pick up good habits from those
27.
by joe_91 5y ago
It's going to get really interesting when the world has 1-2 working aged person for 2-3 retirees... Not sure the old people will be able to riot on the streets or anything but it will be an interesting problem for humanity to solve! Ma
28.
by joe_91 5y ago
When I worked at Dell they were giving out cash bonuses for people to submit patent ideas with different levels of rewards depending on how far your patent idea got in the process. The crazy thing is, some people (mostly the Indian cohort)
29.
by joe_91 5y ago
At this stage - I don't see wide spread adoption happening outside of Japan or somewhere where a country really pushes for it. Battery/recharging tech is improving year on year. For their latest model S plaid they've claimed:
30.
by joe_91 5y ago
Another point I think is relevant is that I feel many solutions that you've described are easy to understand, quick fixes. In a world that is growing more and more complicated I think people are more prone to gravitate towards the simp

More ›