gavinhking

5 ms·

1.
by gavinhking 1mo ago
Seems like you’re part of the group represented in this dataset trend then, many of these visits are also from (compromised) Google servers in that same ASN.
2.
by gavinhking 1mo ago
Yup, in fact most of them are already. That's one of the ways this data is verifying whether the visits are spoofed or not: https://knownagents.com/insights#spoofing-and-security
3.
by gavinhking 1mo ago
Appreciate it, I'll check out your posts.
4.
by gavinhking 1mo ago
Basically, unless CF is counting static asset network requests etc. For what it's worth, GA also miscategorizes some bots as humans as well.
5.
by gavinhking 1mo ago
(Insert spider man meme)
6.
by gavinhking 1mo ago
Good to know, thank you. Would you do this by fully blocking particular ASNs? Or something more granular?
7.
by gavinhking 1mo ago
Fair enough
8.
by gavinhking 1mo ago
That doesn't change the data/math brother
9.
by gavinhking 1mo ago
What's your strategy?
10.
by gavinhking 1mo ago
Not asking for trust, just sharing the data/math
11.
by gavinhking 1mo ago
Totally. I'm sure this campaign was inspired by sloppy vibe coding
12.
by gavinhking 1mo ago
This is a random sample of completely unrelated websites, which indicates that the total scale is much larger. This is not saying that it is difficult to make thousands of requests.
13.
by gavinhking 1mo ago
Looks like many of the paths relate to AI coding tools. There are some examples below the chart
14.
by gavinhking 1mo ago
Another interesting thing here is the paths they're targeting, many are for newish AI coding tools
15.
by gavinhking 1mo ago
Definitely, the point here though is there is a stat sig surge in the chart in the last week, across thousands of websites. At least a surge in this particular spoofing pattern.
16.
by gavinhking 1mo ago
Yeah, that's exactly what these visits are: faked user agents that fail IP verification or Web Bot Auth. What's interesting is the surge across so many websites in the last week.
17.
Someone is running mass vulnerability scans, spoofing AI bots like ClaudeBot(knownagents.com)
305 points by gavinhking 1mo ago|228 comments
18.
by gavinhking 2y ago
I made this, let me know if you have questions or feedback.
19.
by gavinhking 3y ago
Yup, here is an example with all listed agents, although you probably want to modify it to not fully block all of them: https://darkvisitors.com/robots-txt-builder
20.
by gavinhking 3y ago
Yeah they respect robots.txt: https://commoncrawl.org/faq
21.
by gavinhking 3y ago
Thank you, will try to confirm this.
22.
by gavinhking 3y ago
You're not missing anything, they're just for any humans reading the file who want to know more about the agent. This is also just an example file.
23.
by gavinhking 3y ago
Here it is: https://darkvisitors.com/robots-txt-builder
24.
by gavinhking 3y ago
Right here: https://darkvisitors.com/robots-txt-builder This example blocks everything, which is probably not what you want, but it's meant to be a starting point.
25.
by gavinhking 3y ago
It's updated daily. Thanks for posting by the way.
26.
by gavinhking 3y ago
Ha thanks, it was a shower thought
27.
by gavinhking 3y ago
Fixed, thanks!
28.
by gavinhking 3y ago
Hi all, I made this site. I wasn't expecting this post, but happy to answer questions and take feedback. Hopefully it's pretty self-explanatory but I made this website as a simple resource for people who want to stay up to date wi
29.
by gavinhking 6y ago
Hi all, Budget Burndown is a personal finance app that borrows the idea of a "burndown chart" from Agile software development. You set a monthly budget, which is plotted as an expected spending rate. Your actual spending plots aga
30.
Show HN: Budget Burndown – Visually track your spending against your budget(apps.apple.com)
3 points by gavinhking 6y ago|1 comments

More ›