7 ms·

I'm surprised at the effectiveness of simple PoW to stop practically all activity. I'll implement Anubis at low difficulty for all my projects and leave a dece

I'm surprised at the effectiveness of simple PoW to stop practically all activity. I'll implement Anubis at low difficulty for all my projects and leave a decent llms.txt referenced in my sitemap and robots.txt so LLMs can still get relevant data for my site while.keeping bad bots out. I'm getting thousands of requests from China that have really increased costs, glad it seems the fix is rather easy.

gruez 6mo ago
>I'm surprised at the effectiveness of simple PoW to stop practically all activity. It's even dumber than that, because by default anubis whitelists the curl user agent. curl -H "User-agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/146.0.0.0 Safari/537.36" "https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git/diff/?id=v7.0-rc5&id2=v7.0-rc4&dt=2" <!doctype html><html lang="en"><head><title>Making sure you're not a bot!</title><link rel="stylesheet" vs curl "https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git/diff/?id=v7.0-rc5&id2=v7.0-rc4&dt=2" <!DOCTYPE html> <html lang='en'> <head> <title>kernel/git/torvalds/linux.git - Linux kernel source tree</title>
- functionmouse 6mo ago
  shhhh don't tell the bots !
- marginalia_nu 6mo ago
  Anubis' white lists and block rules are configurable though. The defaults are a bit silly.
  - xena 6mo ago
    The default is to allow non-Mozilla user agents so that existing (good) automation continues to work and so that people stopped threatening to burn my house down. Lovely people in the privacy community.
    - otterley 6mo ago
      Sorry xe :(
wolvoleo 6mo ago
It's definitely more than enough to stop me as a human wanting to visit the site, so yeah. In that case a better solution would be to take the site down altogether.
- xboxnolifes 6mo ago
  Take down the site entirely because a couple humans get into a fit about it?
  - jlarocco 6mo ago
    The site's down entirely anyway. The silly "proof of work" finishes only to tell me the site is down. What a waste of time.
  - wolvoleo 6mo ago
    I'm just saying, making visitors wait at least a minute while making their device turn red hot is going to stop 99,9% of your visitors. So at that point what's the point in trying to serve the content?

gruez 6mo ago

>I'm surprised at the effectiveness of simple PoW to stop practically all activity. It's even dumber than that, because by default anubis whitelists the curl user agent. curl -H "User-agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/146.0.0.0 Safari/537.36" "https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git/diff/?id=v7.0-rc5&id2=v7.0-rc4&dt=2" <!doctype html><html lang="en"><head><title>Making sure you're not a bot!</title><link rel="stylesheet" vs curl "https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git/diff/?id=v7.0-rc5&id2=v7.0-rc4&dt=2" <!DOCTYPE html> <html lang='en'> <head> <title>kernel/git/torvalds/linux.git - Linux kernel source tree</title>

functionmouse 6mo ago
shhhh don't tell the bots !
marginalia_nu 6mo ago
Anubis' white lists and block rules are configurable though. The defaults are a bit silly.
- xena 6mo ago
  The default is to allow non-Mozilla user agents so that existing (good) automation continues to work and so that people stopped threatening to burn my house down. Lovely people in the privacy community.
  - otterley 6mo ago
    Sorry xe :(

wolvoleo 6mo ago

It's definitely more than enough to stop me as a human wanting to visit the site, so yeah. In that case a better solution would be to take the site down altogether.

xboxnolifes 6mo ago
Take down the site entirely because a couple humans get into a fit about it?
- jlarocco 6mo ago
  The site's down entirely anyway. The silly "proof of work" finishes only to tell me the site is down. What a waste of time.
- wolvoleo 6mo ago
  I'm just saying, making visitors wait at least a minute while making their device turn red hot is going to stop 99,9% of your visitors. So at that point what's the point in trying to serve the content?