8 ms·

The truth is this won't actually stop AI crawlers and they'll just move to a large residential proxy pool to work around it. Not sure what the solution is hones

by jhgg 1y ago

The truth is this won't actually stop AI crawlers and they'll just move to a large residential proxy pool to work around it. Not sure what the solution is honestly.

miohtama 1y ago
At GitHub scale, crawlers will run out of IP addresses regardless if they are use residential addresses.
dmitrygr 1y ago
Criminal charges under CFAA to actual CEOs of actual companies doing this, with long jail terms.
- latentsea 1y ago
  I don't know if I ever recall seeing a CEO go to jail for practically anything, ever. I'm sure there are lots of examples, but at this point in my life I have kind of derived a rule of thumb of "if you want to commit a crime, just disguise it as a legitimate business" based off seeing so many times where CEOs get off scott free .
  - simoncion 1y ago
    FWIW, Joseph Nacchio (the CEO of Qwest Communications) went to jail for like a decade for refusing to help the NSA violate FISA circa 2001.
    - umbra07 1y ago
      He went to jail because he refused to help the NSA violate FISA, and then he sold the stock knowing that his refusal would cause the stock to drop (i.e. insider trading). His conviction was entirely on the basis of insider trading. The SEC went after him, not the NSA or DOJ or whatever.
      - simoncion 1y ago
        > His conviction was entirely on the basis of insider trading. Insider trading charges are to high-flying executive-types as "Based on my training and experience, I detected the distinct odor of cannabis on the suspect's person" is to folks who are committing the crime of walking while black near an officer with something to prove. Seriously, these regs are very, very vague and open-ended, and a ton of deference is given to the SEC.
      - dragonwriter 1y ago
        > His conviction was entirely on the basis of insider trading. The SEC went after him, not the NSA or DOJ or whatever. The SEC has no criminal prosecution powers; all they can do in that regard is write a note asking the DOJ to pretty-please look into something. The only way to get a federal (civilian) criminal conviction is to have the DOJ go after you.
- miohtama 1y ago
  Criminally charging Russian and Chinese does not work. The solution would be to drop these contries off the internet if we want to play hard. The US cannot even stop NSO to hack the system with spyware and Israel is a political ally.
  - dmitrygr 1y ago
    Most of ML training crawlers hitting my site come from USA. Should we drop USA too?
    - DonHopkins 1y ago
      "US Out of North America!" -Ironic Protest T-Shirt and Graffiti (Social-Revolutionary Anarchist Federation) ;) https://the-t-shirt-chronicles.com/2022/02/15/u-s-out-of/ https://the-t-shirt-chronicles.com/2022/02/15/u-s-out-of/

by jhgg 1y ago

The truth is this won't actually stop AI crawlers and they'll just move to a large residential proxy pool to work around it. Not sure what the solution is honestly.

miohtama 1y ago

At GitHub scale, crawlers will run out of IP addresses regardless if they are use residential addresses.

dmitrygr 1y ago

Criminal charges under CFAA to actual CEOs of actual companies doing this, with long jail terms.

latentsea 1y ago
I don't know if I ever recall seeing a CEO go to jail for practically anything, ever. I'm sure there are lots of examples, but at this point in my life I have kind of derived a rule of thumb of "if you want to commit a crime, just disguise it as a legitimate business" based off seeing so many times where CEOs get off scott free .
- simoncion 1y ago
  FWIW, Joseph Nacchio (the CEO of Qwest Communications) went to jail for like a decade for refusing to help the NSA violate FISA circa 2001.
  - umbra07 1y ago
    He went to jail because he refused to help the NSA violate FISA, and then he sold the stock knowing that his refusal would cause the stock to drop (i.e. insider trading). His conviction was entirely on the basis of insider trading. The SEC went after him, not the NSA or DOJ or whatever.
    - simoncion 1y ago
      > His conviction was entirely on the basis of insider trading. Insider trading charges are to high-flying executive-types as "Based on my training and experience, I detected the distinct odor of cannabis on the suspect's person" is to folks who are committing the crime of walking while black near an officer with something to prove. Seriously, these regs are very, very vague and open-ended, and a ton of deference is given to the SEC.
    - dragonwriter 1y ago
      > His conviction was entirely on the basis of insider trading. The SEC went after him, not the NSA or DOJ or whatever. The SEC has no criminal prosecution powers; all they can do in that regard is write a note asking the DOJ to pretty-please look into something. The only way to get a federal (civilian) criminal conviction is to have the DOJ go after you.
miohtama 1y ago
Criminally charging Russian and Chinese does not work. The solution would be to drop these contries off the internet if we want to play hard. The US cannot even stop NSO to hack the system with spyware and Israel is a political ally.
- dmitrygr 1y ago
  Most of ML training crawlers hitting my site come from USA. Should we drop USA too?
  - DonHopkins 1y ago
    "US Out of North America!" -Ironic Protest T-Shirt and Graffiti (Social-Revolutionary Anarchist Federation) ;) https://the-t-shirt-chronicles.com/2022/02/15/u-s-out-of/ https://the-t-shirt-chronicles.com/2022/02/15/u-s-out-of/