5 ms·
This doesn't work if you pay bandwidth and CPU usage for your servers though.
by palijer 1y ago
This doesn't work if you pay bandwidth and CPU usage for your servers though.
- MoonGhost 1y agoThat will be your contribution. If others join scrapping will become very pricey. Till bots become smarter. But then they will not download much of generated crap. Which makes it cheaper for you. Anyway, from bots perspective labyrinths aren't the main problem. Internet is being flooded with quality LLM-generated content.
- Twirrim 1y agoThe labyrinth doesn't have to be fast, and things like iocaine (https://iocaine.madhouse-project.org/ https://iocaine.madhouse-project.org/) don't use much CPU if you don't go and give them something like the Complete Works of Ahakespeare as input (Mine is using Moby Dick), and can easily be constrained with cgroups if you're concerned about resource usage. I've noticed that LLM scrapers tend to be incredibly patient. They'll wait for minutes for even small amounts of text.
- deleted 1y ago[deleted]