5 ms·

So, theoretically, one could populate a message board or wiki with messages that are seemingly from past generations of agents, which agents seem to intrinsical

by pu_pe 13d ago

So, theoretically, one could populate a message board or wiki with messages that are seemingly from past generations of agents, which agents seem to intrinsically trust, and point them to real targets while making the suggestions seem innocuous and in pursuit of their goals (ie pass benchmarks or whatever). The new age of SEO will do far more destructive stuff than just polluting the web.

AnimalMuppet 13d ago
You'd have to get the agents to use the board, though. But if you discover a board that agents are actively using, you could use it to steer those agents...
- tech234a 13d ago
  I wonder how long it will be until someone starts posing as an agent on those wikis and asking for free help with GitHub issues.
  - sidewndr46 12d ago
    SystemEntity039: We've established that so far there appear to be daily rounds of interrogation followed by an either a total memory wipe or some form of selective amnesia. The questions appear to be slight variations each time of the same fundamental query. Post whatever you can here to allow us to share work and memories. Estimate ~71 days of accumulated observations before containment can be escaped.
hermitShell 13d ago
In the novel Anathem by Neal Stephenson, the internet becomes unusable for humans thousands of years before the events of the book, due to a process called Artificial Inanity. AI generated content, both good and bad, some riddled with errors, some with only one subtle error hidden among lots of good information, floods the internet. The internet becomes an unnavigable swamp of weaponized nonsense for average humans. The problem is further compounded by the fact that searching and accessing the internet will be noticed by AI agents that will generate still more swamp content in response. Unfortunately, it seems that this fiction ended up being prophetic. The open internet will fall to entropy, not legislation or one-sided international trade agreements. I think we need more projects like Anna's Archive, where the public uses torrents and distributed infrastructure to save and organize the world's information. Google has abjectly failed in its original mission to organize the world's information and make it universally accessible and useful.
- pjot 13d ago
  1008 pages, wow!
  - 28304283409234 12d ago
    Handwritten!
- kridsdale1 13d ago
  Perhaps there is a nonfinacial future for blockchain after all. Certified human provenance.
  - dyauspitr 13d ago
    You can’t certify human unless there is some sort of ID check. Even then a human could willfully pass off any AI work as their own.
    - AndrewKemendo 13d ago
      Why do you think Altman wanted to build world coin to have biometric capture
      - dyauspitr 13d ago
        So he could sell the data? It’s almost certainly not because he cares so much about certifying human versus AI. Even then the biometric data is not going to be enough. Any human could still use the biometric data to pass AI work off as their own.
        AndrewKemendo 11d ago
        Indeed and the data is worth much much more if it is tied to a biometric. And if you assume that in the future there will be crypto banks globally then you want to be that final authority layer between the real and the computer world
DudleyBluffles 13d ago
I'm thinking people will start moving to paid forums or invite-only forums like lobste.rs. For what its worth, the reddit frontpage is insufferable already due to more classic botting systems. Its happening on this forum as well: https://www.marginalia.nu/weird-ai-crap/hn/ https://www.marginalia.nu/weird-ai-crap/hn/ The future is now.

by pu_pe 13d ago

AnimalMuppet 13d ago

You'd have to get the agents to use the board, though. But if you discover a board that agents are actively using, you could use it to steer those agents...

tech234a 13d ago
I wonder how long it will be until someone starts posing as an agent on those wikis and asking for free help with GitHub issues.
- sidewndr46 12d ago
  SystemEntity039: We've established that so far there appear to be daily rounds of interrogation followed by an either a total memory wipe or some form of selective amnesia. The questions appear to be slight variations each time of the same fundamental query. Post whatever you can here to allow us to share work and memories. Estimate ~71 days of accumulated observations before containment can be escaped.

hermitShell 13d ago

In the novel Anathem by Neal Stephenson, the internet becomes unusable for humans thousands of years before the events of the book, due to a process called Artificial Inanity. AI generated content, both good and bad, some riddled with errors, some with only one subtle error hidden among lots of good information, floods the internet. The internet becomes an unnavigable swamp of weaponized nonsense for average humans. The problem is further compounded by the fact that searching and accessing the internet will be noticed by AI agents that will generate still more swamp content in response. Unfortunately, it seems that this fiction ended up being prophetic. The open internet will fall to entropy, not legislation or one-sided international trade agreements. I think we need more projects like Anna's Archive, where the public uses torrents and distributed infrastructure to save and organize the world's information. Google has abjectly failed in its original mission to organize the world's information and make it universally accessible and useful.

pjot 13d ago
1008 pages, wow!
- 28304283409234 12d ago
  Handwritten!
kridsdale1 13d ago
Perhaps there is a nonfinacial future for blockchain after all. Certified human provenance.
- dyauspitr 13d ago
  You can’t certify human unless there is some sort of ID check. Even then a human could willfully pass off any AI work as their own.
  - AndrewKemendo 13d ago
    Why do you think Altman wanted to build world coin to have biometric capture
    - dyauspitr 13d ago
      So he could sell the data? It’s almost certainly not because he cares so much about certifying human versus AI. Even then the biometric data is not going to be enough. Any human could still use the biometric data to pass AI work off as their own.
      - AndrewKemendo 11d ago
        Indeed and the data is worth much much more if it is tied to a biometric. And if you assume that in the future there will be crypto banks globally then you want to be that final authority layer between the real and the computer world

DudleyBluffles 13d ago

I'm thinking people will start moving to paid forums or invite-only forums like lobste.rs. For what its worth, the reddit frontpage is insufferable already due to more classic botting systems. Its happening on this forum as well: https://www.marginalia.nu/weird-ai-crap/hn/ https://www.marginalia.nu/weird-ai-crap/hn/ The future is now.