13 ms·
Disrupting a new covert influence campaign from Russia
- GolfPopper 22d ago>Our mission is to ensure that artificial general intelligence benefits all of humanity. Pull the other one. It's got bells on.
- metalman 22d agounfortunatly it appears to me that Russia has gone from doing good service providing a reasonable counter narative to the US/west, has become lazy and resorted to promoting convienient irrational and extreamist naratives present at the fringes of western societies, but worse for them and us, is that they are now consuming the excess product and activly meddling, not that our various 3 and 4 letter agencys are refraing from operating there, but it's all tedious and evil mean spirited, lacking any identifiable moral or cultural basis, just a dirty fight for power on both sides.
- jimbob45 22d agoWe recently banned a cluster of ChatGPT accounts originating in Russia We banned a cluster of ChatGPT accounts that very likely originated in Russia. Methinks AI helped write this. Although…their evidence is pretty damning.
- andOlga 22d agoSeems pretty normal to me. Your first sentence is taken from the abstract, a short summary of the article as a whole, so details are excluded or glossed over. Your second sentence is from a section titled "Actor", which goes into actual detail on who the actors were and so has more fluff like this. They go on to explain their reasoning in that section -- you can't actually create an account from Russia itself, but a VPN can be used to bypass the block, which lends some uncertainty. They then proceed to systematically eliminate that uncertainty by showing how the accounts were acting.
- andOlga 22d agoEven as a speaker of the language I haven't a single bloody clue what a "hazzy" is. Is ChatGPT normally this bad at being prompted in one language to generate text in another, or is this an operator fuckup, I wonder?
- thin_carapace 22d agomixing languages results in huge hallucination increase from my experience
- codedokode 22d agoCould it be "hazy", which is supposed to mean "cloudy"? The word "cloudy" is often used in Russian for "unclear", "vague", for example, one could say: "Western countries are awaiting a cloudy perspectives due to discarding traditional values". You can notice one more example of original language leak in the quote from a report ("And she needs politicians...") where Germany is referred to as "she", because in Russian "Germany", as many other countries, has a female gender, so we call it "she", not "it". In English I usually see people using "it" for countries.
- andOlga 22d agoIn the quote provided in the article, it's used as a noun: "unhackneyed perspective on hazzy". And literally the only thing I can think of is the acronym "hz", which is a rough equivalent of the English "idfk". Like someone prompted the bot to tell them the channel gives a perspective on "something, I don't know what". But even this is a stretch of stretches.
- codedokode 22d agoThe text could be truncated for some reason. Or maybe "hazzy" is an adjective before the bot link? "Hz" is translated by both Google and Yandex as "don't know".
- MomsAVoxell 22d agoWe should be tracking and identifying all covert influence campaigns, from all states - not just Russia - and collecting a registry of these efforts for wide public distribution. We should also be tracking and identifying all covert influence campaigns of our own government, too, while we’re at it. In fact, all covert influence, everywhere, should be identified and made overt. It is the covert nature of the influence that is the most insidious aspect, incompatible with free and open society. So yeah, let’s start at home by disassembling the national security apparatus which allows covert influence to be wielded against The People. After all, anything less than full exposure is hypocrisy. More leaks now! Perhaps there will be an application of LLM’s towards identifying covert influence, which we can apply to a corpus and identify its true authorship. This would be pretty useful for a lot of things, eh ..
- dgellow 22d ago> We should be tracking and identifying all covert influence campaigns, from all states - not just Russia - and collecting a registry of these efforts for wide public distribution. Close to nothing happened after Snowden leaks. The republican party has been able to convince pretty much everybody that the Mueller report was a hoax, a report that very explicitly found collusion between Russia and US operatives close to Trump, so bad that his own guys went to prison. The 2nd trump admin destroyed the cyber monitoring apparatus and might have let Russian hackers access citizens data. I don’t think there is anything to be expected from the US at this point.
- MomsAVoxell 22d agoI'm in the camp that the US government is the biggest threat to world peace there is, so the anti-Russia agitprop is not really my thing. Sure, all imperialist war criminals should be prosecuted .. but there's a long, long list of those to prosecute on our side, which is committing far greater atrocities, and yet nobody is doing anything effective about it. Our liberal democracies are failing at reigning in our imperialist war criminals. If there is hope, it is that Europes' youth will continue their current awakening and start holding their governments accountable for the support of genocide and war that their parents have been propagating for decades. Yeah, there's not much hope. But the rest of the world long since turned away from any hope that the US would lead the way for justice. What we have now is war criminals calling for more war against other war criminals. The "War is Peace" crowd have the mic.
- dandaka 22d agoThis got me mixed feelings. I don't support such campaigns. Still I would prefer my AI tool to behave more like a notepad app and less like a government or a corporate censor.
- tyre 22d agoIdeally our government would regulate this, but our government is an absolute dumpster fire intent on destroying respect for America and gives no care for what’s best for its people. So, you know, we gotta take what we can get
- pferde 22d agoIf there's a big centralized service that a lot of people use, there will always be the temptation to abuse it to influence those people.
- hackernud3s 22d agoDoes it seem strange that Russia would go with Israel to astroturf credibility?
- villish 22d agoEvangelical Christians are the target audience. They are strong supporters of Israel because of their interpretation of the bible.
- venzaspa 22d agoIt depends on who your target audience is.
- edu 22d agoNo, Israel has maintained relations with the Kremlin and has refused to impose sanctions against them, as well as rejected calls to send military aid to Ukraine.
- halflife 22d agoUkraine received Patriot missile defense systems from Israel, Zelensky confirms https://www.jpost.com/international/internationalrussia-ukraine-war/article-868735 https://www.jpost.com/international/internationalrussia-ukra...
- ReptileMan 22d agoIf you want to understand Israel - think of it as Eastern European country that is geographically misplaced. Kremlin knows how to pass convincingly as them. And Israel is a wedge issue. In psyops - discord is the goal.
- karmakurtisaani 22d agoNah man, most EE countries want to be aligned with the EU. Unless you mean Belarus.
- 22d ago
- __coder__ 22d agoWhy didn't they used any Chinese open models?
- edu 22d agoHow many user do the Chinese open models have and how many users do OpenAI have?
- codedokode 22d agoMaybe they were not as good at the time, or the contractor just used to use ChatGPT. Also ChatGPT can be used without a phone number registration, unlike Chinese models.
- dgellow 22d agoThey very likely also do that
- stavros 22d agoHow do you know they didn't?
- trueno 22d agoi think a lot of people don't realize how far not just nation-states are willing to go, but bajillionaire entities are willing to go to control any given narrative now that AI is so accessible. ig comments, tiktok comments, reddit comments, hn comments, on seemingly innocuous and harmless content, just out there trying to look real and game the perception. these entities are well aware that people go to comments and discussion for "the real tea" and yeah. marketing behemoths offer "social media engagement" packages to entities like disney to push trailer hype. flood youtube and other socials with fake content engagement. i remember within the first like minute disney dropped the latest tron trailer on youtube, it was absolutely flooded with "i'm not ready" "omggggg" caliber comments from seemingly real looking youtube profiles. bring back lan parties, aol instant messenger and throw the current platforms into the sun
- quietbritishjim 22d agoI agree with a lot of what you're saying but on this point: > i remember within the first like minute disney dropped the latest tron trailer on youtube, it was absolutely flooded with "i'm not ready" "omggggg" caliber comments from seemingly real looking youtube profiles. Disney is too much of a faceless corporation to both with something like that. Especially since, why would anyone be convinced a trailer is good from an astroturfed comment? You're looking at the same content. It's different from a HN comment from an apparent expert who's supposedly verifying that an article is true. The final nail in the coffin is that I've met plenty of people who really who react like that to a new Disney video.
- trueno 22d agoi mean maybe? i wouldn't put it past them personally. producers allocate kind of a lot of budget to the marketing channels and late night talk shows for the cast to try and generate buzz, i think i'd be zero percent surprised disney was willing to burn money engaging in fake content if that's what "the industry" showed to be effective. there was a smaller budget film and by small i mean not disney-wallet that did terribly because it's marketing firm shit the bed on the social media engagement it promised, and that led to a lawsuit. basically all their bots only engaged with themselves on the movies instagram page. this stuff absolutely exists, and on the tron trailer point: sure, again maybe. but the vid was up for like.. literally a minute, like im not even certain any of the commenters would have finished the trailer by the time they had commented. and it was an early morning drop iirc.
- 0-_-0 22d agoWhy didn't Russia just use local models?
- edu 22d agoBecause they want to influence the mainstream outside of their frontiers.
- luke-stanley 22d agoUsing local models, usually means generating content on a more private, local device with the weights of the model stored on that device - a local LLM model could have helped write these posts. It only gets easier to self-host increasingly capable models for generation of text, images, video etc. E.g: Prism ML Bonsai have an older 27B text generating LLM model squashed down to a few GB at what they describe as 95% quality, which can run on a phone.
- realusername 22d agoRussian propaganda operations are not centralized, I'm sure some of them are using other models and for this one, the guy in charge decided to use ChatGPT
- deleted 22d ago[deleted]
- fsuts 22d agoOpen Ai is fighting for defence and other state contracts in USA and similar minded countries Writing about Russia negatively is in their interests, in reality all nation states are doing the same stuff “We banned a cluster of ChatGPT accounts that very likely originated in Russia. The operators prompted in Russian to generate social media comments that were posted on Substack, Telegram, X, Facebook and LinkedIn. Most of the comments they generated were in English, and the operators instructed ChatGPT to hide any linguistic clues that they were Russian. ” They replaced them the next day with English speakers and carried on as normal
- 21asdffdsa12 22d agoJoke aside, it is really hard to determine by goal- as russia has not these "talking" points chinese operators have. If you know the talking points handed of the month- you can very easily spot chinese propaganda. But russia, is just opinion-fog. Covering all. Occasionally - taking some sane take- and glueing some insane conspiracy to it, to discredit opposition. But the fog- that is really tough to filter for. For a time it was structure. The whole: "As a midwestern working joe.."
- dgellow 22d agoYou have to be able to keep two different things in your mind: - yes OpenAI benefits from talking about actions Russia is taking against other countries and how they handle that - and also, Russia is one of the worst actor in the politics and has been non stop active for more than a decade to destroy democratic systems from the inside You cannot just label something as irrelevant just because that benefits the one reporting the issue
- secondary_op 22d agoDo not use US based AI, OpenAI, or Ben Nimmo (highly likely the author of this article) or any similar minion of The Digital Forensic Research Lab (DFRLab) of the Atlantic Council of the NATO could read all your chat history and leverage all the data on you up to your social media accounts and foreign state data. Securing Our Autonomy: How AI Fuels Cognitive Warfare – and How We Can Fight Back https://youtu.be/jH2i0Y9GjJc?t=1273 https://youtu.be/jH2i0Y9GjJc?t=1273 https://youtu.be/jH2i0Y9GjJc?t=2536 https://youtu.be/jH2i0Y9GjJc?t=2536 https://youtu.be/jH2i0Y9GjJc?t=2880 https://youtu.be/jH2i0Y9GjJc?t=2880 So the question then becomes how can these technologies be leveraged in such a way to be able to maximize signal intelligence, communication intelligence with human intelligence. And this is where AI really began to play a role with regard to big data. The more data you have about individuals as those individuals relate and engage in their collectives and ecologies, the more you know about them, what makes them tick. We here in the United States and among our technological and scientific allies recognize the benefit of this as do our international peer competitors scientifically, technologically, bioeconomically, economically, and certainly militarily, and geopolitically. this idea of precision engagement with regard to being able to get intel about various human targets individually and collectively. Either high priority targets as individuals or groups that may be highly prioritized as individuals. What are their needs? What are their likes? What are their patterns? What are their spends? What are their vulnerabilities? Biocschosocial vulnerabilities and how can those be not only accessed utilizing big data and AI but accessed in the cognitive space but very often in the physical space as well. - the National Defense University dude sitting next to the author of this article. OpenAI's China Report, Meta Trains America & the Pentagon Blacklist https://youtu.be/H_WaQl_Q17Q?t=3286 https://youtu.be/H_WaQl_Q17Q?t=3286
- deleted 22d ago[deleted]
- tuesdaynight 22d agoPeople would be uncomfortable if the truth about how much influence nation-states have in the online discourse nowadays was really exposed. I don't mean only bots, but how many political influencers are receiving money from adversaries, from all over the spectrum, without they even knowing who is paying them. American people would feel like LATAM countries, which are used to be heavily influenced by external countries.
- crabbone 21d agoI couldn't help laughing a little at all those Russian phrases weirdly translated into English. Granted I probably sound like that too... at least I don't work for any intelligence service. For the context: I think, English was the most commonly taught foreign language in the Soviet Union, and later in Russia. But, because nobody had access to the genuine English media, whatever we had to read or listen to was produced by Russian speakers who also never heard or never read genuine English, well, perhaps outside of very outdated prose from the 19th century or even earlier. -- How much watch? -- Six watch. -- Such much?! -- For whom how... -- MGIMO finished? -- A-a-a-ask! The joke from that time, but, apparently, little has changed.
- thmryth 20d agoMost of the Russians I've met while traveling were really good guys. I distrust our government, the EU, UK, Canada and especially Israel. Seems we treat each other like garbage on this planet for made up reasons. The US and EU are as much bad actors as any other superpower. Probably not as evil as Israel but then again the Israelis have their hand up all of our politicians arses like sock puppets. Let Russia cook everybody come to dinner and talk about how to get Israel to stop meddling in other countries affairs and finances and we might be able to make progress in space, AI, wth ever.
- karp773 20d agoWithout knowing who you are your comment has no value. On whoee behalf are you posting? Where are you from? China?