Scaling Misinformation With AI

Published Aug 7, 2024, 6:00 AM

Daniel Miessler discusses how AI can grow the number of elite propagandists and hackers employed by foreign intelligence agencies.

Discussed in this video:

AI-Enhanced Software and Disinformation (00:00:00)
Russia utilizes AI software, Millio Radar, to create sophisticated fake personas for disinformation.

Concerns About AI Sophistication (00:01:12)
The increasing capabilities of AI could enable enemies to manipulate information on a massive scale.

Shift from Block List to Allow List (00:02:30)
The internet may need to transition to an allow list system to combat overwhelming disinformation.

Risks for Ordinary Individuals (00:03:44)
Regular users, especially the less tech-savvy, are at high risk of falling victim to manipulation online.

Subscribe to the newsletter at: 
https://danielmiessler.com/subscribe

Join the UL community at:
https://danielmiessler.com/upgrade

Follow on X:
https://twitter.com/danielmiessler

Follow on LinkedIn:
https://www.linkedin.com/in/danielmiessler

See you in the next one!

Russia is using AI enhanced software called Meliorator to create fake online personas for disinformation campaigns. I love this because the better this gets, the more it's going to look like a real human. And then if the AI starts acting like a human with like clicking on things, uh, being able to tell the difference is going to get a whole lot more difficult. And this is actually one of the things I'm most worried about from AI is disinformation bots, not just the sheer number of them, but also their how advanced they are, how sophisticated they are. Basically, the better AI gets, and especially from agent frameworks, the more it's going to be exactly the same, or almost exactly the same, as if our enemies have millions of employees in their intelligence agencies. Okay, let me say that again. That was that was too convoluted. One of the things I'm most worried about is that the better AI gets, it'll be like our foreign intelligence agencies for our enemies. China, Russia, Iran, North Korea. Instead of having a few hundred elite people, they're going to have a few hundred elite people and 40,000 right below them, elite people. And then the better the AI gets, those move up into the elite, and then the elite humans become augmented with that AI and they become like super elite. And the better the AI gets, I mean, it just keeps moving up that chain. So if you think it's bad to have ten, 50, 100 elite people in these different countries who are both Intel trained and manipulation trained, but they're also like super hackers and they're good at all these different skills. But there's I mean, there's only so many in the world. Well, now imagine them with a thousand of them, 10,000 of them, 100,000, 100 million. And they're working consistently with no sleep to go after all your targets. That that's what I'm personally worried about right now. And if they are producing content and the content is all manipulative, the internet is going to have to switch from blocklist to an allow list. I mean, think about that. The internet currently is an allow list. I'm sorry, it's a block list. Everything is available, and you have to specifically go into a place and say, I don't want to see this. I don't want to see this. I don't want to see this because of this problem right here that I'm talking about. We're going to have to switch. We're going to have to switch to the other method, which is to say my I, my internet platform, my mobile OS, okay, Android, Mac macOS, iOS. They're not going to allow anything in unless you have the green checkmark. What is a green checkmark? Green checkmark is an agreement between the the tech platform, the mobile platform, the OS, and trusted providers like a YouTube, which has approved sources from approved individuals and approved organizations. So your news is going to have to come that way because it's going to have to be vetted. So it gets the green check mark. This might be something that's required. It's going to happen anyway, but it might be something that's required within settings and within operating systems, because it's simply too hard to drown out everything. Because this problem right here, the amount of disinformation bots, pretty soon it's going to be like, whatever, 50% of all content is going to going to be manipulation, then it's going to be like 75%, then it's going to be 95%. So if you are naive and you just walk onto the internet, especially as like a regular person or like a grandma or something, you're going to be screwed. You're going to be just like pulled around, like all your money will disappear because you had to save your kids from some horrible accident. And all of a sudden there was an asteroid that hit the thing and aliens came. And pretty soon you're in a bunker and you have no money, and it's like none of it was real. The amount of and quality of manipulation. Think about that as well. The quality of the pitches and the manipulation and the deepfakes and the trickery is going to get so good. It's going to trick us too. It's going to trick experts, not just regular people.

Unsupervised Learning

Unsupervised Learning is about ideas and trends in Cybersecurity, National Security, AI, Technology, 
Social links
Follow podcast
Recent clips
Browse 514 clip(s)