A YouTuber who exploited generative artificial intelligence (AI) to produce and spread false information manipulating social issues, while also collecting donations, has been caught by police. In this case, the individual created fake information by inducing the AI to give specific answers, then produced video content presenting it as fact.
The Cyber Investigation Division of the Busan Metropolitan Police Agency said on the 15th that it had referred a man in his 40s, identified as A, to prosecutors without detention on charges of violating the Framework Act on Telecommunications (false communication).
According to police, A, who operates a YouTube channel with about 87,700 subscribers, is accused of using generative AI to produce false information and repeatedly posting it on his channel.
Starting in March with the false claim that "900,000 barrels of stockpiled oil were delivered to North Korea," A successively posted fake videos on high-profile issues, including claims that "a U.S. private military company is landing in Yeouido" and that "an arrest operation is underway targeting a former senior Ministry of the Interior and Safety official and figures from a specific political party in connection with electoral fraud."
A did not stop posting false information even while under investigation. He was found to have additionally posted videos claiming that "masked police officers of Chinese nationality are committing violence at the Jamsil site" and that "an arson terror attack was attempted in the basement of the Jamsil Handball Stadium."
The police investigation found that A exploited loopholes in generative AI by repeating the same question until the desired conclusion was reached, or by changing the way he phrased questions, to induce the AI to give incorrect answers, and then used these as the basis for YouTube scripts and videos. Police concluded that rather than using AI-generated answers as they were without fact-checking, he intentionally drew out specific false conclusions.
Police believe A continuously spread false information for the purpose of receiving donations, and that he actually earned about 10 million won in YouTube revenue through the related content, and have applied for a pre-indictment preservation of assets for forfeiture.
With the recent advancement of generative AI, anyone can now easily produce videos and images, and methods of spreading false information are becoming increasingly sophisticated. In particular, AI-based fake news targeting sensitive issues such as social conflict, disasters, and elections is emerging as a new social risk factor, given that it can spread rapidly online in a short period of time.
"We plan to respond firmly to acts that use AI for profit to plausibly dress up clearly false facts and cause social confusion," a police official said.
