Deepfake 'news anchors' in pro-China footage: research

Deepfake 'news anchors' in pro-China footage: research

The "news broadcasters" appear stunningly real, but they are AI-generated deepfakes in a first-of-its-kind propaganda video that a research report published on February 7, 2023 attributed to Chinese state-aligned actors. PERMISSION PENDING - This undated handout screen grab image of AI generated videos shared on social media and downloaded by Graphika as part of their investigation into deepfake disinformation campaigns shows two AI-generated news anchors in Wolf News videos.
The "news broadcasters" appear stunningly real, but they are AI-generated deepfakes in a first-of-its-kind propaganda video that a research report published on February 7, 2023 attributed to Chinese state-aligned actors. PERMISSION PENDING - This undated handout screen grab image of AI generated videos shared on social media and downloaded by Graphika as part of their investigation into deepfake disinformation campaigns shows two AI-generated news anchors in Wolf News videos.. Photo: - / Graphika/AFP
Source: AFP

PAY ATTENTION: Enjoy reading our stories? Join YEN.com.gh's Telegram channel for more!

The "news broadcasters" appear stunningly real, but they are AI-generated deepfakes in first-of-their-kind propaganda videos that a research report published Tuesday attributed to Chinese state-aligned actors.

The fake anchors -- for a fictious news outlet called Wolf News -- were created by artificial intelligence software and appeared in footage on social media that seemed to promote the interests of the Chinese Communist Party, US-based research firm Graphika said in its report.

"This is the first time we've seen a state-aligned operation use AI-generated video footage of a fictitious person to create deceptive political content," Jack Stubbs, vice president of intelligence at Graphika, told AFP.

In one video analyzed by Graphika, a fictious male anchor who calls himself Alex critiques US inaction over gun violence plaguing the country. In the second, a female anchor stresses the importance of "great power cooperation" between China and the United States.

Read also

Fakery and fraud: Energy scammers cast 'wide net' on Facebook

Advancements in AI have stoked global alarm over the technology's potential for disinformation and misuse, with deepfake images created out of thin air and people shown mouthing things they never said.

There was no immediate comment from China on Graphika's report, which comes just weeks after Beijing adopted expansive rules to regulate deepfakes.

PAY ATTENTION: Сheck out news that is picked exactly for YOU ➡️ click on “Recommended for you” and enjoy!

China enforced new rules last month that will require businesses offering deepfake services to obtain the real identities of their users. They also require deepfake content to be appropriately tagged to avoid "any confusion."

The Chinese government has warned that deepfakes present a "danger to national security and social stability."

Graphika's report said the two Wolf News anchors were almost certainly created using technology provided by the London-based AI startup Synthesia.

Read also

Microsoft says 'new day' for search as AI-powered Bing challenges Google

The website of Synthesia, which did not immediately respond to AFP's request for comment, advertizes software for creating deepfake avatars "based on video footage of real actors."

Graphika said it discovered the deepfakes while tracking pro-China disinformation operations known as "spamouflage".

"Spamouflage is a pro-Chinese influence operation that predominantly amplifies low-quality political spam videos," said Stubbs.

"Despite using some sophisticated technology, these latest videos are much the same. This shows the limitations of using deepfakes in influence operations -- they are just one tool in an increasingly advanced toolbox."

New feature: Сheck out news that is picked for YOU ➡️ click on “Recommended for you” and enjoy!

Source: AFP

Authors:
AFP avatar

AFP AFP text, photo, graphic, audio or video material shall not be published, broadcast, rewritten for broadcast or publication or redistributed directly or indirectly in any medium. AFP news material may not be stored in whole or in part in a computer or otherwise except for personal and non-commercial use. AFP will not be held liable for any delays, inaccuracies, errors or omissions in any AFP news material or in transmission or delivery of all or any part thereof or for any damages whatsoever. As a newswire service, AFP does not obtain releases from subjects, individuals, groups or entities contained in its photographs, videos, graphics or quoted in its texts. Further, no clearance is obtained from the owners of any trademarks or copyrighted materials whose marks and materials are included in AFP material. Therefore you will be solely responsible for obtaining any and all necessary releases from whatever individuals and/or entities necessary for any uses of AFP material.