- +10
Rosa Balfour, Frances Z. Brown, Yasmine Farouk, …
{
"authors": [
"Moisés Naím"
],
"type": "legacyinthemedia",
"centerAffiliationAll": "",
"centers": [
"Carnegie Endowment for International Peace"
],
"collections": [],
"englishNewsletterAll": "",
"nonEnglishNewsletterAll": "",
"primaryCenter": "Carnegie Endowment for International Peace",
"programAffiliation": "",
"programs": [],
"projects": [],
"regions": [
"North America",
"United States",
"Middle East",
"North Africa",
"Egypt",
"Saudi Arabia",
"United Arab Emirates"
],
"topics": [
"Economy",
"Security",
"Global Governance",
"Foreign Policy"
]
}Source: Getty
It Started With Porn
Image manipulation is nothing new. But deepfake is different and more dangerous because the technology is used as a weapon.
Source: El País
At the end of last year a series of pornographic videos began showing up on the internet. This is nothing new, but these were different because they starred some of the world’s top actresses and singers. Naturally, they went viral: millions of people around the world saw them. Very quickly it became clear that Scarlett Johansson, Taylor Swift, Katy Perry, and other artists were not the real protagonists of the sex videos, but rather the victims of a new technology that – using artificial intelligence and other advanced digital tools – allows their creators to insert anyone’s face into a very credible video.
And this was just the beginning. It wasn’t long before Angela Merkel, Donald Trump, and Mauricio Macri were also victims of what is known as “deepfake.” Barack Obama was used, without his consent, to exemplify the possible nefarious uses of the new technology. We can watch Obama saying what the forger wants him to but has never said before. But it is, nevertheless, a very realistic video.
Image manipulation is nothing new. Authoritarian governments have a long history of “disappearing” disgraced leaders from official photographs. And since 1990 Photoshop has allowed users to alter digital photographs, a practice that has become so common it is considered a verb by Merriam-Webster.
The potential for the videos to exacerbate international conflicts is enormous
But deepfake is different. And much more dangerous. In just the year since the fake celebrity porn videos appeared, the technology has improved dramatically. Everything about these videos is hyper realistic, and the person’s voice and gestures are so exactly rendered that it becomes impossible to know it is a forgery without using sophisticated verification programs. And perhaps the biggest danger of deepfake is that the technology is available to anyone.
A distraught ex could create (and anonymously distribute) a video that perfectly imitates the voice, gestures, and face of the woman who left him and in which she appears to be doing and saying the most shameful and degrading things. A video of the police brutally beating an elderly woman who is participating in a street march could provoke violent clashes between protesters and the police. The respected leader of a racial or religious group could incite his followers to attack members of another race or religion. Some students could produce a compromising video of a teacher they despise. Or digital extortionists could threaten a company with disclosing a damaging video, if the company does not pay a hefty ransom.
The possible uses of deepfake in politics, economics, or international relations are as varied as they are sinister. The release of a video showing a presidential candidate saying or doing reprehensible things shortly before the elections will certainly become a more commonly used election trick. Even if the candidate’s opponent doesn’t approve the hoax, his most radical followers can produce and distribute the video without asking for anyone’s permission.
The possible uses of deepfake in politics, economics, or international relations are as varied as they are sinister
The counterfeit videos’ potential to cloud relations between countries and exacerbate international conflicts is also enormous.
And this is not hypothetical. It has already happened. Last year, the Emir of Qatar, Tamim bin Hamad al-Thani, appeared in a video praising and supporting Hamas, Hezbollah, the Muslim Brotherhood, and Iran. This provoked a furious reaction from Saudi Arabia, the United Arab Emirates, Bahrain, and Egypt, countries that already had strained ties with Qatar. They denounced the emir’s speech as supporting terrorism, broke diplomatic relations, closed the borders, and imposed a blockade by air, sea, and land. The reality, however, is that the Emir of Qatar never gave that speech; while the video that escalated the conflict was not produced with deepfake technologies it was sufficient to provoke a dangerous escalation of the conflict that was already simmering. The video was still a fake but the boycott that resulted is very real, and remains in force.
The threat that deepfake represents to social harmony, democracy, and international security is obvious. The antidotes to this threat are much less clear, although there are some proposals. All organizations that produce or distribute photographs or videos should be forced to use technology blocks that make their visual and audio material unalterable. People must also have access to technologies that protect them from being victims of deepfakes. Laws must be adapted so that those who defame or cause harm to others through the use of these technologies can be brought to justice. The ease with which it is now possible to operate anonymously on the web should not be tolerated. All this is necessary, but insufficient. We will need to do much more.
We have entered an era in which the ability to differentiate the truth from lies, facts from fiction, is being eroded. And with it, trust in institutions and in democracy. Deepfake is another new and powerful weapon in the arsenal that the merchants of lies have at their disposal.
We have to fight them.
About the Author
Distinguished Fellow
Moisés Naím is a distinguished fellow at the Carnegie Endowment for International Peace, a best-selling author, and an internationally syndicated columnist.
- The World Reacts to Biden’s First 100 DaysResearch
- View From Latin AmericaCommentary
Moisés Naím
Recent Work
Carnegie India does not take institutional positions on public policy issues; the views represented herein are those of the author(s) and do not necessarily reflect the views of Carnegie, its staff, or its trustees.
More Work from Carnegie India
- A Halting Turn: India’s Military TransformationCommentary
In any defense establishment, change is an ongoing process. However, despite the best of intentions, existing bureaucracies, bound by habit and years of socialization, have their limits in implementing transformative change.
Anit Mukherjee
- AI in Outer Space: Opportunities, Risks, and the Governance GapCommentary
How is AI reshaping space security, creating governance challenges, and where does international diplomacy stand today?
Tejas Bharadwaj, Almudena Azcárate Ortega
- Threading the Needle: India’s Path Forward with ChinaPaper
After the chill in ties between 2020 and 2024 that brought India–China relations to their lowest point in several decades, the two countries have engaged each other afresh. This paper argues that there are predominantly four imperatives guiding India’s approach to China, and they exist in an order of priority.
Saheb Singh Chadha
- Managing Divergence: India’s BRICS Presidency in 2026Article
This piece argues that India’s central challenge is not managing a single flashpoint but resolving the underlying tension between expansion and institutional coherency of the BRICS grouping.
Vrinda Sahai
- India–Africa Strategic Partnership: Challenges, Potential, and Possible PathwaysArticle
A partnership between India, a country of subcontinental size, and Africa, a continent of fifty-four countries, may seem asymmetric until one notes that both are home to nearly the same number of people—1.4 billion. This essay spells out the existing challenges to the partnership, its optimal potential, and the possible pathways to realize it over the next quarter-century.
Rajiv Bhatia