Commentary
A prophetic Romanian novel about a town at the mouth of the Danube carries a warning: Europe decays when it stops looking outward. In a world of increasing insularity, the EU should heed its warning.
Thomas de Waal
{
"authors": [
"Steve Feldstein"
],
"type": "other",
"centerAffiliationAll": "dc",
"centers": [
"Carnegie Endowment for International Peace"
],
"collections": [
"Democracy and Governance"
],
"englishNewsletterAll": "",
"nonEnglishNewsletterAll": "",
"primaryCenter": "Carnegie Endowment for International Peace",
"programAffiliation": "DCG",
"programs": [
"Democracy, Conflict, and Governance"
],
"projects": [],
"regions": [],
"topics": [
"Political Reform",
"Democracy",
"Technology"
]
}
Source: Getty
Other
How Artificial Intelligence Is Reshaping Repression
Around the world, AI systems are showing their potential for abetting repressive regimes and upending the relationship between citizen and state, thereby accelerating a global resurgence of authoritarianism.
Published on Jan 9, 2019
Source: Journal of Democracy
In early 2018, one of Malaysia’s key security forces made a startling announcement. The Auxiliary Force, a branch of the Royal Malaysia Police Cooperative, had entered into a partnership with the Chinese company Yitu Technology to equip the Force’s officers with facial-recognition capabilities. Security officials will be able to rapidly compare images caught by live body cameras with images from a central database. The head of the Auxiliary Force explained that this use of artificial intelligence (AI) was a “significant step forward” in efforts to improve public security. He also noted that his agency planned eventually to enhance the body-camera system so as to enable “real-time facial recognition and instant alerts to the presence of persons of interest from criminal watch lists.”1
Neighboring Singapore soon followed suit, declaring its plans to launch a pilot camera-installation project with the end goal of embedding facial-recognition technology on every public lamppost. The project is ostensibly aimed at facilitating “crowd analytics” and assisting with antiterror operations. Privacy advocates such as the Electronic Frontier Foundation have warned that this technology will enable governments to target political opponents and suppress free expression, but their protests have been to no avail.2
Meanwhile in April 2018, AI startup CloudWalk Technology, based in the Chinese city of the Guangzhou, reportedly signed a deal with Zimbabwe’s government to provide facial-recognition technology for use by state-security services and to build a national image database. CloudWalk is also known for supplying facial-recognition and identity- verification technology to police forces in China’s Xinjiang region, one of the most heavily repressed regions in the world. Its new African partnership falls under the umbrella of the multicontinental Chinese infrastructure and investment scheme known as the Belt and Road Initiative (BRI).3 CloudWalk’s offerings threaten to exacerbate political repression in Zimbabwe, where authorities recently carried out a violent postelection crackdown.
These are not isolated examples. Around the world, AI systems are showing their potential for abetting repressive regimes and upending the relationship between citizen and state, thereby accelerating a global resurgence of authoritarianism. The People’s Republic of China (PRC) is driving the proliferation of AI technology to authoritarian and illiberal regimes, an approach that has become a key component of Chinese geopolitical strategy.
The concept of AI has proven resistant to exact definition. One widespread assertion is that the goal of AI is to “make machines intelligent,” a concept often explained with reference to human intelligence.4 Others, such as Jerry Kaplan, question the usefulness of such analogies. Kaplan maintains that whether machines are “self-aware as people are” is irrelevant. Instead, the essence of AI can be boiled down to a computer’s “ability to make appropriate generalizations in a timely fashion based on limited data.”5
This article does not seek to resolve these disputes. Rather, it focuses on the practical effects of new technologies that are coming into circulation thanks to three major developments: 1) the increased availability of big data from public and private sources; 2) enhanced machine learning and algorithmic approaches; and 3) correspondingly advanced computer processing. (Machine learning, which can be applied to tasks that range from winning Go matches to identifying pathogens, is an iterative statistical process in which an AI system is introduced to a set of data and “tries to derive a rule or procedure that explains the data or can predict future data.”6) The import of this technology for the world’s authoritarians and their democratic opponents alike is growing ever clearer. In recent years, autocracies have achieved new levels of control and manipulation by applying advanced computing systems to the vast quantities of unstructured data now available online and from live video feeds and other sources of monitoring and surveillance. From facial-recognition technologies that cross-check real-time images against massive databases to algorithms that crawl social media for signs of opposition activity, these innovations are a game-changer for authoritarian efforts to shape discourse and crush opposition voices.
AI is not the only category of new technology increasingly being harnessed by autocrats for political gain. Other communications and information technologies, frequently used in tandem with AI, are having equally alarming effects. These include advanced biometrics, state-based cyber hacking, and information-distortion techniques. This article highlights the repressive impact of AI technology for two reasons. First, AI provides a higher-order capability that integrates and enhances the functions of other technologies in startling new ways. Second, mainstream understanding of the policy impact of AI technology remains limited; policy makers have yet to seriously grapple with AI’s repressive implications....
This article was originally published in the Journal of Democracy.
Carnegie does not take institutional positions on public policy issues; the views represented herein are those of the author(s) and do not necessarily reflect the views of Carnegie, its staff, or its trustees.
More Work from Carnegie Europe
- Europolis, Where Europe Ends
- New Tricks and AI Tools in Hungary’s High-Stakes ElectionCommentary
Hungarian Prime Minister Viktor Orbán faces his most serious challenge yet in the April 2026 parliamentary elections. All of Europe should monitor the Fidesz campaign: It will use unprecedented methods of electoral manipulation to secure victory and maintain power.
Zsuzsanna Szelényi
- Europe’s American PredicamentCommentary
Between Greenland and U.S. interference in Europe’s democracies, transatlantic relations risk rising to an unprecedented level of crisis. Amid continued arguments on how Brussels should react, tough times lie ahead for European leaders.
Marc Pierini
- Rules or Deals? The EU’s Challenge in Regulating Corrosive Capital in the Western BalkansPaper
The United Arab Emirates has become a major investor in the Western Balkans. With enlargement back on the agenda, the EU must ensure that foreign capital meets rather than undermines its governance standards.
- +1
Iliriana Gjoni, Iva Čukić, Alba Çela, …
- Armenia’s Election Is a Foreign AffairCommentary
As the 2026 Armenian election approaches, Prime Minister Nikol Pashinyan is facing fierce opposition from both Russia and the diaspora. He will need the help of Europe, the United States, and regional neighbours to advance his ambitious foreign policy.
Thomas de Waal
