Infrastructure for AI Agents
The world needs external protocols and systems that shape how agents interact with institutions and other actors.
by Seth Lazar, Alan Chan, Kevin Wei, Sihao Huang, Nitarshan Rajkumar, Elija Perrier, Gillian K. Hadfield, and Markus Anderljung
published by on May 10, 2025
Transactions in Machine Learning Research
More work from Carnegie
Artificial IntelligenceAs artificial intelligence (AI) changes how people around the world live and work, new frontiers for international collaboration, competition, and conflict are opening. AI can, for example, improve (or detract) from international cyber stability, optimize (or bias) cloud-based services, or guide the targeting of biotechnology toward great discoveries (or terrible abuses). Carnegie partners with governments, industry, academia, and civil society to anticipate and mitigate the international security challenges from AI. By confronting both the short-term (2-5 years) and medium-term (5-10 years) challenges, we hope to mitigate the most urgent risks of AI while laying the groundwork for addressing its slower and subtler effects.
Digital Connectivity and Digital Informants in WarOver the past twenty-five years, digital connectivity—including the internet and smartphones—has spread across the globe, including into every conflict zone.
- Jack McDonald
Advancing Science- and Evidence-based AI PolicyEffectively steering outcomes for and through AI will require thoughtful, evidence-based policy development. Though it may seem self-evident that evidence should inform policy, this is far from inevitable in the inherently messy policy process.
- +17
- Rishi Bommasani,
- Sanjeev Arora,
- Jennifer Chayes,
- Yejin Choi,
- Mariano-Florentino (Tino) Cuéllar,
- Li Fei-Fei,
- Daniel Ho,
- Dan Jurafsky,
- Sanmi Koyejo,
- Hima Lakkaraju,
- Arvind Narayanan,
- Alondra Nelson,
- Emma Pierson,
- Joelle Pineau,
- Scott Singer,
- Gaël Varoquaux,
- Suresh Venkatasubramanian,
- Ion Stoica,
- Percy Liang,
- Dawn Song
Science
Iran-Israel AI War Propaganda Is a Warning to the WorldThe war signaled critical challenges in the growing gap between the sophistication of AI deception and analysts’ ability to detect it, heralding a frightening new phase in global conflict.
- Mahsa Alimardani,
- Sam Gregory
The Other AI Race: An Export Promotion Strategy for the Global SouthU.S. efforts should position domestic AI technologies at the center of a forward-looking international engagement strategy.
- Marianne Lu,
- Sam Winter-Levy
