• Research
  • Emissary
  • About
  • Experts
Carnegie Global logoCarnegie lettermark logo
DemocracyIran
  • Donate
Visualization of technology and democracy intersection

Source: Getty

Article

Realizing the Potential Gains of AI-Enabled Deliberative Democracy

Democratic institutions currently lack the capacity needed to govern AI-augmented deliberation in ways that serve democratic imperatives.

Link Copied
By Micah Weinberg
Published on May 19, 2026
Program mobile hero image

Program

Carnegie California

Carnegie California links developments in California and the West Coast with national and global conversations around technology, democracy, and trans-Pacific relationships. At a distance from national capitals, and located in one of the world’s great experiments in pluralist democracy, Carnegie California engages a wide array of stakeholders as partners in its research and policy engagement.


Learn More

Artificial intelligence (AI) is transforming the mechanisms through which citizens learn, assemble, deliberate, and communicate with policymakers, activities that are at the heart of democratic systems. Deliberation, for example, has long promised democratic legitimacy through reasoned public exchange, but it has been constrained by practical limits on who could participate and at what scale. AI fundamentally alters this equation by enabling structured, high-quality dialogue among tens of thousands rather than dozens of people. These tools can summarize public input at scale and connect it to levers of responsiveness within complex governing systems, increase the level of inclusion in dialogues, and provide real-time learning support for participants. However, realizing the enabling potential of AI to improve democratic processes is structurally conditioned on whether democratic institutions have the staffing, procurement rules, audit capacity, and legal frameworks to govern these tools responsibly. As things stand, these elements are all deeply inadequate to realize this potential while containing potential risks.

This is not a problem with a technical solution. The tools to support large-scale, accessible, evidence-based deliberation already exist. The constraints are political and bureaucratic. Democratic institutions currently lack the capacity, authority, and coordination mechanisms needed to govern AI-augmented deliberation in ways that serve democratic imperatives rather than commercial or partisan ones. And the chasm between the possibilities inherent in these technologies and the ability of our political systems to metabolize and deploy them responsibly grows wider with every passing month.

The most important near-term investments needed, therefore, are not in AI capability development but in democratic governance infrastructure: standard-setting (such as certification frameworks for algorithmic transparency, third-party safety standards, and minority-voice preservation), institutional capacity-building (including hiring AI-literate staff or doing significant upskilling within public deliberation bodies), open-source public platform development (to reduce dependence on proprietary vendors), and cross-sector coordination between the AI governance and democratic-process communities. Without successfully accomplishing the difficult and complicated work required to address these human-centered challenges, the democratic gains enabled by AI technologies will remain partial, fragile, and unevenly distributed—if they materialize at all.

The Potential for Concrete Gains Through Improved Deliberative Democracy

Deliberative democracy holds that the legitimacy of collective decisions derives not from mere aggregation of preferences but from the quality of the reasoning process through which those decisions are reached. Democratic outcomes are, therefore, more legitimate to the extent that they emerge from free, equal, and reasoned exchange among participants who are genuinely open to revising their views in light of better arguments.

This tradition rooted in the work of thinkers such as Jürgen Habermas, James Fishkin, and John Dryzek makes several demanding normative claims about what adequate deliberation requires. Participants must have access to relevant information, they must be able to speak and be heard on roughly equal terms, and the exchange must be oriented toward the common good rather than strategic advantage. And, critically, outcomes must be traceable to the deliberative process in ways that are clear and reinforce the importance of these dialogues.

These normative commitments generate practical requirements that have historically proved difficult to meet at scale. Small-group deliberation such as citizen juries, deliberative polls, and mini-publics can achieve high informational quality and genuine exchange, but at the cost of representativeness and reach. Large-scale democratic participatory processes, such as referendums, online consultations, and public comment periods, on the other hand, achieve breadth at the cost of depth. This tension between scale and quality is the central structural problem that AI-augmented deliberation promises, with varying degrees of credibility, to address.

The intersection of AI and deliberative democracy is not merely a site of risk; it is also a domain of genuine democratic possibility.

The intersection of AI and deliberative democracy is not merely a site of risk, including algorithmic bias in synthesis, erosion of participant trust through opaque AI processes, and concentration of deliberative infrastructure in private hands; it is also a domain of genuine democratic possibility. There are four main potential gains from the use of this technology.

Scaling Deliberation Without Sacrificing Depth

One of the most persistent tensions in deliberative theory is the trade-off between scale and quality. As the number of participants grows, the depth of exchange typically declines. AI offers a partial but meaningful solution. Synthesis tools based on large language models—such as those deployed in mass deliberation platforms like Polis (an open-source opinion-mapping tool that identifies clusters of agreement across large groups), Talk to the City (a platform for synthesizing deliberative input into structured reports), and vTaiwan (Taiwan’s pioneering participatory governance initiative that uses Polis and other tools to inform government action), or those used in novel government programs such as Engaged California—can aggregate thousands of individual contributions into structured thematic maps while preserving minority positions that would otherwise be submerged. The complexity of topics such as how to rebuild in the wake of the Los Angeles fires of 2025, the first use case of Engaged California, require the type of sophisticated qualitative coding that only AI can practice at scale.

AI-assisted synthesis enables civic assemblies and digital consultations to operate at national and sub-national scale, involving tens of thousands of participants while retaining the structure of small-group deliberation. This addresses the representativeness deficit that has historically limited deliberative mini-publics to samples of tens or hundreds of people. Recent implementations illustrate the potential. AI synthesis tools provided a vital input into the 2023 AI Safety Summit consultation run by the UK government. They were used to process public input from over 100,000 respondents, generating thematic clusters on topics including frontier AI risks, safety frameworks, and international coordination that directly informed plenary discussions and contributed to the Bletchley Declaration on AI safety. Analogous tools have been tested in the European Citizens’ Panels under the Conference on the Future of Europe. At the local level in the United States, AI-enabled analysis helped the city of Fort Collins, Colorado engage with over 4,000 long-form resident responses on a highly contested land-use issue, a scale of qualitative engagement that would previously have been impossible for a municipal government.

Reducing Informational Asymmetries Among Participants

Deliberative quality depends in part on participants having access to roughly comparable relevant information. In practice, informational asymmetries between technically expert actors and lay citizens, or between well-resourced and under-resourced participants often systematically distort deliberative outcomes. AI-powered civic tools have the potential to reduce these asymmetries at the point of participation. This includes by offering:

  • real-time, plain-language summaries of technical policy documents during deliberative sessions;
  • fact-checking and source triangulation embedded in deliberation platforms;
  • adaptive explanation depth by adjusting the complexity of information to participants’ background; and
  • translation and accessibility tools that enable cross-lingual and cross-ability participation.

These tools shift AI from a potential vector of elite capture toward a democratizing force within deliberative and other democratic processes, provided their design prioritizes participant autonomy over engagement optimization (as explained further below) risks.

Expanding Inclusion Through Participation Infrastructure

Structural barriers to deliberative participation, such as geographic distance, disability, care responsibilities, and linguistic-minority status, have historically concentrated deliberative voice among those with the greatest discretionary time and mobility. Digital deliberation platforms, augmented by AI accessibility features, offer a meaningful expansion of who can participate, though it would be necessary to alleviate inequities of access, including gender ones, to reap the rewards of this.

AI-enabled participation infrastructure can include: automated captioning and sign-language interpretation for synchronous deliberation, asynchronous contribution models that do not require simultaneous availability, multilingual interface layers that reduce the dominance of majority-language speakers, and sentiment and engagement analytics that flag when certain participant subgroups are systematically disengaging or being talked over. Early evidence about the utilization of tools for these purposes is mixed, though, with most analysts noting that their full potential has yet to be realized.

As AI accessibility tools improve, the inclusion ceiling for deliberative processes rises substantially. The constraint shifts from technical capacity to whether organizing bodies are willing to redesign process architecture around the needs of historically excluded groups rather than retrofitting accessibility as an add-on.

Improving Deliberative Feedback Loops and Accountability

A recurrent criticism of participatory processes is that they produce input for which there is no traceable impact: Citizens deliberate, recommendations are issued, and then institutional response is opaque or absent. AI-enabled tracking and reporting tools create new possibilities for closing this accountability loop as well.

Process organizers, working with independent auditors, can deploy AI to map deliberative outputs against subsequent legislative or executive decisions, generate auditable records of how citizen input was weighted or discarded, and produce public dashboards that translate complex policy genealogies into accessible narratives. These functions strengthen what deliberative theorists call the “input-throughput-output” chain, the connective tissue between citizen participation and legitimate democratic outcomes.

Barriers to Realizing Gains

Each opportunity identified above faces substantial barriers. These are not merely implementation difficulties but structural tensions that reflect deeper conflicts between imperatives of AI system design and values of deliberative democracy.

The Alignment Problem in Deliberative AI

AI systems used in public deliberation are built to hit specific targets, such as keeping people engaged, deciding which comments to show first, or producing accurate summaries of thousands of responses. But these targets do not always line up with what good democratic discussion actually needs. This is not a bug that developers can patch with a quick fix. It is baked into the basic way these systems are designed to work.

The mismatch shows up in at least five ways:

  • AI systems applied to social interaction are generally designed to maximize engagement, which tends to boost emotional and divisive content. Imagine a city running an online forum on a proposed homeless shelter: An algorithm optimized for engagement might surface an angry rant with hundreds of reactions over a carefully reasoned comment weighing the trade-offs, even though the second contribution is far more useful for reaching a good decision.
  • Automated summarization tools tend to lose uncommon viewpoints. If 10,000 people submit comments on a new transit plan and only 200 raise concerns about how it will affect a specific immigrant neighborhood, a summary tool focused on accuracy might fold those voices into a generic “community impact” category or drop them entirely. But those are exactly the perspectives that democratic deliberation is supposed to protect.
  • The systems that decide which comments rise to the top are not neutral. A relevance-ranking algorithm might bury an important insight connecting housing policy to environmental justice because it does not match the most common keywords, even though that kind of crosscutting insight is exactly what deliberation is meant to surface.
  • An attempt to deliver personalized information can undermine shared deliberation. If an AI system shows different participants different background materials tailored to their background and education level, people in the same discussion could end up working from different sets of facts, making genuine common ground harder to find.
  • The drive to process more input faster works against the slow, reflective thinking that makes deliberation valuable in the first place. Rushing 50,000 responses through an AI pipeline in forty-eight hours to meet a government deadline might produce a tidy report, but it skips the kind of careful, iterative review that helps people genuinely understand each other’s reasoning.

Some of these problems can be addressed through smarter design choices, such as training summarization tools to flag and preserve minority viewpoints or building ranking systems that prioritize diverse perspectives rather than just popular ones. Others, like the fundamental tension between speed and reflective depth, represent deeper trade-offs that require ongoing human oversight rather than a one-time technical fix.

Institutional Incapacity and Procurement Pathologies

Public institutions responsible for designing and overseeing deliberative processes, such as parliaments, local governments, electoral commissions, and civic oversight bodies, largely lack the technical capacity to procure, evaluate, or govern AI-augmented deliberation tools. This creates a dependency on private vendors whose incentives may be misaligned with democratic objectives.

This procurement pathology operates in a recognizable pattern. Institutions with limited technical staff issue specifications that commercial vendors interpret liberally, accountability mechanisms are written into contracts in ways that are not enforceable in practice, and audit rights over algorithmic decisionmaking are routinely waived or poorly exercised. The result is that AI systems shaping deliberative outputs are effectively ungoverned by the democratic institutions nominally responsible for them.

Unlike electoral technology, for which international monitoring norms have been developed, AI-augmented deliberation operates in a near-total standards vacuum.

There is no established international standard or certification framework for AI tools used in democratic deliberation. Unlike electoral technology, for which international monitoring norms have been developed, AI-augmented deliberation operates in a near-total standards vacuum, one that must be filled through the development of analogous certification and monitoring frameworks specifically designed for deliberative contexts. Several institutions are positioned to fill this gap. The Organisation for Economic Co-operation and Development (OECD) already operates the field’s most developed evaluation infrastructure for deliberative processes and organizations like MetaGov are working on issues like interoperability of platforms.

The Legitimacy Deficit of Automated Synthesis

For a democratic process to feel legitimate, people need to be able to see how their input actually shapes the final result. But when an AI system takes thousands of contributions and produces a summary, participants are left having to trust a process they cannot see or verify. That is a real problem. If you spent an hour carefully writing out your views on how your city should spend its budget, and then an AI-generated summary did not reflect what you said or, worse, claimed a consensus you never agreed to, you would have good reason to feel that the process failed you.

And that distrust is not simply paranoia. Today’s AI summarization tools have real, documented shortcomings. They tend to sand down disagreements, making it sound as if people were more aligned than they actually were. They can generate summaries that sound reasonable but do not accurately reflect what participants said. And when contributions come in multiple languages, the tool often defaults to the framing used by majority-language speakers, sidelining perspectives expressed in other languages.

Consider a theoretical example: A state government runs an online deliberation on healthcare policy and receives 15,000 responses in English, Spanish, and Mandarin. The AI synthesis produces a five-page report organized around four major themes. But the Spanish-language responses, which disproportionately emphasized concerns about undocumented residents’ access to care, have been folded into a generic “access and affordability” category that strips away their specific focus. Meanwhile, a genuine split among participants over whether to prioritize rural clinics or urban hospitals gets presented as broad agreement on “expanding healthcare infrastructure.” No one involved, not the participants, not even the organizers, can easily tell that the summary papered over these differences, because there is no accessible way to check the AI tool’s work, especially given the scale of input and the often-limited bandwidth of humans that are “in the loop.”

Without clear transparency requirements, like showing participants how their specific input was categorized and giving them a chance to flag misrepresentations, these kinds of errors remain invisible to everyone involved. And publicly sponsored engagements, especially on the topic of AI itself, still largely fall short on these dimensions.

Concentration of AI Deliberation Infrastructure

A small number of private actors, primarily large AI laboratories and civic tech firms, currently control the infrastructure on which AI-augmented deliberation depends. This concentration creates systemic fragility. Democratic processes built on proprietary platforms are exposed to vendor lock-in, commercial discontinuation, and unilateral changes to terms of service or algorithmic behavior.

Concentration also poses a deeper democratic concern. Decisions about the design of tools that shape citizen deliberation, such as which voices to surface, how to frame trade-offs, and what counts as relevant information, are effectively delegated to private entities without a democratic mandate or accountability. Addressing this requires greater public oversight of private deliberation vendors and sustained investment in publicly governed alternatives. This is analogous to privatizing electoral infrastructure, yet it has attracted far less regulatory scrutiny.

Toward Democratic Governance of AI-Augmented Deliberation

The risks identified above will shape the likely trajectory of AI-augmented deliberation in the absence of institutional intervention, but they do not ordain an inevitable endpoint. Realizing the democratic gains AI technologies make possible while containing their attendant risks requires a coordinated set of mitigations across four interconnected domains.

Realigning AI Objectives with Deliberative Values

The misalignment between AI optimization targets and deliberative democratic values is not an immutable technical constraint. It is a consequence of design choices made under particular commercial incentive structures. Correcting it requires that metrics of deliberative quality such as strength of evidence, preservation of minority views, and reflective depth be built into the objective functions and evaluation criteria of AI systems deployed in civic contexts, rather than appended as afterthoughts to tools optimized for engagement or throughput. Efforts in this direction, such as the Collective Intelligence Project’s work on alignment assemblies and Anthropic’s experiments with collective constitutional AI, are promising but still nascent steps.

Reorientation demands collaboration between AI developers and deliberative-democracy practitioners at the design stage, rather than only at the deployment stage. Public funding bodies and philanthropic intermediaries, whose investment in “AI for democracy” has to date been modest and fragmented, have a critical role to play in directing research investment toward the development of “deliberation-native” AI tools whose core optimization targets are defined by democratic-process values. This includes support for policy-led, technology enabled innovations that support those in the democracy space to develop internal technical capacity and external partnerships that bring technical ability to the organizations best positioned to monitor and evaluate deliberation processes. Funders should prioritize multi-year support for open-source deliberation infrastructure and require that grantees adopt deliberative quality benchmarks as a condition of funding. Evaluation frameworks, such as those developed by independent academic institutions and civil society organizations in partnership with public bodies, should require that AI synthesis tools demonstrate, through independent testing, that they protect dissenting and low-frequency contributions at rates comparable to unmediated human synthesis, and they should treat failure on this dimension as disqualifying for deployment in public deliberative processes.

Building Institutional Capacity and Procurement Integrity

The procurement pathologies that currently leave democratic institutions dependent on misaligned private vendors cannot be resolved by better contracts alone. They require sustained investment in the internal technical capacity of the public institutions responsible for deliberative governance, something that aligns with the calls for the building-up a new cadre of public-interest technologists who can bridge technical and democratic expertise. This means hiring and retaining staff with advanced AI literacy, embedding technical expertise within policy and process teams, and creating dedicated units capable of conducting meaningful algorithmic audits as a condition of contract renewal rather than this being a formality. Public-sector hiring processes and the resources available to compensate employees, however, are not optimized for hiring and retaining high-level technical talent. In addition, the standards vacuum that currently characterizes AI-augmented deliberation must be addressed through internationally recognized certification frameworks analogous to those for electoral technology. Standard-setting bodies, such as the OECD and the International Organization for Standardization, or emerging multi-stakeholder initiatives like the Partnership on AI, working in close coordination with civil society organizations, should establish minimum requirements for transparency, auditability, the protection of minority voices, and data sovereignty as preconditions for the deployment of AI tools in public deliberative contexts.

Establishing Transparency and Participant Auditability

The legitimacy deficit of automated synthesis is fundamentally a transparency problem, and its resolution requires structural transparency obligations rather than voluntary disclosure norms. AI tools used in deliberative processes should be required to provide participants with accessible accounts of how their contributions were categorized, weighted, and represented in aggregate outputs. The experience of vTaiwan offers a partial model, with Polis’s open-source architecture enabling participants to see how opinion clusters form in real time, though more robust post-deliberation audit mechanisms remain underdeveloped. This does not require full technical explainability but it does require procedural transparency, including clear documentation of synthesis methodology, publicly available accuracy assessments, and accessible redress mechanisms for participants who believe their contributions were misrepresented. Critically, transparency mechanisms should be designed for participants, not merely for technical auditors, and process organizers should build participant-review stages into deliberative workflows. There need to be moments at which AI-generated syntheses are returned to participant groups for verification and correction before they are transmitted to decisionmaking bodies.

Decentralizing and Publicly Anchoring Deliberative Infrastructure

Addressing the concentration of AI deliberation infrastructure requires sustained public investment in open-source, publicly governed alternatives to proprietary platforms. Governments, foundations, and multilateral bodies should jointly fund the development and maintenance of open-source deliberation platforms whose algorithmic logic is publicly auditable, whose governance structures are democratically accountable, and whose continued operation is not contingent on the commercial decisions of private actors.

Existing open-source deliberation tools such as Polis are partial models, and they require substantially greater institutional support and interoperability investment to function as genuine public infrastructure. Data-sovereignty arrangements are equally critical. Citizen contributions to deliberative processes are a form of democratic speech whose storage, processing, and ownership should be governed by law rather than commercial terms of service. Regulatory frameworks should establish clear requirements that deliberation data remain within the jurisdiction of the democratic process it serves, subject to independent oversight, and inaccessible for commercial repurposing without explicit democratic authorization.

The Potential of AI-Enhanced Deliberative Democracy Relies Almost Entirely on Human Decisions

None of these mitigations are straightforward to implement, and none can be achieved by any single actor working alone. They share a common orientation in that they treat the governance of AI in deliberative contexts not as a technical compliance problem to be managed at the margins of democratic practice, but as a fundamental challenge for democratic institutions. The work that will determine whether the next generation of deliberative tools strengthens democratic legitimacy or corrodes it—such as building procurement capacity, drafting certification standards, designing participant-facing audit mechanisms, and sustaining open-source infrastructure—is slow and do not fit the metrics by which technology investments are typically judged. The decisive choices here are made not at the moment a platform is deployed, but much earlier in the institutional decisions about who will govern these tools, under what standards, and on whose behalf.

What does not yet exist is the democratic governance infrastructure to ensure that such deliberation produces legitimate outcomes rather than the appearance of them.

Such decisions are being made now, and most public institutions are still effectively absent from the table. The technical capacity to deliberate at the scale of a state or a continent already exists. What does not yet exist is the democratic governance infrastructure to ensure that such deliberation produces legitimate outcomes rather than the appearance of them. Filling that gap requires investments that are modest compared to what governments and philanthropies routinely commit to AI capability development, but it also demands a level of cross-sector coordination and sustained institutional attention that is conspicuously absent. AI-augmented deliberation will, in some form, become a fixture of twenty-first century governance. The question is whose interests it will serve and whose voices it will faithfully carry. Meeting that challenge is the defining test of whether AI-augmented deliberation becomes a genuine expansion of democratic possibility or merely a more efficient mechanism for its simulation.

About the Author

Micah Weinberg headshot
Micah Weinberg

Nonresident Scholar, Carnegie California

Dr. Micah Weinberg is a nonresident scholar at Carnegie California. His scholarship centers on the global relevance of the quality of democracy and public policy in this important subnational polity.

    Recent Work

  • Commentary
    California Sees Ways AI Can Support Policymaking. Here’s What It Needs to Succeed.
      • Micah Weinberg headshot

      Micah Weinberg

  • Commentary
    The Promise and Potential of Engaged California
      • Micah Weinberg headshot

      Micah Weinberg

Micah Weinberg
Nonresident Scholar, Carnegie California
Micah Weinberg
DemocracyAITechnology

Carnegie does not take institutional positions on public policy issues; the views represented herein are those of the author(s) and do not necessarily reflect the views of Carnegie, its staff, or its trustees.

More Work from Carnegie Endowment for International Peace

  • San Francisco Skyline
    Paper
    California’s Global Trade Cities: Driving Local and National Outcomes

    Cities across the United States facilitate investment in American communities. Yet, because global attention remains focused on U.S. trade policy, their distinctive and bold local approaches to international trade and investment promotion are often underappreciated.

      • Wyatt Frank
      • Marissa Jordan

      Wyatt Frank, Marissa Jordan

  • Commentary
    Cities Have a Crucial Role to Play in Advancing Climate Mobility Priorities

    Ensuring that cities’ perspectives shape international discussions at this year’s forums is not just equitable; it is likely to produce better outcomes.

      • Marissa Jordan

      Liliana Gamboa, Marissa Jordan

  • illustration of AI chat bubbles
    Commentary
    California Sees Ways AI Can Support Policymaking. Here’s What It Needs to Succeed.

    For AI to capture the public’s policy concerns, people need to know that the models are elevating human concerns in human words, not generating their own.

      • Micah Weinberg headshot

      Micah Weinberg

  • Abstract AI
    Paper
    AI and Democracy: Mapping the Intersections

    Emerging AI technologies are entangling with a crisis in democracy.

      • Rachel George

      Rachel George, Ian Klaus

  • Photo of bags of groceries being distributed to SNAP recipients in a parking lot.
    Commentary
    Shrinking Welfare in the United States Will Bring Political and Social Consequences

    Government benefits can increase civic participation, strengthen trust in society, and improve compliance with the rule of law. Taking them away can do the opposite.

      Katrina Kosec, Cecilia Hyunjung Mo

Get more news and analysis from
Carnegie Endowment for International Peace
Carnegie global logo, stacked
1779 Massachusetts Avenue NWWashington, DC, 20036-2103Phone: 202 483 7600
  • Research
  • Emissary
  • About
  • Experts
  • Donate
  • Programs
  • Events
  • Blogs
  • Podcasts
  • Contact
  • Annual Reports
  • Careers
  • Privacy
  • For Media
  • Government Resources
Get more news and analysis from
Carnegie Endowment for International Peace
© 2026 Carnegie Endowment for International Peace. All rights reserved.