Paper by Mossavar-Rahmani Center For Business and Government: “Governments across the world are exploring how generative AI might improve their ability to effectively pass legislation and deliver public services. This includes the UK government, which has stated that utilising AI to reduce costs and improve public services is a national priority. Current efforts to deploy AI tools are focused on streamlining internal bureaucracy, such as writing ministerial briefings or analysing public consultations, and supporting the direct delivery of public services. In contrast, there has been limited exploration of the role generative AI could play in directly improving policy development and implementation, in support of a government’s high-level agenda or manifesto commitments.
This project seeks to add practical context to hypothetical considerations of how generative AI might impact policymaking. Published articles and commentary provide insights and recommendations, with varying degrees of specificity, on the opportunities, risks, and limitations of using AI to support national policymaking. However, there does not appear to be any instances of meaningful ‘direct experimentation’ with currently available generative AI tools, to explore the potential role of generative AI in more detail, identifying context-specific areas of strength, weakness, or risk.
This project is designed as an initial first step towards addressing this research gap. Using our direct experience of government policymaking, we begin to assess the performance and relative ‘value-add’ of using publicly available generative AI tools to support typical policymaking functions. This is conducted through ‘policy simulations’ in which we assessed how useful (or problematic) AI tools were in helping us to perform a range of policymaking tasks.
Our simulated ‘performance assessments’ were conducted in two phases. Firstly, we undertook basic assessments of the utility of publicly available generative AI across typical policymaking tasks for three different high-level policy contexts. Secondly, we conducted a more granular and in-depth assessment in an area where we have domain expertise (Regional Growth and Development), to explore the impact of output verification (by experts) and corpus design on the utility of generative AI in a national policymaking context.
From this research, we have identified an indicative set of policymaking functions for which generative AI appears to offer significant value (provided this deployment is specific, deliberate, and targeted). We also found that the use of generative AI does not replace the need for in-depth policy expertise but rather increases the utilisation of this expertise by a wider range of government stakeholders, and significant risks may be introduced in the absence of meaningful human engagement with AI outputs. Significant limitations of using generative AI to support policymaking also emerged from this preliminary research, alongside the well-documented broader risks associated with generative AI (such as unclear provenance, biased outputs, hallucinations, and broader security risks). The full set of our indicative findings are below, which we use to inform a proposed set of basic recommendations for governments seeking to better utilise generative AI to support national policymaking…(More)”.
