WikiCrow: Automating Synthesis of Human Scientific Knowledge

Curated on Posted on by Stefaan Verhulst

About: “As scientists, we stand on the shoulders of giants. Scientific progress requires curation and synthesis of prior knowledge and experimental results. However, the scientific literature is so expansive that synthesis, the comprehensive combination of ideas and results, is a bottleneck. The ability of large language models to comprehend and summarize natural language will  transform science by automating the synthesis of scientific knowledge at scale. Yet current LLMs are limited by hallucinations, lack access to the most up-to-date information, and do not provide reliable references for statements.

Here, we present WikiCrow, an automated system that can synthesize cited Wikipedia-style summaries for technical topics from the scientific literature. WikiCrow is built on top of Future House’s internal LLM agent platform, PaperQA, which in our testing, achieves state-of-the-art (SOTA) performance on a retrieval-focused version of PubMedQA and other benchmarks, including a new retrieval-first benchmark, LitQA, developed internally to evaluate systems retrieving full-text PDFs across the entire scientific literature.

As a demonstration of the potential for AI to impact scientific practice, we use WikiCrow to generate draft articles for the 15,616 human protein-coding genes that currently lack Wikipedia articles, or that have article stubs. WikiCrow creates articles in 8 minutes, is much more consistent than human editors at citing its sources, and makes incorrect inferences or statements about 9% of the time, a number that we expect to improve as we mature our systems. WikiCrow will be a foundational tool for the AI Scientists we plan to build in the coming years, and will help us to democratize access to scientific research…(More)”.

A Manifesto on Enforcing Law in the Age of ‘Artificial Intelligence’

Curated on Posted on by Stefaan Verhulst

Manifesto by the Transatlantic Reflection Group on Democracy and the Rule of Law in the Age of ‘Artificial Intelligence’: “… calls for the effective and legitimate enforcement of laws concerning AI systems. In doing so, we recognise the important and complementary role of standards and compliance practices. Whereas the first manifesto focused on the relationship between democratic law-making and technology, this second manifesto shifts focus from the design of law in the age of AI to the enforcement of law. Concretely, we offer 10 recommendations for addressing the key enforcement challenges shared across transatlantic stakeholders. We call on those who support these recommendations to sign this manifesto…(More)”.

Using AI to support people with disability in the labour market

Curated on Posted on by Stefaan Verhulst

OECD Report: “People with disability face persisting difficulties in the labour market. There are concerns that AI, if managed poorly, could further exacerbate these challenges. Yet, AI also has the potential to create more inclusive and accommodating environments and might help remove some of the barriers faced by people with disability in the labour market. Building on interviews with more than 70 stakeholders, this report explores the potential of AI to foster employment for people with disability, accounting for both the transformative possibilities of AI-powered solutions and the risks attached to the increased use of AI for people with disability. It also identifies obstacles hindering the use of AI and discusses what governments could do to avoid the risks and seize the opportunities of using AI to support people with disability in the labour market…(More)”.

Making democratic innovations stick

Curated on Posted on by Stefaan Verhulst

Report by NESTA: “A survey of 52 people working on participation in local government in the UK and the Nordic countries found that:

  • a lack of funding and bureaucracy are the biggest barriers to using and scaling democratic innovations
  • enabling citizens to influence decision making, building trust and being more inclusive are the most important reasons for using democratic innovations
  • tackling climate change and reducing poverty and inequality are seen as the most important challenges to involve the public in.

When we focused on attitudes towards participation in the UK more broadly, and on attitudes to participation in climate change more specifically we found that:

  • the public think it is important that they are being involved in how we make decisions on climate change. 71% of the public think it is important they are given a say in how to reduce the UK’s carbon emissions and transition to net zero
  • the public doesn’t think the government is doing a good job of involving them – only 12% thought that the government is doing a good job of involving them in making decisions on how we tackle climate change
  • not having the ability to influence decision makers and not having the right skills to participate are seen as the biggest barriers by the public….(More)”.

Policy primer on non-personal data 

Curated on Posted on by Stefaan Verhulst

Primer by the International Chamber of Commerce: “Non-personal data plays a critical role in providing solutions to global challenges. Unlocking its full potential requires policymakers, businesses, and all other stakeholders to collaborate to construct policy environments that can capitalise on its benefits.  

This report gives insights into the different ways that non-personal data has a positive impact on society, with benefits including, but not limited to: 

  1. Tracking disease outbreaks; 
  2. Facilitating international scientific cooperation; 
  3. Understanding climate-related trends; 
  4.  Improving agricultural practices for increased efficiency; 
  5. Optimising energy consumption; 
  6. Developing evidence-based policy; 
  7. Enhancing cross-border cybersecurity cooperation. 

In addition, businesses of all sizes benefit from the transfer of data across borders, allowing companies to establish and maintain international supply chains and smaller businesses to enter new markets or reduce operating costs. 

Despite these benefits, international flows of non-personal data are frequently limited by restrictions and data localisation measures. A growing patchwork of regulations can also create barriers to realising the potential of non-personal data. This report explores the impact of data flow restrictions including: 

  • Hindering global supply chains; 
  • Limiting the use of AI reliant on large datasets; 
  • Disincentivising data sharing amongst companies; 
  • Preventing companies from analysing the data they hold…(More)”.

GovTech in Fragile and Conflict Situations Trends, Challenges, and Opportunities

Curated on Posted on by Stefaan Verhulst

Report by the World Bank: “This report takes stock of the development of GovTech solutions in Fragile and Conflict-Affected Situations (FCS), be they characterized by low institutional capacity and/or by active conflict and provides insights on challenges and opportunities for implementing GovTech reforms in such contexts. It is aimed at practitioners and policy makers working in FCS but will also be useful for practitioners working in Fragility, Conflict, and Violence (FCV) contexts, at-risk countries, or low-income countries as some similar challenges and opportunities can be present…(More)”.

Creating a Citizen Participation Service and other ideas

Curated on Posted on by Stefaan Verhulst

Paper by Kathy Peach: “…This paper explains how public participation can improve national policy, long-term decision making and increase democratic legitimacy and trust.

Taking a practical approach it examines how the wide range of tools available for harnessing citizen’s collective intelligence and explores how, and in what circumstances, they can best be used.

Examining how public participation can be embedded in climate policy at a national level, it suggests three models for restructuring central government – a Public Participation Secretariat, new public bodies and at most ambitious, a Citizen Participation Service.

Finally, it outlines the contours of a flagship participation programme for climate policy covering digital infrastructure, citizen science, participatory budgeting and other proposals…(More)”.

The Time is Now: Establishing a Mutual Commitment Framework (MCF) to Accelerate Data Collaboratives

Curated on Posted on by Stefaan Verhulst

Article by Stefaan Verhulst, Andrew Schroeder and William Hoffman: “The key to unlocking the value of data lies in responsibly lowering the barriers and shared risks of data access, re-use, and collaboration in the public interest. Data collaboratives, which foster responsible access and re-use of data among diverse stakeholders, provide a solution to these challenges.

Today, however, setting up data collaboratives takes too much time and is prone to multiple delays, hindering our ability to understand and respond swiftly and effectively to urgent global crises. The readiness of data collaboratives during crises faces key obstacles in terms of data use agreements, technical infrastructure, vetted and reproducible methodologies, and a clear understanding of the questions which may be answered more effectively with additional data.

Organizations aiming to create data collaboratives often face additional challenges, as they often lack established operational protocols and practices which can streamline implementation, reduce costs, and save time. New regulations are emerging that should help drive the adoption of standard protocols and processes. In particular, the EU Data Governance Act and the forthcoming Data Act aim to enable responsible data collaboration. Concepts like data spaces and rulebooks seek to build trust and strike a balance between regulation and technological innovation.

This working paper advances the case for creating a Mutual Commitment Framework (MCF) in advance of a crisis that can serve as a necessary and practical means to break through chronic choke points and shorten response times. By accelerating the establishment of operational (and legally cognizable) data collaboratives, duties of care can be defined and a stronger sense of trust, clarity, and purpose can be instilled among participating entities. This structured approach ensures that data sharing and processing are conducted within well-defined, pre-authorized boundaries, thereby lowering shared risks and promoting a conducive environment for collaboration…(More)”.

Open Government for Stronger Democracies

Curated on Posted on by Stefaan Verhulst

A Global Assessment by the OECD: “Open government is a powerful catalyst for driving democracy, public trust, and inclusive growth. In recognition of this, the OECD Council adopted the Recommendation on Open Government in 2017. To date, it remains the first – and only – internationally recognised legal instrument on open government and has guided many countries in designing and implementing their open government agendas. This report takes stock of countries’ implementation of the Recommendation, its dissemination, and its ongoing significance. It is based on an OECD survey carried out in 2020/2021 among all countries that adhered to the Recommendation and other partner countries, as well as on further data collected through a perception survey with delegates to the OECD Working Party on Open Government…(More)”.

Innovation in Anticipation for Migration: A Deep Dive into Methods, Tools, and Data Sources

Curated on Posted on by Stefaan Verhulst

Blog by Sara Marcucci and Stefaan Verhulst: “In the ever-evolving landscape of anticipatory methods for migration policy, innovation is a dynamic force propelling the field forward. This seems to be happening in two main ways: first, as we mentioned in our previous blog, one of the significant shifts lies in the blurring of boundaries between quantitative forecasting and qualitative foresight, as emerging mixed-method approaches challenge traditional paradigms. This transformation opens up new pathways for understanding complex phenomena, particularly in the context of human migration flows. 

Innovation in Anticipation for Migration: A Deep Dive into Methods, Tools, and Data Sources

Second, the innovation happening today is not necessarily rooted in the development of entirely new methodologies, but rather in how existing methods are adapted and enhanced. Indeed, innovation seems to extend to the utilization of diverse tools and data sources that bolster the effectiveness of existing methods, offering a more comprehensive and timely perspective on migration trends.

In the context of this blog series, methods refer to the various approaches and techniques used to anticipate and analyze migration trends, challenges, and opportunities. These methods are employed to make informed decisions and develop policies related to human migration. They can include a wide range of strategies to gather and interpret data and insights in the field of migration policy. 

Tools, on the other hand, refer to the specific instruments or technologies used to support and enhance the effectiveness of these methods. They encompass a diverse set of resources and technologies that facilitate data collection, analysis, and decision-making in the context of migration policy. These tools can include both quantitative and qualitative data collection and analysis tools, as well as innovative data sources, software, and techniques that help enhance anticipatory methods.

This blog aims to deep dive into the main anticipatory methods adopted in the field of migration, as well as some of the tools and data sources employed to enhance and experiment with them. First, the blog will provide a list of methods considered; second, it will illustrate the main innovative tools employed, and finally it will provide a set of new, non-traditional data sources that are increasingly being used to feed anticipatory methods…(More)”.