Inside the world’s ‘what works’ teams


Jen Gold at What Works Blog: “There’s a small but growing band of government teams around the world dedicated to making experiments happen. The Cabinet Office’s What Works Team, set up in 2013, was the first of its kind. But you’ll now find them in Canada, the US, Finland, Australia, Colombia, and the UAE.

All of these teams work across government to champion the testing and evaluation of new approaches to public service delivery. This blog takes a look at the many ways in which we’re striving to make experimentation the norm in our governments.

Unsurprisingly we’re all operating in very different contexts. Some teams were set up in response to central requirements for greater experimentation. Take Canada, for instance. In 2016 the Treasury Board directed departments and agencies to devote a fixed proportion of programme funds to “experimenting with new approaches” (building on Prime Minister Trudeau’s earlier instruction to Ministers). An Innovation and Experimentation Team was then set up in the Treasury Board to provide some central support.

Finland’s Experimentation Office, based in the Prime Minister’s Office, is in a similar position. The team supports the delivery of Prime Minister Juha Sipilä’s 2016 national action plan that calls for “a culture of experimentation” in public services and a series of flagship policy experiments.

Others, like the US Office of Evaluation Sciences (OES) and the Behavioural Economics Team of the Australian Government (BETA), grew out of political interest in using behavioural science experiments in public policy. But these teams now run experiments in a much broader set of areas.

What unites us is a focus on helping public servants generate and use new evidence in policy decisions and service delivery….(More)”.

Index: Open Data


By Alexandra Shaw, Michelle Winowatan, Andrew Young, and Stefaan Verhulst

The Living Library Index – inspired by the Harper’s Index – provides important statistics and highlights global trends in governance innovation. This installment focuses on open data and was originally published in 2018.

Value and Impact

  • The projected year at which all 28+ EU member countries will have a fully operating open data portal: 2020

  • Between 2016 and 2020, the market size of open data in Europe is expected to increase by 36.9%, and reach this value by 2020: EUR 75.7 billion

Public Views on and Use of Open Government Data

  • Number of Americans who do not trust the federal government or social media sites to protect their data: Approximately 50%

  • Key findings from The Economist Intelligence Unit report on Open Government Data Demand:

    • Percentage of respondents who say the key reason why governments open up their data is to create greater trust between the government and citizens: 70%

    • Percentage of respondents who say OGD plays an important role in improving lives of citizens: 78%

    • Percentage of respondents who say OGD helps with daily decision making especially for transportation, education, environment: 53%

    • Percentage of respondents who cite lack of awareness about OGD and its potential use and benefits as the greatest barrier to usage: 50%

    • Percentage of respondents who say they lack access to usable and relevant data: 31%

    • Percentage of respondents who think they don’t have sufficient technical skills to use open government data: 25%

    • Percentage of respondents who feel the number of OGD apps available is insufficient, indicating an opportunity for app developers: 20%

    • Percentage of respondents who say OGD has the potential to generate economic value and new business opportunity: 61%

    • Percentage of respondents who say they don’t trust governments to keep data safe, protected, and anonymized: 19%

Efforts and Involvement

  • Time that’s passed since open government advocates convened to create a set of principles for open government data – the instance that started the open data government movement: 10 years

  • Countries participating in the Open Government Partnership today: 79 OGP participating countries and 20 subnational governments

  • Percentage of “open data readiness” in Europe according to European Data Portal: 72%

    • Open data readiness consists of four indicators which are presence of policy, national coordination, licensing norms, and use of data.

  • Number of U.S. cities with Open Data portals: 27

  • Number of governments who have adopted the International Open Data Charter: 62

  • Number of non-state organizations endorsing the International Open Data Charter: 57

  • Number of countries analyzed by the Open Data Index: 94

  • Number of Latin American countries that do not have open data portals as of 2017: 4 total – Belize, Guatemala, Honduras and Nicaragua

  • Number of cities participating in the Open Data Census: 39

Demand for Open Data

  • Open data demand measured by frequency of open government data use according to The Economist Intelligence Unit report:

    • Australia

      • Monthly: 15% of respondents

      • Quarterly: 22% of respondents

      • Annually: 10% of respondents

    • Finland

      • Monthly: 28% of respondents

      • Quarterly: 18% of respondents

      • Annually: 20% of respondents

    •  France

      • Monthly: 27% of respondents

      • Quarterly: 17% of respondents

      • Annually: 19% of respondents

        •  
    • India

      • Monthly: 29% of respondents

      • Quarterly: 20% of respondents

      • Annually: 10% of respondents

    • Singapore

      • Monthly: 28% of respondents

      • Quarterly: 15% of respondents

      • Annually: 17% of respondents 

    • UK

      • Monthly: 23% of respondents

      • Quarterly: 21% of respondents

      • Annually: 15% of respondents

    • US

      • Monthly: 16% of respondents

      • Quarterly: 15% of respondents

      • Annually: 20% of respondents

  • Number of FOIA requests received in the US for fiscal year 2017: 818,271

  • Number of FOIA request processed in the US for fiscal year 2017: 823,222

  • Distribution of FOIA requests in 2017 among top 5 agencies with highest number of request:

    • DHS: 45%

    • DOJ: 10%

    • NARA: 7%

    • DOD: 7%

    • HHS: 4%

Examining Datasets

  • Country with highest index score according to ODB Leaders Edition: Canada (76 out of 100)

  • Country with lowest index score according to ODB Leaders Edition: Sierra Leone (22 out of 100)

  • Number of datasets open in the top 30 governments according to ODB Leaders Edition: Fewer than 1 in 5

  • Average percentage of datasets that are open in the top 30 open data governments according to ODB Leaders Edition: 19%

  • Average percentage of datasets that are open in the top 30 open data governments according to ODB Leaders Edition by sector/subject:

    • Budget: 30%

    • Companies: 13%

    • Contracts: 27%

    • Crime: 17%

    • Education: 13%

    • Elections: 17%

    • Environment: 20%

    • Health: 17%

    • Land: 7%

    • Legislation: 13%

    • Maps: 20%

    • Spending: 13%

    • Statistics: 27%

    • Trade: 23%

    • Transport: 30%

  • Percentage of countries that release data on government spending according to ODB Leaders Edition: 13%

  • Percentage of government data that is updated at regular intervals according to ODB Leaders Edition: 74%

  • Number of datasets available through:

  • Number of datasets classed as “open” in 94 places worldwide analyzed by the Open Data Index: 11%

  • Percentage of open datasets in the Caribbean, according to Open Data Census: 7%

  • Number of companies whose data is available through OpenCorporates: 158,589,950

City Open Data

  • New York City

  • Singapore

    • Number of datasets published in Singapore: 1,480

    • Percentage of datasets with standardized format: 35%

    • Percentage of datasets made as raw as possible: 25%

  • Barcelona

    • Number of datasets published in Barcelona: 443

    • Open data demand in Barcelona measured by:

      • Number of unique sessions in the month of September 2018: 5,401

    • Quality of datasets published in Barcelona according to Tim Berners Lee 5-star Open Data: 3 stars

  • London

    • Number of datasets published in London: 762

    • Number of data requests since October 2014: 325

  • Bandung

    • Number of datasets published in Bandung: 1,417

  • Buenos Aires

    • Number of datasets published in Buenos Aires: 216

  • Dubai

    • Number of datasets published in Dubai: 267

  • Melbourne

    • Number of datasets published in Melbourne: 199

Sources

  • About OGP, Open Government Partnership. 2018.  

Implementing Public Policy: Is it possible to escape the ‘Public Policy Futility’ trap?


Blogpost by Matt Andrews:

Screen Shot 2018-12-06 at 6.29.15 PM

“Polls suggest that governments across the world face high levels of citizen dissatisfaction, and low levels of citizen trust. The 2017 Edelman Trust Barometer found, for instance, that only 43% of those surveyed trust Canada’s government. Only 15% of those surveyed trust government in South Africa, and levels are low in other countries too—including Brazil (at 24%), South Korea (28%), the United Kingdom (36%), Australia, Japan, and Malaysia (37%), Germany (38%), Russia (45%), and the United States (47%). Similar surveys find trust in government averaging only 40-45% across member countries of the Organization for Economic Cooperation and Development (OECD), and suggest that as few as 31% and 32% of Nigerians and Liberians trust government.

There are many reasons why trust in government is deficient in so many countries, and these reasons differ from place to place. One common factor across many contexts, however, is a lack of confidence that governments can or will address key policy challenges faced by citizens.

Studies show that this confidence deficiency stems from citizen observations or experiences with past public policy failures, which promote jaundiced views of their public officials’ capabilities to deliver. Put simply, citizens lose faith in government when they observe government failing to deliver on policy promises, or to ‘get things done’. Incidentally, studies show that public officials also often lose faith in their own capabilities (and those of their organizations) when they observe, experience or participate in repeated policy implementation failures. Put simply, again, these public officials lose confidence in themselves when they repeatedly fail to ‘get things done’.

I call the ‘public policy futility’ trap—where past public policy failure leads to a lack of confidence in the potential of future policy success, which feeds actual public policy failure, which generates more questions of confidence, in a vicious self fulfilling prophecy. I believe that many governments—and public policy practitioners working within governments—are caught in this trap, and just don’t believe that they can muster the kind of public policy responses needed by their citizens.

Along with my colleagues at the Building State Capability (BSC) program, I believe that many policy communities are caught in this trap, to some degree or another. Policymakers in these communities keep coming up with ideas, and political leaders keep making policy promises, but no one really believes the ideas will solve the problems that need solving or produce the outcomes and impacts that citizens need. Policy promises under such circumstances center on doing what policymakers are confident they can actually implement: like producing research and position papers and plans, or allocating inputs toward the problem (in a budget, for instance), or sponsoring visible activities (holding meetings or engaging high profile ‘experts’ for advice), or producing technical outputs (like new organizations, or laws). But they hold back from promising real solutions to real problems, as they know they cannot really implement them (given past political opposition, perhaps, or the experience of seemingly interactable coordination challenges, or cultural pushback, and more)….(More)”.

Abandoning Silos: How innovative governments are collaborating horizontally to solve complex problems


Report by Michael Crawford Urban: “The complex challenges that governments at all levels are facing today cut across long-standing and well-defined government boundaries and organizational structures. Solving these problems therefore requires a horizontal approach. This report looks at how such an approach can be successfully implemented.There are a number of key obstacles to effective horizontal collaboration in government, ranging from misaligned professional incentive structures to incompatible computer systems. But a number of governments – Estonia, the UK, and New Zealand – have all recently introduced innovative initiatives that are succeeding in creatively tackling these complex horizontal challenges. In each case, this is delivering critical benefits – reduced government costs and regulatory burdens, getting more out of existing personnel while recruiting more high quality professionals, or providing new and impactful data-driven insights that are helping improve the quality of human services.

How are they achieving this? We answer this question by using an analytical framework organized along three fundamental dimensions: governance(structuring accountability and responsibility), people (managing culture and personnel), and data (collecting, transmitting and using information). In each of our three cases, we show how specific steps taken along one of these dimensions can help overcome important obstacles that commonly arise and, in so doing, enable successful horizontal collaboration….(More)”.

We Need an FDA For Algorithms


Interview with Hannah Fry on the promise and danger of an AI world by Michael Segal:”…Why do we need an FDA for algorithms?

It used to be the case that you could just put any old colored liquid in a glass bottle and sell it as medicine and make an absolute fortune. And then not worry about whether or not it’s poisonous. We stopped that from happening because, well, for starters it’s kind of morally repugnant. But also, it harms people. We’re in that position right now with data and algorithms. You can harvest any data that you want, on anybody. You can infer any data that you like, and you can use it to manipulate them in any way that you choose. And you can roll out an algorithm that genuinely makes massive differences to people’s lives, both good and bad, without any checks and balances. To me that seems completely bonkers. So I think we need something like the FDA for algorithms. A regulatory body that can protect the intellectual property of algorithms, but at the same time ensure that the benefits to society outweigh the harms.

Why is the regulation of medicine an appropriate comparison?

If you swallow a bottle of colored liquid and then you keel over the next day, then you know for sure it was poisonous. But there are much more subtle things in pharmaceuticals that require expert analysis to be able to weigh up the benefits and the harms. To study the chemical profile of these drugs that are being sold and make sure that they actually are doing what they say they’re doing. With algorithms it’s the same thing. You can’t expect the average person in the street to study Bayesian inference or be totally well read in random forests, and have the kind of computing prowess to look up a code and analyze whether it’s doing something fairly. That’s not realistic. Simultaneously, you can’t have some code of conduct that every data science person signs up to, and agrees that they won’t tread over some lines. It has to be a government, really, that does this. It has to be government that analyzes this stuff on our behalf and makes sure that it is doing what it says it does, and in a way that doesn’t end up harming people.

How did you come to write a book about algorithms?

Back in 2011 in London, we had these really bad riots in London. I’d been working on a project with the Metropolitan Police, trying mathematically to look at how these riots had spread and to use algorithms to ask how could the police have done better. I went to go and give a talk in Berlin about this paper we’d published about our work, and they completely tore me apart. They were asking questions like, “Hang on a second, you’re creating this algorithm that has the potential to be used to suppress peaceful demonstrations in the future. How can you morally justify the work that you’re doing?” I’m kind of ashamed to say that it just hadn’t occurred to me at that point in time. Ever since, I have really thought a lot about the point that they made. And started to notice around me that other researchers in the area weren’t necessarily treating the data that they were working with, and the algorithms that they were creating, with the ethical concern they really warranted. We have this imbalance where the people who are making algorithms aren’t talking to the people who are using them. And the people who are using them aren’t talking to the people who are having decisions made about their lives by them. I wanted to write something that united those three groups….(More)”.

Harnessing Digital Tools to Revitalize European Democracy


Article by Elisa Lironi: “…Information and communication technology (ICT) can be used to implement more participatory mechanisms and foster democratic processes. Often referred to as e-democracy, there is a large range of very different possibilities for online engagement, including e-initiatives, e-consultations, crowdsourcing, participatory budgeting, and e-voting. Many European countries have started exploring ICT’s potential to reach more citizens at a lower cost and to tap into the so-called wisdom of the crowd, as governments attempt to earn citizens’ trust and revitalize European democracy by developing more responsive, transparent, and participatory decisionmaking processes.

For instance, when Anne Hidalgo was elected mayor of Paris in May 2014, one of her priorities was to make the city more collaborative by allowing Parisians to propose policy and develop projects together. In order to build a stronger relationship with the citizens, she immediately started to implement a citywide participatory budgeting project for the whole of Paris, including all types of policy issues. It started as a small pilot, with the city of Paris putting forward fifteen projects that could be funded with up to about 20 million euros and letting citizens vote on which projects to invest in, via ballot box or online. Parisians and local authorities deemed this experiment successful, so Hidalgo decided it was worth taking further, with more ideas and a bigger pot of money. Within two years, the level of participation grew significantly—from 40,000 voters in 2014 to 92,809 in 2016, representing 5 percent of the total urban population. Today, Paris Budget Participatif is an official platform that lets Parisians decide how to spend 5 percent of the investment budget from 2014 to 2020, amounting to around 500 million euros. In addition, the mayor also introduced two e-democracy platforms—Paris Petitions, for e-petitions, and Idée Paris, for e-consultations. Citizens in the French capital now have multiple channels to express their opinions and contribute to the development of their city.

In Latvia, civil society has played a significant role in changing how legislative procedures are organized. ManaBalss (My Voice) is a grassroots NGO that creates tools for better civic participation in decisionmaking processes. Its online platform, ManaBalss.lv, is a public e-participation website that lets Latvian citizens propose, submit, and sign legislative initiatives to improve policies at both the national and municipal level. …

In Finland, the government itself introduced an element of direct democracy into the Finnish political system, through the 2012 Citizens’ Initiative Act (CI-Act) that allows citizens to submit initiatives to the parliament. …

Other civic tech NGOs across Europe have been developing and experimenting with a variety of digital tools to reinvigorate democracy. These include initiatives like Science For You (SCiFY) in Greece, Netwerk Democratie in the Netherlands, and the Citizens Foundation in Iceland, which got its start when citizens were asked to crowdsource their constitution in 2010.

Outside of civil society, several private tech companies are developing digital platforms for democratic participation, mainly at the local government level. One example is the Belgian start-up CitizenLab, an online participation platform that has been used by more than seventy-five municipalities around the world. The young founders of CitizenLab have used technology to innovate the democratic process by listening to what politicians need and including a variety of functions, such as crowdsourcing mechanisms, consultation processes, and participatory budgeting. Numerous other European civic tech companies have been working on similar concepts—Cap Collectif in France, Delib in the UK, and Discuto in Austria, to name just a few. Many of these digital tools have proven useful to elected local or national representatives….

While these initiatives are making a real impact on the quality of European democracy, most of the EU’s formal policy focus is on constraining the power of the tech giants rather than positively aiding digital participation….(More)”

Motivating Participation in Crowdsourced Policymaking: The Interplay of Epistemic and Interactive Aspects


Paper by Tanja Aitamurto and Jorge Saldivar in Proceedings of ACM Human-Computer Interaction (CSCW ’18):  “…we examine the changes in motivation factors in crowdsourced policymaking. By drawing on longitudinal data from a crowdsourced law reform, we show that people participated because they wanted to improve the law, learn, and solve problems. When crowdsourcing reached a saturation point, the motivation factors weakened and the crowd disengaged. Learning was the only factor that did not weaken. The participants learned while interacting with others, and the more actively the participants commented, the more likely they stayed engaged. Crowdsourced policymaking should thus be designed to support both epistemic and interactive aspects. While the crowd’s motives were rooted in self-interest, their knowledge perspective showed common-good orientation, implying that rather than being dichotomous, motivation factors move on a continuum. The design of crowdsourced policymaking should support the dynamic nature of the process and the motivation factors driving it….(More)”.

Artificial Intelligence: Public-Private Partnerships join forces to boost AI progress in Europe


European Commission Press Release: “…the Big Data Value Association and euRobotics agreed to cooperate more in order to boost the advancement of artificial intelligence’s (AI) in Europe. Both associations want to strengthen their collaboration on AI in the future. Specifically by:

  • Working together to boost European AI, building on existing industrial and research communities and on results of the Big Data Value PPP and SPARC PPP. This to contribute to the European Commission’s ambitious approach to AI, backed up with a drastic increase investment, reaching €20 billion total public and private funding in Europe until 2020.
  • Enabling joint-pilots, for example, to accelerate the use and integration of big data, robotics and AI technologies in different sectors and society as a whole
  • Exchanging best practices and approaches from existing and future projects of the Big Data PPP and the SPARC PPP
  • Contributing to the European Digital Single Market, developing strategic roadmaps and  position papers

This Memorandum of Understanding between the PPPs follows the European Commission’s approach to AI presented in April 2018 and the Declaration of Cooperation on Artificial Intelligence signed by all 28 Member States and Norway. This Friday 7 December the Commission will present its EU coordinated plan….(More)”.

New study on eGovernment shows how Europe’s digital public services can do better


European Commission: “Today the European Commission published a new study, the eGovernment benchmark report 2018, which demonstrates that the availability and quality of online public services have improved in the EU. Overall there has been significant progress in respect to the efficient use of public information and services online, transparency of government authorities’ operations and users’ control of personal data, cross-border mobility and key enablers, such as the availability of electronic identity cards and other documents.

EU average scores on different eGov criteria such as user centricity, transparency and cross-border mobility

10 EU countries (Malta, Austria, Sweden, Finland, the Netherlands, Estonia, Lithuania, Latvia, Portugal, Denmark) and Norway are delivering high-quality digital services with a score above 75% on important events of daily life such as moving, finding a job, starting a business or studying. Estonia, Latvia and Lithuania are outperforming the rest of the countries in terms of digitisation of the public administrations and adoption of online public services....

Further efforts are notably needed in cross-border mobility and digital identification. So far only 6 EU countries have notified their eID means which enables their cross-border recognition….(More) (Report)”

Force Google, Apple and Uber to share mapping data, UK advised


Aliya Ram and Madhumita Murgia at the Financial Times: “The UK government should force Google, Apple, Uber and others to share their mapping data so that other companies can develop autonomous cars, drones and transport apps, according to an influential campaign group. The Open Data Institute, co-founded by Tim Berners-Lee at MIT and Nigel Shadbolt, artificial intelligence professor at the University of Oxford, warned on Tuesday that big tech companies had become “data monopolies”.

The group said the UK’s Geospatial Commission should ask the companies to share map data with rivals and the public sector in a collaborative database or else force them to do so with legislation.

“Google along with all of the other companies like Apple and Uber are trying to deliver an excellent service to their clients and customers,” said Jeni Tennison, chief executive of the Open Data Institute. “The status quo is not optimal because all of the organisations we are talking about are replicating effort. This means that people are overall not getting the best service from the data that is being collected and maintained. “The large companies are becoming more like data monopolies and that doesn’t give us the best value from our data.”

On Tuesday, the UK government said its Office for Artificial Intelligence had teamed up with the ODI to pilot two new “data trusts” — legal structures that allow multiple groups to share anonymised information. Data trusts have been described as a good way for small business to compete with large rivals that have lots of data, but only a handful have been set up so far.

The trusts will be designed over the next few months and could be used to share data, for example, about cities, the environment, biodiversity and transport. Ms Tennison said the ODI was also working on a data trust with the mayor of London, Sadiq Khan, and local authorities in Greenwich to see how real time data from the internet of things and sensors could be shared with start-ups to solve problems in the city. London’s transport authority has said ride hailing apps would be forced to turn over travel data to the government. Uber now provides public access to its data on traffic and travel conditions in the UK….(More) (Full Report)”.