The Open Data Barometer (3rd edition)


The Open Data Barometer: “Once the preserve of academics and statisticians, data has become a development cause embraced by everyone from grassroots activists to the UN Secretary-General. There’s now a clear understanding that we need robust data to drive democracy and development — and a lot of it.

Last year, the world agreed the Sustainable Development Goals (SDGs) — seventeen global commitments that set an ambitious agenda to end poverty, fight inequality and tackle climate change by 2030. Recognising that good data is essential to the success of the SDGs, the Global Partnership for Sustainable Development Data and the International Open Data Charter were launched as the SDGs were unveiled. These alliances mean the “data revolution” now has over 100 champions willing to fight for it. Meanwhile, Africa adopted the African Data Consensus — a roadmap to improving data standards and availability in a region that has notoriously struggled to capture even basic information such as birth registration.

But while much has been made of the need for bigger and better data to power the SDGs, this year’s Barometer follows the lead set by the International Open Data Charter by focusing on how much of this data will be openly available to the public.

Open data is essential to building accountable and effective institutions, and to ensuring public access to information — both goals of SDG 16. It is also essential for meaningful monitoring of progress on all 169 SDG targets. Yet the promise and possibilities offered by opening up data to journalists, human rights defenders, parliamentarians, and citizens at large go far beyond even these….

At a glance, here are this year’s key findings on the state of open data around the world:

    • Open data is entering the mainstream.The majority of the countries in the survey (55%) now have an open data initiative in place and a national data catalogue providing access to datasets available for re-use. Moreover, new open data initiatives are getting underway or are promised for the near future in a number of countries, including Ecuador, Jamaica, St. Lucia, Nepal, Thailand, Botswana, Ethiopia, Nigeria, Rwanda and Uganda. Demand is high: civil society and the tech community are using government data in 93% of countries surveyed, even in countries where that data is not yet fully open.
    • Despite this, there’s been little to no progress on the number of truly open datasets around the world.Even with the rapid spread of open government data plans and policies, too much critical data remains locked in government filing cabinets. For example, only two countries publish acceptable detailed open public spending data. Of all 1,380 government datasets surveyed, almost 90% are still closed — roughly the same as in the last edition of the Open Data Barometer (when only 130 out of 1,290 datasets, or 10%, were open). What is more, much of the approximately 10% of data that meets the open definition is of poor quality, making it difficult for potential data users to access, process and work with it effectively.
    • “Open-washing” is jeopardising progress. Many governments have advertised their open data policies as a way to burnish their democratic and transparent credentials. But open data, while extremely important, is just one component of a responsive and accountable government. Open data initiatives cannot be effective if not supported by a culture of openness where citizens are encouraged to ask questions and engage, and supported by a legal framework. Disturbingly, in this edition we saw a backslide on freedom of information, transparency, accountability, and privacy indicators in some countries. Until all these factors are in place, open data cannot be a true SDG accelerator.
    • Implementation and resourcing are the weakest links.Progress on the Barometer’s implementation and impact indicators has stalled or even gone into reverse in some cases. Open data can result in net savings for the public purse, but getting individual ministries to allocate the budget and staff needed to publish their data is often an uphill battle, and investment in building user capacity (both inside and outside of government) is scarce. Open data is not yet entrenched in law or policy, and the legal frameworks supporting most open data initiatives are weak. This is a symptom of the tendency of governments to view open data as a fad or experiment with little to no long-term strategy behind its implementation. This results in haphazard implementation, weak demand and limited impact.
    • The gap between data haves and have-nots needs urgent attention.Twenty-six of the top 30 countries in the ranking are high-income countries. Half of open datasets in our study are found in just the top 10 OECD countries, while almost none are in African countries. As the UN pointed out last year, such gaps could create “a whole new inequality frontier” if allowed to persist. Open data champions in several developing countries have launched fledgling initiatives, but too often those good open data intentions are not adequately resourced, resulting in weak momentum and limited success.
    • Governments at the top of the Barometer are being challenged by a new generation of open data adopters. Traditional open data stalwarts such as the USA and UK have seen their rate of progress on open data slow, signalling that new political will and momentum may be needed as more difficult elements of open data are tackled. Fortunately, a new generation of open data adopters, including France, Canada, Mexico, Uruguay, South Korea and the Philippines, are starting to challenge the ranking leaders and are adopting a leadership attitude in their respective regions. The International Open Data Charter could be an important vehicle to sustain and increase momentum in challenger countries, while also stimulating renewed energy in traditional open data leaders….(More)”

Open Data and Beyond


Paper by Frederika Welle Donker, Bastiaan van Loenen and Arnold K. Bregt: “In recent years, there has been an increasing trend of releasing public sector information as open data. Governments worldwide see the potential benefits of opening up their data. The potential benefits are more transparency, increased governmental efficiency and effectiveness, and external benefits, including societal and economic benefits. The private sector also recognizes potential benefits of making their datasets available as open data. One such company is Liander, an energy network administrator in the Netherlands. Liander views open data as a contributing factor to energy conservation. However, to date there has been little research done into the actual effects of open data. This research has developed a monitoring framework to assess the effects of open data, and has applied the framework to Liander’s small-scale energy consumption dataset….(More)

Evaluating e-Participation: Frameworks, Practice, Evidence


Book edited by Georg Aichholzer, Herbert Kubicek and Lourdes Torres: “There is a widely acknowledged evaluation gap in the field of e-participation practice and research, a lack of systematic evaluation with regard to process organization, outcome and impacts. This book addresses the state of the art of e-participation research and the existing evaluation gap by reviewing various evaluation approaches and providing a multidisciplinary concept for evaluating the output, outcome and impact of citizen participation via the Internet as well as via traditional media. It offers new knowledge based on empirical results of its application (tailored to different forms and levels of e-participation) in an international comparative perspective. The book will advance the academic study and practical application of e-participation through fresh insights, largely drawing on theoretical arguments and empirical research results gained in the European collaborative project “e2democracy”. It applies the same research instruments to a set of similar citizen participation processes in seven local communities in three countries (Austria, Germany and Spain). The generic evaluation framework has been tailored to a tested toolset, and the presentation and discussion of related evaluation results aims at clarifying to what extent these tools can be applied to other consultation and collaboration processes, making the book of interest to policymakers and scholars alike….(More)”

The 4 Types of Cities and How to Prepare Them for the Future


John D. Macomber at Harvard Business Review: “The prospect of urban innovation excites the imagination. But dreaming up what a “smart city” will look like in some gleaming future is, by its nature, a utopian exercise. The messy truth is that cities are not the same, and even the most innovative approach can never achieve universal impact. What’s appealing for intellectuals in Copenhagen or Amsterdam is unlikely to help millions of workers in Jakarta or Lagos. To really make a difference, private entrepreneurs and civic entrepreneurs need to match projects to specific circumstances. An effective starting point is to break cities into four segments across two distinctions: legacy vs. new cities, and developed vs. emerging economies. The opportunities to innovate will differ greatly by segment.

Segment 1: Developed Economy, Legacy City
Examples: London, Detroit, Tokyo, Singapore

Characteristics: Any intervention in a legacy city has to dismantle something that existed before — a road or building, or even a regulatory authority or an entrenched service business. Slow demographic growth in developed economies creates a zero-sum situation (which is part of why the licensed cabs vs Uber/Lyft contest is so heated). Elites live in these cities, so solutions arise that primarily help users spend their excess cash. Yelp, Zillow, and Trip Advisor are examples of innovations in this context.
Implications for city leaders: Leaders should try to establish a setting where entrepreneurs can create solutions that improve quality of life — without added government expense. …

Implications for entrepreneurs: Denizens of developed legacy cities have discretionary income. …

Segment 2: Emerging Economy, Legacy City
Examples: Mumbai, São Paolo, Jakarta

Characteristics: Most physical and institutional structures are already in place in these megacities, but with fast-growing populations and severe congestion, there is an opportunity to create value by improving efficiency and livability, and there is a market of customers with cash to pay for these benefits.

Implications for city leaders: Leaders should loosen restrictions so that private finance can invest in improvements to physical infrastructure, to better use what already exists. …

Implications for entrepreneurs: Focus on public-private partnerships (PPP). …

Segment 3: Emerging Economy, New City
Examples: Phu My Hung, Vietnam; Suzhou, China; Astana, Kazakhstan; Singapore (historically)

Characteristics: These cities tend to have high population growth and high growth rates in GDP per capita, demographic and economic tailwinds that help to boost returns. The urban areas have few existing physical or social structures to dismantle as they grow, hence fewer entrenched obstacles to new offerings. There is also immediate ROI for investments in basic services as population moves in, because they capture new revenues from new users. Finally, in these cities there is an important chance to build it right the first time, notably with respect to the roads, bridges, water, and power that will determine both economic competitiveness and quality of life for decades. The downside? If this chance is missed, new urban agglomerations will be characterized by informal sprawl and new settlements will be hard to reach after the fact with power, roads, and sanitation.
Implications for city leaders: Leaders should first focus on building hard infrastructure that will support services such as schools, hospitals, and parks. …

Implications for entrepreneurs: In these cities, it’s too soon to think about optimizing existing infrastructure or establishing amusing ways for wealthy people to spend their disposable income. …

Segment 4: Developed Economy, New City
Examples and characteristics: Such cities are very rare. All the moment, almost all self-proclaimed “new cities” in the developed world are in fact large, integrated real-estate developments with an urban theme, usually in close proximity to a true municipality. Examples of these initiatives include New Songdo City in South Korea, Masdar City in Abu Dhabi, and Hafen City Hamburg in Germany.

Implications for city leaders: These satellites of existing metropolises compete for jobs and to attract talented participants in the creative economy. ….

Implications for entrepreneurs: Align with city leaders on services that are important to knowledge workers, and help build the cities’ brand. ….

Cities are different. So are solutions….(More)

Drones better than human rescuers at following mountain pathways


Springwise: “Every year in Switzerland, emergency centers respond to around 1,000 call outs for lost and injured hikers. It can often take hours and significant manpower to locate lost mountaineers, but new software for quadcopter drones is making the hunt quicker and easier, and has the potential to help find human survivors in disaster zones around the world.

The drone uses a computer algorithm called a Deep Neural Network. The program was developed by researchers at the University of Zurich and the Dalle Molle Institute for Artificial Intelligence. The drone uses the algorithm to learn trails and paths through a pair of small cameras, interpreting the images and recognizing man-made pathways. Even when working on a previously unseen trail, it was able to guess the correct direction in 85 percent of the cases. The drones’ speed and accuracy make them more effective than human trackers.

Drohnen-Scaramuzza-2
The researchers hope that eventually multiple small drones could be combined with human search and rescue missions, to cover more terrain and find people faster. The drones can cover terrain quickly and check hazardous areas to minimize risk to human workers, and its AI can identify paths and avoid crashing without any human involvement….(More)”

Hoaxmap: Debunking false rumours about refugee ‘crimes’


Teo Kermeliotis at AlJazeera: “Back in the summer of 2015, at the height of the ongoing refugee crisis, Karolin Schwarz started noticing a disturbing pattern.

Just as refugee arrivals in her town of Leipzig, eastern Germany, began to rise, so did the frequency of rumours over supposed crimes committed by those men, women and children who had fled war and hardship to reach Europe.

As months passed by, the allegations became even more common, increasingly popping up in social media feeds and often reproduced by mainstream news outlets.

The online map featured some 240 incidents in its first week [Source: Hoaxmap/Al Jazeera]

 

“The stories seemed to be [orchestrated] by far-right parties and organisations and I wanted to try to find some way to help organise this – maybe find patterns and give people a tool to look up these stories [when] they were being confronted with new ones.”

And so she did.

Along with 35-year-old developer Lutz Helm, Schwarz launched last week Hoaxmap, an online platform that allows people to separate fact from fiction by debunking false rumours about supposed crimes committed by refugees.

Using an interactive system of popping dots, the map documents and categorises where those “crimes” allegedly took place. It then counters that false information with official statements from the police and local authorities, as well as news reports in which the allegations have been disproved. The debunked cases marked on the map range from thefts and assaults to manslaughter – but one of the most common topics is rape, Schwarz said….(More)”

The Populist Signal


Book by Claudia Chwalisz: “The book is about the turbulent political scene unfolding in Britain and across western Europe. It focuses on why large swathes of voters feel that politics does not work, how this fuels support for insurgent parties and actors, and it investigates the power of democratic innovations….

Examples include:

– The Melbourne People’s panel, where 43 randomly selected citizens presented the City council with a 10 year, $4bn plan for Melbourne

– The Flemish minister of culture’s citizens’ cabinet, which advised him on his upcoming legislation before he presented it to parliament

– The G1000 local citizens’ assemblies in the Netherlands, which bring randomly selected members of the community together to deliberate on collective solutions to the challenges being faced

– The Grandview-Woodlands citizens’ assembly on town planning in Vancouver, Canada…(More)

Improving government effectiveness: lessons from Germany


Tom Gash at Global Government Forum: “All countries face their own unique challenges but advanced democracies also have much in common: the global economic downturn, aging populations, increasingly expensive health and pension spending, and citizens who remain as hard to please as ever.

At an event last week in Bavaria, attended by representatives of Bavaria’s governing party, the Christian Social Union (CSU) and their guests, it also became clear that there is a growing consensus that governments face another common problem. They have relied for too long on traditional legislation and regulation to drive change. The consensus was that simply prescribing in law what citizens and companies can and can’t do will not solve the complex problems governments are facing, that governments cannot legislate their way to improved citizen health, wealth and wellbeing….

…a number of developments …from which both UK and international policymakers and practitioners can learn to improve government effectiveness.

  1. Behavioural economics: The Behavioural Insights Team (BIT), which span out of government in 2013 and is the subject of a new book by one of its founders and former IfG Director of Research, David Halpern, is being watched carefully by many countries abroad. Some are using its services, while others – including the New South Wales Government in Australia –are building their own skills in this area. BIT and others using similar principles have shown that using insights from social psychology – alongside an experimental approach – can help save money and improve outcomes. Well known successes include increasing the tax take through changing wording of reminder letters (work led by another IfG alumni Mike Hallsworth) and increasing pension take-up through auto-enrolment.
  2. Market design: There is an emerging field of study which is examining how algorithms can be used to match people better with services they need – particularly in cases where it is unfair or morally repugnant to let allow a free market to operate. Alvin Roth, the Harvard Professor and Nobel prize winner, writes about these ‘matching markets’ in his book Who Gets What and Why – in which he also explains how the approach can ensure that more kidneys reach compatible donors, and children find the right education.
  3. Big data: Large datasets can now be mined far more effectively, whether it is to analyse crime patterns to spot where police patrols might be useful or to understand crowd flows on public transport. The use of real-time information allows far more sophisticated deployment of public sector resources, better targeted at demand and need, and better tailored to individual preferences.
  4. Transparency: Transparency has the potential to enhance both the accountability and effectiveness of governments across the world – as shown in our latest Whitehall Monitor Annual Report. The UK government is considered a world-leader for its transparency – but there are still areas where progress has stalled, including in transparency over the costs and performance of privately provided public services.
  5. New management models: There is a growing realisation that new methods are best harnessed when supported by effective management. The Institute’s work on civil service reform highlights a range of success factors from past reforms in the UK – and the benefits of clear mechanisms for setting priorities and sticking to them, as is being attempted by governments new(ish) Implementation Taskforces and the Departmental Implementation Units currently cropping up across Whitehall. I looked overseas for a different model that clearly aligns government activities behind citizens’ concerns – in this case the example of the single non-emergency number system operating in New York City and elsewhere. This system supports a powerful, highly responsive, data-driven performance management regime. But like many performance management regimes it can risk a narrow and excessively short-term focus – so such tools must be combined with the mind-set of system stewardship that the Institute has long championed in its policymaking work.
  6. Investment in new capability: It is striking that all of these developments are supported by technological change and research insights developed outside government. But to embed new approaches in government, there appear to be benefits to incubating new capacity, either in specialist departmental teams or at the centre of government….(More)”

Developing Global Norms for Sharing Data and Results during Public Health Emergencies


Paper by Kayvon Modjarrad et al in PLOS Med: “…When a new or re-emergent pathogen causes a major outbreak, rapid access to both raw and analysed data or other pertinent research findings becomes critical to developing a rapid and effective public health response. Without the timely exchange of information on clinical, epidemiologic, and molecular features of an infectious disease, informed decisions about appropriate responses cannot be made, particularly those that relate to fielding new interventions or adapting existing ones. Failure to share information in a timely manner can have disastrous public health consequences, leading to unnecessary suffering and death. The 2014–2015 Ebola epidemic in West Africa revealed both successful practices and important deficiencies within existing mechanisms for information sharing. For example, trials of two Ebola vaccine candidates (ChAd3-ZEBOV and rVSV-ZEBOV) benefited greatly from an open collaboration between investigators and institutions in Africa, Europe, and North America . These teams, coordinated by the WHO, were able to generate and exchange critical data for the development of urgently needed, novel vaccines along faster timelines than have ever before been achieved. Similarly, some members of the genome sequencing community made viral sequence data publicly available within days of accessing samples , thus adhering to their profession’s long-established principles of rapid, public release of sequence data in any setting. In contrast, the dissemination of surveillance data early in the epidemic was comparatively slow, and in some cases, the criteria for sharing were unclear.

In recognition of the need to streamline mechanisms of data dissemination—globally and in as close to real-time as possible—the WHO held a consultation in Geneva, Switzerland, on 1–2 September 2015 to advance the development of data sharing norms, specifically in the context of public health emergencies….

preservation of global health requires prioritization of and support for international collaboration. These and other principles were affirmed at the consultation (Table 1) and codified into a consensus statement that was published on the WHO website immediately following the meeting (http://www.who.int/medicines/ebola-treatment/data-sharing_phe/en/). A more comprehensive set of principles and action items was made available in November 2015, including the consensus statement made by the editorial staff of journals that attended the meeting (http://www.who.int/medicines/ebola-treatment/blueprint_phe_data-share-results/en/). The success of prior initiatives to accelerate timelines for reporting clinical trial results has helped build momentum for a broader data sharing agenda. As the quick and transparent dissemination of information is the bedrock of good science and public health practice, it is important that the current trends in data sharing carry over to all matters of acute public health need. Such a global norm would advance the spirit of open collaboration, simplify current mechanisms of information sharing, and potentially save many lives in subsequent outbreaks….(More)”

 

The Power of the Nudge to Change Our Energy Future


Sebastian Berger in the Scientific American: “More than ever, psychology has become influential not only in explaining human behavior, but also as a resource for policy makers to achieve goals related to health, well-being, or sustainability. For example, President Obama signed an executive order directing the government to systematically use behavioral science insights to “better serve the American people.” Not alone in this endeavor, many governments – including the UK, Germany, Denmark, or Australia – are turning to the insights that most frequently stem from psychological researchers, but also include insights from behavioral economics, sociology, or anthropology.

Particularly relevant are the analysis and the setting of “default-options.” A default is the option that a decision maker receives if he or she does not specifically state otherwise. Are we automatically enrolled in a 401(k), are we organ donors by default, or is the flu-shot a standard that is routinely given to all citizens? Research has given us many examples of how and when defaults can promote public safety or wealth.

One of the most important questions facing the planet, however, is how to manage the transition into a carbon-free economy. In a recent paper, Felix Ebeling of the University of Cologne and I tested whether defaults could nudge consumers into choosing a green energy contract over one that relies on conventional energy. The results were striking: setting the default to green energy increased participation nearly tenfold. This is an important result because it tells us that subtle, non-coercive changes in the decision making environment are enough to show substantial differences in consumers’ preferences in the domain of clean energy. It changes green energy participation from “hardly anyone” to “almost everyone”. Merely within the domain of energy behavior, one can think of many applications where this finding can be applied:  For instance, default engines of new cars could be set to hybrid and customers would need to actively switch to standard options. Standard temperatures of washing machines could be low, etc….(More)”