Open Data Inventory 2016


Open Data Watch is pleased to announce the release of the 2016 Open Data Inventory (ODIN). The new ODIN results provide a comprehensive review of the coverage and openness of official statistics in 173 countries around the world, including most OECD countries.  Featuring a methodology updated to reflect the latest international open data standards, ODIN 2016 results are fully available online at odin.opendatawatch.com, including interactive functions to compare year-to-year results from 122 countries.

ODIN assesses the coverage and openness of data provided on the websites maintained by national statistical offices (NSOs). The overall ODIN score is an indicator of how complete and open an NSO’s data offerings are. In addition to ratings of coverage and openness in twenty statistical categories, ODIN assessments provide the online location of key indicators in each data category, permitting quick access to hundreds of indicators.

ODIN 2016 Top Scores Reveal Gaps Between Openness and Coverage

In the 2016 round, the top scores went to high-income and OECD countries. Sweden was ranked first overall with a score of 81. Sweden was also the most open site, with an openness score of 91. Among non-OECD countries, the highest rank was Lithuania with an overall score of 77. Among non-high-income countries, Mexico again earned the highest ranking with a score of 67, followed by the lower-middle-income economies of Mongolia (61), and Moldova (59). Among low-income countries, Rwanda received the highest score of 55. ODIN overall scores are scaled from 0 to 100 and provide equal weighting for social, economic, and environmental statistics….

The new ODIN website allows users to compare and download scores for 2015 and 2016….(More)”

Fighting Ebola with information


Larissa Fast and Adele Waugaman at Global Innovation Exchange: What can be learned from the use of data, information, and digital technologies, such as mobile-based systems and internet connectivity, during the Ebola outbreak response in West Africa? What worked, what didn’t, and how can we apply these lessons to improve data and information flows in the future? This report details key findings and recommendations about the collection, management, analysis, and use of paper-based and digital data and information, drawing upon the insights of more than 130 individuals and organizations who worked tirelessly to end the Ebola outbreak in West Africa in 2014 and 2015….(More)”

The Emergence of a Post-Fact World


Francis Fukuyama in Project Syndicate: “One of the more striking developments of 2016 and its highly unusual politics was the emergence of a “post-fact” world, in which virtually all authoritative information sources were called into question and challenged by contrary facts of dubious quality and provenance.

The emergence of the Internet and the World Wide Web in the 1990s was greeted as a moment of liberation and a boon for democracy worldwide. Information constitutes a form of power, and to the extent that information was becoming cheaper and more accessible, democratic publics would be able to participate in domains from which they had been hitherto excluded.

The development of social media in the early 2000s appeared to accelerate this trend, permitting the mass mobilization that fueled various democratic “color revolutions” around the world, from Ukraine to Burma (Myanmar) to Egypt. In a world of peer-to-peer communication, the old gatekeepers of information, largely seen to be oppressive authoritarian states, could now be bypassed.

While there was some truth to this positive narrative, another, darker one was also taking shape. Those old authoritarian forces were responding in dialectical fashion, learning to control the Internet, as in China, with its tens of thousands of censors, or, as in Russia, by recruiting legions of trolls and unleashing bots to flood social media with bad information. These trends all came together in a hugely visible way during 2016, in ways that bridged foreign and domestic politics….

The traditional remedy for bad information, according to freedom-of-information advocates, is simply to put out good information, which in a marketplace of ideas will rise to the top. This solution, unfortunately, works much less well in a social-media world of trolls and bots. There are estimates that as many as a third to a quarter of Twitter users fall into this category. The Internet was supposed to liberate us from gatekeepers; and, indeed, information now comes at us from all possible sources, all with equal credibility. There is no reason to think that good information will win out over bad information….

The inability to agree on the most basic facts is the direct product of an across-the-board assault on democratic institutions – in the US, in Britain, and around the world. And this is where the democracies are headed for trouble. In the US, there has in fact been real institutional decay, whereby powerful interest groups have been able to protect themselves through a system of unlimited campaign finance. The primary locus of this decay is Congress, and the bad behavior is for the most part as legal as it is widespread. So ordinary people are right to be upset.

And yet, the US election campaign has shifted the ground to a general belief that everything has been rigged or politicized, and that outright bribery is rampant. If the election authorities certify that your favored candidate is not the victor, or if the other candidate seemed to perform better in a debate, it must be the result of an elaborate conspiracy by the other side to corrupt the outcome. The belief in the corruptibility of all institutions leads to a dead end of universal distrust. American democracy, all democracy, will not survive a lack of belief in the possibility of impartial institutions; instead, partisan political combat will come to pervade every aspect of life….(More)”

Data capitalism is cashing in on our privacy . . . for now


John Thornhill in the Financial Times: “The buzz at last week’s Consumer Electronics Show in Las Vegas was all about connectivity and machine learning. …The primary effect of these consumer tech products seems limited — but we will need to pay increasing attention to the secondary consequences of these connected devices. They are just the most visible manifestation of a fundamental transformation that is likely to shape our societies far more than Brexit, Donald Trump or squabbles over the South China Sea. It concerns who collects, owns and uses data. The subject of data is so antiseptic that it seldom generates excitement. To make it sound sexy, some have described data as the “new oil”, fuelling our digital economies. In reality, it is likely to prove far more significant than that. Data are increasingly determining economic value, reshaping the practice of power and intruding into the innermost areas of our lives. Some commentators have suggested that this transformation is so profound that we are moving from an era of financial capitalism into one of data capitalism. The Israeli historian Yuval Noah Harari even argues that Dataism, as he calls it, can be compared with the birth of a religion, given the claims of its most fervent disciples to provide universal solutions. …

Sir Nigel Shadbolt, co-founder of the Open Data Institute, argues in a recent FT TechTonic podcast that it is too early to give up on privacy…The next impending revolution, he argues, will be about giving consumers control over their data. Considering the increasing processing power and memory capacity of smartphones, he believes new models of data collection and more localised use may soon gain traction. One example is the Blue Button service used by US veterans, which allows individuals to maintain and update their medical records. “That has turned out to be a really revolutionary step,” he says. “I think we are going to see a lot more of that kind of re-empowering.” According to this view, we can use data to create a far smarter world without sacrificing precious rights. If we truly believe in such a benign future, we had better hurry up and invent it….(More)”

Rethinking how we collect, share, and use development results data


Development Gateway: “The international development community spends a great deal of time, effort, and money gathering data on thousands of indicators embedded in various levels of Results Frameworks. These data comprise outputs (school enrollment, immunization figures), program outcomes (educational attainment, disease prevalence), and, in some cases, impacts (changes in key outcomes over time).

Ostensibly, we use results data to allocate resources to the places, partners, and programs most likely to achieve lasting success. But is this data good enough – and is it used well enough – to genuinely increase development impact in priority areas?

Experience suggests that decision-makers at all levels may often face inadequate, incorrect, late, or incomplete results data. At the same time, a figurative “Tower of Babel” of both project-level M&E and program-level outcome data can make it difficult for agencies and organizations to share and use data effectively. Further, potential users may not have the skills, resources, or enabling environment to meaningfully analyze and apply results data to decisions. With these challenges in mind, the development community needs to re-think its investments in results data, making sure that the right users are able to collect, share, and use this information to maximum effect.

Our Initiative

To this end, Development Gateway (DG), with the support of the Bill & Melinda Gates Foundation, aims to “diagnose” the results data ecosystem in three countries, identifying ways to improve data quality, sharing, and use in the health and agriculture sectors. Some of our important questions include:

  • Quality: Who collects data and how? Is data quality adequate? Does the data meet actual needs? How much time does data collection demand? How can data collection, quality, and reporting be improved?
  • Sharing: How can we compare results data from different donors, governments, and implementers? Is there demand for comparability? Should data be shared more freely? If so, how?
  • Use: How is results data analyzed and used to inform actual policies and plans? Does (or can) access to results data improve decision-making? Do the right people have the right data? How else can (or should) we promote data use?…(More)”

Can you crowdsource water quality data?


Pratibha Mistry at The Water Blog (Worldbank): “The recently released Contextual Framework for Crowdsourcing Water Quality Data lays out a strategy for citizen engagement in decentralized water quality monitoring, enabled by the “mobile revolution.”

According to the WHO, 1.8 billion people lack access to safe drinking water worldwide. Poor source water quality, non-existent or insufficient treatment, and defects in water distribution systems and storage mean these consumers use water that often doesn’t meet the WHO’s Guidelines for Drinking Water Quality.

The crowdsourcing framework develops a strategy to engage citizens in measuring and learning about the quality of their own drinking water. Through their participation, citizens provide utilities and water supply agencies with cost-effective water quality data in near-real time. Following a typical crowdsourcing model: consumers use their mobile phones to report water quality information to a central service. That service receives the information, then repackages and shares it via mobile phone messages, websites, dashboards, and social media. Individual citizens can thus be educated about their water quality, and water management agencies and other stakeholders can use the data to improve water management; it’s a win-win.

A well-implemented crowdsourcing project both depends on and benefits end users.Source: Figure modified from Hutchings, M., Dev, A., Palaniappan, M., Srinivasan, V., Ramanathan, N., Taylor, J.  2012. “mWASH: Mobile Phone Applications for the Water, Sanitation, and Hygiene Sector.” Pacific Institute, Oakland, California.  114 p.  (Link to full text)

Several groups, from the private sector to academia to non-profits, have taken a recent interest in developing a variety of so-called mWASH apps (mobile phone applications for the water, sanitation, and hygiene WASH sector).  A recent academic study analyzed how mobile phones might facilitate the flow of water quality data between water suppliers and public health agencies in Africa. USAID has invested in piloting a mobile application in Tanzania to help consumers test their water for E. coli….(More)”

Introducing the Agricultural Open Data Package: BETA Version


PressRelease: “GODAN, Open Data for Development (OD4D) Network, Open Data Charter, and the Open Data Institute are pleased to announce the release of the Agricultural Open Data Package: BETA version. …The Agriculture Open Data Package (http://AgPack.info) has been designed to help governments get to impact with open data in the agriculture sector. This practical resource provides key policy areas, key data categories, examples datasets, relevant interoperability initiatives, and use cases that policymakers and other stakeholders in the agriculture sector or open data should focus on, in order to address food security challenges.

The Package is meant as a source of inspiration and an invitation to start a national open data for agriculture initiative.

In the Package we identify fourteen key categories of data and discuss the effort it will take for a government to make this data available in a meaningful way. …

The Package also highlights more than ten use cases (the number is growing) demonstrating how open data is being harnessed to address sustainable agriculture and food security around the world. Examples include:

  • mapping water points to optimise scarce resource allocation in Burkina Faso

  • surfacing daily price information on multiple food commodities across India

  • benchmarking agricultural productivity in the Netherlands

Where relevant we also highlight applicable interoperability initiatives, such as open contracting, international aid transparency initiative (IATI), and global product classification (GPC) standards.

We recognise that the agriculture sector is diverse, with many contextual differences affecting scope of activities, priorities and capacities. In the full version of the Agricultural Open Data Package we discuss important implementation considerations such as inter-agency coordination and resourcing to develop an appropriate data infrastructure and a healthy data ‘ecosystem’ for agriculture….(More)”

Four steps to precision public health


Scott F. DowellDavid Blazes & Susan Desmond-Hellmann at Nature: “When domestic transmission of Zika virus was confirmed in the United States in July 2016, the entire country was not declared at risk — nor even the entire state of Florida. Instead, precise surveillance defined two at-risk areas of Miami-Dade County, neighbourhoods measuring just 2.6 and 3.9 square kilometres. Travel advisories and mosquito control focused on those regions. Six weeks later, ongoing surveillance convinced officials to lift restrictions in one area and expand the other.

By contrast, a campaign against yellow fever launched this year in sub-Saharan Africa defines risk at the level of entire nations, often hundreds of thousands of square kilometres. More granular assessments have been deemed too complex.

The use of data to guide interventions that benefit populations more efficiently is a strategy we call precision public health. It requires robust primary surveillance data, rapid application of sophisticated analytics to track the geographical distribution of disease, and the capacity to act on such information1.

The availability and use of precise data is becoming the norm in wealthy countries. But large swathes of the developing world are not reaping its advantages. In Guinea, it took months to assemble enough data to clearly identify the start of the largest Ebola outbreak in history. This should take days. Sub-Saharan Africa has the highest rates of childhood mortality in the world; it is also where we know the least about causes of death…..

The value of precise disease tracking was baked into epidemiology from the start. In 1854, John Snow famously located cholera cases in London. His mapping of the spread of infection through contaminated water dealt a blow to the idea that the disease was caused by bad air. These days, people and pathogens move across the globe swiftly and in great numbers. In 2009, the H1N1 ‘swine flu’ influenza virus took just 35 days to spread from Mexico and the United States to China, South Korea and 12 other countries…

The public-health community is sharing more data faster; expectations are higher than ever that data will be available from clinical trials and from disease surveillance. In the past two years, the US National Institutes of Health, the Wellcome Trust in London and the Gates Foundation have all instituted open data policies for their grant recipients, and leading journals have declared that sharing data during disease emergencies will not impede later publication.

Meanwhile, improved analysis, data visualization and machine learning have expanded our ability to use disparate data sources to decide what to do. A study published last year4 used precise geospatial modelling to infer that insecticide-treated bed nets were the single most influential intervention in the rapid decline of malaria.

However, in many parts of the developing world, there are still hurdles to the collection, analysis and use of more precise public-health data. Work towards malaria elimination in South Africa, for example, has depended largely on paper reporting forms, which are collected and entered manually each week by dozens of subdistricts, and eventually analysed at the province level. This process would be much faster if field workers filed reports from mobile phones.

Sources: Ref. 8/Bill & Melinda Gates Foundation

…Frontline workers should not find themselves frustrated by global programmes that fail to take into account data on local circumstances. Wherever they live — in a village, city or country, in the global south or north — people have the right to public-health decisions that are based on the best data and science possible, that minimize risk and cost, and maximize health in their communities…(More)”

Solving some of the world’s toughest problems with the Global Open Policy Report


 at Creative Commons: “Open Policy is when governments, institutions, and non-profits enact policies and legislation that makes content, knowledge, or data they produce or fund available under a permissive license to allow reuse, revision, remix, retention, and redistribution. This promotes innovation, access, and equity in areas of education, data, software, heritage, cultural content, science, and academia.

For several years, Creative Commons has been tracking the spread of open policies around the world. And now, with the new Global Open Policy Report (PDF) by the Open Policy Network, we’re able to provide a systematic overview of open policy development.

screen-shot-2016-12-02-at-5-57-09-pmThe first-of-its-kind report gives an overview of open policies in 38 countries, across four sectors: education, science, data and heritage. The report includes an Open Policy Index and regional impact and local case studies from Africa, the Middle East, Asia, Australia, Latin America, Europe, and North America. The index measures open policy strength on two scales: policy strength and scope, and level of policy implementation. The index was developed by researchers from CommonSphere, a partner organization of CC Japan.

The Open Policy Index scores were used to classify countries as either Leading, Mid-Way, or Delayed in open policy development. The ten countries with the highest scores are Argentina, Bolivia, Chile, France, Kyrgyzstan, New Zealand, Poland, South Korea, Tanzania, and Uruguay…(More)

Future of e-government: learning from the past


Special issue of SOCRATES edited by Manoj Dixit: “We are living in an era of digitization thus moving towards a digital government. The use of ICT in public-administration is beneficial and it is not mere a coincidence that the top 10 countries in e-government implementation (according to UN E-Government Survey 2016) are flourishing democracies. There has been a sharp rise in the number of countries using e-government to provide public services online through one stop-platform. According to the 2016 survey, 90 countries now offer one or more single entry portal on public information or online services, or both and 148 countries provide at-least one form of online transaction services. More and more countries are making efforts through e-government to ensure and increase inclusiveness, effectiveness, accountability and transparency in their public institutions. Across the globe, data for public information and security is being opened up. The 2016 survey shows that 128 countries now provide data-sets on government spending in machine readable formats. E-government and innovation seems to have provided significant opportunities to transform public administration into an instrument of sustainable development. The governments around the globe are rapidly transforming. The use of information and communication technology in public administration – combined with organizational change and new skills- seems to be improving public services and democratic processes and strengthening support to public policies. There has been an increased effort to utilize advanced electronic and mobile services that benefits all. Fixed and wireless broadband subscriptions have increased unevenly across regions, with Europe leading, but Africa still lagging behind. We have to focus on these substantial region disparities and growing divide. All countries agreed, in SDG 9, that a major effort is required to ensure universal access to internet in the least developed countries. The rise of Social media and its easy access seems to have enabled an increasing number of countries moving towards participatory decision making, in which developed European countries are among the top 50 performers. But, the issues of diminishing collective thinking and rising Individual thinking are some rising issues that we will have to deal with in the future. There are more sensitive issues like the new classification of citizens into literate-illiterate, e-literate and e-illiterate, that the governments need to look upon. It is a good sign that many developing countries are making good progress. Enhanced e-participation can support the realization of the SDGs by enabling more participatory decision making, but the success of e-government will ultimately depend upon our ability and capability to solve the contrasting issues raised due to this transition with sensitivity.

In this issue of SOCRATES we have discussed, this new era of Digital Government. We have focused on what we have learned from the past and the future we want. From discussions on the role of e-governance within the local government settings in a modern democratic state to the experience of an academia with online examination, we have tried to include every possible aspect of e-government….(More)”