Open Data Inventory 2016


Open Data Watch is pleased to announce the release of the 2016 Open Data Inventory (ODIN). The new ODIN results provide a comprehensive review of the coverage and openness of official statistics in 173 countries around the world, including most OECD countries.  Featuring a methodology updated to reflect the latest international open data standards, ODIN 2016 results are fully available online at odin.opendatawatch.com, including interactive functions to compare year-to-year results from 122 countries.

ODIN assesses the coverage and openness of data provided on the websites maintained by national statistical offices (NSOs). The overall ODIN score is an indicator of how complete and open an NSO’s data offerings are. In addition to ratings of coverage and openness in twenty statistical categories, ODIN assessments provide the online location of key indicators in each data category, permitting quick access to hundreds of indicators.

ODIN 2016 Top Scores Reveal Gaps Between Openness and Coverage

In the 2016 round, the top scores went to high-income and OECD countries. Sweden was ranked first overall with a score of 81. Sweden was also the most open site, with an openness score of 91. Among non-OECD countries, the highest rank was Lithuania with an overall score of 77. Among non-high-income countries, Mexico again earned the highest ranking with a score of 67, followed by the lower-middle-income economies of Mongolia (61), and Moldova (59). Among low-income countries, Rwanda received the highest score of 55. ODIN overall scores are scaled from 0 to 100 and provide equal weighting for social, economic, and environmental statistics….

The new ODIN website allows users to compare and download scores for 2015 and 2016….(More)”

The Emergence of a Post-Fact World


Francis Fukuyama in Project Syndicate: “One of the more striking developments of 2016 and its highly unusual politics was the emergence of a “post-fact” world, in which virtually all authoritative information sources were called into question and challenged by contrary facts of dubious quality and provenance.

The emergence of the Internet and the World Wide Web in the 1990s was greeted as a moment of liberation and a boon for democracy worldwide. Information constitutes a form of power, and to the extent that information was becoming cheaper and more accessible, democratic publics would be able to participate in domains from which they had been hitherto excluded.

The development of social media in the early 2000s appeared to accelerate this trend, permitting the mass mobilization that fueled various democratic “color revolutions” around the world, from Ukraine to Burma (Myanmar) to Egypt. In a world of peer-to-peer communication, the old gatekeepers of information, largely seen to be oppressive authoritarian states, could now be bypassed.

While there was some truth to this positive narrative, another, darker one was also taking shape. Those old authoritarian forces were responding in dialectical fashion, learning to control the Internet, as in China, with its tens of thousands of censors, or, as in Russia, by recruiting legions of trolls and unleashing bots to flood social media with bad information. These trends all came together in a hugely visible way during 2016, in ways that bridged foreign and domestic politics….

The traditional remedy for bad information, according to freedom-of-information advocates, is simply to put out good information, which in a marketplace of ideas will rise to the top. This solution, unfortunately, works much less well in a social-media world of trolls and bots. There are estimates that as many as a third to a quarter of Twitter users fall into this category. The Internet was supposed to liberate us from gatekeepers; and, indeed, information now comes at us from all possible sources, all with equal credibility. There is no reason to think that good information will win out over bad information….

The inability to agree on the most basic facts is the direct product of an across-the-board assault on democratic institutions – in the US, in Britain, and around the world. And this is where the democracies are headed for trouble. In the US, there has in fact been real institutional decay, whereby powerful interest groups have been able to protect themselves through a system of unlimited campaign finance. The primary locus of this decay is Congress, and the bad behavior is for the most part as legal as it is widespread. So ordinary people are right to be upset.

And yet, the US election campaign has shifted the ground to a general belief that everything has been rigged or politicized, and that outright bribery is rampant. If the election authorities certify that your favored candidate is not the victor, or if the other candidate seemed to perform better in a debate, it must be the result of an elaborate conspiracy by the other side to corrupt the outcome. The belief in the corruptibility of all institutions leads to a dead end of universal distrust. American democracy, all democracy, will not survive a lack of belief in the possibility of impartial institutions; instead, partisan political combat will come to pervade every aspect of life….(More)”

Data capitalism is cashing in on our privacy . . . for now


John Thornhill in the Financial Times: “The buzz at last week’s Consumer Electronics Show in Las Vegas was all about connectivity and machine learning. …The primary effect of these consumer tech products seems limited — but we will need to pay increasing attention to the secondary consequences of these connected devices. They are just the most visible manifestation of a fundamental transformation that is likely to shape our societies far more than Brexit, Donald Trump or squabbles over the South China Sea. It concerns who collects, owns and uses data. The subject of data is so antiseptic that it seldom generates excitement. To make it sound sexy, some have described data as the “new oil”, fuelling our digital economies. In reality, it is likely to prove far more significant than that. Data are increasingly determining economic value, reshaping the practice of power and intruding into the innermost areas of our lives. Some commentators have suggested that this transformation is so profound that we are moving from an era of financial capitalism into one of data capitalism. The Israeli historian Yuval Noah Harari even argues that Dataism, as he calls it, can be compared with the birth of a religion, given the claims of its most fervent disciples to provide universal solutions. …

Sir Nigel Shadbolt, co-founder of the Open Data Institute, argues in a recent FT TechTonic podcast that it is too early to give up on privacy…The next impending revolution, he argues, will be about giving consumers control over their data. Considering the increasing processing power and memory capacity of smartphones, he believes new models of data collection and more localised use may soon gain traction. One example is the Blue Button service used by US veterans, which allows individuals to maintain and update their medical records. “That has turned out to be a really revolutionary step,” he says. “I think we are going to see a lot more of that kind of re-empowering.” According to this view, we can use data to create a far smarter world without sacrificing precious rights. If we truly believe in such a benign future, we had better hurry up and invent it….(More)”

Montreal monitoring city traffic via drivers’ Bluetooth


Springwise: “Rather than rely on once-yearly spot checks of traffic throughout the city, Montreal, Canada, decided to build a more comprehensive picture of what was working well, and what wasn’t working very well, around the city. Working with traffic management company Orange Traffic, the city installed more than 100 sensors along the busiest vehicular routes. The sensors pick up mobile phone Bluetooth signals, making the system inexpensive to use and install as no additional hardware or devices are needed.

Once the sensors pick up a Bluetooth signal, they track it through several measurement points to get an idea of how fast or slow traffic is moving. The data is sent to the city’s Urban Mobility Management Center. City officials are keen to emphasize that no personal data is recorded as Bluetooth signals cannot be linked to individuals. Traffic management and urban planning teams will be able to use the data to redesign problematic intersections and improve the overall mobility of the city’s streets and transport facilities.

Smart cities are those making safety and efficiency a priority, from providing digital driver licenses in India to crowdsourcing a map of cars in bike lanes in New York City….(More)”

Iran’s Civic Tech Sector


Leah Hunter at Forbes: “This is the story of Firuzeh Mahmoudi, founder of United4Iran and Irancubator, the first civic tech-focused startup incubator in Iran. She is also a creator of civil justice apps and a businessperson. Her business? Creating social good in a country she loves.

“Our mission is to improve civil liberties in Iran, and we do that in three ways,” says Mahmoudi, 45, who spent four years working for the United Nations in countries across the world as an international project coordinator before becoming a founder….

Mahmoudi realized that there wasn’t anyone focused on apps made for civic engagement inside Iran, so she built a team to create Irancubator. She works with 30 consultants and partners in the Iranian-American community. She also has a staff of 10 in her San Francisco Bay Area office—most of whom are Iranian, and were still in the country until 2009. “I really worked hard in bringing in resilient people…people who are smart, creative, kind. It’s so important to be kind. How you do the work, and how you show up, is that critical. If you try to make the world a better place, you’d better be nice. If you want to make the government be nicer, you’d better be nice, too.”

She and her team, based in the San Francisco Bay Area are creating apps like the Iran Prison Atlas – a database of all the country’s political prisoners, the judges who sentenced them and the prisons where they’re held. “We believe how these people are treated is a litmus test for our country,” Mahmoudi explains.

They are building an app women can use to track their ovulation cycles and periods. It also acts as a Trojan horse; as you dig deeper, it includes all sorts of information on women’s rights, including how to have equal rights in a marriage. (In Iran, divorce rights for women—as well as the right to equal custody of their children afterward—require a document signed before the wedding ceremony.) “This one’s not specifically targeting the richer women who are living in Northern Tehran. It’s an app that aims to engage people who live in rural areas, or not be as well-off or educated or perhaps more conservative or religious,” Mahmoudi explains. “Once you get in the app, you realize there are other parts. They include information on one’s rights as a woman in a marriage. Or basic concepts that may be completely foreign to them. Like maybe say, “Hey, do you know there’s a concept called ‘marital rape’? Even if someone’s your husband, they can’t treat you this way.”…

Right now, Irancubator is building a dozen apps. The first is launching in late January. Named RadiTo, this app works similarly to YouTube, but for radio instead of TV, allowing people in Iran to broadcast channels about the topics they care about. Someone can create a channel about LGBT rights or about children and education in their language. “Whatever they want—they can have a secure, safe platform to broadcast their message,” Mahmoudi explains.

From an operational perspective, this isn’t easy. Mahmoudi and her staff aren’t just building a startup. They’re operating from the other side of the world, working for users with whom they cannot directly communicate.  “Any startup is challenging and has so many hurdles. For us, it’s another level, working with so many security challenges,” says Mahmoudi….

The biggest challenge of all: they cannot go back to Iran. “The Islamic Republic coined me as an anti-revolutionary fugitive in one of their articles,” Mahmoudi says. “Half of my staff are refugees who got out.”…(More).

Results of early Open Government Partnership initiatives


The Open Government Partnership: “The search for these stories ended with finding seven very different reform initiatives in different regions and covering a broad range of open government topics.

In Costa Rica, we learn about how the government is using its participation in OGP to restart a process halted for 23 years to create a consultation mechanism that will allow indigenous groups to participate in all policy making decisions that affect them, and the results of the dialogue leading to an improvement in the delivery of public services.

The Chilean story documents how a 10-year campaign to regulate influence peddling was given a boost by an explicit commitment included in the first Chilean action plan to introduce legislation to regulate lobbying – a commitment since fulfilled. The resulting Lobbying Act sheds new light on the relationship between officials and influence groups and is beginning to democratize access to authorities.

Italy’s OpenCoesione and its spin-off initiatives show how top-down open data initiatives on public spending can be combined with bottom-up, data-driven monitoring to promote accountability and public participation in the policy-making process, including promoting civic engagement amongst school students.

The Tanzanian case study tells the story of how the “How Do I?” – or “Nifanyeje?” – website is making information on basic public services available to citizens and cutting down transaction times and costs, but it also highlights the need to still reach the last mile in a country where Internet penetration remains low.

Indonesia’s initiative to create a One Map portal with official base maps for the country, part of a much larger initiative of synchronizing various maps for the country that when completed could help resolve land-related conflicts and address illegal deforestation, shows technical progress and some improvements in inter-agency cooperation.

In Macedonia, we learn how opening up data on air quality has acted as an engine for civic activism and about short and medium-term policy options being implemented and explored by the relevant authorities as a result.

Finally, the case from Israel shows how collaboration between civil society and champions within the Parliament is helping make data on the state budget accessible to citizens, journalists, and the parliamentarians themselves.

Each story demonstrates measurable progress and the added value of the collaboration between government and civil society that is at the very heart of OGP. The stories also show the immense importance of political will, bureaucratic buy-in, adequate resourcing, and demand-side calls for accountability in ensuring that the reforms take root and continue into the future, so that their impact can be felt by a broader range of citizens. In that sense, the last chapter for each story is still to be written. In a majority of the cases, these commitments’ inclusion in the OGP National Action Plans gave prominence and momentum to the envisioned reforms, helping them along. We hope to be able to continue to track these reforms in the years to come….(More)”.

Global Standards in National Contexts: The Role of Transnational Multi-Stakeholder Initiatives in Public Sector Governance Reform


Paper by Brandon Brockmyer: “Multi-stakeholder initiatives (i.e., partnerships between governments, civil society, and the private sector) are an increasingly prevalent strategy promoted by multilateral, bilateral, and nongovernmental development organizations for addressing weaknesses in public sector governance. Global public sector governance MSIs seek to make national governments more transparent and accountable by setting shared standards for information disclosure and multi- stakeholder collaboration. However, research on similar interventions implemented at the national or subnational level suggests that the effectiveness of these initiatives is likely to be mediated by a variety of socio-political factors.

This dissertation examines the transnational evidence base for three global public sector governance MSIs — the Extractive Industries Transparency Initiative, the Construction Sector Transparency Initiative, and the Open Government Partnership — and investigates their implementation within and across three shared national contexts — Guatemala, the Philippines, and Tanzania — in order to determine whether and how these initiatives lead to improvements in proactive transparency (i.e., discretionary release of government data), demand-driven transparency (i.e., reforms that increase access to government information upon request), and accountability (i.e., the extent to which government officials are compelled to publicly explain their actions and/or face penalties or sanction for them), as well as the extent to which they provide participating governments with an opportunity to project a public image of transparency and accountability, while maintaining questionable practices in these areas (i.e., openwashing).

The evidence suggests that global public sector governance MSIs often facilitate gains in proactive transparency by national governments, but that improvements in demand-driven transparency and accountability remain relatively rare. Qualitative comparative analysis reveals that a combination of multi-stakeholder power sharing and civil society capacity is sufficient to drive improvements in proactive transparency, while the absence of visible, high-level political support is sufficient to impede such reforms. The lack of demand-driven transparency or accountability gains suggests that national-level coalitions forged by global MSIs are often too narrow to successfully advocate for broader improvements to public sector governance. Moreover, evidence for openwashing was found in one-third of cases, suggesting that national governments sometimes use global MSIs to deliberately mislead international observers and domestic stakeholders about their commitment to reform….(More)”

Rethinking how we collect, share, and use development results data


Development Gateway: “The international development community spends a great deal of time, effort, and money gathering data on thousands of indicators embedded in various levels of Results Frameworks. These data comprise outputs (school enrollment, immunization figures), program outcomes (educational attainment, disease prevalence), and, in some cases, impacts (changes in key outcomes over time).

Ostensibly, we use results data to allocate resources to the places, partners, and programs most likely to achieve lasting success. But is this data good enough – and is it used well enough – to genuinely increase development impact in priority areas?

Experience suggests that decision-makers at all levels may often face inadequate, incorrect, late, or incomplete results data. At the same time, a figurative “Tower of Babel” of both project-level M&E and program-level outcome data can make it difficult for agencies and organizations to share and use data effectively. Further, potential users may not have the skills, resources, or enabling environment to meaningfully analyze and apply results data to decisions. With these challenges in mind, the development community needs to re-think its investments in results data, making sure that the right users are able to collect, share, and use this information to maximum effect.

Our Initiative

To this end, Development Gateway (DG), with the support of the Bill & Melinda Gates Foundation, aims to “diagnose” the results data ecosystem in three countries, identifying ways to improve data quality, sharing, and use in the health and agriculture sectors. Some of our important questions include:

  • Quality: Who collects data and how? Is data quality adequate? Does the data meet actual needs? How much time does data collection demand? How can data collection, quality, and reporting be improved?
  • Sharing: How can we compare results data from different donors, governments, and implementers? Is there demand for comparability? Should data be shared more freely? If so, how?
  • Use: How is results data analyzed and used to inform actual policies and plans? Does (or can) access to results data improve decision-making? Do the right people have the right data? How else can (or should) we promote data use?…(More)”

Introducing the Agricultural Open Data Package: BETA Version


PressRelease: “GODAN, Open Data for Development (OD4D) Network, Open Data Charter, and the Open Data Institute are pleased to announce the release of the Agricultural Open Data Package: BETA version. …The Agriculture Open Data Package (http://AgPack.info) has been designed to help governments get to impact with open data in the agriculture sector. This practical resource provides key policy areas, key data categories, examples datasets, relevant interoperability initiatives, and use cases that policymakers and other stakeholders in the agriculture sector or open data should focus on, in order to address food security challenges.

The Package is meant as a source of inspiration and an invitation to start a national open data for agriculture initiative.

In the Package we identify fourteen key categories of data and discuss the effort it will take for a government to make this data available in a meaningful way. …

The Package also highlights more than ten use cases (the number is growing) demonstrating how open data is being harnessed to address sustainable agriculture and food security around the world. Examples include:

  • mapping water points to optimise scarce resource allocation in Burkina Faso

  • surfacing daily price information on multiple food commodities across India

  • benchmarking agricultural productivity in the Netherlands

Where relevant we also highlight applicable interoperability initiatives, such as open contracting, international aid transparency initiative (IATI), and global product classification (GPC) standards.

We recognise that the agriculture sector is diverse, with many contextual differences affecting scope of activities, priorities and capacities. In the full version of the Agricultural Open Data Package we discuss important implementation considerations such as inter-agency coordination and resourcing to develop an appropriate data infrastructure and a healthy data ‘ecosystem’ for agriculture….(More)”

Four steps to precision public health


Scott F. DowellDavid Blazes & Susan Desmond-Hellmann at Nature: “When domestic transmission of Zika virus was confirmed in the United States in July 2016, the entire country was not declared at risk — nor even the entire state of Florida. Instead, precise surveillance defined two at-risk areas of Miami-Dade County, neighbourhoods measuring just 2.6 and 3.9 square kilometres. Travel advisories and mosquito control focused on those regions. Six weeks later, ongoing surveillance convinced officials to lift restrictions in one area and expand the other.

By contrast, a campaign against yellow fever launched this year in sub-Saharan Africa defines risk at the level of entire nations, often hundreds of thousands of square kilometres. More granular assessments have been deemed too complex.

The use of data to guide interventions that benefit populations more efficiently is a strategy we call precision public health. It requires robust primary surveillance data, rapid application of sophisticated analytics to track the geographical distribution of disease, and the capacity to act on such information1.

The availability and use of precise data is becoming the norm in wealthy countries. But large swathes of the developing world are not reaping its advantages. In Guinea, it took months to assemble enough data to clearly identify the start of the largest Ebola outbreak in history. This should take days. Sub-Saharan Africa has the highest rates of childhood mortality in the world; it is also where we know the least about causes of death…..

The value of precise disease tracking was baked into epidemiology from the start. In 1854, John Snow famously located cholera cases in London. His mapping of the spread of infection through contaminated water dealt a blow to the idea that the disease was caused by bad air. These days, people and pathogens move across the globe swiftly and in great numbers. In 2009, the H1N1 ‘swine flu’ influenza virus took just 35 days to spread from Mexico and the United States to China, South Korea and 12 other countries…

The public-health community is sharing more data faster; expectations are higher than ever that data will be available from clinical trials and from disease surveillance. In the past two years, the US National Institutes of Health, the Wellcome Trust in London and the Gates Foundation have all instituted open data policies for their grant recipients, and leading journals have declared that sharing data during disease emergencies will not impede later publication.

Meanwhile, improved analysis, data visualization and machine learning have expanded our ability to use disparate data sources to decide what to do. A study published last year4 used precise geospatial modelling to infer that insecticide-treated bed nets were the single most influential intervention in the rapid decline of malaria.

However, in many parts of the developing world, there are still hurdles to the collection, analysis and use of more precise public-health data. Work towards malaria elimination in South Africa, for example, has depended largely on paper reporting forms, which are collected and entered manually each week by dozens of subdistricts, and eventually analysed at the province level. This process would be much faster if field workers filed reports from mobile phones.

Sources: Ref. 8/Bill & Melinda Gates Foundation

…Frontline workers should not find themselves frustrated by global programmes that fail to take into account data on local circumstances. Wherever they live — in a village, city or country, in the global south or north — people have the right to public-health decisions that are based on the best data and science possible, that minimize risk and cost, and maximize health in their communities…(More)”