Open Data Barometer 2016


Open Data Barometer: “Produced by the World Wide Web Foundation as a collaborative work of the Open Data for Development (OD4D) network and with the support of the Omidyar Network, the Open Data Barometer (ODB) aims to uncover the true prevalence and impact of open data initiatives around the world. It analyses global trends, and provides comparative data on countries and regions using an in-depth methodology that combines contextual data, technical assessments and secondary indicators.

Covering 115 jurisdictions in the fourth edition, the Barometer ranks governments on:

  • Readiness for open data initiatives.
  • Implementation of open data programmes.
  • Impact that open data is having on business, politics and civil society.

After three successful editions, the fourth marks another step towards becoming a global policymaking tool with a participatory and inclusive process and a strong regional focus. This year’s Barometer includes an assessment of government performance in fulfilling the Open Data Charter principles.

The Barometer is a truly global and collaborative effort, with input from more than 100 researchers and government representatives. It takes over six months and more than 10,000 hours of research work to compile. During this process, we address more than 20,000 questions and respond to more than 5,000 comments and suggestions.

The ODB global report is a summary of some of the most striking findings. The full data and methodology is available, and is intended to support secondary research and inform better decisions for the progression of open data policies and practices across the world…(More)”.

The cloud, the crowd, and the city: How new data practices reconfigure urban governance?


Introduction to Special Issue of Big Data & Society by ,  and : “The urban archetype of the flâneur, so central to the concept of modernity, can now experience the city in ways unimaginable one hundred years ago. Strolling around Paris, the contemporary flâneur might stop to post pictures of her discoveries on Instagram, simultaneously identifying points of interest to the rest of her social network and broadcasting her location (perhaps unknowingly). The café she visits might be in the middle of a fundraising campaign through a crowdfunding site such as Kickstarter, and she might be invited to tweet to her followers in exchange for a discount on her pain au chocolate. As she ambles about Paris, the route of her stroll is captured by movement sensors positioned on top of street lights, and this data—aggregated with that of thousands of other pedestrians—could be used by the City of Paris to sync up transit schedules. And if those schedules were not convenient, she might tap Uber to whisk her home to her threadbare pension booked on AirBnB.

This vignette attests to the transformation of the urban experience through technology-enabled platforms that allow for the quick mobilization and exchange of information, public services, surplus capacity, entrepreneurial energy, and money. However, these changes have implicated more than just consumers, as multiple technologies have been taken up in urban governance processes through platforms variously labeled as Big Data, crowd sourcing, or the sharing economy. These systems combine inexpensive data collection and cloud-based storage, distributed social networks, geotagged locational sensing, mobile access (often through “app” platforms), and new collaborative entrepreneurship models to radically alter how the needs of urban residents are identified and how services are delivered and consumed in so-called “smart cities” (Townsend, 2013). Backed by Big Data, smart city initiatives have made inroads into urban service provision and policy in areas such as e-government and transparency, new forms of public-private partnerships through “urban lab” arrangements, or models such as impact investing, civic hacking, or tactical urbanism (cf. Karvonen and van Heur, 2014; Kitchin, 2014; Swyngedouw, 2005).

In the rhetoric used by their boosters, the vision and practice of these technologies “disrupts” existing markets by harnessing the power of “the crowd”—a process fully evident in sectors such as taxi (Uber/Lyft), hoteling (AirBnB), and finance (peer-to-peer lending). However, the notion of disruption has also targeted government bureaucracies and public services, with new initiatives seeking to insert crowd mechanisms or characteristics—at once self-organizing and collectively rational (Brabham, 2008)—into public policy. These mechanisms envision reconfiguring the traditional relationship of public powers with planning and governance by vesting data collection and problem-solving in crowd-like institutional arrangements that are partially or wholly outside the purview of government agencies. While scholars are used to talking about “governance beyond-the-state” (Swyngedouw, 2005) in terms of privatization and a growing scope for civil society organizations, technological intermediation potentially changes the scale and techniques of governance as well as its relationship to sovereign authority.

For instance, civic crowdfunding models have emerged as new means of organizing public service provision and funding community economic development by embracing both market-like bidding mechanisms and social-network technologies to distribute responsibility for planning and financing socially desirable investments to laypeople (Brickstarter, 2012; Correia de Freitas and Amado, 2013; Langley and Leyshon, 2016). Other practices are even more radical in their scope. Toronto’s Urban Repair Squad—an offshoot of the aptly named Critical Mass bike happenings—urges residents to take transportation planning into their own hands and paint their own bike lanes. Their motto: “They say city is broke. We fix. No charge.” (All that is missing is the snarky “you’re welcome” at the end.)

Combined, these emerging platforms and practices are challenging the tactics, capabilities, and authorizations employed to define and govern urban problems. This special theme of Big Data & Society picks up these issues, interrogating the emergence of digital platforms and smart city initiatives that rely on both the crowd and the cloud (new on-demand, internet-based technologies that store and process data) to generate and fold Big Data into urban governance. The papers contained herein were presented as part of a one-day symposium held at the University of Illinois at Chicago (UIC) in April 2015 and sponsored by UIC’s Department of Urban Planning and Policy. Setting aside the tired narratives of individual genius and unstoppable technological progress, workshop participants sought to understand why these practices and platforms have recently gained popularity and what their implementation might mean for cities. Papers addressed numerous questions: How have institutional supports and political-economic contexts facilitated the ascendance of “crowd” and “cloud” models within different spheres of urban governance? How do their advocates position them relative to imaginaries of state or market failure/dysfunction? What kinds of assumptions and expectations are embedded in the design and operation of these platforms and practices? What kinds of institutional reconfigurations have been spurred by the push to adopt smart city initiatives? How is information collected through these initiatives being used to advance particular policy agendas? Who is likely to benefit from them?…(More)”.

Policymakers around the world are embracing behavioural science


The Economist: “In 2013 thousands of school pupils in England received a letter from a student named Ben at the University of Bristol. The recipients had just gained good marks in their GCSEs, exams normally taken at age 16. But they attended schools where few pupils progressed to university at age 18, and those that did were likely to go to their nearest one. That suggested the schools were poor at nurturing aspiration. In his letter Ben explained that employers cared about the reputation of the university a job applicant has attended. He pointed out that top universities can be a cheaper option for poorer pupils, because they give more financial aid. He added that he had not known these facts at the recipient’s age.

The letters had the effect that was hoped for. A study published in March found that after leaving school, the students who received both Ben’s letter and another, similar one some months later were more likely to be at a prestigious university than those who received just one of the letters, and more likely again than those who received none. For each extra student in a better university, the initiative cost just £45 ($58), much less than universities’ own attempts to broaden their intake. And the approach was less heavy-handed than imposing quotas for poorer pupils, an option previous governments had considered. The education department is considering rolling out the scheme….

Some critics feared that nudges would do little good, and that their effects would fade over time. Others warned that governments were straying perilously close to mass manipulation. More recently, some of the findings on which the behavioural sciences rest have been questioned, as researchers in many fields have sought to replicate famous results, and failed.

By and large those doubts have been allayed. Even if specific results turn out to be mistaken, an experimental, iterative, data-driven approach to policymaking is gaining ground in many places, not just in dedicated units, but throughout government.

Nudging is hardly new. “In Genesis, Satan nudged, and Eve did too,” writes Cass Sunstein of Harvard University. From the middle of the 20th century psychologists such as Stanley Milgram and Philip Zimbardo showed how sensitive humans are to social pressure. Daniel Kahneman and Amos Tversky described the mental shortcuts and biases that influence decision-making. Dale Carnegie and Robert Cialdini wrote popular books on persuasion. Firms, especially in technology, retail and advertising, used behavioural science to shape brand perception and customer behaviour—and, ultimately, to sell more stuff.

But governments’ use of psychological insights to achieve policy goals was occasional and unsystematic. According to David Halpern, the boss of BIT, as far as policymakers were concerned, psychology was “the sickly sibling to economics”. That began to change after Mr Sunstein and Richard Thaler, an economist, published “Nudge”, in 2008. The book attacked the assumption of rational decision-making inherent in most economic models and showed how “choice architecture”, or context, could be changed to “nudge” people to make better choices…..

Now many governments are turning to nudges to save money and do better. In 2014 the White House opened the Social and Behavioural Sciences Team. A report that year by Mark Whitehead of Aberystwyth University counted 51 countries in which “centrally directed policy initiatives” were influenced by behavioural sciences. Non-profit organisations such as Ideas42, set up in 2008 at Harvard University, help run dozens of nudge-style trials and programmes around the world. In 2015 the World Bank set up a group that is now applying behavioural sciences in 52 poor countries. The UN is turning to nudging to help hit the “sustainable development goals”, a list of targets it has set for 2030….

Among the most effective nudges are “social” ones: those that communicate norms or draw on people’s networks. A scheme tested in Guatemala with help from the World Bank and BIT tweaked the wording of letters sent to people and firms who had failed to submit tax returns the previous year. The letters that framed non-payment as an active choice, or noted that paying up is more common than evasion, cut the number of non-payers in the following year and increased the average sum paid. And a trial involving diabetes shows that it matters to nudge at the right moment. In 2014 Hamad Medical Corporation, a health-care provider in Qatar, raised take-up rates for diabetes screening by offering it during Ramadan. That meant most Qataris were fasting, so the need to do so before the test imposed no extra burden….(More)”.

A Framework for Assessing Technology Hubs in Africa


Paper by Jeremy de BeerPaula MillarJacquelen MwangiVictor B. Nzomo, and Isaac Rutenberg: “This article explains the importance of technology hubs as drivers of innovation, social change, and economic opportunity within and beyond the African continent. The article is the first to thoroughly review and synthesize findings from multi-disciplinary literature, and integrate insights from qualitative data gathered via interviews and fieldwork. It identifies three archetypes of hubs — clusters, companies, and countries — and discusses examples of each archetype using Kenya as a case study. The article discusses potential collaboration, conflicts, and competition among these archetypes of hubs, and concludes with recommendations for future researchers….(More)”

Using Open Data to Combat Corruption


Robert Palmer at Open Data Charter: “…today we’re launching the Open Up Guide: Using Open Data to Combat Corruption. We think that with the right conditions in place, greater transparency can lead to more accountability, less corruption and better outcomes for citizens. This guide builds on the work in this area already done by the G20’s anti-corruption working group, Transparency International and the Web Foundation.

Inside the guide you’ll find a number of tools including:

  • A short overview on how open data can be used to combat corruption.
  • Use cases and methodologies. A series of case studies highlighting existing and future approaches to the use of open data in the anti-corruption field.
  • 30 priority datasets and the key attributes needed so that they can talk to each other. To address corruption networks it is particularly important that connections can be established and followed across data sets, national borders and different sectors.
  • Data standards. Standards describe what should be published, and the technical details of how it should be made available. The report includes some of the relevant standards for anti-corruption work, and highlights the areas where there are currently no standards.

The guide has been developed by Transparency International-Mexico, Open Contracting Partnership and the Open Data Charter, building on input from government officials, open data experts, civil society and journalists. It’s been designed as a practical tool for governments who want to use open data to fight corruption. However, it’s still a work in progress and we want feedback on how to make it more useful. Please either comment directly on the Google Doc version of the guide, or email us at [email protected]….View the full guide.”

What next for digital social innovation? Realising the potential of people and technology to tackle social challenges


Matt Stokes et al at nesta: “This report, and accompanying guide, produced as part of the DSI4EU project, maps the projects and organisations using technology to tackle social challenges across Europe, and explores the barriers to the growth of digital social innovation.

Key findings

  • There are almost 2,000 organisations and over 1,000 projects involved in digital social innovation (DSI) across Europe, with the highest concentration of activity in Western and Southern Europe.
  • Despite this activity, there are relatively few examples of DSI initiatives delivering impact at scale. The growth of DSI is being held back by barriers at the system level and at the level of individual projects.
  • Projects and organisations involved in DSI are still relatively poorly connected to each other. There is a pressing need to grow strong networks within and across countries and regions to boost collaboration and knowledge-sharing.
  • The growth of DSI is being held back by lack of funding and investment across the continent, especially outside Western Europe, and structural digital skills shortages.
  • Civil society organisations and the public sector have been slow to adopt DSI, despite the opportunity it offers them to deliver better services at a lower cost, although there are emerging examples of good practice from across Europe.
  • Practitioners struggle to engage citizens and users, understand and measure the impact of their digital social innovations, and plan for growth and sustainability.

Across Europe, thousands of people, projects and organisations are using digital technologies to tackle social challenges in fields like healthcare, education, employment, democratic participation, migration and the environment. We call this phenomenon digital social innovation.

Through crowdmapping DSI across Europe, we find that there are almost 2,000 organisations and over 1,000 projects using open and collaborative technologies to tackle social challenges. We complement this analysis by piloting experimental data methods such as Twitter analysis to understand in further depth the distribution of DSI across Europe. You can explore the data on projects and organisations on digitalsocial.eu.

However, despite widespread activity, few initiatives have grown to deliver impact at scale, to be institutionalised, or to become “the new normal”.

In this research, we find that weak networks between stakeholders, insufficient funding and investment, skills shortages, and slow adoption by public sector and established civil society organisations is holding back the growth of DSI…(More)”.

Tech Companies Should Speak Up for Refugees, Not Only High-Skilled Immigrants


Mark Latonero at Harvard Business Review: “The Trump administration’s latest travel ban is back in U.S. federal court. The Fourth Circuit, based in Virginia, and Ninth Circuit, based in San Francisco, are hearing cases challenging the latest executive order banning immigrants and refugees from six Muslim majority countries from entering the United States. Joining the fray are 162 technology companies, whose lawyers collectively filed an amicus brief to both courts. Amazon, eBay, Google, Facebook, Netflix, and Uber are among the companies urging federal judges to rule against the executive order, detailing why it is unjust and how it would hurt their businesses.

While the 40-page brief is filled with arguments in support of immigration, it hardly speaks about refugees, except to note that those seeking protection should be welcomed. Any multinational company with a diverse workforce would be concerned about limits to international hiring and employee travel. But tech companies should also be concerned about the refugee populations that depend on their digital services for safety and survival.

In researching migration and the refugee crisis in Europe, my team and I interviewed over 140 refugees from Syria, and I’ve learned that technology has been crucial to those fleeing war and violence across the Middle East and North Africa. Services like Google Maps, Facebook, WhatsApp, Skype, and Western Union have helped refugees find missing loved ones or locate safe places to sleep. Mobile phones have been essential — refugees have even used them on sinking boats to call rescue officials patrolling the Mediterranean.

Refugees’ reliance on these platforms demonstrates what tech companies often profess: that innovation can empower people to improve their lives and society. Tech companies did not intend for their tools to facilitate one of the largest mass movements of refugees in history, but they have a responsibility to look out for the safety and security of the vulnerable consumers using their products.

Some tech companies have intervened directly in the refugee crisis. Google has created apps to help refugees in Greece find medical facilities and other services; Facebook promised to provide free Wi-Fi in U.N. refugee camps. A day after President Trump issued the first travel ban, which initially suspended the U.S. Refugee Admissions Program, Airbnb announced it would provide free housing to refugees left stranded….

The sector should extend these efforts by making sure its technologies aren’t used to target broad groups of people based on nationality or religion. Already the U.S. Customs and Border Protection (CPB) is asking for the social media accounts — even passwords — of visitors from other counties. The Council on American-Islamic Relations has filed complaints against the CPB, stating that Muslim American citizens have been subjected to enhanced screening that includes scrutiny of their social media accounts and cell phones.

Trump has talked about creating a database to identify and register Muslims in America, including refugees. A number of companies, including IBM, Microsoft, and Salesforce, have stated they will not help build a Muslim registry if asked by the government. In addition, a group of nearly 3,000 American tech employees signed an online pledge promising they would not develop data processing systems to help the U.S. government target individuals based on race, religion, or national origin….(More)”.

Building a Better Relationship Between Citizens and Governments


Felipe Estefan at Positive Returns: “Right now you don’t have to look very hard to find evidence of the tense, often broken, relationship between between citizens and their governments around the world.

Nowhere is this more apparent than in Brazil. In just the past couple of years the country has faced the impeachment of a President, numerous major corruption scandals, and most recently the news that investigations are being opened into the conduct of more than 100 high-ranking political officials.

Each of these incidents has deepened the distrust of government and those that hold privileged positions of power in Brazil. At the same time this is reinforcing the belief that those in power operate to a different set of rules that are focused on self-interest rather than public good….

When governments fail to listen to and provide the services citizens need, opportunities are removed. If we are to restore the relationship between citizens and governments many things need to change. Not the least is the ability of citizens to have their voices heard and their needs met by government, and in turn for governments to be more efficient and effective in their responses….Colab — a Brazilian civic technology startup which provides a social network for engagement between citizens and local governments.

Colab provides citizens an opportunity to report local issues and suggest urban improvements, such as potholes, illegal car parking, public lighting, broken sidewalks, among others. It also allows citizens to proactively participate in the decisions that will impact their future and the futures of those around them.

For local governments, Colab offers a workflow management and engagement tool, as well as a data analytics system to manage and respond to citizens’ requests and to better evaluate their own performance.

Colab has already reached over 130 municipalities in Brazil, including Santos, Campinas, Niteroi, and Teresina. Across the country, they have over 150,000 members. So far the platform has enabled citizens from across these municipalities to submit more than 85,000 reports, with local governments responding to over 75% of those.

For instance, in Niteroi a citizen reported an issue with the drainage in the streets. Government resolved the issue and informed the citizen through the Colab platform. In a similar case in Pelotas, a citizen reported an issue with a pothole which government didn’t address correctly. Using the Colab platform the citizen engaged with government again to ensure to appropriate resolution of the issue. Similar cases in which government has successfully addressed the issues reported by citizens can be found in municipalities from Teresina to Recife.

Colab has been so successful at creating a vital bridge between citizens and local governments that it is now being used for a wide-range of purposes, from conducting participatory budgeting consultations to managing the outbreak of Zika….(More)”.

Making cities wiser – Crowdsourcing for better decisions


Maarit Kahila and Anna Broberg at FIG: “The need in urban planning to make knowledge-driven decisions has spurred the creation of new solutions to gather and utilize insight from residents. Participatory planning has often been realized through workshops and during face-to-face encounters, but little of the knowledge gathered in these situations is of use in further urban planning and city development. New technological innovations, such as map-based public participation tools, support gathering information that matters and makes cities wiser. Interaction with citizens not only creates information, but supports also learning and innovation building, and creates trusts.

Technological innovations like Maptionnaire help gather information that makes cities wiser. Maptionnaire is a leading solution for collecting, analyzing and discussing resident insight on a map. With the help of Maptionnaire, various cities have been able to change their modus operandi. Through these learning processes actors from different sectors of the city are brought together to create joint understanding of the possibilities of public participation. Cities have started to value and use resident input as an equally important part of its knowledge base for planning. There is a great potential for more efficient use of participatory tools to make processes smoother and to save money. Future development work is needed to further facilitate knowledge transfer from residents to the use of planners and other city officials.

In our presentation we will present different innovative case studies from Finland and abroad where Maptionnaire has been used to support two-way communication in different phases of planning processes. Based on our findings we will draft a new public participation model that assist the effective gathering of experiential knowledge from inhabitants, provide high quality place-based data for various analysis and informs participants about the stage and goals of the planning process more innovatively….(More)”.

CityDash: Visualising a Changing City Using Open Data


Chapter by Christopher Pettit, Scott N. Lieske and Murad Jamal in Planning Support Science for Smarter Urban Futures: “In an increasingly urbanised world, there are pressures being placed on our cities, which planners, decision-makers, and communities need to be able to respond to. Data driven responses and tools that can support the communication of information, and indicators on a city’s performance are becoming increasingly available and have the potential to play a critical role in understanding and managing complex urban systems . In this research, we will review international efforts in the creation of city dashboards and introduce the City of Sydney Dashboard, known as CityDash. This chapter culminates in a number of recommendations for city dashboards’ implementation. The recommendations for city dashboards include: consolidated information on a single web page, live data feeds relevant to planners and decision-makers as well as citizens’ daily lives, and site analytics as a way of evaluating user interactions and preferences….(More)”.