Open Data Index 2015


Open Knowledge: “….This year’s Index showed impressive gains from non-OECD countries with Taiwan topping the Index and Colombia and Uruguay breaking into the top ten at four and seven respectively. Overall, the Index evaluated 122 places and 1586 datasets and determined that only 9%, or 156 datasets, were both technically and legally open.

The Index ranks countries based on the availability and accessibility of data in thirteen key categories, including government spending, election results, procurement, and pollution levels. Over the summer, we held a public consultation, which saw contributions from individuals within the open data community as well as from key civil society organisations across an array of sectors. As a result of this consultation, we expanded the 2015 Index to include public procurement data, water quality data, land ownership data and weather data; we also decided to removed transport timetables due to the difficulties faced when comparing transport system data globally.

Open Knowledge International began to systematically track the release of open data by national governments in 2013 with the objective of measuring if governments were releasing the key datasets of high social and democratic value as open data. That enables us to better understand the current state of play and in turn work with civil society actors to address the gaps in data release. Over the course of the last three years, the Global Open Data Index has become more than just a benchmark – we noticed that governments began to use the Index as a reference to inform their open data priorities and civil society actors began to use the Index advocacy tool to encourage governments to improve their performance in releasing key datasets.

Furthermore, indices such as the Global Open Data Index are not without their challenges. The Index measures the technical and legal openness of datasets deemed to be of critical democratic and social value – it does not measure the openness of a given government. It should be clear that the release of a few key datasets is not a sufficient measure of the openness of a government. The blurring of lines between open data and open government is nothing new and has been hotly debated by civil society groups and transparency organisations since the sharp rise in popularity of open data policies over the last decade. …Index at http://index.okfn.org/”

The Internet’s Loop of Action and Reaction Is Worsening


Farhad Manjoo in the New York Times: “Donald J. Trump and Hillary Clinton said this week that we should think about shutting down parts of the Internet to stop terrorist groups from inspiring and recruiting followers in distant lands. Mr. Trump even suggested an expert who’d be perfect for the job: “We have to go see Bill Gates and a lot of different people that really understand what’s happening, and we have to talk to them — maybe, in certain areas, closing that Internet up in some way,” he said on Monday in South Carolina.

Many online responded to Mr. Trump and Mrs. Clinton with jeers, pointing out both constitutional and technical limits to their plans. Mr. Gates, the Microsoft co-founder who now spends much of his time on philanthropy, has as much power to close down the Internet as he does to fix Mr. Trump’s hair.

Yet I had a different reaction to Mr. Trump and Mrs. Clinton’s fantasy of a world in which you could just shut down parts of the Internet that you didn’t like: Sure, it’s impossible, but just imagine if we could do it, just for a bit. Wouldn’t it have been kind of a pleasant dream world, in these overheated last few weeks, to have lived free of social media?

Hear me out. If you’ve logged on to Twitter and Facebook in the waning weeks of 2015, you’ve surely noticed that the Internet now seems to be on constant boil. Your social feed has always been loud, shrill, reflexive and ugly, but this year everything has been turned up to 11. The Islamic State’s use of the Internet is perhaps only the most dangerous manifestation of what, this year, became an inescapable fact of online life: The extremists of all stripes are ascendant, and just about everywhere you look, much of the Internet is terrible.“The academic in me says that discourse norms have shifted,” said Susan Benesch, a faculty associate at Harvard’s Berkman Center for Internet & Society and the director of the Dangerous Speech Project, an effort to study speech that leads to violence. “It’s become so common to figuratively walk through garbage and violent imagery online that people have accepted it in a way. And it’s become so noisy that you have to shout more loudly, and more shockingly, to be heard.”

You might argue that the angst online is merely a reflection of the news. Terrorism, intractable warfare, mass shootings, a hyperpartisan presidential race, police brutality, institutional racism and the protests over it have dominated the headlines. It’s only natural that the Internet would get a little out of control over that barrage.

But there’s also a way in which social networks seem to be feeding a cycle of action and reaction. In just about every news event, the Internet’s reaction to the situation becomes a follow-on part of the story, so that much of the media establishment becomes trapped in escalating, infinite loops of 140-character, knee-jerk insta-reaction.

“Presidential elections have always been pretty nasty, but these days the mudslinging is omnipresent in a way that’s never been the case before,” said Whitney Phillips, an assistant professor of literary studies and writing at Mercer University, who is the author of “This Is Why We Can’t Have Nice Things,” a study of online “trolling.” “When Donald Trump says something that I would consider insane, it’s not just that it gets reported on by one or two or three outlets, but it becomes this wave of iterative content on top of content on top of content in your feed, taking over everything you see.”

The spiraling feedback loop is exhausting and rarely illuminating. The news brims with instantly produced “hot takes” and a raft of fact-free assertions. Everyone — yours truly included — is always on guard for the next opportunity to meme-ify outrage: What crazy thing did Trump/Obama/The New York Times/The New York Post/Rush Limbaugh/etc. say now, and what clever quip can you fit into a tweet to quickly begin collecting likes?

There is little room for indulging nuance, complexity, or flirting with the middle ground. In every issue, you are either with one aggrieved group or the other, and the more stridently you can express your disdain — short ofhurling profanities at the president on TV, which will earn you a brief suspension — the better reaction you’ll get….(More)”

New frontiers in social innovation research


Geoff Mulgan: “Nesta has published a new book with Palgrave which contains an introduction by me and many important chapters from leading academics around the world. I hope that many people will read it, and think about it, because it challenges, in a highly constructive way, many of the rather tired assumptions of the London media/political elite of both left and right.

The essay is by Roberto Mangabeira Unger, perhaps the world’s most creative and important contemporary intellectual. He is Professor of Law at Harvard (where he taught Obama); a philosopher and political theorist; author of one of the most interesting recent books on religion; co-author of an equally ground-breaking recent book on theoretical physics; and serves as strategy minister in the Brazilian government.

His argument is that a radically different way of thinking about politics, government and social change is emerging, which has either not been noticed by many political leaders, or misinterpreted. The essence of the argument is that practice is moving faster than theory; that systematic experimentation is a faster way to solve problems than clever authorship of pamphlets, white papers and plans; and that societies have the potential to be far more active agents of their own future than we assume.

The argument has implications for many fields. One is think-tanks. Twenty years ago I set up a think-tank, Demos. At that time the dominant model for policy making was to bring together some clever people in a capital city to write pamphlets, white papers and then laws. In the 1950s to 1970s a primary role was played by professors in universities, or royal commissions. Then it shifted to think-tanks. Sometimes teams within governments played a similar role – and I oversaw several of these, including the Strategy Unit in government. All saw policy as an essentially paper-based process, involving a linear transmission from abstract theories and analyses to practical implementation.

There’s still an important role to be played by think-tanks. But an opposite approach has now become common, and is promoted by Unger. In this approach, practice precedes theory. Experiment in the real world drives the development of new ideas – in business, civil society, and on the edges of the public sector. Learning by doing complements, and often leads analysis. The role of the academics and think-tanks shifts from inventing ideas to making sense of what’s emerging, and generalising it. Policies don’t try to specify every detail but rather set out broad directions and then enable a process of experiment and discovery.

As Unger shows, this approach has profound philosophical roots (reaching back to the 19th century pragmatists and beyond), and profound political implications (it’s almost opposite to the classic Marxist view, later adopted by the neoliberal right, in which intellectuals define solutions in theory which are then translated into practice). It also has profound implications for civil society – which he argues should adopt a maximalist rather than a minimalist view of social innovation.

The Unger approach doesn’t work for everything – for example, constitutional reform. But it is a superior method for improving most of the fields where governments have power – from welfare and health, to education and economic policy, and it has worked well for Nesta – evolving new models of healthcare, working with dozens of governments to redesign business policy, testing out new approaches to education.

The several hundred public sector labs and innovation teams around the world – from Chile to China, south Africa to Denmark – share this ethos too, as do many political leaders. Michael Bloomberg has been an exemplar, confident enough to innovate and experiment constantly in his time as New York Mayor. Won Soon Park in Korea is another…..

Unger’s chapter should be required reading for anyone aspiring to play a role in 21st century politics. You don’t have to agree with what he says. But you do need to work out where you disagree and why….(New Frontiers in Social Innovation Research)

The ‘data revolution’ will be open


Martin Tisne at Devex: “There is a huge amount of talk about a “data revolution.” The phrase emerged in the years preceding this September’s announcement of the Sustainable Development Goals, and has recently been strongly reaffirmed by the launch of a Global Partnership on Sustainable Development Data.

The importance of data in measuring, assessing and verifying the new SDGs has been powerfully made and usually includes a mention of the data needing to be “open.” However, the role of “open” has not been clearly articulated. Fundamentally, the discussion focuses on the role of data (statistics, for example) in decision-making, and not on the benefits of that data being open to the public. Until this case is made, difficult decisions to make data open will go by the wayside.

Much of the debate justly focuses on why data matters for decision-making. Knowing how many boys and girls are in primary and secondary schools, how good their education is, and the number of teachers in their schools, are examples of relevant data used in shaping education delivery, and perhaps policy. Likewise, new satellite and cellphone data can help us prevent and understand the causes of death by HIV and AIDS, tuberculosis, and malaria.

Proponents of the data revolution make powerful points, such as that 1 in 3 births go unregistered. If you are uncounted, you will be ignored. If you don’t have an identity, you do not exist.

Yet as important as this information is, I still can’t help but think: Do we change the course of history with the mere existence of more data or because people access it, mobilize and press for change?

We need an equally eloquent narrative for why open data matters and what it means.

To my thinking, we need the data to be open because we need to hold governments accountable for their promises under the SDGs, in order to incentivize action. The data needs to be available, accessible and comparable to enable journalists and civil society to prod, push and test the validity of these promises. After all, what good are the goals if governments do not deliver, beginning with the funding to implement? We will need to know what financial resources, both public and private, will be put to work and what budget allocations governments will make in their draft budgets. We need to have those debates in the open, not in smoke-filled rooms.

Second, the data needs to be open in order to be verified, quality-checked and improved. …(More)”

For people, by people


Geeta Padmanabhan at the Hindu: “Ippodhu, a mobile app, is all about crowd-sourced civic participation for good governance…Last week, a passer-by noticed how the large hoardings outside Vivekanandar Illam, facing Marina Beach, blocked the view of the iconic building. Enraged, he whipped out his smartphone, logged on to Ippodhu and wrote: “How is this allowed? The banners are in the walking space and we can’t see the historic building!” Ippodhu.com carried the story with pictures.

“On Ippodhu, a community information mobile application, the person complaining has the option to do more,” says Peer Mohamed, the team leader of the app/website. “He could have registered a complaint with the police, the Corporation or a relevant NGO, using the ‘Act’ option. This facility makes Ippodhu a valuable tool for beleaguered citizens to complain and puts it above other social media avenues.”

Users can choose between Tamil and English, and read the latest posts just as they would in a Twitter feed. While posting, your location is geo-tagged automatically; if you find that intrusive, you can post anonymously. There is no word limit and one can enlarge the font, write an essay, a note or a rant and post it under one of 15 categories. I decided to check out the app and created an account. My post went live in less than a minute. Then I moved to Ippodhu’s USP. I clicked‘Act’, chose ‘civic issue’ as the category, and posted a note about flooding in my locality. “It’s on Apple and Android as just text now, but expect picture and video features soon when the circulation hits the target,” says Peer. “My team of 12 journalists curates the feeds 24/7, allowing no commercials, ads or abusive language. We want to keep it non-controversial and people-friendly.” It’s crowd-sourced citizen journalism and civic participation for good governance….(More)”

Artificial Intelligence Aims to Make Wikipedia Friendlier and Better


Tom Simonite in MIT Technology Review: “Software trained to know the difference between an honest mistake and intentional vandalism is being rolled out in an effort to make editing Wikipedia less psychologically bruising. It was developed by the Wikimedia Foundation, the nonprofit organization that supports Wikipedia.

One motivation for the project is a significant decline in the number of people considered active contributors to the flagship English-language Wikipedia: it has fallen by 40 percent over the past eight years, to about 30,000. Research indicates that the problem is rooted in Wikipedians’ complex bureaucracy and their often hard-line responses to newcomers’ mistakes, enabled by semi-automated tools that make deleting new changes easy (see “The Decline of Wikipedia”).

Aaron Halfaker, a senior research scientist at Wikimedia Foundation who helped diagnose that problem, is now leading the project trying to fight it, which relies on algorithms with a sense for human fallibility. His ORES system, for “Objective Revision Evaluation Service,” can be trained to score the quality of new changes to Wikipedia and judge whether an edit was made in good faith or not….

ORES can allow editing tools to direct people to review the most damaging changes. The software can also help editors treat rookie or innocent mistakes more appropriately, says Halfaker. “I suspect the aggressive behavior of Wikipedians doing quality control is because they’re making judgments really fast and they’re not encouraged to have a human interaction with the person,” he says. “This enables a tool to say, ‘If you’re going to revert this, maybe you should be careful and send the person who made the edit a message.’”

..Earlier efforts to make Wikipedia more welcoming to newcomers have been stymied by the very community that’s supposed to benefit. Wikipedians rose up in 2013 when Wikimedia made a word-processor-style editing interface the default, forcing the foundation to make it opt-in instead. To this day, the default editor uses a complicated markup language called Wikitext…(More)”

Tech and Innovation to Re-engage Civic Life


Hollie Russon Gilman at the Stanford Social Innovation Review: “Sometimes even the best-intentioned policymakers overlook the power of people. And even the best-intentioned discussions on social impact and leveraging big data for the social sector can obscure the power of every-day people in their communities.

But time and time again, I’ve seen the transformative power of civic engagement when initiatives are structured well. For example, the other year I witnessed a high school student walk into a school auditorium one evening during Boston’s first-ever youth-driven participatory budgeting project. Participatory budgeting gives residents a structured opportunity to work together to identify neighborhood priorities, work in tandem with government officials to draft viable projects, and prioritize projects to fund. Elected officials in turn pledge to implement these projects and are held accountable to their constituents. Initially intrigued by an experiment in democracy (and maybe the free pizza), this student remained engaged over several months, because she met new members of her community; got to interact with elected officials; and felt like she was working on a concrete objective that could have a tangible, positive impact on her neighborhood.

For many of the young participants, ages 12-25, being part of a participatory budgeting initiative is the first time they are involved in civic life. Many were excited that the City of Boston, in collaboration with the nonprofit Participatory Budgeting Project, empowered young people with the opportunity to allocate $1 million in public funds. Through participating, young people gain invaluable civic skills, and sometimes even a passion that can fuel other engagements in civic and communal life.

This is just one example of a broader civic and social innovation trend. Across the globe, people are working together with their communities to solve seemingly intractable problems, but as diverse as those efforts are, there are also commonalities. Well-structured civic engagement creates the space and provides the tools for people to exert agency over policies. When citizens have concrete objectives, access to necessary technology (whether it’s postcards, trucks, or open data portals), and an eye toward outcomes, social change happens.

Using Technology to Distribute Expertise

Technology is allowing citizens around the world to participate in solving local, national, and global problems. When it comes to large, public bureaucracies, expertise is largely top-down and concentrated. Leveraging technology creates opportunities for people to work together in new ways to solve public problems. One way is through civic crowdfunding platforms like Citizinvestor.com, which cities can use to develop public sector projects for citizen support; several cities in Rhode Island, Oregon, and Philadelphia have successfully pooled citizen resources to fund new public works. Another way is through citizen science. Old Weather, a crowdsourcing project from the National Archives and Zooniverse, enrolls people to transcribe old British ship logs to identify climate change patterns. Platforms like these allow anyone to devote a small amount of time or resources toward a broader public good. And because they have a degree of transparency, people can see the progress and impact of their efforts. ….(More)”

Assessing the Evidence: The Effectiveness and Impact of Public Governance-Oriented Multi-Stakeholder Initiatives


Paper by Brandon Brockmyer and Jonathan A. Fox: “Transnational multi-stakeholder initiatives (MSIs) – voluntary partnerships between governments, civil society, and the private sector – are an increasingly prevalent strategy for promoting government responsiveness and accountability to citizens. While most transnational MSIs involve using voluntary standards to encourage socially and environmentally responsible private sector behavior, a handful of these initiatives – the Extractive Industries Transparency Initiative (EITI), the Construction Sector Transparency Initiative (CoST), the Open Government Partnership (OGP), the Global Initiative on Fiscal Transparency (GIFT) and the Open Contracting Partnership (OCP) – focus on information disclosure and participation in the public sector. Unlike private sector MSIs, which attempt to supplement weak government capacity to enforce basic social and environmental standards through partnerships between businesses and civil society, public sector MSIs ultimately seek to bolster public governance. But how exactly are these MSIs supposed to work? And how much has actually been achieved?

The purpose of this study is to identify and consolidate the current state of the evidence for public governance-oriented MSI effectiveness and impact. Researchers collected over 300 documents and interviewed more than two-dozen MSI stakeholders about their experiences with five public governance oriented multi-stakeholder initiatives.

This report provides a ‘snapshot’ of the evidence related to these five MSIs, and suggests that the process of leveraging transparency and participation through these initiatives for broader accountability gains remains uncertain. The report highlights the ongoing process of defining MSI success and impact, and how these initiatives intersect with other accountability actors and processes in complex ways. The study closes with key recommendations for MSI stakeholders….(More)”

‘Refoodgee’ App Connects Berlin Locals With Refugees Through Food


Alexandra Ma at HuffPost: “A group of German tech entrepreneurs wants to help refugees in their country by providing them with an enriching way to receive meals and make connections to their new communities.

Five members of Berlin-based startup Memorado created “Refoodgee,” an app that helps pair newly arrived refugees with the city’s locals based on food preferences and shared languages.

The Memorado team built the app during #HackWeek15, a hackathon hosted by the startup that ran from Sept. 28 to Oct. 1 in Werbellinsee, Germany. The conference was focused on creating apps to help refugees entering the country with aspects of their daily lives, and “Refoodgee” was one of the products that came out of the event.

<span class='image-component__caption' itemprop="caption">The "Refoodgee" app helps connect refugees in Berlin to the city's locals.</span>
MEMORADO The “Refoodgee” app helps connect refugees in Berlin to the city’s locals.

To use the app, refugees and locals can sign up for a free account as either a dinner guest or host. They then provide information including their countries of origin, languages spoken and preferred cuisine. Locals can then invite refugees to a meal, which the refugees can either accept or decline…

“Refoodgee” is also just one of many efforts to help newcomers integrate into German society through technology. A Berlin-based nonprofit called “Refugees on Rails” is gearing up to teach refugees how to code in order to help them find jobs at European technology firms. And last month, online academic institution Kiron University also started enrolling refugee students in free, three-year university-level courses that will culminate in a degree….(More)”

Will Open Data Policies Contribute to Solving Development Challenges?


Fabrizio Scrollini at IODC: “As the international open data charter  gains momentum  in the context of the wider development agenda related to the sustainable development goals set by the United Nations, a pertinent question to ask is: will open data policies contribute to solve development challenges? In this post  I try to answer this question grounded in recent Latin American experience to contribute to a global debate.

Latin America has been exploring open data since 2013, when  the first open data unconference (Abrelatam)and  conference took place in Montevideo. In September 2015 in Santiago de Chile a vibrant community of activists, public servants, and entrepreneurs gathered  in the third edition of Abrelatam and Condatos. It is now a more mature community. The days where it was sufficient to  just open a few datasets and set  up a portal are now gone. The focus of this meeting was on collaboration and use of data to address several social challenges.

Take for instance the health sector. Transparency in this sector is key to deliver better development goals. One of the panels at Condatos showed three different ways to use data to promote transparency and citizen empowerment in this sector. A tu servicio, a joint venture of DATA  and the Uruguayan Ministry of Health helped to standardize and open public datasets that allowed around 30,000 users to improve the way they choose health providers. Government-civil society collaboration was crucial in this process in terms pooling resources and skills. The first prototype was only possible because some data was already open.

This contrasts with Cuidados Intensivos, a Peruvian endeavour  aiming to provide key information about the health sector. Peruvian activists had to fill right to information requests, transform, and standardize data to eventually release it. Both experiences demanded a great deal of technical, policy, and communication craft. And both show the attitudes the public sector can take: either engaging or at the very best ignoring the potential of open data.

In the same sector look at a recent study dealing with Dengue and open data developed by our research initiative. If international organizations and countries were persuaded to adopt common standards for Dengue outbreaks, they could be potentially predicted if the right public data is available and standardized. Open data in this sector not only delivers accountability but also efficiency and foresight to allocate scarce resources.

Latin American countries – gathered in the open data group of the Red Gealc – acknowledge the increasing public value of open data. This group engaged constructively in Condatos with the principles enshrined in the charter and will foster the formalization of open data policies in the region. A data revolution won’t yield results if data is closed. When you open data you allow for several initiatives to emerge and show its value.

Once a certain level of maturity is reached in a particular sector, more than data is needed.  Standards are crucial to ensure comparability and ease the collection, processing, and use of open government data. To foster and engage with open data users is also needed,  as several strategies deployed by some Latin American cities show.

Coming back to our question: will open data policies contribute to solve development challenges?  The Latin American experience shows evidence that  it will….(More)”