We must create a culture of “open data makers”


Rufus Pollock (@rufuspollock), Founder and Director of the Open Knowledge Foundation: “Open data and open knowledge are fundamentally about empowerment, about giving people – citizens, journalists, NGOs, companies and policy-makers – access to the information they need to understand and shape the world around them.

Through openness, we can ensure that technology and data improve science, governance, and society. Without it, we may see the increasing centralisation of knowledge – and therefore power – in the hands of the few, and a huge loss in our potential, individually and collectively, to innovate, understand, and improve the world around us.

Open data is data that can be freely accessed, used, built upon and shared by anyone, for any purpose. With digital technology – from mobiles to the internet – increasingly everywhere, we’re seeing a data revolution. Its a revolution both in the amount of data available and in our ability to use, and share, that data. And it’s changing everything we do – from how we travel home from work to how scientists do research, to how government set policy….

its about people, the people who use data, and the people who use the insights from that data to drive change. We need to create a culture of “open data makers”, people able and ready to make apps and insights with open data. We need to connect open data with those who have the best questions and the biggest needs – a healthcare worker in Zambia, the London commuter travelling home – and go beyond the data geeks and the tech savvy.”

Power to the people: how open data is improving health service delivery


The Guardian: “…What’s really interesting is how this data can be utilised by citizens to enable them to make more informed choices and demand improved services in sectors such as health. A growing community of technologists and social activists is emerging across Africa, supported by a burgeoning network of technology innovation hubs. They’re beginning to explore the ways in which data can be utilised to improve health outcomes.
In Northern Uganda, the brutal Lord’s Resistance Army conflict displaced two million people, leaving the social infrastructure in tatters. In 2008, the government launched a Peace, Recovery and Development Plan, but progress has been limited. There are insufficient health centres to serve the population, a severe shortage of staff, drugs and equipment, and corruption is widespread.
Cipesa – an organisation that uses communication technologies to support poverty reduction and development – and Numec, a local media organisation, have launched the iParticipate project. A multimedia platform is being populated with baseline data outlining the current status of the health service across three districts….
In the same region, Wougnet is training women to use information technologies to tackle social challenges. Local officials and community members have formed voluntary social accountability committees and been trained in the use of an online platform to capture and store information relating to poor governance and corruption in the health sector, often via mobile phones.
The platform strengthened campaign efforts which resulted in the construction of a health centre in Aloni Parish. In Amuru district, five health workers were arrested following reports highlighting negligence.
In the village of Bagega in Nigeria, 400 children died and thousands suffered significant health problems as the result of lead poisoning caused by poor mining practices. The government pledged $5.3m (£3.23m) for remediation, but the funds never reached the affected region.
A local organisation, Follow the Money, created an infographic highlighting the government’s commitments and combined this with real life testimonies and photographs showing the actual situation on the ground. Within 48 hours of a targeted Twitter campaign, the president committed to releasing funds to the village and, in February this year, children started receiving long overdue medical attention.
All these initiatives depend on access to critical government data and an active citizens who feel empowered to effect change in their own lives and communities. At present, it’s often hard to access data which is sufficiently granular, particularly at district or local level. For citizens to be engaged with information from government, it also needs to be accessible in ways that are simple to understand and linked to campaigns that impact their daily lives.
Tracking expenditure can also operate across borders. Donors are beginning to open up aid data by publishing to the IATI registry. This transparency by donor governments should improve the effectiveness of aid spending and contribute towards improved health outcomes.
It’s hard to draw general conclusions about how technology can contribute towards improving health outcomes, particularly when context is so critical and the field is so new. Nonetheless, some themes are emerging which can maximise the chances of an intervention’s success.
It can at times be challenging to encourage citizens to report for an array of reasons, including a lack of belief in their ability to effect change, cultural norms, a lack of time and both perceived and real risks. Still, participation seems to increase when citizens receive feedback from reports submitted and when mechanisms are in place that enable citizens to take collective action. On-the-ground testimonies and evidence can also help shift public opinion and amplify critical messages.
Interventions are dramatically strengthened when integrated into wider programmes, implemented by organisations that have established a strong relationship with the communities in which they work. They need to be backed by at least one strong civil society organisation that can follow up on any reports, queries or challenges which may arise. Where possible, engagement from government and local leaders can make a real difference. Identifying champions within government can also significantly improve responsiveness.”

6 Projects That Make Data More Accessible Win $100,000 Each From Gates


Chronicle of Philanthropy: “Six nonprofit projects that aim to combine multiple sets of data to help solve social problems have each won $100,000 grants from the Bill & Melinda Gates Foundation…The winners:
• Pushpa Aman Singh, who founded GuideStar India as an effort of the Civil Society Information Services India. GuideStar India is the most comprehensive database of India’s registered charities. It has profiles of more than 4,000 organizations, and Ms. Singh plans to expand that number and the types of information included.
• Development Initiatives, an international aid organization, to support its partnership with the Ugandan nonprofit Development Research and Training. Together, they are trying to help residents of two districts in Uganda identify a key problem the communities face and use existing data sets to build both online and offline tools to help tackle that challenge…
• H.V. Jagadish, at the University of Michigan, to develop a prototype that will merge sets of incompatible geographic data to make them comparable. Mr. Jagadish, a professor of electrical engineering and computer science, points to crime precincts and school districts as an example. “We want to understand the impact of education on crime, but the districts don’t quite overlap with the precincts,” he says. “This tool will address the lack of overlap.”
• Vijay Modi, at Columbia University, to work with government agencies and charities in Nigeria on a tool similar to Foursquare, the social network that allows people to share their location with friends. Mr. Modi, a mechanical-engineering professor and faculty member of the university’s Earth Institute, envisions a tool that will help people find important resources more easily…
• Gisli Olafsson and his team at NetHope, a network of aid organizations. The group is building a tool to help humanitarian charities share their data more widely and in real time—potentially saving more lives during disasters…
• Development Gateway, a nonprofit that assists international development charities with technology, and GroundTruth Initiative, a nonprofit that helps residents of communities learn mapping and media skills. The two groups want to give people living in the slums of Nairobi, Kenya, more detailed information about local schools…”

Citizen participation in municipal budgeting: Origins, practices, impact


Leighton Walter Kille: “Citizen participation in governance is generally limited to the ballot box in the United States: If you don’t like what the last year’s crop of politicians is up to, throw them out of office next year. Residents almost never have a say on budget decisions beyond holding protests at press conferences or picketing city hall. Appointed community boards are found in New York and other municipalities, but their roles are strictly advisory. Still, more participation can lead to greater perceptions of procedural fairness and support for government, some research has shown.

For residents of other countries, more options exist. A practice known as “participatory budgeting” (PB) allows citizens to determine how some government funds are used. As detailed in a 2010 study by political scientist Yves Sintomer of the University of Paris and others, “Learning from the South: Participatory Budgeting Worldwide,” it was first developed in Porto Alegre, Brazil, in the late 1980s. Residents took part in local and citywide assemblies to help establish spending priorities for a select portion of the city’s spending budget. Larger issues such as taxation, debt service and pensions were specifically excluded. (A 2003 study from the Inter-American Development Bank and Harvard University goes deep into the specifics of the Brazilian experience.)
Since this beginning, participatory budgeting has spread to hundreds of other cities around the world, Sintomer and his team state: “There are between 511 and 920 participatory budgets in Latin America: more than the half of the participatory budgets in the world, where we can count between 795 and 1,469 experiences.” The range of numbers is an indication of how widely definition of participatory budgeting varies. Interest in the United States has been growing, with a number of New York council districts using the technique, as well as Chicago and Vallejo, California.
A 2013 paper in the International Journal of Urban and Regional Research, “The Struggle for a Voice: Tensions between Associations and Citizens in Participatory Budgeting,” notes that “the heterogeneous nature of the existing experiments calls into question even the possibility of defining [participatory budgeting].” Similarly, in a 2012 issue of the Journal of Public Deliberation dedicated to the issue, the authors note that “there is no standardized set of ‘best practices’ that governments are adopting, but there are a broader set of principles that are adapted by local governments to meet local circumstances.” Writing in the issue, Brian Wampler of Boise State University, states that there are four main principles: active citizen participation; increased citizen authority; improved governmental transparency; and reallocation of resources to improve social justice.
A 2013 study in the American Review of Public Administration, “Citizen Input in the Budget Process: When Does It Matter Most?” examines the impact of public participation on organizational effectiveness. The researchers, Hai (David) Guo and Milena I. Neshkova of Florida International University, used survey data from state departments of transportation to examine the effectiveness of citizen input at four different stages of the budgeting process: information sharing, budget discussion, budget decision and program assessment.
The findings of the study include:

  • Citizen participation is positively correlated with higher organizational performance. “In general if a state DOT adopts more citizen input strategies in the budget process, it achieves better outcomes. In other words, other things held equal, more citizen participation in the budget process is associated with fewer poor-quality roads and less fatalities on state highways.”
  • In terms of road condition, citizen participation makes a difference at all but the budget discussion stage.
  • Overall, citizen input matters most at the information-sharing and program-assessment stages. Consequently, “public managers should seek public input at these stages not only because it is normatively desirable but also for the very practical reasons of achieving better performance. When conveyed at the information-sharing stage, citizens’ preferences can be taken into account by decision makers and incorporated into the budget priorities.”

From Crowdsourcing to Crowdseeding: The Cutting Edge of Empowerment?


New chapter by Peter van der Windt in the book Bits and Atoms: Information and Communication Technology in Areas of Limited Statehood: “In 2009 Columbia University launched a pilot project in the Kivus region of the Democratic Republic of Congo called Voix des Kivus. The point of the project was to examine the potential for using SMS technology to gather conflict event data in real-time. Given previous experiences in Eastern Congo, the research team expected that collecting high-quality event data in Eastern Congo in the traditional way (sending out enumerator teams) would be challenging, while using traditional approaches to collect event information in real-time would be impossible. As a result the team launched an SMS-based pilot project called Voix des Kivus. Parts of the Kivus have cellphone coverage, and cellphones are relatively inexpensive. Moreover, while enumerator teams have problems crossing bad roads or washed-away bridges, phone-signals do not. Finally, an SMS-message sent is received
instantaneously.
The Voix des Kivus project used a “crowdseeding” approach which combines the innovations of crowdsourcing with standard principles of survey research and
statistical analysis. It used a sampling frame, selected sites through systematic random sampling, and identified specific reporters in each site. Researchers then
“seeded” mobile phones to select “phoneholders” and trained them on how to use the system and what to report. Only these pre-selected reporters could contribute
into the system, rather than anyone with a mobile phone or connection of some sort, as it the case with standard crowdsourcing platforms.
This chapter draws on this experience to discuss how such ICT projects might empower populations by enabling the collection and distribution of information as an alternative mechanism of governance…”

Findings from the emerging field of Transparency Research


Tiago Peixoto: “HEC Paris has just hosted the 3rd Global Conference on Transparency Research, and they have made the list of accepted papers available. …
As one goes through the papers,  it is clear that unlike most of the open government space, when it comes to research, transparency is treated less as a matter of technology and formats and more as a matter of social and political institutions.  And that is a good thing.”
This year’s papers are listed below:

Open Data Barometer


Press Release by the Open Data Research Network: “New research by World Wide Web Foundation and Open Data Institute shows that 55% of countries surveyed have open data initiatives in place, yet less than 10% of key government datasets across the world are truly open to the public…the Open Data Barometer. This 77-country study, which considers the interlinked areas of policy, implementation and impact, ranks the UK at number one. The USA, Sweden, New Zealand, Denmark and Norway (tied) make up the rest of the top five. Kenya is ranked as the most advanced developing country, outperforming richer countries such as Ireland, Italy and Belgium in global comparisons.

The Barometer reveals that:

  • 55% of countries surveyed have formal open data policies in place.

  • Valuable but potentially controversial datasets – such as company registers and land registers – are among the least likely to be openly released. It is unclear whether this stems from reluctance to drop lucrative access charges, or from desire to keep a lid on politically sensitive information, or both. However, the net effect is to severely limit the accountability benefits of open data.

  • When they are released, government datasets are often issued in inaccessible formats. Across the nations surveyed, fewer that than 1 in 10 key datasets that could be used to hold governments to account, stimulate enterprise, and promote better social policy, are available and truly open for re-use.

The research also makes the case that:

  • Efforts should be made to empower civil society, entrepreneurs and members of the public to use government data made available, rather than simply publishing data online.

  • Business activity and innovation can be boosted by strong open data policies.  In Denmark, for example, free of charge access to address data has had a significant economic impact. In 2010, an evaluation recorded an estimated financial benefit to society of EUR 62 million against costs of EUR 2million.”

Open Data Index provides first major assessment of state of open government data


Press Release from the Open Knowledge Foundation: “In the week of a major international summit on government transparency in London, the Open Knowledge Foundation has published its 2013 Open Data Index, showing that governments are still not providing enough information in an accessible form to their citizens and businesses.
The UK and US top the 2013 Index, which is a result of community-based surveys in 70 countries. They are followed by Denmark, Norway and the Netherlands. Of the countries assessed, Cyprus, St Kitts & Nevis, the British Virgin Islands, Kenya and Burkina Faso ranked lowest. There are many countries where the governments are less open but that were not assessed because of lack of openness or a sufficiently engaged civil society. This includes 30 countries who are members of the Open Government Partnership.
The Index ranks countries based on the availability and accessibility of information in ten key areas, including government spending, election results, transport timetables, and pollution levels, and reveals that whilst some good progress is being made, much remains to be done.
Rufus Pollock, Founder and CEO of the Open Knowledge Foundation said:

Opening up government data drives democracy, accountability and innovation. It enables citizens to know and exercise their rights, and it brings benefits across society: from transport, to education and health. There has been a welcome increase in support for open data from governments in the last few years, but this Index reveals that too much valuable information is still unavailable.

The UK and US are leaders on open government data but even they have room for improvement: the US for example does not provide a single consolidated and open register of corporations, while the UK Electoral Commission lets down the UK’s good overall performance by not allowing open reuse of UK election data.
There is a very disappointing degree of openness of company registers across the board: only 5 out of the 20 leading countries have even basic information available via a truly open licence, and only 10 allow any form of bulk download. This information is critical for range of reasons – including tackling tax evasion and other forms of financial crime and corruption.
Less than half of the key datasets in the top 20 countries are available to re-use as open data, showing that even the leading countries do not fully understand the importance of citizens and businesses being able to legally and technically use, reuse and redistribute data. This enables them to build and share commercial and non-commercial services.
To see the full results: https://index.okfn.org. For graphs of the data: https://index.okfn.org/visualisations.”

The Decline of Wikipedia


Tom Simonite in MIT Technology Review: “The sixth most widely used website in the world is not run anything like the others in the top 10. It is not operated by a sophisticated corporation but by a leaderless collection of volunteers who generally work under pseudonyms and habitually bicker with each other. It rarely tries new things in the hope of luring visitors; in fact, it has changed little in a decade. And yet every month 10 billion pages are viewed on the English version of Wikipedia alone. When a major news event takes place, such as the Boston Marathon bombings, complex, widely sourced entries spring up within hours and evolve by the minute. Because there is no other free information source like it, many online services rely on Wikipedia. Look something up on Google or ask Siri a question on your iPhone, and you’ll often get back tidbits of information pulled from the encyclopedia and delivered as straight-up facts.
Yet Wikipedia and its stated ambition to “compile the sum of all human knowledge” are in trouble. The volunteer workforce that built the project’s flagship, the English-language Wikipedia—and must defend it against vandalism, hoaxes, and manipulation—has shrunk by more than a third since 2007 and is still shrinking. Those participants left seem incapable of fixing the flaws that keep Wikipedia from becoming a high-quality encyclopedia by any standard, including the project’s own. Among the significant problems that aren’t getting resolved is the site’s skewed coverage: its entries on Pokemon and female porn stars are comprehensive, but its pages on female novelists or places in sub-Saharan Africa are sketchy. Authoritative entries remain elusive. Of the 1,000 articles that the project’s own volunteers have tagged as forming the core of a good encyclopedia, most don’t earn even Wikipedia’s own middle-­ranking quality scores.
The main source of those problems is not mysterious….”

Talking About a (Data) Revolution


Dave Banisar at Article 19: “It is important to recognize the utility that data can bring. Data can ease analysis, reveal important patterns and facilitate comparisons. For example, the Transactional Access Clearing House (TRAC – http://www.trac.org) at Syracuse University uses data sets from the US Department of Justice to analyze how the federal government enforces its criminal and civil laws, showing how laws are applied differently across the US.
The (somewhat ICT-companies manufactured) excitement over “E-government” in the late 1990s imagined a brave new e-world where governments would quickly and easily provide needed information and services to their citizens. This was presented as an alternative to the “reactive” and “confrontational” right to information laws but eventually led to the realization that ministerial web pages and the ability to pay tickets online did not lead to open government. Singapore ranks near the top every year on e-government but is clearly not an ‘open government’. Similarly, it is important to recognize that governments providing data through voluntary measures is not enough.
For open data to promote open government, it needs to operate within a framework of law and regulation that ensures that information is collected, organized and stored and then made public in a timely, accurate and useful form.   The information must be more than just what government bodies find useful to release, but what is important for the public to know to ensure that those bodies are accountable.
Otherwise, it is in danger of just being propaganda, subject to manipulation to make government bodies look good. TRAC has had to sue the USA federal government dozens of times under the Freedom of Information Act to obtain the government data and after they publish it, some government bodies still claim that the information is incorrect.  Voluntary systems of publication usually fail when they potentially embarrass the bodies doing the publication.
In the countries where open data has been most successful such as the USA and UK, there also exists a legal right to demand information which keeps bodies honest. Most open government laws around the world now have requirements for affirmative publication of key information and they are slowly being amended to include open data requirements to ensure that the information is more easily usable.
Where there is no or weak open government laws, many barriers can obstruct open data. In Kenya, which has been championing their open data portal while being slow to adopt a law on freedom of information, a recent review found that the portal was stagnating. In part, the problem was that in the absence of laws mandating openness, there remains a culture of secrecy and fear of releasing information.
Further, mere access to data is not enough to ensure informed participation by citizens and enable their ability to affect decision-making processes.  Legal rights to all information held by governments – right to information laws – are essential to tell the “why”. RTI reveals how and why decisions and policy are made – secret meetings, questionable contracts, dubious emails and other information. These are essential elements for oversight and accountability. Being able to document why a road was built for political reasons is as crucial for change as recognizing that it’s in the wrong place. The TRAC users, mostly journalists, use the system as a starting point to ask questions or why enforcement is so uneven or taxes are not being collected. They need sources and open government laws to ask these questions.
Of course, even open government laws are not enough. There needs to be strong rights for citizen consultation and participation and the ability to enforce those rights, such as is mandated by the UNECE Convention on Access to Environment Information, Public Participation and Access to Justice (Aarhus Convention). A protocol to that convention has led to a Europe-wide data portal on environmental pollution.
For open data to be truly effective, there needs to be a right to information enshrined in law that requires that information is made available in a timely, reliable format that people want, not just what the government body wants to release. And it needs to be backed up with rights of engagement and participation. From this open data can flourish.  The OGP needs to refocus on the building blocks of open government – good law and policy – and not just the flashy apps.”