The Global Open Data Index 2016/2017 – Advancing the State of Open Data Through Dialogue

Curated on Posted on by Stefaan Verhulst

Open Knowledge International: “The Global Open Data Index (GODI) is the annual global benchmark for publication of open government data, run by the Open Knowledge Network. Our crowdsourced survey measures the openness of government data according to the Open Definition.

By having a tool that is run by civil society, GODI creates valuable insights for government’s data publishers to understand where they have data gaps. It also shows how to make data more useable and eventually more impactful. GODI therefore provides important feedback that governments are usually lacking.

For the last 5 years we have been revising GODI methodology to fit the changing needs of the open data movement. This year, we changed our entire survey design by adding experimental questions to assess data findability and usability. We also improved our datasets definitions by looking at essential data points that can solve real world problems. Using more precise data definitions also increased the reliability of our cross-country comparison. See all about the GODI methodology here

In addition, this year shall be more than a mere measurement tool. We see it as a tool for conversation. To spark debate, we release GODI in two phases:

  1. The dialogue phase – We are releasing the data to the public after a rigorous review. Yet, like everyone, our work is not assessment in not always perfect. We give all users a chance to contest the index results for 30 days, starting May 2nd. In this period, users of the index can comment on our assessments through our Global Open Data Index forum. On June 2nd, we will review those comments and will change some index submissions if needed.
  2. The final results – on June 15 we will present the final results of the index. For the first time ever, we will also publish the GODI white paper. This paper will include our main findings and recommendations to advance open data publication….

… findings from this year’s GODI

  • GODI highlights data gaps. Open data is the final stage of an information production chain, where governments measure and collect data, process and share data internally, and publish this data openly. While being designed to measure open data, the Index also highlights gaps in this production chain. Does a government collect data at all? Why is data not collected? Some governments lack the infrastructure and resources to modernise their information systems; other countries do not have information systems in place at all.
  • Data findability is a major challenge. We have data portals and registries, but government agencies under one national government still publish data in different ways and different locations. Moreover, they have different protocols for license and formats. This has a hazardous impact – we may not find open data, even if it is out there, and therefore can’t use it. Data findability is a prerequisite for open data to fulfill its potential and currently most data is very hard to find.
  • A lot of ‘data’ IS online, but the ways in which it is presented are limiting their openness. Governments publish data in many forms, not only as tabular datasets but also visualisations, maps, graphs and texts. While this is a good effort to make data relatable, it sometimes makes the data very hard or even impossible for reuse. It is crucial for governments to revise how they produce and provide data that is in good quality for reuse in its raw form. For that, we need to be aware what is best raw data required which varies from data category to category.
  • Open licensing is a problem, and we cannot assess public domain status. Each year we find ourselves more confused about open data licences. On the one hand, more governments implement their unique open data license versions. Some of them are compliant with the Open Definition, but most are not officially acknowledged. On the other hand, some governments do not provide open licenses, but terms of use, that may leave users in the dark about the actual possibilities to reuse data. There is a need to draw more attention to data licenses and make sure data producers understand how to license data better….(More)”.

Killer Apps: Vanishing Messages, Encrypted Communications, and Challenges to Freedom of Information Laws When Public Officials ‘Go Dark’

Curated on Posted on by Stefaan Verhulst

Paper by Daxton Stewart: “In the early weeks of the new presidential administration, White House staffers were communicating among themselves and leaking to journalists using apps such as Signal and Confide, which allow users to encrypt messages or to make them vanish after being received. By using these apps, government officials are “going dark” by avoiding detection of their communications in a way that undercuts freedom of information laws. In this paper, the author explores the challenges presented by encrypted and ephemeral messaging apps when used by government employees, examining three policy approaches – banning use of the apps, enhancing existing archiving and record-keeping practices, or legislatively expanding quasi-government body definitions – as potential ways to manage the threat to open records laws these “killer apps” present….(More)”.

OpenAerialMap

Curated on Posted on by Stefaan Verhulst

“OpenAerialMap (OAM) is a set of tools for searching, sharing, and using openly licensed satellite and unmanned aerial vehicle (UAV) imagery.

Built on top of the Open Imagery Network (OIN), OAM is an open service that provides search and access to this imagery…

Use the map to pan and zoom to search available imagery. Imagery can be previewed by selecting a tile and browsing the sidebar. Read the User Guide for more information.

All imagery is publicly licensed and made available through the Humanitarian OpenStreetMap Team’s Open Imagery Network (OIN) Node. All imagery contained in OIN is licensed CC-BY 4.0, with attribution as contributors of Open Imagery Network. All imagery is available to be traced in OpenStreetMap.

OAM is available for sharing and distributing aerial imagery. There are plenty of ways to get involved in OpenAerialMap.

Check out the GitHub repository to learn more about the design and how to get involved in the project….(More)”

Openness as social praxis

Curated on Posted on by Stefaan Verhulst

Matthew Longshore Smith and Ruhiya Seward in First Monday: “Since the early 2000s, there has been an explosion in the usage of the term open, arguably stemming from the advent of networked technologies — including the Internet and mobile technologies. ‘Openness’ seems to be everywhere, and takes many forms: from open knowledge, open education, open data and open science, to open Internet, open medical records systems and open innovation. These applications of openness are having a profound, and sometimes transformative, effect on social, political and economic life.

This explosion of the use of the term has led to multiple interpretations, ambiguities, and even misunderstandings, not to mention countless debates and disagreements over precise definitions. The paper “Fifty shades of open” by Pomerantz and Peek (2016) highlighted the increasing ambiguity and even confusion surrounding this term. This article builds on Pomerantz and Peek’s attempt to disambiguate the term by offering an alternative understanding to openness — that of social praxis. More specifically, our framing can be broken down into three social processes: open production, open distribution, and open consumption. Each process shares two traits that make them open: you don’t have to pay (free price), and anyone can participate (non-discrimination) in these processes.

We argue that conceptualizing openness as social praxis offers several benefits. First, it provides a way out of a variety of problems that result from ambiguities and misunderstandings that emerge from the current multitude of uses of openness. Second, it provides a contextually sensitive understanding of openness that allows space for the many different ways openness is experienced — often very different from the way that more formal definitions conceptualize it. Third, it points us towards an approach to developing practice-specific theory that we believe helps us build generalizable knowledge on what works (or not), for whom, and in what contexts….(More)”.

A Data-driven Approach to Assess the Potential of Smart Cities: The Case of Open Data for Brussels Capital Region

Curated on Posted on by Stefaan Verhulst

Paper by Miguel Angel Gomez Zotano and Hugues Bersini in Energy Procedia: “The success of smart city projects is intrinsically related to the existence of large volumes of data that could be processed to achieve their objectives. For this purpose, the plethora of data stored by public administrations becomes an incredibly rich source of insight and information due to its volume and diversity. However, it was only with the Open Government Movement when governments have been concerned with the need to open their data to citizens and businesses. Thus, with the emergence of open data portals, these myriad of data enables the development of new business models. The achievement of the benefits sought by making this data available triggers new challenges to cope with the diversity of sources involved. The business potential could be jeopardized by the scarcity of relevant data in the different blocks and domains that makes a city and by the lack of a common approach to data publication, in terms of format, content, etc.

This paper introduces a holistic approach that relies on the Smart City Ontology as the cornerstone to standardise and structure data. This approach, which is proposed to be an analytical tool to assess the potential of data in a given smart city, analyses three main aspects: availability of data, the criteria that data should fulfil to be considered eligible and the model used to structure and organise data. The approach has been applied to the case of Brussels Capital Region, which first results are presented and discussed in this paper. The main conclusion that has been obtained is that, besides its commitment with open data and smart cities, Brussels is not mature enough to fully exploit the real intelligence that smart cities could provide. This maturity would be achieved in the following years with the implementation of the new Brussels’ Smart City Strategy…(More)”.

How Open Data Can Revolutionize a Society in Crisis

Curated on Posted on by Stefaan Verhulst

Beth Noveck at BrinkNews:”…These myriad open data success stories, however, depend on the political will to be transparent and collaborative. There is a looming risk that governments will only post what is expedient and noncontroversial while seeking recognition for their proactive disclosure—a practice increasingly referred to as “open-washing.” Governments of all political stripes refuse to disclose data when they should. The data to be found on government websites is not always the information most in demand by journalists, activists, and researchers.

Especially as political administrations turnover, there is a risk that change will result in a failure to collect and publish important data. These practices will be subject to the vagaries of politics.

The genie should not, however, be put back in the bottle.

Open data appeals to both right and left politically: the former sees open data as a pathway to smaller, more efficient government and the latter sees open data as a tool to pursue more effective social programs. The bipartisan interest in evidence-based approaches to governing should fuel greater demand for access to administrative information of all kinds—including the data that agencies collect about companies, workplaces, the environment, and the world beyond government.

Government data should be open in part because of the ill-effects of secrecy, but also because taxpayers have paid for the collection of this data by government in its role as regulator and researcher.

It is a pragmatic tool to make government and companies more accountable at solving social problems and to help communities make better informed buying decisions. It helps create jobs and generate entrepreneurship. Perhaps of paramount importance, open data can advance civil rights and help us to govern more legitimately and effectively….(More).

Open Data Maturity in Europe 2016

Curated on Posted on by Stefaan Verhulst

European Data Portal Report: “…the second in a series of annual studies and explores the level of Open Data Maturity in the EU28 and Norway, Switzerland and Liechtenstein – referred to as EU28+. The measurement is built on two key indicators Open Data Readiness and Portal Maturity, thereby covering the level of development of national activities promoting Open Data as well as the level of development of national portals. In 2016, with a 28.6% increase compared to 2015, the EU28+ countries completed over 55% of their Open Data journey showing that, by 2016, a majority of the EU28+ countries have successfully developed a basic approach to address Open Data. The Portal Maturity level increased by 22.6 percentage points from 41.7% to 64.3% thanks to the development of more advanced features on country data portals. The overall Open Data Maturity groups countries into different clusters: Beginners, Followers, Fast Trackers and Trend Setters. Barriers do remain to move Open Data forward. The report concludes on a series of recommendations, providing countries with guidance to further improve Open Data maturity. Countries need to raise more (political) awareness around Open Data, increase automated processes on their portals to increase usability and re-usability of data, and organise more events and trainings to support both local and national initiatives….(More)”.

Standard Business Reporting: Open Data to Cut Compliance Costs

Curated on Posted on by Stefaan Verhulst

Report by the Data Foundation: “Imagine if U.S. companies’ compliance costs could be reduced, by billions of dollars. Imagine if this could happen without sacrificing any transparency to investors and governments. Open data can make that possible.

This first-ever research report, co-published by the Data Foundation and PwC, explains how Standard Business Reporting (SBR), in which multiple regulatory agencies adopt a common open data structure for the information they collect, reduces costs for both companies and agencies.

SBR programs are in place in the Netherlands, Australia, and elsewhere – but the concept is unknown in the United States. Our report is intended to introduce SBR to U.S. policymakers and lay the groundwork for future change….(More)”.

Software used to predict crime can now be scoured for bias

Curated on Posted on by Stefaan Verhulst

Dave Gershgorn in Quartz: “Predictive policing, or the idea that software can foresee where crime will take place, is being adopted across the country—despite being riddled with issues. These algorithms have been shown to disproportionately target minorities, and private companies won’t reveal how their software reached those conclusions.

In an attempt to stand out from the pack, predictive-policing startup CivicScape has released its algorithm and data online for experts to scour, according to Government Technology magazine. The company’s Github page is already populated with its code, as well as a variety of documents detailing how its algorithm interprets police data and what variables are included when predicting crime.

“By making our code and data open-source, we are inviting feedback and conversation about CivicScape in the belief that many eyes make our tools better for all,” the company writes on Github. “We must understand and measure bias in crime data that can result in disparate public safety outcomes within a community.”…

CivicScape claims to not use race or ethnic data to make predictions, although it is aware of other indirect indicators of race that could bias its software. The software also filters out low-level drug crimes, which have been found to be heavily biased against African Americans.

While this startup might be the first to publicly reveal the inner machinations of its algorithm and data practices, it’s not an assurance that predictive policing can be made fair and transparent across the board.

“Lots of research is going on about how algorithms can be transparent, accountable, and fair,” the company writes. “We look forward to being involved in this important conversation.”…(More)”.

Civic Tech & GovTech: An Overlooked Lucrative Opportunity for Technology Startups

Curated on Posted on by Stefaan Verhulst

Elena Mesropyan at LTP: “Civic technology, or Civic Tech, is defined as a technology that enables greater participation in government or otherwise assists government in delivering citizen services and strengthening ties with the public. In other words, Civic Tech is where the public lends its talents, usually voluntarily, to help government do a better job. Moreover, Omidyar Network(which invested over $90 million across 35 civic tech organizations over the past decade) emphasizes that like a movement, civic tech is mission-driven, focused on making a change that benefits the public, and in most cases enables better public input into decision making.

As an emerging sector, Civic Tech is defined as incorporating any technology that is used to empower citizens or help make government more accessible, efficient, and effective. Civic tech isn’t just talk, Omidyar notes, it is a community of people coming together to create tangible projects and take action. The civic tech and open data movements have grown with the ubiquity of personal technology.

Civic tech can be defined as a convergence of various fields. An example of such convergence has been given by Knight Foundation, a national foundation with a goal to foster informed and engaged communities to power a healthy democracy:

Civic Tech & GovTech: An Overlooked Lucrative Opportunity for Technology Startups

Source: The Emergence of Civic Tech: Investments in a Growing Field

In the report called Engines of Change: What Civic Tech Can Learn From Social Movements, Civic Tech is divided into three categories:

  • Citizen to Citizen (C2C): Technology that improves citizen mobilization or improves connections between citizens
  • Citizen to Government (C2G): Technology that improves the frequency or quality of interaction between citizens and government
  • Government Technology (Govtech): Innovative technology solutions that make government more efficient and effective at service delivery

In 2015, Forbes reported that Civic Tech makes up almost a quarter of local and state government spendings on technology….

Civic tech initiatives address a diverse range of industries – from energy and payments to agriculture and telecommunications. Mattermark outlines the following top ten industries associated with government and civic tech:

…There are certainly much more examples of GovTech/civic tech companies, and just tech startups offering solutions across the board that can significantly improve the way governments are run, and services are delivered to citizens and businesses. More importantly, GovTech should no longer be considered a charity and solely non-profit type of venture. Recently reviewed global P2G payments flows only, for example, are estimated to be at $7.7 trillion and represent a significant feature of the global payments landscape. For the low- and lower-middle-income countries alone, the number hits $375 billion (~50% of annual government expenditure)….(More)”