research paper / thesis / dissertation

A new approach to measuring the impact of open data

Curated on May 6, 2015August 15, 2018 by Stefaan Verhulst

Júlia Keserű at SunLight Foundation: “Strong evidence on the long-term impact of open data initiatives is incredibly scarce. The lack of compelling proof is partly due to the relative novelty of the open government field, but also to the inherent difficulties in measuring good governance and social change. We know that much of the impact of policy advocacy, for instance, occurs even before a new law or policy is introduced, and is thus incredibly difficult to evaluate. At the same time, it is also very hard to detect the causality between a direct change in the legal environment and the specific activities of a policy advocacy group. Attribution is equally challenging when it comes to assessing behavioral changes – who gets to take credit for increased political engagement and greater participation in democratic processes?

Open government projects tend to operate in an environment where the contribution of other stakeholders and initiatives is essential to achieving sustainable change, making it even more difficult to show the causality between a project’s activities and the impact it strives to achieve. Therefore, these initiatives cannot be described through simple “cause and effect” relationships, as they mostly achieve changes through their contribution to outcomes produced by a complex ecosystem of stakeholders — including journalists, think tanks, civil society organizations, public officials and many more — making it even more challenging to measure their direct impact.

We at the Sunlight Foundation wanted to tackle some of the methodological challenges of the field through building an evidence base that can empower further generalizations and advocacy efforts, as well as developing a methodological framework to unpack theories of change and to evaluate the impact of open data and digital transparency initiatives. A few weeks ago, we presented our research at the Cartagena Data Festival, and today we are happy to launch the first edition of our paper, which you can read below or on Scribd.

The outputs of this research include:

A searchable repository of more than 100 examples on the outputs, outcomes and impacts of open data and digital technology projects;
Three distinctive theories of change for open data and digital transparency initiatives from the Global South;
A methodological framework to help develop more robust indicators of social and political change for the ecosystem of open data initiatives, by applying and revising the Outcome Mapping approach of IDRC to the field…(You can read the study at :The Social Impact of Open Data by juliakeseru)

Nepal Aid Workers Helped by Drones, Crowdsourcing

Curated on May 6, 2015August 3, 2018 by Stefaan Verhulst

Shirley Wang et al in the Wall Street Journal: “….It is too early to gauge the exact impact of the technology in Nepal relief efforts, which have just begun amid chaos on the ground. Aid organizations have reported hospitals are overstretched, a shortage of capacity at Katmandu’s airport is crippling aid distribution and damaged roads and the mountainous country’s difficult terrain make reaching villages difficult.

Still, technology is playing an increasing role in the global response to humanitarian crises. Within hours of Saturday’s 7.8-magnitude temblor, U.S. giants such as Google Inc. and Facebook Inc. were offering their networks for use in verifying survivors and helping worried friends and relatives locate their loved ones.

Advances in online mapping—long used to calculate distances and plot driving routes—and the ability of camera-equipped drones are playing an increasingly important role in coordinating emergency responses at ground zero of any disaster.

A community of nonprofit groups uses satellite images, private images and open-source mapping technology to remap areas affected by the earthquake. They mark damaged buildings and roads so rescuers can identify the worst-hit areas and assess how accessible different areas are. The technology complements more traditional intelligence from aircraft.

Such crowdsourced real-time mapping technologies were first used in the 2010 Haiti earthquake, according to Chris Grundy, a professor in Geographical Information Systems at the London School of Hygiene and Tropical Medicine. The technology “has been advancing a little bit every time [every situation where it is used] as we start to see what works,” said Prof. Grundy.

The American Red Cross supplied its relief team on the Wednesday night flight to Nepal from Washington, D.C. with 50 digital maps and an inch-thick pile of paper maps that help identify where the needs are. The charity has a mapping project with the British Red Cross, Doctors Without Borders and the Humanitarian OpenStreetMap Team, a crowdsourced data-sharing group.

Almost a week after the Nepal earthquake, two more people have been pulled from the rubble in Katmandu by teams of international rescuers. But hope for finding more survivors is waning. Photo: Sean McLain/The Wall Street Journal.

Mapping efforts have grown substantially since Haiti, according to Dale Kunce, head of the geographic information systems team at the American Red Cross. In the two months after the Haiti temblor, 600 mapping contributors made 1.5 million edits, while in the first 48 hours after the Nepal earthquake, 2,000 mappers had already made three million edits, Mr. Kunce said.

Some 3,400 volunteers from around the world are now inspecting images of Nepal online to identify road networks and conditions, to assess the extent of damage and pinpoint open spaces where displaced persons tend to congregate, according to Nama Budhathoki, executive director of a nonprofit technology company called Katmandu Living Labs.

His group is operating from a cramped but largely undamaged meeting room in a central-Katmandu office building to help coordinate the global effort of various mapping organizations with the needs of agencies like Doctors Without Borders and the international Red Cross community.

In recent days the Nepal Red Cross and Nepalese army have requested and been supplied with updated maps of severely damaged districts, said Dr. Budhathoki….(More)”

Global Diseases, Collective Solutions

Curated on May 5, 2015August 3, 2018 by Stefaan Verhulst

New paper by Ben Ramalingam: “Environmental disruption, mass urbanization and the runaway globalization of trade and transport have created ideal conditions for infectious diseases to emerge and spread around the world. Rapid spill-overs from local into regional and global crises reveal major gaps in the global system for dealing with infectious diseases.

A number of Global Solution Networks have emerged that address failures of systems, of institutions and of markets. At their most ambitious, they aim to change the rules of the global health game—opening up governance structures, sharing knowledge and science, developing new products, creating markets—all with the ultimate aim of preventing and treating diseases, and saving lives.

These networks have emerged in an ad-hoc and opportunistic fashion. More strategic thinking and investment is needed to build networking competencies and to identify opportunities for international institutions to best leverage new forms of collaboration and partnership. (Read the paper here).”

Urban Data Games: creating smart citizens for smart cities

Curated on May 1, 2015August 3, 2018 by Stefaan Verhulst

Paper by Wolff, Annika; Kortuem, Gerd and Cavero, Jose: “A bottom-up approach to smart cities places citizens in an active role of contributing, analysing and interpreting data in pursuit of tackling local urban challenges and building a more sustainable future city. This vision can only be realised if citizens have sufficient data literacy skills and experience of large, complex, messy, ever expanding data sets. Schools typically focus on teaching data handling skills using small, personally collected data sets obtained through scientific experimentation, leading to a gap between what is being taught and what will be needed as big data and analytics become more prevalent. This paper proposes an approach to teaching data literacy in the context of urban innovation tasks, using an idea of Urban Data Games. These are supported by a set of training data and resources that will be used in school trials for exploring the problems people have when dealing with large data and trialling novel approaches for teaching data literacy….(More)”

Serious Gaming Takes Flight

Curated on April 30, 2015August 15, 2018 by Stefaan Verhulst

Dennis Glenn at “Chief Learning Officer” Media: “Gamification is one of the hottest topics in corporate learning today, yet we don’t entirely trust it. So before delving into how leaders can take a reasoned, serious approach to use games in learning environments, let’s get one thing straight: Gamification is different from serious gaming.

Gamification places nongame experiences into a gamelike environment. Serious games are educational experiences specifically designed to deliver formative or summative assessments based on predetermined learning objectives. Gamification creates an experience; serious games promote task or concept mastery. The underlying aim of serious games concentrates the user’s effort on mastery of a specific task, with a feedback loop to inform users of their progress toward that goal….

In addition to simulations and gamification, many corporate learning leaders are turning to serious games, which demand social engagement. For instance, consider the World of Warcraft wiki, which has more than 101,000 players and contributors helping others master the online game.

Some of the most important benefits to gaming:

Accepting failure, which is seen as a benefit to mastery.
Rewarding players with appropriate and timely feedback.
Making social connections and feeling part of something bigger.

In serious games, frequent feedback — when accompanied by specific instruction — can dramatically reduce the time to mastery. Because the computer will record all data during the assessment, learning leaders can identify specific pathways to mastery and offer them to learners.

This feedback loop leads to self-reflection and that can be translated into learning, according the 2014 paper titled “Working Paper: Learning by Thinking: How Reflection Aids Performance.” Authors Giada Di Stefano, Francesca Gino, Gary Pisano and Bradley Staats found that individuals performed significantly better on subsequent tasks when thinking about what they learned from the previously completed task.

Social learning is the final link to understanding mastery learning. In a recent massive open online course, titled “Design and Development of Educational Technology MITx: 11.132x,” instructor Scot Osterweil said our understanding of literacy is rooted in a social environment and in interactions with other people and the world. But again, engagement is key. Gaming provides the structure needed to engage with peers, often irrespective of cultural and language differences….(More)”.

Preparing for Responsible Sharing of Clinical Trial Data

Curated on April 29, 2015August 3, 2018 by Stefaan Verhulst

Paper by Michelle M. Mello et al in the New England Journal of Medicine: “Data from clinical trials, including participant-level data, are being shared by sponsors and investigators more widely than ever before. Some sponsors have voluntarily offered data to researchers, some journals now require authors to agree to share the data underlying the studies they publish, the Office of Science and Technology Policy has directed federal agencies to expand public access to data from federally funded projects, and the European Medicines Agency (EMA) and U.S. Food and Drug Administration (FDA) have proposed the expansion of access to data submitted in regulatory applications. Sharing participant-level data may bring exciting benefits for scientific research and public health but may also have unintended consequences. Thus, expanded data sharing must be pursued thoughtfully.

We provide a suggested framework for broad sharing of participant-level data from clinical trials and related technical documents. After reviewing current data-sharing initiatives, potential benefits and risks, and legal and regulatory implications, we propose potential governing principles and key features for a system of expanded access to participant-level data and evaluate several governance structures….(More)”

Health Big Data in the Commercial Context

Curated on April 28, 2015August 3, 2018 by Stefaan Verhulst

CDT Press Release: “This paper is the third in a series of three, each of which explores health big data in a different context. The first — on health big data in the government context — is available here, and the second — on health big data in the clinical context — is available here.

Consumers are increasingly using mobile phone apps and wearable devices to generate and share data on health and wellness. They are using personal health record tools to access and copy health records and move them to third party platforms. They are sharing health information on social networking sites. They leave digital health footprints when they conduct online searches for health information. The health data created, accessed, and shared by consumers using these and many other tools can range from detailed clinical information, such as downloads from an implantable device and details about medication regimens, to data about weight, caloric intake, and exercise logged with a smart phone app.

These developments offer a wealth of opportunities for health care and personal wellness. However, privacy questions arise due to the volume and sensitivity of health data generated by consumer-focused apps, devices, and platforms, including the potential analytics uses that can be made of such data.

Many of the privacy issues that face traditional health care entities in the big data era also apply to app developers, wearable device manufacturers, and other entities not part of the traditional health care ecosystem. These include questions of data minimization, retention, and secondary use. Notice and consent pose challenges, especially given the limits of presenting notices on mobile device screens, and the fact that consumer devices may be bought and used without consultation with a health care professional. Security is a critical issue as well.

However, the privacy and security provisions of the Heath Insurance Portability and Accountability Act (HIPAA) do not apply to most app developers, device manufacturers or others in the consumer health space. This has benefits to innovation, as innovators would otherwise have to struggle with the complicated HIPAA rules. However, the current vacuum also leaves innovators without clear guidance on how to appropriately and effectively protect consumers’ health data. Given the promise of health apps, consumer devices, and consumer-facing services, and given the sensitivity of the data that they collect and share, it is important to provide such guidance….

As the source of privacy guidelines, we look to the framework provided by the Fair Information Practice Principles (FIPPs) and explore how it could be applied in an age of big data to patient-generated data. The FIPPs have influenced to varying degrees most modern data privacy regimes. While some have questioned the continued validity of the FIPPs in the current era of mass data collection and analysis, we consider here how the flexibility and rigor of the FIPPs provide an organizing framework for responsible data governance, promoting innovation, efficiency, and knowledge production while also protecting privacy. Rather than proposing an entirely new framework for big data, which could be years in the making at best, using the FIPPs would seem the best approach in promoting responsible big data practices. Applying the FIPPs could also help synchronize practices between the traditional health sector and emerging consumer products….(More)”