Harnessing the Power of Feedback Loops


Thomas Kalil and David Wilkinson at the White House: “When it comes to strengthening the public sector, the Federal Government looks for new ways to achieve better results for the people we serve. One promising tool that has gained momentum across numerous sectors in the last few years is the adoption of feedback loops.  Systematically collecting data and learning from client and customer insights can benefit organizations across all sectors.

The collection of these valuable insights—and acting on them—remains an underutilized tool.  The people who receive services are the experts on their effectiveness and usefulness.  While the private sector has used customer feedback to improve products and services, the government and nonprofit sectors have often lagged behind.  User experience is a critically important factor in driving positive outcomes.  Getting honest feedback from service recipients can help nonprofit service providers and agencies at all levels of government ensure their work effectively addresses the needs of the people they serve. It’s equally important to close the loop by letting those who provided feedback know that their input was put to good use.

In September, the White House Office of Social Innovation and the White House Office of Science and Technology Policy (OSTP) hosted a workshop at the White House on data-driven feedback loops for the social and public sectors.  The event brought together leaders across the philanthropy, nonprofit, and business sectors who discussed ways to collect and utilize feedback.

The program featured organizations in the nonprofit sector that use feedback to learn what works, what might not be working as well, and how to fix it. One organization, which offers comprehensive employment services to men and women with recent criminal convictions, explained that it has sought feedback from clients on its training program and learned that many people were struggling to find their work site locations and get to the sessions on time. The organization acted on this feedback, shifting their start times and providing maps and clearer directions to their participants.  These two simple changes increased both participation in and satisfaction with their program.

Another organization collected feedback to learn whether factory workers attend and understand trainings on fire evacuation procedures. By collecting and acting on this feedback in Brazil, the organization was able to help a factory reduce fire-drill evacuation time from twelve minutes to two minutes—a life-saving result of seeking feedback.

With results such as these in mind, the White House has emphasized the importance of evidence and data-driven solutions across the Federal Government.  …

USAID works to end extreme poverty in over 100 countries around the world. The Agency has recently changed its operational policy to enable programs to adapt to feedback from the communities in which they work. They did this by removing bureaucratic obstacles and encouraging more flexibility in their program design. For example, if a USAID-funded project designed to increase agricultural productivity is unexpectedly impacted by drought, the original plan may no longer be relevant or effective; the community may want drought-resistant crops instead.  The new, more flexible policy is intended to ensure that such programs can pivot if a community provides feedback that its needs have changed or projects are not succeeding…(More)”

Doctors take inspiration from online dating to build organ transplant AI


Ariel Bogle at Mashable :”When Bob Jones performed one of Victoria’s first liver transplants in 1988, he could not imagine that 29 years later he’d be talking about artificial intelligence and online dating. Jones is the director of Austin Health’s Victorian liver transplant unit in Melbourne, Australia, and along with his colleague Lawrence Lau, he has helped develop an algorithm that could potentially better match organ donors with organ recipients.

Comparing it to the metrics behind dating site eHarmony, Jone said they planned to use the specially-designed AI to improve the accuracy of matching liver donors and recipients, hopefully resulting in less graft failures and fewer patient deaths.

“It’s a specially designed machine learning algorithm using multiple donor and recipient features to predict the outcome,” he explained.

The team plugged around 25 characteristics of donors and recipients into their AI, using the data points to retrospectively predict what would happen to organ grafts.

“We used all the basic things like sex, age, underlying disease, blood type,” he said. “And then there are certain characteristics about the donor … and all the parameters that might indicate the liver might be upset.”

Using the AI to assess the retrospective results of 75 adult patients who’d had transplants, they found the method predicted graft failure 30 days post-transplant at an accuracy of 84 percent compared to 68 percent with current methods.

“It really meant for the first time we could assess an organ’s suitability in a quantitive way,” he added, “as opposed to the current method, which really comes down to the position of the doctor eyeballing all the data and making a call based on their experience.”

Improving the accuracy of organ donor matches is vital, because as Jones put it, “it’s an extraordinary, precious gift from one Australian to another.”…(More)”

How Mobile Crowdsourcing Can Improve Occupational Safety


Batu Sayici & Beth Simone Noveck at The GovLab’s Medium: “With 150 workers dying each day from hazardous working conditions, work safety continues to be a serious problem in the U.S. Using mobile technology to collect information about workplace safety conditions from those on the ground could help prevent serious injuries and save lives by accelerating the ability to spot unsafe conditions. The convergence of wireless devices, low-cost sensors, big data, and crowdsourcing can transform the way we assess risk in our workplaces. Government agencies, labor unions, workers’ rights organizations, contractors and crowdsourcing technology providers should work together to create new tools and frameworks in a way that can improve safety and provide value to all stakeholders.

Crowdsourcing (the act of soliciting help from a distributed audience) can provide a real-time source of data to complement data collected by government agencies as part of the regulatory processes of monitoring workplace safety. Having access to this data could help government agencies to more effectively monitor safety-related legal compliance, help building owners, construction companies and procurement entities to more easily identify “responsible contractors and subcontractors,” and aid workers and unions in making more informed choices and becoming better advocates for their own protection. Just as the FitBit and Nike Wristband provide individuals with a real-time reflection of their habits designed to create the incentive for healthier living, crowdsourcing safety data has the potential to provide employers and employees alike with a more accurate picture of conditions and accelerate the time needed to take action….(More)”

Urban Exposures: How Cell Phone Data Helps Us Better Understand Human Exposure To Air Pollution


Senseable City Lab: “Global urbanization has led to one of the world’s most pressing environmental health concerns: the increasing number of people contributing to and being affected by air pollution, leading to 7 million early deaths each year. The key issue is human exposure to pollution within cities and the consequential effects on human health.

With new research conducted at MIT’s Senseable City Lab, human exposure to air pollution can now be accurately quantified at an unprecedented scale. Researchers mapped the movements of several million people using ubiquitous cell phone data, and intersected this information with neighborhood air pollution measures. Covering the expanse of New York City and its 8.5 million inhabitants, the study reveals where and when New Yorkers are most at risk of exposure to air pollution – with major implications for environment and public health policy… (More)”

Crowdsourcing the Egyptian Constitution


Tofigh Maboudi and Ghazal P. Nadi in Political Research Quarterly: “Drawing on empirical evidence from online citizen feedback on the 2012 Egyptian Constitution, we demonstrate that despite normative skepticism about implications of participatory constitution making, citizen participation matters. Using data of more than 650,000 online votes and comments on the constitution, we find that draft provisions with higher public approval are less likely to change and those with lower approval are more likely to change. We also find that Articles related to rights and freedoms are more likely to change based on online public input. Finally, following the boycott of the Constituent Assembly by non-Islamists, changes in draft Articles based on public feedback drop sharply. These findings highlight the conditions under which participatory constitution making becomes more effective. First, consensus among citizens over the most salient issues increases the probability that those issues would be successfully incorporated in the constitution. Second, without ex ante elite agreement over the design of the constitution, it becomes difficult to account for citizen proposals amid political clash between elites…(More)”.

Crowdsourcing Medical Data Through Gaming


Felix Morgan in The Austin Chronicle: “Video games have changed the way we play, but they also have the potential to change the way we research and solve problems, in fields such as health care and education. One game that’s made waves in medical research is Sea Hero Quest. This smartphone game has created a groundbreaking approach to data collection, leading to an earlier diagnosis of dementia. So far, 2.5 million people have played the game, providing scientists with years’ worth of data across borders and demographics.

By offering this game as a free mobile app, researchers are overcoming the ever-present problems of small sample sizes and time-consuming data gathering in empirical research. Sea Hero Quest was created by Glitchers, partnering with University College London, University of East Anglia, and Alzheimer’s Research. As players navigate mazes, shoot flares into baskets, and photograph sea creatures, they answer simple demographic questions and generate rich data sets.

“The idea of crowdsourced data-gathering games for research is a new and exciting method of obtaining data that would be prohibitively expensive otherwise,” says Paul Toprac, who along with his colleague Matt O’Hair, run the Simulation and Game Applications (SAGA) Lab at University of Texas Austin. Their team helps researchers across campus and in the private sector design, implement, and find funding for video game-based research.

O’Hair sees a lot of potential for Sea Hero Quest and other research-based games. “One of the greatest parts about the SAGA Lab is that we get to help researchers make strides in these kinds of fields,” he says.

The idea of using crowdsourcing for data collection is relatively new, but using gaming for research is something that has been well established. Last year at SXSW, Nolan Bushnell, the founder of Atari, made a statement that video games were the key to understanding and treating dementia and related issues, which certainly seems possible based on the preliminary results from Sea Hero Quest. “We have had about 35 years of research using games as a medium,” Toprac says. “However, only recently have we used games as a tool for explicit data gathering.”…(More)”

Protecting One’s Own Privacy in a Big Data Economy


Anita L. Allen in the Harvard Law Review Forum: “Big Data is the vast quantities of information amenable to large-scale collection, storage, and analysis. Using such data, companies and researchers can deploy complex algorithms and artificial intelligence technologies to reveal otherwise unascertained patterns, links, behaviors, trends, identities, and practical knowledge. The information that comprises Big Data arises from government and business practices, consumer transactions, and the digital applications sometimes referred to as the “Internet of Things.” Individuals invisibly contribute to Big Data whenever they live digital lifestyles or otherwise participate in the digital economy, such as when they shop with a credit card, get treated at a hospital, apply for a job online, research a topic on Google, or post on Facebook.

Privacy advocates and civil libertarians say Big Data amounts to digital surveillance that potentially results in unwanted personal disclosures, identity theft, and discrimination in contexts such as employment, housing, and financial services. These advocates and activists say typical consumers and internet users do not understand the extent to which their activities generate data that is being collected, analyzed, and put to use for varied governmental and business purposes.

I have argued elsewhere that individuals have a moral obligation to respect not only other people’s privacy but also their own. Here, I wish to comment first on whether the notion that individuals have a moral obligation to protect their own information privacy is rendered utterly implausible by current and likely future Big Data practices; and on whether a conception of an ethical duty to self-help in the Big Data context may be more pragmatically framed as a duty to be part of collective actions encouraging business and government to adopt more robust privacy protections and data security measures….(More)”

International Open Data Roadmap


IODC16: We have entered the next phase in the evolution of the open data movement. Just making data publicly available can no longer be the beginning and end of every conversation about open data. The focus of the movement is now shifting to building open data communities, and an increasingly sophisticated network of communities have begun to make data truly useful in addressing a myriad of problems facing citizens and their governments around the world:

  • More than 40 national and local governments have already committed to implement the principles of the International Open Data Charter;
  • Open data is central to many commitments made this year by world leaders, including the Sustainable Development Goals (SDGs), the Paris Climate Agreement, and the G20 Anti Corruption Data Principles; and
  • Open data is also an increasingly local issue, as hundreds of cities and sub-national governments implement open data policies to drive transparency, economic growth, and service delivery in close collaboration with citizens.

Screen Shot 2017-01-17 at 11.32.32 AMTo further accelerate collaboration and increase the impact of open data activities globally, the Government of Spain, the International Development Research Centre, the World Bank, and the Open Data for Development Network recently hosted the fourth International Open Data Conference (IODC) on October 6-7, 2106 in Madrid, Spain.

Under the theme of Global Goals, Local Impact, the fourth IODC reconvened an ever expanding open data community to showcase best practices, confront shared challenges, and deepen global and regional collaboration in an effort to maximize the impact of open data. Supported by a full online archive of the 80+ sessions and 20+ special events held in Madrid during the first week of October 2016, this report reflects on the discussions and debates that took place, as well as the information shared on a wide range of vibrant global initiatives, in order to map out the road ahead, strengthen cohesion among existing efforts, and explore new ways to use open data to drive social and economic inclusion around the world….(More)”

Empirical data on the privacy paradox


Benjamin Wittes and Emma Kohse at Brookings: “The contemporary debate about the effects of new technology on individual privacy centers on the idea that privacy is an eroding value. The erosion is ongoing and takes place because of the government and big corporations that collect data on us all: In the consumer space, technology and the companies that create it erode privacy, as consumers trade away their solitude either unknowingly or in exchange for convenience and efficiency.

On January 13, we released a Brookings paper that challenges this idea. Entitled, “The Privacy Paradox II: Measuring the Privacy Benefits of Privacy Threats,” we try to measure the extent to which this focus ignores the significant privacy benefits of the technologies that concern privacy advocates. And we conclude that quantifiable effects in consumer behavior strongly support the reality of these benefits.

In 2015, one of us, writing with Jodie Liu, laid out the basic idea last year in a paper published by Brookings called “The Privacy Paradox: the Privacy Benefits of Privacy Threats.” (The title, incidentally, became the name of Lawfare’s privacy-oriented subsidiary page.) Individuals, we argued, might be more concerned with keeping private information from specific people—friends, neighbors, parents, or even store clerks—than from large, remote corporations, and they might actively prefer to give information remote corporations by way of shielding it from those immediately around them. By failing to associate this concern with the concept of privacy, academic and public debates tends to ignore countervailing privacy benefits associated with privacy threats, and thereby keeps score in a way biased toward the threats side of the ledger.To cite a few examples, an individual may choose to use a Kindle e-reader to read Fifty Shades of Grey precisely because she values the privacy benefit of hiding her book choice from the eyes of people on the bus or the store clerk at the book store, rather than for reasons of mere convenience. This privacy benefit, for many consumers, can outweigh the privacy concern presented by Amazon’s data mining. At the very least, the privacy benefits of the Kindle should enter into the discussion.

To cite a few examples, an individual may choose to use a Kindle e-reader to read Fifty Shades of Grey precisely because she values the privacy benefit of hiding her book choice from the eyes of people on the bus or the store clerk at the book store, rather than for reasons of mere convenience. This privacy benefit, for many consumers, can outweigh the privacy concern presented by Amazon’s data mining. At the very least, the privacy benefits of the Kindle should enter into the discussion.

In this paper, we tried to begin the task for measuring the effect and reasoning that supported the thesis in the “Privacy Paradox” using Google Surveys, an online survey tool….(More)”.