Trustworthy Privacy Indicators: Grades, Labels, Certifications and Dashboards


Paper by Joel R. Reidenberg et al: “Despite numerous groups’ efforts to score, grade, label, and rate the privacy of websites, apps, and network-connected devices, these attempts at privacy indicators have, thus far, not been widely adopted. Privacy policies, however, remain long, complex, and impractical for consumers. Communicating in some short-hand form, synthesized privacy content is now crucial to empower internet users and provide them more meaningful notice, as well as nudge consumers and data processors toward more meaningful privacy. Indeed, on the basis of these needs, the National Institute of Standards and Technology and the Federal Trade Commission in the United States, as well as lawmakers and policymakers in the European Union, have advocated for the development of privacy indicator systems.

Efforts to develop privacy grades, scores, labels, icons, certifications, seals, and dashboards have wrestled with various deficiencies and obstacles for the wide-scale deployment as meaningful and trustworthy privacy indicators. This paper seeks to identify and explain these deficiencies and obstacles that have hampered past and current attempts. With these lessons, the article then offers criteria that will need to be established in law and policy for trustworthy indicators to be successfully deployed and adopted through technological tools. The lack of standardization prevents user-recognizability and dependability in the online marketplace, diminishes the ability to create automated tools for privacy, and reduces incentives for consumers and industry to invest in a privacy indicators. Flawed methods in selection and weighting of privacy evaluation criteria and issues interpreting language that is often ambiguous and vague jeopardize success and reliability when baked into an indicator of privacy protectiveness or invasiveness. Likewise, indicators fall short when those organizations rating or certifying the privacy practices are not objective, trustworthy, and sustainable.

Nonetheless, trustworthy privacy rating systems that are meaningful, accurate, and adoptable can be developed to assure effective and enduring empowerment of consumers. This paper proposes a framework using examples from prior and current attempts to create privacy indicator systems in order to provide a valuable resource for present-day, real world policymaking….(More)”.

Problem Framing Expertise in Public and Social Innovation


Paper by Mieke van derBijl-Brouwer: “Public and social sector organizations are increasingly turning to innovation as a way to address the complex problems that society is facing. Design practice has already contributed significantly to public and social innovation, but to be effective at the public and social systems level, these practices must be adapted. This study investigates how five public and social innovation agencies adapted and used the core design practice of problem framing to address complex problems in society. The frames evolved according to nonlinear patterns through the co-evolution of problem and solution spaces. Practitioners adapted their framing practices to suit the complex social contexts by applying systemic design principles, pursuing multiple solutions and problem frames, and operationalizing wider research and thinking methods that align with the complex nature of each specific challenge. I argue that such practices require high-level expertise, and that capability building in public and social innovation should consider these emerging practices and levels of expertise….(More)”.

Negotiating with the future: incorporating imaginary future generations into negotiations


Paper by Yoshio Kamijo et al: “People to be born in the future have no direct
influence on current affairs. Given the disconnect between people who are currently living and those who will inherit the planet left for them, individuals who are currently alive tend to be more oriented toward the present, posing a fundamental problem related to sustainability.

In this study, we propose a new framework for reconciling the disconnect between the present and the future whereby some individuals in the current generation serve as an imaginary future generation that negotiates with individuals in the real-world present. Through a laboratory-controlled intergenerational sustainability dilemma game (ISDG), we show how the presence of negotiators for a future generation increases the benefits of future generations. More specifically, we found that when faced with members of an imaginary future generation, 60% of participants selected
an option that promoted sustainability. In contrast, when the imaginary future generation was not salient, only 28% of participants chose the sustainable option…(More)”.

Big Data in the U.S. Consumer Price Index: Experiences & Plans


Paper by Crystal G. Konny, Brendan K. Williams, and David M. Friedman: “The Bureau of Labor Statistics (BLS) has generally relied on its own sample surveys to collect the price and expenditure information necessary to produce the Consumer Price Index (CPI). The burgeoning availability of big data has created a proliferation of information that could lead to methodological improvements and cost savings in the CPI. The BLS has undertaken several pilot projects in an attempt to supplement and/or replace its traditional field collection of price data with alternative sources. In addition to cost reductions, these projects have demonstrated the potential to expand sample size, reduce respondent burden, obtain transaction prices more consistently, and improve price index estimation by incorporating real-time expenditure information—a foundational component of price index theory that has not been practical until now. In CPI, we use the term alternative data to refer to any data not collected through traditional field collection procedures by CPI staff, including third party datasets, corporate data, and data collected through web scraping or retailer API’s. We review how the CPI program is adapting to work with alternative data, followed by discussion of the three main sources of alternative data under consideration by the CPI with a description of research and other steps taken to date for each source. We conclude with some words about future plans… (More)”.

Using massive online choice experiments to measure changes in well-being


Paper by Erik Brynjolfsson, Avinash Collis, and Felix Eggers: “Gross domestic product (GDP) and derived metrics such as productivity have been central to our understanding of economic progress and well-being. In principle, changes in consumer surplus provide a superior, and more direct, measure of changes in well-being, especially for digital goods. In practice, these alternatives have been difficult to quantify. We explore the potential of massive online choice experiments to measure consumer surplus. We illustrate this technique via several empirical examples which quantify the valuations of popular digital goods and categories. Our examples include incentive-compatible discrete-choice experiments where online and laboratory participants receive monetary compensation if and only if they forgo goods for predefined periods.

For example, the median user needed a compensation of about $48 to forgo Facebook for 1 mo. Our overall analyses reveal that digital goods have created large gains in well-being that are not reflected in conventional measures of GDP and productivity. By periodically querying a large, representative sample of goods and services, including those which are not priced in existing markets, changes in consumer surplus and other new measures of well-being derived from these online choice experiments have the potential for providing cost-effective supplements to the existing national income and product accounts….(More)”.

Beyond opinion classification: Extracting facts, opinions and experiences from health forums


Paper by Jorge Carrillo-de-Albornoz et al in PLOS-ONE: “Surveys indicate that patients, particularly those suffering from chronic conditions, strongly benefit from the information found in social networks and online forums. One challenge in accessing online health information is to differentiate between factual and more subjective information. In this work, we evaluate the feasibility of exploiting lexical, syntactic, semantic, network-based and emotional properties of texts to automatically classify patient-generated contents into three types: “experiences”, “facts” and “opinions”, using machine learning algorithms. In this context, our goal is to develop automatic methods that will make online health information more easily accessible and useful for patients, professionals and researchers….

We work with a set of 3000 posts to online health forums in breast cancer, morbus crohn and different allergies. Each sentence in a post is manually labeled as “experience”, “fact” or “opinion”. Using this data, we train a support vector machine algorithm to perform classification. The results are evaluated in a 10-fold cross validation procedure.

Overall, we find that it is possible to predict the type of information contained in a forum post with a very high accuracy (over 80 percent) using simple text representations such as word embeddings and bags of words. We also analyze more complex features such as those based on the network properties, the polarity of words and the verbal tense of the sentences and show that, when combined with the previous ones, they can boost the results….(More)”.

Comparative Accuracy of Diagnosis by Collective Intelligence of Multiple Physicians vs Individual Physicians


Study by Michael L. Barnett et al in JAMA: “Is a collective intelligence approach of pooling multiple clinician and medical student diagnoses associated with improvement in diagnostic accuracy in online, structured clinical cases?

Findings  This cross-sectional study analyzing data from the Human Diagnosis Project found that, across a broad range of medical cases and common presenting symptoms, independent differential diagnoses of multiple physicians combined into a weighted list significantly outperformed diagnoses of individual physicians with groups as small as 2, and accuracy increased with larger groups up to 9 physicians. Groups of nonspecialists also significantly outperformed individual specialists solving cases matched to the individual specialist’s specialty….

Main Outcomes and Measures  The primary outcome was diagnostic accuracy, assessed as a correct diagnosis in the top 3 ranked diagnoses for an individual; for groups, the top 3 diagnoses were a collective differential generated using a weighted combination of user diagnoses with a variety of approaches. A version of the McNemar test was used to account for clustering across repeated solvers to compare diagnostic accuracy.

Conclusions and Relevance  A collective intelligence approach was associated with higher diagnostic accuracy compared with individuals, including individual specialists whose expertise matched the case diagnosis, across a range of medical cases. Given the few proven strategies to address misdiagnosis, this technique merits further study in clinical settings….(More)”.

Crowdsourcing Change: A Novel Vantage Point for Investigating Online Petitioning Platforms


Presentation by Shipi Dhanorkar and Mary Beth Rosson: “The internet connects people who are spatially and temporally separated. One result is new modes of reaching out to, organizing and mobilizing people, including online activism. Internet platforms can be used to mobilize people around specific concerns, short-circuiting structures such as organizational hierarchies or elected officials. These online processes allow consumers and concerned citizens to voice their opinions, often to businesses, other times to civic groups or other authorities. Not surprisingly, this opportunity has encouraged a steady rise in specialized platforms dedicated to online petitioning; eg., Change.org, Care2 Petitions, MoveOn.org, etc.

These platforms are open to everyone; any individual or group who is affected by a problem or disappointed with the status quo, can raise awareness for or against corporate or government policies. Such platforms can empower ordinary citizens to bring about social change, by leveraging support from the masses. In this sense, the platforms allow citizens to “crowdsource change”. In this paper, we offer a comparative analysis of the affordances of four online petitioning platforms, and use this analysis to propose ideas for design enhancements to online petitioning platforms….(More)”.

So Many Nudges, So Little Time: Can Cost-effectiveness Tell Us When It Is Worthwhile to Try to Change Provider Behavior?


Paper by David Atkins: “Interest in behavioral economics has grown steadily within health care. Policy makers, payers, and providers now recognize that the decisions of patients and of their doctors frequently deviate from the strictly “rational” choices that classical economic theory would predict. For example, patients rarely adhere to the medication regimens or health behaviors that would optimize their health outcomes, and clinicians often make decisions that conflict with evidence-based recommendations or even the practices they profess to endorse. The groundbreaking work of psychologist Daniel Kahneman and his collaborator Amos Tversky raised attention to this field, which was accelerated by Kahneman’s 2002 Nobel Prize in economics and his popular 2011 book “Thinking Fast and Slow” which reached a much broader audience.

Behavioral economics examines cognitive, psychological, and cultural factors that may influence how we make decisions, resulting in behavior that another Nobel laureate, economist Richard Thaler, has termed “predictably irrational.” Principles from behavioral economics have been adopted to health care, including the role of heuristics (rules of thumb), the importance of framing, and the effects of specific cognitive biases (for example, overconfidence and status quo bias).

These principles have been incorporated into interventions that seek to use these insights to change health-related behaviors—these include nudges, where systems are redesigned to make the preferred choice the default choice (for example, making generic versions the default in electronic prescribing); incentive programs that reward patients for taking their medications on schedule or getting preventive interventions like immunizations; and specific interventions aimed at how clinicians respond to information or make decisions….(More)”.

How Effective Is Nudging? A Quantitative Review on the Effect Sizes and Limits of Empirical Nudging Studies


Paper by Dennis Hummel and Alexander Maedche: “Changes in the choice architecture, so-called nudges, have been employed in a variety of contexts to alter people’s behavior. Although nudging has gained a widespread popularity, the effect sizes of its influences vary considerably across studies. In addition, nudges have proven to be ineffective or even backfire in selected studies which raises the question whether, and under which conditions, nudges are effective. Therefore, we conduct a quantitative review on nudging with 100 primary publications including 317 effect sizes from different research areas. We derive four key results. (1) A morphological box on nudging based on eight dimensions, (2) an assessment of the effectiveness of different nudging interventions, (3) a categorization of the relative importance of the application context and the nudge category, and (4) a comparison of nudging and digital nudging. Thereby, we shed light on the (in)effectiveness of nudging and we show how the findings of the past can be used for future research. Practitioners, especially government officials, can use the results to review and adjust their policy making….(More)”.