Observing Many Researchers Using the Same Data and Hypothesis Reveals a Hidden Universe of Uncertainty


Paper by Nate Breznau et al: “This study explores how researchers’ analytical choices affect the reliability of scientific findings. Most discussions of reliability problems in science focus on systematic biases. We broaden the lens to include conscious and unconscious decisions that researchers make during data analysis and that may lead to diverging results. We coordinated 161 researchers in 73 research teams and observed their research decisions as they used the same data to independently test the same prominent social science hypothesis: that greater immigration reduces support for social policies among the public. In this typical case of research based on secondary data, we find that research teams reported widely diverging numerical findings and substantive conclusions despite identical start conditions. Researchers’ expertise, prior beliefs, and expectations barely predicted the wide variation in research outcomes. More than 90% of the total variance in numerical results remained unexplained even after accounting for research decisions identified via qualitative coding of each team’s workflow. This reveals a universe of uncertainty that is hidden when considering a single study in isolation. The idiosyncratic nature of how researchers’ results and conclusions varied is a new explanation for why many scientific hypotheses remain contested. It calls for greater humility and clarity in reporting scientific findings..(More)”.

Does South Africa’s Proposed State Ownership of Data Make Any Sense?


Paper by Enyinna S. Nwauche: “This paper interrogates the proposed state ownership of data by South Africa’s Draft National Cloud and Data Policy 2021 and argues that the quest for state ownership is evidence of South Africa’s policy preference for the state custodianship of critical natural resources. The paper suggests that a preferred reading of the proposed state ownership is the affirmation of a regulatory space to address issues related to the digital economy. This paper further suggests that regulatory oversight is inconsistent with the proposed state ownership because of the multi-dimensional nature of data and the fact that data is constitutional property. Rather than seek state ownership of data, the paper examines how to strike a delicate balance between the rights of citizens over data, such as privacy and the data use by companies who are recognized by South African Law to be entitled to some protection of privacy; intellectual property rights and confidential information. The paper sketches a framework of the balance in data governance in South Africa by reviewing jurisprudence that enables South Africa assert appropriate regulatory oversight through laws policies and institutions that enhance her digital economy…(More)”.

Who rules the deliberative party? Examining the Agora case in Belgium


Paper by Nino Junius and Joke Matthieu: “In recent years, pessimism about plebiscitary intra-party democracy has been challenged by assembly-based models of intra-party democracy. However, research has yet to explore the emergence of new power dynamics in parties originating from the implementation of deliberative practices in their intra-party democracy. We investigate how deliberative democratization reshuffles power relations within political parties through a case study of Agora, an internally deliberative movement party in Belgium. Employing a process-tracing approach using original interview and participant observation data, we argue that while plebiscitary intra-party democracy shifts power towards passive members prone to elite domination, our case suggests that deliberative intra-party democracy shifts power towards active members that are more likely to be critical of elites…(More)”

Can Social Media Rhetoric Incite Hate Incidents? Evidence from Trump’s “Chinese Virus” Tweets


Paper by Andy Cao, Jason M. Lindo & Jiee Zhong: “We will investigate whether Donald Trump’s “Chinese Virus” tweets contributed to the rise of anti-Asian incidents. We find that the number of incidents spiked following Trump’s initial “Chinese Virus” tweets and the subsequent dramatic rise in internet search activity for the phrase. Difference-in-differences and event-study analyses leveraging spatial variation indicate that this spike in anti-Asian incidents was significantly more pronounced in counties that supported Donald Trump in the 2016 presidential election relative to those that supported Hillary Clinton. We estimate that anti-Asian incidents spiked by 4000 percent in Trump-supporting counties, over and above the spike observed in Clinton-supporting counties…(More)”.

Antitrust, Regulation, and User Union in the Era of Digital Platforms and Big Data


Paper by Lin William Cong and Simon Mayer: “We model platform competition with endogenous data generation, collection, and sharing, thereby providing a unifying framework to evaluate data-related regulation and antitrust policies. Data are jointly produced from users’ economic activities and platforms’ investments in data infrastructure. Data improves service quality, causing a feedback loop that tends to concentrate market power. Dispersed users do not internalize the impact of their data contribution on (i) service quality for other users, (ii) market concentration, and (iii) platforms’ incentives to invest in data infrastructure, causing inefficient over- or under-collection of data. Data sharing proposals, user privacy protections, platform commitments, and markets for data cannot fully address these inefficiencies. We propose and analyze user union, which represents and coordinates users, as an effective solution for antitrust and consumer protection in the digital era…(More)”.

Charting an Equity-Centered Public Health Data System


Introduction to Special Issue by Alonzo L. Plough: “…The articles in this special issue were written with that vision in mind; several of them even informed the commission’s deliberations. Each article addresses an issue essential to the challenge of building an equity-focused public health data system:

  • Why Equity Matters in Public Health Data. Authors Anita Chandra, Laurie T. Martin, Joie D. Acosta, Christopher Nelson, Douglas Yeung, Nabeel Qureshi, and Tara Blagg explore where and how equity has been lacking in public health data and the implications of considering equity to the tech and data sectors.
  • What is Public Health Data? As authors Joie D. Acosta, Anita Chandra, Douglas Yeung, Christopher Nelson, Nabeel Qureshi, Tara Blagg, and Laurie T. Martin explain, good public health data are more than just health data. We need to reimagine the types of data we collect and from where, as well data precision, granularity, timeliness, and more.
  • Public Health Data and Special Populations. People of color, women, people with disabilities, and people who are lesbian, gay bisexual trans-gendered queer are among the populations that have been inconsistently represented in public health data over time. This article by authors Tina J. Kauh and Maryam Khojasteh reviews findings for each population, as well as commonalities across populations.
  • Public health data interoperability and connectedness. What are challenges to connecting public health data swiftly yet accurately? What gaps need to be filled? How can the data and tech sector help address these issues? These are some of the questions explored in this article by authors Laurie T. Martin, Christopher Nelson, Douglas Yeung, Joie D. Acosta, Nabeel Qureshi, Tara Blagg, and Anita Chandra.
  • Integrating Tech and Data Expertise into the Public Health Workforce. This article by authors Laurie T. Martin, Anita Chandra, Christopher Nelson, Douglas Yeung, Joie D. Acosta, Nabeel Qureshi, and Tara Blag envisions what a tech-savvy public health workforce will look like and how it can be achieved through new workforce models, opportunities to expand capacity, and training….(More)”.

Wicked Problems Might Inspire Greater Data Sharing


Paper by Susan Ariel Aaronson: “In 2021, the United Nations Development Program issued a plea in their 2021 Digital Economy Report. “ Global data-sharing can help address major global development challenges such as poverty, health, hunger and climate change. …Without global cooperation on data and information, research to develop the vaccine and actions to tackle the impact of the pandemic would have been a much more difficult task. Thus, in the same way as some data can be public goods, there is a case for some data to be considered as global public goods, which need to be addressed and provided through global governance.” (UNDP: 2021, 178). Global public goods are goods and services with benefits and costs that potentially extend to all countries, people, and generations. Global data sharing can also help solve what scholars call wicked problems—problems so complex that they require innovative, cost effective and global mitigating strategies. Wicked problems are problems that no one knows how to solve without
creating further problems. Hence, policymakers must find ways to encourage greater data sharing among entities that hold large troves of various types of data, while protecting that data from theft, manipulation etc. Many factors impede global data sharing for public good purposes; this analysis focuses on two.
First, policymakers generally don’t think about data as a global public good; they view data as a commercial asset that they should nurture and control. While they may understand that data can serve the public interest, they are more concerned with using data to serve their country’s economic interest. Secondly, many leaders of civil society and business see the data they have collected as proprietary data. So far many leaders of private entities with troves of data are not convinced that their organization will benefit from such sharing. At the same time, companies voluntarily share some data for social good purposes.

However, data cannot meet its public good purpose if data is not shared among societal entities. Moreover, if data as a sovereign asset, policymakers are unlikely to encourage data sharing across borders oriented towards addressing shared problems. Consequently, society will be less able to use data as both a commercial asset and as a resource to enhance human welfare. As the Bennet Institute and ODI have argued, “value comes from data being brought together, and that requires organizations to let others use the data they hold.” But that also means the entities that collected the data may not accrue all of the benefits from that data (Bennett Institute and ODI: 2020a: 4). In short, private entities are not sufficiently incentivized to share data in the global public good…(More)”.

Addressing ethical gaps in ‘Technology for Good’: Foregrounding care and capabilities


Paper by Alison B. Powell et al: “This paper identifies and addresses persistent gaps in the consideration of ethical practice in ‘technology for good’ development contexts. Its main contribution is to model an integrative approach using multiple ethical frameworks to analyse and understand the everyday nature of ethical practice, including in professional practice among ‘technology for good’ start-ups. The paper identifies inherent paradoxes in the ‘technology for good’ sector as well as ethical gaps related to (1) the sometimes-misplaced assignment of virtuousness to an individual; (2) difficulties in understanding social constraints on ethical action; and (3) the often unaccounted for mismatch between ethical intentions and outcomes in everyday practice, including in professional work associated with an ‘ethical turn’ in technology. These gaps persist even in contexts where ethics are foregrounded as matters of concern. To address the gaps, the paper suggests systemic, rather than individualized, considerations of care and capability applied to innovation settings, in combination with considerations of virtue and consequence. This paper advocates for addressing these challenges holistically in order to generate renewed capacity for change at a systemic level…(More)”.

Does AI Debias Recruitment? Race, Gender, and AI’s “Eradication of Difference”


Paper by Eleanor Drage & Kerry Mackereth: “In this paper, we analyze two key claims offered by recruitment AI companies in relation to the development and deployment of AI-powered HR tools: (1) recruitment AI can objectively assess candidates by removing gender and race from their systems, and (2) this removal of gender and race will make recruitment fairer, help customers attain their DEI goals, and lay the foundations for a truly meritocratic culture to thrive within an organization. We argue that these claims are misleading for four reasons: First, attempts to “strip” gender and race from AI systems often misunderstand what gender and race are, casting them as isolatable attributes rather than broader systems of power. Second, the attempted outsourcing of “diversity work” to AI-powered hiring tools may unintentionally entrench cultures of inequality and discrimination by failing to address the systemic problems within organizations. Third, AI hiring tools’ supposedly neutral assessment of candidates’ traits belie the power relationship between the observer and the observed. Specifically, the racialized history of character analysis and its associated processes of classification and categorization play into longer histories of taxonomical sorting and reflect the current demands and desires of the job market, even when not explicitly conducted along the lines of gender and race. Fourth, recruitment AI tools help produce the “ideal candidate” that they supposedly identify through by constructing associations between words and people’s bodies. From these four conclusions outlined above, we offer three key recommendations to AI HR firms, their customers, and policy makers going forward…(More)”.

Nudging the Nudger: A Field Experiment on the Effect of Performance Feedback to Service Agents on Increasing Organ Donor Registrations


Paper by Julian House, Nicola Lacetera, Mario Macis & Nina Mazar: “We conducted a randomized controlled trial involving nearly 700 customer-service representatives (CSRs) in a Canadian government service agency to study whether providing CSRs with performance feedback with or without peer comparison affected their subsequent organ donor registration rates. Despite having no tie to remuneration or promotion, the provision of individual performance feedback three times over one year resulted in a 25% increase in daily signups, compared to otherwise similar encouragement and reminders. Adding benchmark information that compared CSRs performance to average and top peer performance did not further enhance this effect. Registrations increased more among CSRs whose performance was already above average, and there was no negative effect on lower-performing CSRs. A post-intervention survey showed that CSRs found the information included in the treatments helpful and encouraging. However, performance feedback without benchmark information increased perceived pressure to perform…(More)”.