Not fit for Purpose: A critical analysis of the ‘Five Safes’


Paper by Chris Culnane, Benjamin I. P. Rubinstein, and David Watts: “Adopted by government agencies in Australia, New Zealand, and the UK as policy instrument or as embodied into legislation, the ‘Five Safes’ framework aims to manage risks of releasing data derived from personal information. Despite its popularity, the Five Safes has undergone little legal or technical critical analysis. We argue that the Fives Safes is fundamentally flawed: from being disconnected from existing legal protections and appropriation of notions of safety without providing any means to prefer strong technical measures, to viewing disclosure risk as static through time and not requiring repeat assessment. The Five Safes provides little confidence that resulting data sharing is performed using ‘safety’ best practice or for purposes in service of public interest….(More)”.

Statistical illiteracy isn’t a niche problem. During a pandemic, it can be fatal


Article by Carlo Rovelli: “In the institute where I used to work a few years ago, a rare non-infectious illness hit five colleagues in quick succession. There was a sense of alarm, and a hunt for the cause of the problem. In the past the building had been used as a biology lab, so we thought that there might be some sort of chemical contamination, but nothing was found. The level of apprehension grew. Some looked for work elsewhere.

One evening, at a dinner party, I mentioned these events to a friend who is a mathematician, and he burst out laughing. “There are 400 tiles on the floor of this room; if I throw 100 grains of rice into the air, will I find,” he asked us, “five grains on any one tile?” We replied in the negative: there was only one grain for every four tiles: not enough to have five on a single tile.

We were wrong. We tried numerous times, actually throwing the rice, and there was always a tile with two, three, four, even five or more grains on it. Why? Why would grains “flung randomly” not arrange themselves into good order, equidistant from each other?

Because they land, precisely, by chance, and there are always disorderly grains that fall on tiles where others have already gathered. Suddenly the strange case of the five ill colleagues seemed very different. Five grains of rice falling on the same tile does not mean that the tile possesses some kind of “rice-­attracting” force. Five people falling ill in a workplace did not mean that it must be contaminated. The institute where I worked was part of a university. We, know-­all professors, had fallen into a gross statistical error. We had become convinced that the “above average” number of sick people required an explanation. Some had even gone elsewhere, changing jobs for no good reason.

Life is full of stories such as this. Insufficient understanding of statistics is widespread. The current pandemic has forced us all to engage in probabilistic reasoning, from governments having to recommend behaviour on the basis of statistical predictions, to people estimating the probability of catching the virus while taking part in common activities. Our extensive statistical illiteracy is today particularly dangerous.

We use probabilistic reasoning every day, and most of us have a vague understanding of averages, variability and correlations. But we use them in an approximate fashion, often making errors. Statistics sharpen and refine these notions, giving them a precise definition, allowing us to reliably evaluate, for instance, whether a medicine or a building is dangerous or not.

Society would gain significant advantages if children were taught the fundamental ideas of probability theory and statistics: in simple form in primary school, and in greater depth in secondary school….(More)”.

Responsive Science


Paper by Peter Drahos: “Regulatory capitalism depends heavily on science, but science faces epi-stemic critiques and crises of research integrity. These critiques and crises are outlined and then located within capitalism’s general tragedy of commodification. Drawing on Marx’s insights into the relationship between science, commodity production, and the machine age, the general tragedy of commodification is outlined. From here, the article shifts to discussing some well-known global public good problems relating to access to medicines and access to knowledge. The roots of these problems can be traced back to the way the institution of science has been bent toward processes of capital accumulation. The evidence we have from the history of science suggests that too often its research agendas have been set by capital and the demands of war-making capitalist states. The final part of the article considers whether the ideal of responsiveness might help us to reformulate the way in which we think about the responsibilities and duties of science. It focuses on human rights, citizen science, and the intellectual commons as potential sources of responsiveness. Responsiveness has been a fertile ideal for law and society theorists when it has come to theory building in law and regulation. It also has something to offer the debates around the crises of science….(More)”.

Science Philanthropy and Societal Responsibility: A Match Made for the 21st Century


Blog by Evan S. Michelson: “The overlapping crises the world has experienced in 2020 make clear that resources from multiple sectors — government, private sector, and philanthropy — need to be deployed at multiple scales to better address societal challenges. In particular, science philanthropy has stepped up, helping to advance COVID-19 vaccine developmentidentify solutions to climate change, and make the tools of scientific inquiry more widely available.

As I write in my recently published book, Philanthropy and the Future of Science and Technology (Routledge, 2020), this linkage between science philanthropy and societal responsibility is one that needs to be continually strengthened and advanced as global challenges become more intertwined and as the relationship between science and society becomes more complex. In fact, science philanthropies have an important, yet often overlooked, role in raising the profile of the societal responsibility of research. One way to better understand the role science philanthropies can and should play in society is to draw on the responsible research and innovation (RRI) framework, a concept developed by scholars from fields such as science & technology policy and science & technology studies. Depending on its configuration, the RRI framework has roughly three core dimensions: anticipatory research that is forward-looking and in search of new discoveries, deliberative and inclusive approaches that better engage and integrate members of the public with the research process, and the adoption of reflexive and responsive dispositions by funders (along with those conducting research) to ensure that societal and public values are accounted for and integrated at the outset of a research effort.

Philanthropies that fund research can more explicitly consider this perspective — even just a little bit — when making their funding decisions, thereby helping to better infuse whatever support they provide for individuals, institutions, and networks with attention to broader societal concerns. For instance, doing so not only highlights the need for science philanthropies to identify and support high-quality early career researchers who are pursuing new avenues of science and technology research, but it also raises considerations of diversity, equity, and inclusion as equally important decision-making criteria for funding. The RRI framework also suggests that foundations working in science and technology should not only help to bring together networks of individual scholars and their host institutions, but that the horizon of such collaborations should be actively extended to include practitioners, decision-makers, users, and communities affected by such investigations. Philanthropies can take a further step and reflexively apply these perspectives to how they operate, how they set their strategies and grantmaking priorities, or even in how they directly manage scientific research infrastructure, which some philanthropic institutions have even begun to do within their own institutions….(More)”.

Why Doubt Is Essential to Science


Liv Grjebine at Scientific American: “The confidence people place in science is frequently based not on what it really is, but on what people would like it to be. When I asked students at the beginning of the year how they would define science, many of them replied that it is an objective way of discovering certainties about the world. But science cannot provide certainties. For example, a majority of Americans trust science as long as it does not challenge their existing beliefs. To the question “When science disagrees with the teachings of your religion, which one do you believe?,” 58 percent of North Americans favor religion; 33 percent science; and 6 percent say “it depends.”

But doubt in science is a feature, not a bug. Indeed, the paradox is that science, when properly functioning, questions accepted facts and yields both new knowledge and new questions—not certainty. Doubt does not create trust, nor does it help public understanding. So why should people trust a process that seems to require a troublesome state of uncertainty without always providing solid solutions?


As a historian of science, I would argue that it’s the responsibility of scientists and historians of science to show that the real power of science lies precisely in what is often perceived as its weakness: its drive to question and challenge a hypothesis. Indeed, the scientific approach requires changing our understanding of the natural world whenever new evidence emerges from either experimentation or observation. Scientific findings are hypotheses that encompass the state of knowledge at a given moment. In the long run, many of are challenged and even overturned. Doubt might be troubling, but it impels us towards a better understanding; certainties, as reassuring as they may seem, in fact undermine the scientific process….(More)”.

Science as Scorekeeping



Brendan Foht at New Atlantis: “If there is one thing about the coronavirus pandemic that both sides of the political spectrum seem to agree on, it’s that the science that bears on it should never be “politicized.” From the left, former CDC directors of the Obama and Clinton administrations warn of how the Trump administration has politicized the agency’s science: “The only valid reason to change released guidelines is new information and new science — not politics.” From the right, the Wall Street Journal frets about the scientific journal Nature publishing a politically charged editorial about why China shouldn’t be blamed for the coronavirus: “Political pressure has distorted scientific judgment.” What both sides assume is that political authorities should defer to scientists on important decisions about the pandemic, but only insofar as science itself is somehow kept free from politics.

But politicization, and even polarization, are not always bad for science. There is much about how we can use science to respond to the pandemic that is inescapably political, and that we cannot simply leave to scientists to decide.

There is, however, a real problem with how political institutions in the United States have engaged with science. Too much of the debate over coronavirus science has centered on how bad the disease really is, with the administration downplaying its risks and the opposition insisting on its danger. One side sees the scientists warning of peril as a political obstacle that must be overcome. The other side sees them as authorities to whom we must defer, not as servants of the public who could be directed toward solving the problem. The false choice between these two perspectives on how science relates to politics obscures a wide range of political choices the country faces about how we can make use of our scientific resources in responding to the pandemic….(More)”.

COVID-19 Is Challenging Medical and Scientific Publishing


Article by By Vilas Dhar, Amy Brand & Stefano Bertozzi: “We need a transformation in how early data is shared. But the urgent need for peer-reviewed science, coupled with the potential harms of unreviewed publication, has set the stage for a public discussion on the future of academic publishing. It’s clear that we need rapid, transparent peer review that allows reviewers, authors, and readers to engage with one another, and for dynamic use of technology to accelerate publishing timelines without reducing academic rigor or researcher accountability. However, the field of academic publishing will need significant financial support to catalyze these changes.

Philanthropic organizations, as longtime supporters of scientific research, must be at the vanguard of the effort to fund improvements in how science is curated, reviewed, and published. When the MIT Press first began to address the need for the rapid dissemination of COVID-19-related research and scholarship—by making a selection relevant e-books and journal articles freely available, as well as developing a new, rapid publication model for books, under the imprint First Reads—senior staff were interested in undertaking bolder efforts to address the specific problems engendered by the pandemic. The proliferation of preprints related to COVID-19 was already apparent, as was the danger of un-vetted science seeding mainstream media stories with deleterious results.

Rapid Reviews: COVID-19 (RR:C19) is an innovation in open publishing that allows for rigorous, transparent peer review that is publicly shared in advance of publication. We believe that pushing the peer review process further upstream—so that it occurs at the preprint stage—will benefit a wide variety of stakeholders: journalists, clinicians, researchers, and the public at large.  …

With this and future efforts, we’ve identified five key opportunities to align academic publishing priorities with the public good:

  1. Transparency: Redesign and incentivize the peer review process to publish all peer reviews alongside primary research, reducing duplicate reviews and allowing readers and authors to understand and engage with the critiques.
  2. Accountability: The roles of various authors on any given manuscript should be clearly defined and presented for the readers. When datasets are used, one or more of the authors should have explicit responsibility for verifying the integrity of the data and should document that verification process within the paper’s methodology section.
  3. Urgency: Scientific research can be slow moving and time consuming. Publishing data does not have to be. Publishing houses should build networks of experts who are able to dedicate time to scrutinizing papers in a timely manner with the goal of rapid review with rigor.
  4. Digital-First Publishing: While science is a dynamic process of continued learning and exploration, much of scientific publishing conforms to outdated print models. Academic journals should explore opportunities to deploy AI-powered tools to identify peer-reviewers or preprint scholarship and digital publishing platforms to enable more visible communication and collaboration about research findings. Not only can reviews be closer to real-time, but authors can easily respond and modify their work for continuous quality improvement.
  5. Funding: Pioneering new solutions in academic publishing will require significant trial and error, at a time when traditional business models such as library subscriptions are in decline. Philanthropies should step forward to provide catalytic risk financing, testing new models and driving social good outcomes….(More)”.

Science and Scientists Held in High Esteem Across Global Publics


Pew Research: “As publics around the world look to scientists and the research and development process to bring new treatments and preventive strategies for the novel coronavirus, a new international survey finds scientists and their research are widely viewed in a positive light across global publics, and large majorities believe government investments in scientific research yield benefits for society.

Chart shows most value government investment in scientific research, being a world leader in science

Still, the wide-ranging survey, conducted before the COVID-19 outbreak reached pandemic proportions, reveals ambivalence about certain scientific developments – in areas such as artificial intelligence and genetically modified foods – often exists alongside high trust for scientists generally and positive views in other areas such as space exploration….

Scientists as a group are highly regarded, compared with other prominent groups and institutions in society. In all publics, majorities have at least some trust in scientists to do what is right. A median of 36% have “a lot” of trust in scientists, the same share who say this about the military, and much higher than the shares who say this about business leaders, the national government and the news media.

Still, an appreciation for practical experience, more so than expertise, in general, runs deep across publics. A median of 66% say it’s better to rely on people with practical experience to solve pressing problems, while a median of 28% say it’s better to rely on people who are considered experts about the problems, even if they don’t have much practical experience….(More)”.

An Open-Source Tool to Accelerate Scientific Knowledge Discovery


Mozilla: “Timely and open access to novel outputs is key to scientific research. It allows scientists to reproduce, test, and build on one another’s work — and ultimately unlock progress.

The most recent example of this is the research into COVID-19. Much of the work was published in open access journals, swiftly reviewed and ultimately improving our understanding of how to slow the spread and treat the disease. Although this rapid increase in scientific publications is evident in other domains too, we might not be reaping the benefits. The tools to parse and combine this newly created knowledge have roughly remained the same for years.

Today, Mozilla Fellow Kostas Stathoulopoulos is launching Orion — an open-source tool to illuminate the science behind the science and accelerate knowledge discovery in the life sciences. Orion enables users to monitor progress in science, visually explore the scientific landscape, and search for relevant publications.

Orion

Orion collects, enriches and analyses scientific publications in the life sciences from Microsoft Academic Graph.

Users can leverage Orion’s views to interact with the data. The Exploration view shows all of the academic publications in a three-dimensional visualization. Every particle is a paper and the distance between them signifies their semantic similarity; the closer two particles are, the more semantically similar. The Metrics view visualizes indicators of scientific progress and how they have changed over time for countries and thematic topics. The Search view enables the users to search for publications by submitting either a keyword or a longer query, for example, a sentence or a paragraph of a blog they read online….(More)”.

Reassembling Scholarly Communications: Histories, Infrastructures and Global Politics of Open Access


Book edited by Martin Paul Eve and Jonathan Gray: “The Open Access Movement proposes to remove price and permission barriers for accessing peer-reviewed research work—to use the power of the internet to duplicate material at an infinitesimal cost-per-copy. In this volume, contributors show that open access does not exist in a technological or policy vacuum; there are complex social, political, cultural, philosophical, and economic implications for opening research through digital technologies. The contributors examine open access from the perspectives of colonial legacies, knowledge frameworks, publics and politics, archives and digital preservation, infrastructures and platforms, and global communities.

he contributors consider such topics as the perpetuation of colonial-era inequalities in research production and promulgation; the historical evolution of peer review; the problematic histories and discriminatory politics that shape our choices of what materials to preserve; the idea of scholarship as data; and resistance to the commercialization of platforms. Case studies report on such initiatives as the Making and Knowing Project, which created an openly accessible critical digital edition of a sixteenth-century French manuscript, the role of formats in Bruno Latour’s An Inquiry into Modes of Existence, and the Scientific Electronic Library Online (SciELO), a network of more than 1,200 journals from sixteen countries. Taken together, the contributions represent a substantive critical engagement with the politics, practices, infrastructures, and imaginaries of open access, suggesting alternative trajectories, values, and possible futures…(More)”.