Science as Scorekeeping



Brendan Foht at New Atlantis: “If there is one thing about the coronavirus pandemic that both sides of the political spectrum seem to agree on, it’s that the science that bears on it should never be “politicized.” From the left, former CDC directors of the Obama and Clinton administrations warn of how the Trump administration has politicized the agency’s science: “The only valid reason to change released guidelines is new information and new science — not politics.” From the right, the Wall Street Journal frets about the scientific journal Nature publishing a politically charged editorial about why China shouldn’t be blamed for the coronavirus: “Political pressure has distorted scientific judgment.” What both sides assume is that political authorities should defer to scientists on important decisions about the pandemic, but only insofar as science itself is somehow kept free from politics.

But politicization, and even polarization, are not always bad for science. There is much about how we can use science to respond to the pandemic that is inescapably political, and that we cannot simply leave to scientists to decide.

There is, however, a real problem with how political institutions in the United States have engaged with science. Too much of the debate over coronavirus science has centered on how bad the disease really is, with the administration downplaying its risks and the opposition insisting on its danger. One side sees the scientists warning of peril as a political obstacle that must be overcome. The other side sees them as authorities to whom we must defer, not as servants of the public who could be directed toward solving the problem. The false choice between these two perspectives on how science relates to politics obscures a wide range of political choices the country faces about how we can make use of our scientific resources in responding to the pandemic….(More)”.

COVID-19 Is Challenging Medical and Scientific Publishing


Article by By Vilas Dhar, Amy Brand & Stefano Bertozzi: “We need a transformation in how early data is shared. But the urgent need for peer-reviewed science, coupled with the potential harms of unreviewed publication, has set the stage for a public discussion on the future of academic publishing. It’s clear that we need rapid, transparent peer review that allows reviewers, authors, and readers to engage with one another, and for dynamic use of technology to accelerate publishing timelines without reducing academic rigor or researcher accountability. However, the field of academic publishing will need significant financial support to catalyze these changes.

Philanthropic organizations, as longtime supporters of scientific research, must be at the vanguard of the effort to fund improvements in how science is curated, reviewed, and published. When the MIT Press first began to address the need for the rapid dissemination of COVID-19-related research and scholarship—by making a selection relevant e-books and journal articles freely available, as well as developing a new, rapid publication model for books, under the imprint First Reads—senior staff were interested in undertaking bolder efforts to address the specific problems engendered by the pandemic. The proliferation of preprints related to COVID-19 was already apparent, as was the danger of un-vetted science seeding mainstream media stories with deleterious results.

Rapid Reviews: COVID-19 (RR:C19) is an innovation in open publishing that allows for rigorous, transparent peer review that is publicly shared in advance of publication. We believe that pushing the peer review process further upstream—so that it occurs at the preprint stage—will benefit a wide variety of stakeholders: journalists, clinicians, researchers, and the public at large.  …

With this and future efforts, we’ve identified five key opportunities to align academic publishing priorities with the public good:

  1. Transparency: Redesign and incentivize the peer review process to publish all peer reviews alongside primary research, reducing duplicate reviews and allowing readers and authors to understand and engage with the critiques.
  2. Accountability: The roles of various authors on any given manuscript should be clearly defined and presented for the readers. When datasets are used, one or more of the authors should have explicit responsibility for verifying the integrity of the data and should document that verification process within the paper’s methodology section.
  3. Urgency: Scientific research can be slow moving and time consuming. Publishing data does not have to be. Publishing houses should build networks of experts who are able to dedicate time to scrutinizing papers in a timely manner with the goal of rapid review with rigor.
  4. Digital-First Publishing: While science is a dynamic process of continued learning and exploration, much of scientific publishing conforms to outdated print models. Academic journals should explore opportunities to deploy AI-powered tools to identify peer-reviewers or preprint scholarship and digital publishing platforms to enable more visible communication and collaboration about research findings. Not only can reviews be closer to real-time, but authors can easily respond and modify their work for continuous quality improvement.
  5. Funding: Pioneering new solutions in academic publishing will require significant trial and error, at a time when traditional business models such as library subscriptions are in decline. Philanthropies should step forward to provide catalytic risk financing, testing new models and driving social good outcomes….(More)”.

Science and Scientists Held in High Esteem Across Global Publics


Pew Research: “As publics around the world look to scientists and the research and development process to bring new treatments and preventive strategies for the novel coronavirus, a new international survey finds scientists and their research are widely viewed in a positive light across global publics, and large majorities believe government investments in scientific research yield benefits for society.

Chart shows most value government investment in scientific research, being a world leader in science

Still, the wide-ranging survey, conducted before the COVID-19 outbreak reached pandemic proportions, reveals ambivalence about certain scientific developments – in areas such as artificial intelligence and genetically modified foods – often exists alongside high trust for scientists generally and positive views in other areas such as space exploration….

Scientists as a group are highly regarded, compared with other prominent groups and institutions in society. In all publics, majorities have at least some trust in scientists to do what is right. A median of 36% have “a lot” of trust in scientists, the same share who say this about the military, and much higher than the shares who say this about business leaders, the national government and the news media.

Still, an appreciation for practical experience, more so than expertise, in general, runs deep across publics. A median of 66% say it’s better to rely on people with practical experience to solve pressing problems, while a median of 28% say it’s better to rely on people who are considered experts about the problems, even if they don’t have much practical experience….(More)”.

An Open-Source Tool to Accelerate Scientific Knowledge Discovery


Mozilla: “Timely and open access to novel outputs is key to scientific research. It allows scientists to reproduce, test, and build on one another’s work — and ultimately unlock progress.

The most recent example of this is the research into COVID-19. Much of the work was published in open access journals, swiftly reviewed and ultimately improving our understanding of how to slow the spread and treat the disease. Although this rapid increase in scientific publications is evident in other domains too, we might not be reaping the benefits. The tools to parse and combine this newly created knowledge have roughly remained the same for years.

Today, Mozilla Fellow Kostas Stathoulopoulos is launching Orion — an open-source tool to illuminate the science behind the science and accelerate knowledge discovery in the life sciences. Orion enables users to monitor progress in science, visually explore the scientific landscape, and search for relevant publications.

Orion

Orion collects, enriches and analyses scientific publications in the life sciences from Microsoft Academic Graph.

Users can leverage Orion’s views to interact with the data. The Exploration view shows all of the academic publications in a three-dimensional visualization. Every particle is a paper and the distance between them signifies their semantic similarity; the closer two particles are, the more semantically similar. The Metrics view visualizes indicators of scientific progress and how they have changed over time for countries and thematic topics. The Search view enables the users to search for publications by submitting either a keyword or a longer query, for example, a sentence or a paragraph of a blog they read online….(More)”.

Reassembling Scholarly Communications: Histories, Infrastructures and Global Politics of Open Access


Book edited by Martin Paul Eve and Jonathan Gray: “The Open Access Movement proposes to remove price and permission barriers for accessing peer-reviewed research work—to use the power of the internet to duplicate material at an infinitesimal cost-per-copy. In this volume, contributors show that open access does not exist in a technological or policy vacuum; there are complex social, political, cultural, philosophical, and economic implications for opening research through digital technologies. The contributors examine open access from the perspectives of colonial legacies, knowledge frameworks, publics and politics, archives and digital preservation, infrastructures and platforms, and global communities.

he contributors consider such topics as the perpetuation of colonial-era inequalities in research production and promulgation; the historical evolution of peer review; the problematic histories and discriminatory politics that shape our choices of what materials to preserve; the idea of scholarship as data; and resistance to the commercialization of platforms. Case studies report on such initiatives as the Making and Knowing Project, which created an openly accessible critical digital edition of a sixteenth-century French manuscript, the role of formats in Bruno Latour’s An Inquiry into Modes of Existence, and the Scientific Electronic Library Online (SciELO), a network of more than 1,200 journals from sixteen countries. Taken together, the contributions represent a substantive critical engagement with the politics, practices, infrastructures, and imaginaries of open access, suggesting alternative trajectories, values, and possible futures…(More)”.

Quantified Storytelling: A Narrative Analysis of Metrics on Social Media


Book by Alex Georgakopoulou, Stefan Iversen and Carsten Stage: “This book interrogates the role of quantification in stories on social media: how do visible numbers (e.g. of views, shares, likes) and invisible algorithmic measurements shape the stories we post and engage with? The links of quantification with stories have not been explored sufficiently in storytelling research or in social media studies, despite the fact that platforms have been integrating sophisticated metrics into developing facilities for sharing stories, with a massive appeal to ordinary users, influencers and businesses alike.

With case-studies from Instagram, Reddit and Snapchat, the authors show how three types of metrics, namely content metrics, interface metrics and algorithmic metrics, affect the ways in which cancer patients share their experiences, the circulation of specific stories that mobilize counter-publics and the design of stories as facilities on platforms. The analyses document how numbers structure elements in stories, indicate and produce engagement and become resources for the tellers’ self-presentation….(More)”.

Improving data access democratizes and diversifies science


Research article by Abhishek Nagaraj, Esther Shears, and Mathijs de Vaan: “Data access is critical to empirical research, but past work on open access is largely restricted to the life sciences and has not directly analyzed the impact of data access restrictions. We analyze the impact of improved data access on the quantity, quality, and diversity of scientific research. We focus on the effects of a shift in the accessibility of satellite imagery data from Landsat, a NASA program that provides valuable remote-sensing data. Our results suggest that improved access to scientific data can lead to a large increase in the quantity and quality of scientific research. Further, better data access disproportionately enables the entry of scientists with fewer resources, and it promotes diversity of scientific research….(More)”

Research 4.0: research in the age of automation


Report by Rob Procter, Ben Glover, and Elliot Jones: “There is a growing consensus that we are at the start of a fourth industrial revolution, driven by developments in Artificial Intelligence, machine learning, robotics, the Internet of Things, 3-D printing, nanotechnology, biotechnology, 5G, new forms of energy storage and quantum computing. This report seeks to understand what impact AI is having on the UK’s research sector and what implications it has for its future, with a particular focus on academic research.

Building on our interim report, we find that AI is increasingly deployed in academic research in the UK in a broad range of disciplines. The combination of an explosion of new digital data sources with powerful new analytical tools represents a ‘double dividend’ for researchers. This is allowing researchers to investigate questions that would have been unanswerable just a decade ago. Whilst there has been considerable take-up of AI in academic research, the report highlights that steps could be taken to ensure even wider adoption of these new techniques and technologies, including wider training in the necessary skills for effective utilisation of AI, faster routes to culture change and greater multi-disciplinary collaboration.

This report recognises that the Covid-19 pandemic means universities are currently facing significant pressures, with considerable demands on their resources whilst simultaneously facing threats to income. But as we emerge from the current crisis, we urge policy makers and universities to consider the report’s recommendations and take steps to fortify the UK’s position as a place of world-leading research. Indeed, the current crisis has only reminded us of the critical importance of a highly functioning and flourishing research sector. The report recommends:

The current post-16 curriculum should be reviewed to ensure all pupils receive a grounding in basic digital, quantitative and ethical skills necessary to ensure the effective and appropriate utilisation of AI.A UK-wide audit of research computing and data infrastructure provision is conducted to consider how access might be levelled up.

UK Research and Innovation (UKRI) should consider incentivising institutions to utilise AI wherever it can offer benefits to the economy and society in their future spending on research and development.

Universities should take steps to ensure that it is easier for researchers to move between academia and industry, for example, by putting less emphasis on publications, and recognise other outputs and measures of achievement when hiring for academic posts….(More)”.

Statistics, lies and the virus: lessons from a pandemic


Tim Hartford at the Financial Times: “Will this year be 1954 all over again? Forgive me, I have become obsessed with 1954, not because it offers another example of a pandemic (that was 1957) or an economic disaster (there was a mild US downturn in 1953), but for more parochial reasons. Nineteen fifty-four saw the appearance of two contrasting visions for the world of statistics — visions that have shaped our politics, our media and our health. This year confronts us with a similar choice.

The first of these visions was presented in How to Lie with Statistics, a book by a US journalist named Darrell Huff. Brisk, intelligent and witty, it is a little marvel of numerical communication. The book received rave reviews at the time, has been praised by many statisticians over the years and is said to be the best-selling work on the subject ever published. It is also an exercise in scorn: read it and you may be disinclined to believe a number-based claim ever again….

But they can — and back in 1954, the alternative perspective was embodied in the publication of an academic paper by the British epidemiologists Richard Doll and Austin Bradford Hill. They marshalled some of the first compelling evidence that smoking cigarettes dramatically increases the risk of lung cancer. The data they assembled persuaded both men to quit smoking and helped save tens of millions of lives by prompting others to do likewise. This was no statistical trickery, but a contribution to public health that is almost impossible to exaggerate…

As described in books such as Merchants of Doubt by Erik Conway and Naomi Oreskes, this industry perfected the tactics of spreading uncertainty: calling for more research, emphasising doubt and the need to avoid drastic steps, highlighting disagreements between experts and funding alternative lines of inquiry. The same tactics, and sometimes even the same personnel, were later deployed to cast doubt on climate science. These tactics are powerful in part because they echo the ideals of science.

It is a short step from the Royal Society’s motto, “nullius in verba” (take nobody’s word for it), to the corrosive nihilism of “nobody knows anything”.  So will 2020 be another 1954? From the point of view of statistics, we seem to be standing at another fork in the road.

The disinformation is still out there, as the public understanding of Covid-19 has been muddied by conspiracy theorists, trolls and government spin doctors.  Yet the information is out there too. The value of gathering and rigorously analysing data has rarely been more evident. Faced with a complete mystery at the start of the year, statisticians, scientists and epidemiologists have been working miracles. I hope that we choose the right fork, because the pandemic has lessons to teach us about statistics — and vice versa — if we are willing to learn…(More)”.

Computational social science: Obstacles and opportunities


Paper by David M. J. Lazer et al: “The field of computational social science (CSS) has exploded in prominence over the past decade, with thousands of papers published using observational data, experimental designs, and large-scale simulations that were once unfeasible or unavailable to researchers. These studies have greatly improved our understanding of important phenomena, ranging from social inequality to the spread of infectious diseases. The institutions supporting CSS in the academy have also grown substantially, as evidenced by the proliferation of conferences, workshops, and summer schools across the globe, across disciplines, and across sources of data. But the field has also fallen short in important ways. Many institutional structures around the field—including research ethics, pedagogy, and data infrastructure—are still nascent. We suggest opportunities to address these issues, especially in improving the alignment between the organization of the 20th-century university and the intellectual requirements of the field….(More)”.