Beyond Benchmarking: Why Countries should Ignore International Rankings


Essay by Robyn Klingler-Vidra and Yu-Ching Kuo: “In Ranking the World, Alexander Cooley and Jack Snyder explore the rise of benchmarking and rankings of countries. They indicate more than 95 such rankings by the time their book was published in 2016. Today, with the success of country rankings such as the Economic Intelligence Unit’s Democracy Index and the World Economic Forum’s Global Competitiveness Rankings, that number has grown two-fold, as more than 200 rankings systems compare countries for their democratic quality, investor friendliness, economic competitiveness, and more.

But, international benchmarking methods are problematic; they reflect politics, suffer from incomplete coverage, sample size and bias challenges, and institutional bias. Why, then, do countries increasingly rely on them to inform their policymaking? We employ Taiwan, and entrepreneurship rankings, as a lens to explore the accuracy of benchmarking methodologies, and the offer a new way forward. One that is informed by local evidence rather than global rankings, and as such, is better positioned to solve the ecosystem’s pressing challenges…(More)”.

Lessons from the COVID data wizards


Article by Lynne Peeples: “In March 2020, Beth Blauer started hearing anecdotally that COVID-19 was disproportionately affecting Black people in the United States. But the numbers to confirm that disparity were “very limited”, says Blauer, a data and public-policy specialist at Johns Hopkins University in Baltimore, Maryland. So, her team, which had developed one of the most popular tools for tracking the spread of COVID-19 around the world, added a new graphic to their website: a colour-coded map tracking which US states were — and were not — sharing infection and death data broken down by race and ethnicity.

They posted the map to their data dashboard — the Coronavirus Resource Center — in mid-April 2020 and promoted it through social media and blogs. At the time, just 26 states included racial information with their death data. “Then we started to see the map rapidly filling in,” says Blauer. By the middle of May 2020, 40 states were reporting that information. For Blauer, the change showed that people were paying attention. “And it confirmed that we have the ability to influence what’s happening here,” she says.

COVID-19 dashboards mushroomed around the world in 2020 as data scientists and journalists shifted their work to tracking and presenting information on the pandemic — from infection and death rates, to vaccination data and other variables. “You didn’t have any data set before that was so essential to how you plan your life,” says Lisa Charlotte Muth, a data designer and blogger at Datawrapper, a Berlin-based company that helps newsrooms and journalists to enrich their reporting with embeddable charts. “The weather, maybe, was the closest thing you could compare it to.” The growth in the service’s popularity was impressive. In January 2020 — before the pandemic — Datawrapper had 260 million chart views on its clients’ websites. By April that year, that monthly figure had shot up to more than 4.7 billion.

Policymakers, too, have leaned on COVID-19 data dashboards and charts to guide important decisions. And they had hundreds of local and global examples to reference, including academic enterprises such as the Coronavirus Resource Center, as well as government websites and news-media projects…(More)”.

Social-media reform is flying blind


Paper by Chris Bail: “As Russia continues its ruthless war in Ukraine, pundits are speculating what social-media platforms might have done years ago to undermine propaganda well before the attack. Amid accusations that social media fuels political violence — and even genocide — it is easy to forget that Facebook evolved from a site for university students to rate each other’s physical attractiveness. Instagram was founded to facilitate alcohol-based gatherings. TikTok and YouTube were built to share funny videos.

The world’s social-media platforms are now among the most important forums for discussing urgent social problems, such as Russia’s invasion of Ukraine, COVID-19 and climate change. Techno-idealists continue to promise that these platforms will bring the world together — despite mounting evidence that they are pulling us apart.

Efforts to regulate social media have largely stalled, perhaps because no one knows what something better would look like. If we could hit ‘reset’ and redesign our platforms from scratch, could we make them strengthen civil society?

Researchers have a hard time studying such questions. Most corporations want to ensure studies serve their business model and avoid controversy. They don’t share much data. And getting answers requires not just making observations, but doing experiments.

In 2017, I co-founded the Polarization Lab at Duke University in Durham, North Carolina. We have created a social-media platform for scientific research. On it, we can turn features on and off, and introduce new ones, to identify those that improve social cohesion. We have recruited thousands of people to interact with each other on these platforms, alongside bots that can simulate social-media users.

We hope our effort will help to evaluate some of the most basic premises of social media. For example, tech leaders have long measured success by the number of connections people have. Anthropologist Robin Dunbar has suggested that humans struggle to maintain meaningful relationships with more than 150 people. Experiments could encourage some social-media users to create deeper connections with a small group of users while allowing others to connect with anyone. Researchers could investigate the optimal number of connections in different situations, to work out how to optimize breadth of relationships without sacrificing depth.

A related question is whether social-media platforms should be customized for different societies or groups. Although today’s platforms seem to have largely negative effects on US and Western-Europe politics, the opposite might be true in emerging democracies (P. Lorenz-Spreen et al. Preprint at https://doi.org/hmq2; 2021). One study suggested that Facebook could reduce ethnic tensions in Bosnia–Herzegovina (N. Asimovic et al. Proc. Natl Acad. Sci. USA 118, e2022819118; 2021), and social media has helped Ukraine to rally support around the world for its resistance….(More)”.

Airbnb enabled a movement to help Ukraine. Free housing is only part of it.


Article by Sarah Roach: “When Airbnb announced its goal to provide 100,000 people fleeing Ukraine with free temporary housing, it received an outpouring of support.

Barack Obama promoted the effort on Twitter, and those who could not offer their help decided to support the cause with donations instead.

Now, about 30,000 hosts have signed up on Airbnb.org, the company’s philanthropic site, to provide free housing, according to an Airbnb spokesperson. That figure is already more than the 20,000 Afghan refugees that Airbnb hosts extended free or discounted housing to last summer. Airbnb.org’s goal of providing housing to 100,000 Ukrainian refugees would equal the total number of people Airbnb.org helped through crises between 2017 and 2021 combined.

The company’s nonprofit arm has been slowly building the infrastructure to support more people escaping natural disasters, war and other crises over the past decade. Airbnb’s work started in 2012, when Hurricane Sandy struck and a host wanted to offer free temporary housing. Shortly thereafter, Airbnb launched a tool that allowed hosts to offer their homes to people displaced by natural disasters. After that, Airbnb began extending free or discounted housing to people fleeing conflicts like the Syrian refugee crisis and disasters including hurricanes and earthquakes. By 2020, Airbnb.org broke off into the company’s own philanthropic arm focused on these efforts…(More)”.

How Native Americans Are Trying to Debug A.I.’s Biases


Alex V. Cipolle in The New York Times: “In September 2021, Native American technology students in high school and college gathered at a conference in Phoenix and were asked to create photo tags — word associations, essentially — for a series of images.

One image showed ceremonial sage in a seashell; another, a black-and-white photograph circa 1884, showed hundreds of Native American children lined up in uniform outside the Carlisle Indian Industrial School, one of the most prominent boarding schools run by the American government during the 19th and 20th centuries.

For the ceremonial sage, the students chose the words “sweetgrass,” “sage,” “sacred,” “medicine,” “protection” and “prayers.” They gave the photo of the boarding school tags with a different tone: “genocide,” “tragedy,” “cultural elimination,” “resiliency” and “Native children.”

The exercise was for the workshop Teaching Heritage to Artificial Intelligence Through Storytelling at the annual conference for the American Indian Science and Engineering Society. The students were creating metadata that could train a photo recognition algorithm to understand the cultural meaning of an image.

The workshop presenters — Chamisa Edmo, a technologist and citizen of the Navajo Nation, who is also Blackfeet and Shoshone-Bannock; Tracy Monteith, a senior Microsoft engineer and member of the Eastern Band of Cherokee Indians; and the journalist Davar Ardalan — then compared these answers with those produced by a major image recognition app.

For the ceremonial sage, the app’s top tag was “plant,” but other tags included “ice cream” and “dessert.” The app tagged the school image with “human,” “crowd,” “audience” and “smile” — the last a particularly odd descriptor, given that few of the children are smiling.

The image recognition app botched its task, Mr. Monteith said, because it didn’t have proper training data. Ms. Edmo explained that tagging results are often “outlandish” and “offensive,” recalling how one app identified a Native American person wearing regalia as a bird. And yet similar image recognition apps have identified with ease a St. Patrick’s Day celebration, Ms. Ardalan noted as an example, because of the abundance of data on the topic….(More)”.

Citizen science air quality project in Brussels reveals disparity in pollution levels


Article by Smart Cities World: “A citizen science air quality project in Brussels has revealed a striking disparity in air pollution levels across the city.

It shows socio-economically vulnerable neighbourhoods more likely to suffer from poor air quality. The dataset also shows air quality in the city has improved, but there is still a major health impact.

Between 25 September and 23 October 2021, 3,000 citizens participated in CurieuzenAir, the largest ever citizen science project on air quality in the Belgium capital…

The project is an initiative of the University of Antwerp, urban movement BRAL and Université libre de Bruxelles, in close cooperation with Brussels Environnement, De Standaard, Le Soir and Bruzz. This programme is supported by Bloomberg Philanthropies’ Brussels Clean Air Partnership.

For one month, citizen scientists mapped the concentration of nitrogen dioxide (NO2) – a key indicator of air pollution caused by traffic – in their streets via measuring tubes on the facades of their homes.

The project resulted in a unique dataset showing the impact of road traffic on air quality in Brussels in great detail. Results range from ‘excellent’ to “extremely poor” air quality across Brussels, with a stark contrast in air quality between socio-economically vulnerable neighbourhoods and green, well-off ones.

An interactive dot map shows how the air quality differs greatly from neighbourhood to neighbourhood, and even from street to street. From blue dots (0-15 µg m-3; “very good”) to a number of jet-black dots (>50 µg m-3; “extremely bad”), the CurieuzenAir dataset makes it clear that these differences are explained by emissions from Brussels traffic….

Alain Maron, Brussels minister for climate transition, environment, social affairs and health, said: “CurieuzenAir is a great example of the importance of citizen science. Thanks to all the citizens that took part in the project, we collected unprecedented results on air pollution in Brussels, which help us to better understand the problem in our city.

“While we see that the situation is slowly improving, the concentrations measured still remain unacceptable, and call for urgent, in-depth action. We need to make sure that everyone in the city, wherever they live and whatever they earn, get to breathe a clean and healthy air.”…(More)”.

The first answer for food insecurity: data sovereignty


Interview by Brian Oaster: “For two years now, the COVID-19 pandemic has exacerbated almost every structural inequity in Indian Country. Food insecurity is high on that list.

Like other inequities, it’s an intergenerational product of dispossession and congressional underfunding — nothing new for Native communities. What is new, however, is the ability of Native organizations and sovereign nations to collectively study and understand the needs of the many communities facing the issue. The age of data sovereignty has (finally) arrived.

To that end, the Native American Agriculture Fund (NAAF) partnered with the Indigenous Food and Agricultural Initiative (INAI) and the Food Research and Action Center (FRAC) to produce a special report, Reimagining Hunger Responses in Times of Crisis, which was released in January.

According to the report, 48% of the more than 500 Native respondents surveyed across the country agreed that “sometimes or often during the pandemic the food their household bought just didn’t last, and they didn’t have money to get more.” Food security and access were especially low among Natives with young children or elders at home, people in fair to poor health and those whose employment was disrupted by the pandemic. “Native households experience food insecurity at shockingly higher rates than the general public and white households,” the report noted.

It also detailed how, throughout the pandemic, Natives overwhelmingly turned to their tribal governments and communities — as opposed to state or federal programs — for help. State and federal programs, like the Supplement Nutrition Assistance Program, or SNAP, don’t always mesh with the needs of rural reservations. A benefits card is useless if there’s no food store in your community. In response, tribes and communities came together and worked to get their people fed.

Understanding how and why will help pave the way for legislation that empowers tribes to provide for their own people, by using federal funding to build local agricultural infrastructure, for instance, instead of relying on assistance programs that don’t always work. HCN spoke with the Native American Agriculture Fund’s CEO, Toni Stanger-McLaughlin (Colville), to find out more…(More)”.

Open science, done wrong, will compound inequities


Paper by Tony Ross-Hellauer: “Ten years ago, as a new PhD graduate looking for my next position, I found myself in the academic cold. Nothing says “you are an outsider” more than a paywall asking US$38 for one article. That fuelled my advocacy of open science and, ultimately, drove me to research its implementation.

Now, open science is mainstream, increasingly embedded in policies and expected in practice. But the ways in which it is being implemented can have unintended consequences, and these must not be ignored.

Since 2019, I’ve led ON-MERRIT, a project funded by the European Commission that uses a mixture of computational and qualitative methods to investigate how open science affects the research system. Many in the movement declare equity as a goal, but reality is not always on track for that. Indeed, I fear that without more critical thought, open science could become just the extension of privilege. Our recommendations for what to consider are out this week (see go.nature.com/3kypbj8).

Open science is a vague mix of ideals. Overall, advocates aim to increase transparency, accountability, equity and collaboration in knowledge production by increasing access to research results, articles, methods and tools. This means that data and protocols should be freely shared in high-quality repositories and research articles should be available without subscriptions or reading fees…(More)”.

When Launching a Collaboration, Keep It Agile


Essay by the Stakeholder Alignment Collaborative: “Conventional wisdom holds that large-scale societal challenges require large-scale responses. By contrast, we argue that progress on major societal challenges can and often should begin with small, agile initiatives—minimum viable consortia (MVC)—that learn and adapt as they build the scaffolding for large-scale change. MVCs can address societal challenges by overcoming institutional inertia, opposition, capability gaps, and other barriers because they require less energy for activation, reveal dead ends early on, and can more easily adjust and adapt over time.

Large-scale societal challenges abound, and organizations and institutions are increasingly looking for ways to deal with them. For example, the National Academy of Engineering (NAE) has identified 14 Grand Societal Challenges for “sustaining civilization’s continuing advancement while still improving the quality of life” in the 21st century. They include making solar energy economical, developing carbon sequestration methods, advancing health informatics, and securing cyberspace. The United Nations has set 17 Sustainable Development Goals (SDGs) to achieve by 2030 for a better future for humanity. They include everything from eliminating hunger to reducing inequality.

Tackling such universal goals requires large-scale cooperation, because existing organizations and institutions simply do not have the ability to resolve these challenges independently. Further note that the NAE’s announcement of the challenges stated that “governmental and institutional, political and economic, and personal and social barriers will repeatedly arise to impede the pursuit of solutions to problems.” The United Nations included two enabling SDGs: “peace, justice, and strong institutions” and “partnership for the goals.” The question is how to bring such large-scale partnerships and institutional change into existence.

We are members of the Stakeholder Alignment Collaborative, a research consortium of scholars at different career stages, spanning multiple fields and disciplines. We study collaboration collaboratively and maintain a very flat structure. We have published on multistakeholder consortia associated with science1 and provided leadership and facilitation for the launch and sustainment of many of these consortia. Based on our research into the problem of developing large-scale, multistakeholder partnerships, we believe that MVCs provide an answer.

MVCs are less vulnerable to the many barriers to large-scale solutions, better able to forge partnerships and a more agile framework for making needed adjustments. To demonstrate these points, we focus on examples of MVCs in the domain of scientific research data and computing infrastructure. Research data are essential for virtually all societal challenges, and an upsurge of multistakeholder consortia has occurred in this domain. But the MVC concept is not limited to these challenges, nor to digitally oriented settings. We have chosen this sphere because it offers a diversity of MVC examples for illustration….(More)”. (See also “The Potential and Practice of Data Collaboratives for Migration“).

The Use of Artificial Intelligence as a Strategy to Analyse Urban Informality


Article by Agustina Iñiguez: “Within the Latin American and Caribbean region, it has been recorded that at least 25% of the population lives in informal settlements. Given that their expansion is one of the major problems afflicting these cities, a project is presented, supported by the IDB, which proposes how new technologies are capable of contributing to the identification and detection of these areas in order to intervene in them and help reduce urban informality.

Informal settlements, also known as slums, shantytowns, camps or favelas, depending on the country in question, are uncontrolled settlements on land where, in many cases, the conditions for a dignified life are not in place. Through self-built dwellings, these sites are generally the result of the continuous growth of the housing deficit.

For decades, the possibility of collecting information about the Earth’s surface through satellite imagery has been contributing to the analysis and production of increasingly accurate and useful maps for urban planning. In this way, not only the growth of cities can be seen, but also the speed at which they are growing and the characteristics of their buildings.

Advances in artificial intelligence facilitate the processing of a large amount of information. When a satellite or aerial image is taken of a neighbourhood where a municipal team has previously demarcated informal areas, the image is processed by an algorithm that will identify the characteristic visual patterns of the area observed from space. The algorithm will then identify other areas with similar characteristics in other images, automatically recognising the districts where informality predominates. It is worth noting that while satellites are able to report both where and how informal settlements are growing, specialised equipment and processing infrastructure are also required…(More)”