A Council of Citizens Should Regulate Algorithms

Curated on Posted on by Stefaan Verhulst

Federica Carugati at Wired: “…A new report by OpenAI suggests we should create external auditing bodies to evaluate the societal impact of algorithm-based decisions. But the report does not specify what such bodies should look like.

We don’t know how to regulate algorithms, because their application to societal problems involves a fundamental incongruity. Algorithms follow logical rules in order to optimize for a given outcome. Public policy is all a matter of trade-offs: optimizing for some groups in society necessarily makes others worse off.

Resolving social trade-offs requires that many different voices be heard. This may sound radical, but it is in fact the original lesson of democracy: Citizens should have a say. We don’t know how to regulate algorithms, because we have become shockingly bad at citizen governance.

Is citizen governance feasible today? Sure, it is. We know from social scientists that a diverse group of people can make very good decisions. We also know from a number of recent experiments that citizens can be called upon to make decisions on very tough policy issues, including climate change, and even to shape constitutions. Finally, we can draw from the past for inspiration on how to actually build citizen-run institutions.

The ancient Athenians—the citizens of the world’s first large-scale experiment in democracy—built an entire society on the principle of citizen governance. One institution stands out for our purposes: the Council of Five Hundred, a deliberative body in charge of all decisionmaking, from war to state finance to entertainment. Every year, 50 citizens from each of the 10 tribes were selected by lot to serve. Selection occurred among those that had not served the year before and had not already served twice.

These simple organizational rules facilitated broad participation, knowledge aggregation, and citizen learning. First, because the term was limited and could not be iterated more than twice, over time a broad section of the population—rich and poor, educated and not—participated in decisionmaking. Second, because the council represented the whole population (each tribe integrated three different geographic constituencies), it could draw upon the diverse knowledge of its members. Third, at the end of their mandate, councillors returned home with a body of knowledge about the affairs of their city that they could share with their families, friends, and coworkers, some of whom already served and some who soon would. Certainly, the Athenians did not follow through on their commitment to inclusion. As a result, many people’s voices went unheard, including those of women, foreigners, and slaves. But we don’t need to follow the Athenian example on this front.

A citizen council for algorithms modeled on the Athenian example would represent the entire American citizen population. We already do this with juries (although it is possible that, when decisions affect a specific constituency, a better fit with the actual polity might be required). Citizens’ deliberations would be informed by agency self-assessments and algorithmic impact statements for decision systems used by government agencies, and internal auditing reports for industry, as well as reports from investigative journalists and civil society activists, whenever available. Ideally, the council would act as an authoritative body or as an advisory board to an existing regulatory agency….(More)”.

Wrongfully Accused by an Algorithm

Curated on Posted on by Stefaan Verhulst

Kashmir Hill at the New York Times: “In what may be the first known case of its kind, a faulty facial recognition match led to a Michigan man’s arrest for a crime he did not commit….

The Shinola shoplifting occurred in October 2018. Katherine Johnston, an investigator at Mackinac Partners, a loss prevention firm, reviewed the store’s surveillance video and sent a copy to the Detroit police, according to their report.

Five months later, in March 2019, Jennifer Coulson, a digital image examiner for the Michigan State Police, uploaded a “probe image” — a still from the video, showing the man in the Cardinals cap — to the state’s facial recognition database. The system would have mapped the man’s face and searched for similar ones in a collection of 49 million photos.

The state’s technology is supplied for $5.5 million by a company called DataWorks Plus. Founded in South Carolina in 2000, the company first offered mug shot management software, said Todd Pastorini, a general manager. In 2005, the firm began to expand the product, adding face recognition tools developed by outside vendors.

When one of these subcontractors develops an algorithm for recognizing faces, DataWorks attempts to judge its effectiveness by running searches using low-quality images of individuals it knows are present in a system. “We’ve tested a lot of garbage out there,” Mr. Pastorini said. These checks, he added, are not “scientific” — DataWorks does not formally measure the systems’ accuracy or bias.

“We’ve become a pseudo-expert in the technology,” Mr. Pastorini said.

In Michigan, the DataWorks software used by the state police incorporates components developed by the Japanese tech giant NEC and by Rank One Computing, based in Colorado, according to Mr. Pastorini and a state police spokeswoman. In 2019, algorithms from both companies were included in a federal study of over 100 facial recognition systems that found they were biased, falsely identifying African-American and Asian faces 10 times to 100 times more than Caucasian faces….(More)“.

Nightmare of the Imaginaries: A Critique of Socio-technical Imaginaries Commonly Applied to Governance

Curated on Posted on by Stefaan Verhulst

Essay by Paul Waller: “This essay aims to analyse and debunk several technology-related concepts commonly discussed in papers, reports and speeches by academics, consultancies, politicians and governmental bodies. Each reflects a presumption about how technology, the internet in particular, and technology-enabled social and political processes might affect the practice of governing. The discussion characterizes the concepts as “socio-technical imaginaries”, a term for ideas that link the socio-political environment with technology. Socio-technical imaginaries start as a description of potentially attainable futures, turn into a prescription of futures that ought to be attained, then become received wisdom about the present day. They are speculation that takes root through reuse and endorsement by authoritative figures, becoming an asserted present reality on the basis of little or no evidence. Once imaginaries become widely accepted and used, they may shape trajectories of research and innovation, steering technological progress as well as public and private expenditure. The imaginaries addressed are: Public Sector Innovation, Digital Transformation of Government, Co-creation & Co-production of Public Services, Crowd-sourcing, Wisdom of Crowds, Collaborative Governance, Customer/Citizen Centricity, Once-only Principle, Personalisation, Big Data, Nudge (Behavioral Insights), Platform Government/GaaP, and Online Participation.

Four questions are posed to critique each imaginary: What is the received wisdom? What does that really mean? What is the problem/what has gone wrong? What to do better/what should it be? As a whole package, these imaginaries represent a nightmare for liberal, representative democracy. Some may enable the “panoptic” state, others may undermine existing institutions to open a void for it to step into. Many have the likelihood of creating or reinforcing inequality of opportunity, outcome or influence. But their grip is hard to loosen. The notions that they are inevitable or that issues will be resolved in due course by technology itself need to be challenged by surfacing the human, social and political dimensions and actively addressing them….(More)”.

IRS Used Cellphone Location Data to Try to Find Suspects

Curated on Posted on by Stefaan Verhulst

Byron Tau at the Wall Street Journal: “The Internal Revenue Service attempted to identify and track potential criminal suspects by purchasing access to a commercial database that records the locations of millions of American cellphones.

The IRS Criminal Investigation unit, or IRS CI, had a subscription to access the data in 2017 and 2018, and the way it used the data was revealed last week in a briefing by IRS CI officials to Sen. Ron Wyden’s (D., Ore.) office. The briefing was described to The Wall Street Journal by an aide to the senator.

IRS CI officials told Mr. Wyden’s office that their lawyers had given verbal approval for the use of the database, which is sold by a Virginia-based government contractor called Venntel Inc. Venntel obtains anonymized location data from the marketing industry and resells it to governments. IRS CI added that it let its Venntel subscription lapse after it failed to locate any targets of interest during the year it paid for the service, according to Mr. Wyden’s aide.

Justin Cole, a spokesman for IRS CI, said it entered into a “limited contract with Venntel to test their services against the law enforcement requirements of our agency.” IRS CI pursues the most serious and flagrant violations of tax law, and it said it used the Venntel database in “significant money-laundering, cyber, drug and organized-crime cases.”

The episode demonstrates a growing law enforcement interest in reams of anonymized cellphone movement data collected by the marketing industry. Government entities can try to use the data to identify individuals—which in many cases isn’t difficult with such databases.

It also shows that data from the marketing industry can be used as an alternative to obtaining data from cellphone carriers, a process that requires a court order. Until 2018, prosecutors needed “reasonable grounds” to seek cell tower records from a carrier. In June 2018, the U.S. Supreme Court strengthened the requirement to show probable cause a crime has been committed before such data can be obtained from carriers….(More)”

How Facebook, Twitter and other data troves are revolutionizing social science

Curated on Posted on by Stefaan Verhulst

Heidi Ledford at Nature: “Elizaveta Sivak spent nearly a decade training as a sociologist. Then, in the middle of a research project, she realized that she needed to head back to school.

Sivak studies families and childhood at the National Research University Higher School of Economics in Moscow. In 2015, she studied the movements of adolescents by asking them in a series of interviews to recount ten places that they had visited in the past five days. A year later, she had analysed the data and was feeling frustrated by the narrowness of relying on individual interviews, when a colleague pointed her to a paper analysing data from the Copenhagen Networks Study, a ground-breaking project that tracked the social-media contacts, demographics and location of about 1,000 students, with five-minute resolution, over five months1. She knew then that her field was about to change. “I realized that these new kinds of data will revolutionize social science forever,” she says. “And I thought that it’s really cool.”

With that, Sivak decided to learn how to program, and join the revolution. Now, she and other computational social scientists are exploring massive and unruly data sets, extracting meaning from society’s digital imprint. They are tracking people’s online activities; exploring digitized books and historical documents; interpreting data from wearable sensors that record a person’s every step and contact; conducting online surveys and experiments that collect millions of data points; and probing databases that are so large that they will yield secrets about society only with the help of sophisticated data analysis.

Over the past decade, researchers have used such techniques to pick apart topics that social scientists have chased for more than a century: from the psychological underpinnings of human morality, to the influence of misinformation, to the factors that make some artists more successful than others. One study uncovered widespread racism in algorithms that inform health-care decisions2; another used mobile-phone data to map impoverished regions in Rwanda3.

“The biggest achievement is a shift in thinking about digital behavioural data as an interesting and useful source”, says Markus Strohmaier, a computational social scientist at the GESIS Leibniz Institute for the Social Sciences in Cologne, Germany.

Not everyone has embraced that shift. Some social scientists are concerned that the computer scientists flooding into the field with ambitions as big as their data sets are not sufficiently familiar with previous research. Another complaint is that some computational researchers look only at patterns and do not consider the causes, or that they draw weighty conclusions from incomplete and messy data — often gained from social-media platforms and other sources that are lacking in data hygiene.

The barbs fly both ways. Some computational social scientists who hail from fields such as physics and engineering argue that many social-science theories are too nebulous or poorly defined to be tested.

This all amounts to “a power struggle within the social-science camp”, says Marc Keuschnigg, an analytical sociologist at Linköping University in Norrköping, Sweden. “Who in the end succeeds will claim the label of the social sciences.”

But the two camps are starting to merge. “The intersection of computational social science with traditional social science is growing,” says Keuschnigg, pointing to the boom in shared journals, conferences and study programmes. “The mutual respect is growing, also.”…(More)”.

Normalizing Health-Positive Technology

Curated on Posted on by Stefaan Verhulst

Article by By Sara J. Singer, Stephen Downs, Grace Ann Joseph, Neha Chaudhary, Christopher Gardner, Nina Hersher, Kelsey P. Mellard, Norma Padrón & Yennie Solheim: “….Aligning the technology sector with a societal goal of greater health and well-being entails a number of shifts in thinking. The most fundamental is understanding health not as a vertical market segment, but as a horizontal value: In addition to developing a line of health products or services, health should be expressed across a company’s full portfolio of products and services. Rather than pushing behaviors on people through information and feedback, technology companies should also pull behaviors from people by changing the environment and products they are offered; in addition to developing technology to help people overcome the challenge of being healthy, we need to envision technology that helps to reduce the challenges to being healthy. And in addition to holding individuals responsible for choices that they make, we also need to recognize the collective responsibility that society bears for the choices it makes available.

How to catalyze these shifts?

To find out, we convened a “tech-enabled health,” in which 50 entrepreneurs, leaders from large technology companies, investors, policymakers, clinicians, and public health experts designed a hands-on, interactive, and substantively focused agenda. Participants brainstormed ways that consumer-facing technologies could help people move more, eat better, sleep well, stay socially connected, and reduce stress. In groups and collectively, participants also considered ways in which ideas related and might be synergistic, potential barriers and contextual conditions that might impede or support transformation, and strategies for catalyzing the desired shift. Participants were mixed in terms of sector, discipline, and gender (though the attendees were not as diverse in terms of race/ethnicity or economic strata as the users we potentially wanted to impact—a limitation noted by participants). We intentionally maintained a positive tone, emphasizing potential benefits of shifting toward a health-positive approach, rather than bemoaning the negative role that technology can play….(More)”.

Defining a ‘new normal’ for data privacy in the wake of COVID-19

Curated on Posted on by Stefaan Verhulst

Jack Dunn at IAPP: “…It is revealing that our relationship with privacy is amorphous and requires additional context in light of transformative technologies, new economic realities and public health emergencies. How can we reasonably evaluate the costs and benefits of Google or Facebook sharing location data with the federal government when it has been perfectly legal for Walgreen’s to share access to customer data with pharmaceutical advertisers? How does aggregating and anonymizing data safeguard privacy when a user’s personal data can be revealed through other data points?

The pandemic is only revealing that we’ve yet to reach a consensus on privacy norms that will come to define the digital age. 

This isn’t the first time that technology confounded notions of privacy and consumer protection. In fact, the constitutional right to privacy was born out of another public health crisis. Before 1965, 32 women per 100,000 live births died while giving birth. Similarly, 25 infants died per 100,000 live births. As a result, medical professionals and women’s rights advocates began arguing for greater access to birth control. When state legislatures sought to minimize access, birth control advocates filed lawsuits that eventually lead to the Supreme Court’s seminal case regarding the right to privacy, Griswold v. Connecticut.…

Today, there is growing public concern over the way in which consumer data is used to consolidate economic gain among the few while steering public perception among the many — particularly at a time when privacy seems to be the price for ending public health emergencies.

But the COVID-19 outbreak is also highlighting how user data has the capacity to improve consumer well being and public health. While strict adherence to traditional notions of privacy may be ineffectual in a time of exponential technological growth, the history of our relationship to privacy and technology suggests regulatory policies can strike a balance between otherwise competing interests….(More)“.

Digital diplomacy: States go online

Curated on Posted on by Stefaan Verhulst

Philipp Grüll at Euractiv: “When Germany takes over the European Council Presidency on 1 July, Berlin will have plenty to do. The draft programme seen by EURACTIV Germany focuses on the major challenges of our time: climate change, digitisation, and the coronavirus.

Berlin wants to establish ‘European Digital Diplomacy’ by creating a ‘Digital Diplomacy Network’ to exist alongside the ‘Technospheres USA and China’.

This should not only be about keeping European industries competitive. After all, the term “digital diplomacy” is not new.

Ilan Manor, a researcher at Oxford University and author of numerous papers on digital diplomacy, defines it as “the use of digital tools to achieve foreign policy goals.”

This definition is intentionally broad, Manor told EURACTIV Germany, because technology can be used in so many areas of international relations….

Manor divides the development of this digital public diplomacy into two phases.

In the first one, from 2008 to 2015, governments took the first cautious steps. They experimented and launched random and often directionless online activities. Foreign ministries and embassies set up social media accounts. Sweden opened a virtual embassy in the online video game “Second Life.”

It was only in the second phase, from 2015 to the present, that foreign ministries began to act more strategically. They used “Big Data” to record public opinion in other countries, and also to track down online propaganda against their own country.

As an example, Manor cites the Russian embassy in the United Kingdom, which is said to have deliberately disseminated anti-EU narratives prior to the Brexit referendum, packaged in funny and seemingly innocent Internet memes that spread rapidly….(More)”.

The people solving mysteries during lockdown

Curated on Posted on by Stefaan Verhulst

Frank Swain at the BBC: “For almost half a century, Benedictine monks in Herefordshire dutifully logged the readings of a rain gauge on the grounds of Belmont Abbey, recording the quantity of rain that had fallen each month without fail. That is, until 1948, when measurements were suspended while the abbot waited for someone to repair a bullet hole in the gauge funnel.

How the bullet hole came to be there is still a mystery, but it’s just one of the stories uncovered by a team of 16,000 volunteers who have been taking part in Rainfall Rescue, a project to digitise hand-written records of British weather. The documents, held by the Met Office, contain 3.5 million datapoints and stretch as far back as 1820.

Ed Hawkins, a climate scientist at the University of Reading, leads the project. “It launched at the end of March, we realised people would have a lot of spare time on their hands,” he explains. “It was completed in 16 days. I was expecting 16 weeks, not 16 days… the volunteers absolutely blitzed it.” He says the data will be used to improve future weather predictions and climate modelling.

With millions of people trapped at home during the pandemic, citizen science projects are seeing a boom in engagement. Rainfall Rescue uses a platform called Zooniverse, which hosts dozens of projects covering everything from artworks to zebra. While the projects generally have scientific aims, many allow people to also contribute some good to the world. 

Volunteers can scour satellite images for rural houses across Africa so they can be connected to the electricity grid, for example. Another – led by researchers at the University of Nottingham in the UK – is hunting for signs of modern slavery in the shape of brick kilns in South Asia (although the project has faced some criticism for being an over-simplified way of looking at modern slavery).

Others are trying to track the spread of invasive species in the ocean from underwater photographs, or identify earthquakes and tremors by speeding up the seismic signals so they become audible and can be classified by sharp-eared volunteers. “You could type in data on old documents, count penguins, go to the Serengeti and look at track camera images – it’s an incredible array,” says Hawkins. “Whatever you’re interested in there’s something for you.”…(More)”.

Tech Firms Are Spying on You. In a Pandemic, Governments Say That’s OK.

Curated on Posted on by Stefaan Verhulst

Sam Schechner, Kirsten Grind and Patience Haggin at the Wall Street Journal: “While an undergraduate at the University of Virginia, Joshua Anton created an app to prevent users from drunk dialing, which he called Drunk Mode. He later began harvesting huge amounts of user data from smartphones to resell to advertisers.

Now Mr. Anton’s company, called X-Mode Social Inc., is one of a number of little-known location-tracking companies that are being deployed in the effort to reopen the country. State and local authorities wielding the power to decide when and how to reopen are leaning on these vendors for the data to underpin those critical judgment calls.

In California, Gov. Gavin Newsom’s office used data from Foursquare Labs Inc. to figure out if beaches were getting too crowded; when the state discovered they were, it tightened its rules. In Denver, the Tri-County Health Department is monitoring counties where the population on average tends to stray more than 330 feet from home, using data from Cuebiq Inc.

Researchers at the University of Texas in San Antonio are using movement data from a variety of companies, including the geolocation firm SafeGraph, to guide city officials there on the best strategies for getting residents back to work.

Many of the location-tracking firms, data brokers and other middlemen are part of the ad-tech industry, which has come under increasing fire in recent years for building what critics call a surveillance economy. Data for targeting ads at individuals, including location information, can also end up in the hands of law-enforcement agencies or political groups, often with limited disclosure to users. Privacy laws are cropping up in states including California, along with calls for federal privacy legislation like that in the European Union.

But some public-health authorities are setting aside those concerns to fight an unprecedented pandemic. Officials are desperate for all types of data to identify people potentially infected with the virus and to understand how they are behaving to predict potential hot spots—whether those people realize it or not…(More)”