New York City moves to create accountability for algorithms

Curated on Posted on by Stefaan Verhulst

Lauren Kirchner at ArsTechnica: “The algorithms that play increasingly central roles in our lives often emanate from Silicon Valley, but the effort to hold them accountable may have another epicenter: New York City. Last week, the New York City Council unanimously passed a bill to tackle algorithmic discrimination—the first measure of its kind in the country.

The algorithmic accountability bill, waiting to be signed into law by Mayor Bill de Blasio, establishes a task force that will study how city agencies use algorithms to make decisions that affect New Yorkers’ lives, and whether any of the systems appear to discriminate against people based on age, race, religion, gender, sexual orientation, or citizenship status. The task force’s report will also explore how to make these decision-making processes understandable to the public.

The bill’s sponsor, Council Member James Vacca, said he was inspired by ProPublica’s investigation into racially biased algorithms used to assess the criminal risk of defendants….

A previous, more sweeping version of the bill had mandated that city agencies publish the source code of all algorithms being used for “targeting services” or “imposing penalties upon persons or policing” and to make them available for “self-testing” by the public. At a hearing at City Hall in October, representatives from the mayor’s office expressed concerns that this mandate would threaten New Yorkers’ privacy and the government’s cybersecurity.

The bill was one of two moves the City Council made last week concerning algorithms. On Thursday, the committees on health and public safety held a hearing on the city’s forensic methods, including controversial tools that the chief medical examiner’s office crime lab has used for difficult-to-analyze samples of DNA.

As a ProPublica/New York Times investigation detailed in September, an algorithm created by the lab for complex DNA samples has been called into question by scientific experts and former crime lab employees.

The software, called the Forensic Statistical Tool, or FST, has never been adopted by any other lab in the country….(More)”.

Crowdsourcing Accurately and Robustly Predicts Supreme Court Decisions

Curated on Posted on by Stefaan Verhulst

Paper by Katz, Daniel Martin and Bommarito, Michael James and Blackman, Josh: “Scholars have increasingly investigated “crowdsourcing” as an alternative to expert-based judgment or purely data-driven approaches to predicting the future. Under certain conditions, scholars have found that crowd-sourcing can outperform these other approaches. However, despite interest in the topic and a series of successful use cases, relatively few studies have applied empirical model thinking to evaluate the accuracy and robustness of crowdsourcing in real-world contexts.

In this paper, we offer three novel contributions. First, we explore a dataset of over 600,000 predictions from over 7,000 participants in a multi-year tournament to predict the decisions of the Supreme Court of the United States. Second, we develop a comprehensive crowd construction framework that allows for the formal description and application of crowdsourcing to real-world data. Third, we apply this framework to our data to construct more than 275,000 crowd models. We find that in out-of-sample historical simulations, crowdsourcing robustly outperforms the commonly-accepted null model, yielding the highest-known performance for this context at 80.8% case level accuracy. To our knowledge, this dataset and analysis represent one of the largest explorations of recurring human prediction to date, and our results provide additional empirical support for the use of crowdsourcing as a prediction method….(More)”.

Disrupting Democracy: Point. Click. Transform.

Curated on Posted on by Stefaan Verhulst

Book edited by Anthony T. Silberfeld: “In January 2017, the Bertelsmann Foundation embarked on a nine-month journey to explore how digital innovation impacts democracies and societies around the world. This voyage included more than 40,000 miles in the air, thousands of miles on the ground and hundreds of interviews.

From the rival capitals of Washington and Havana to the bustling streets of New Delhi; the dynamic tech startups in Tel Aviv to the efficient order of Berlin, this book focuses on key challenges that have emerged as a result of technological disruption and offers potential lessons to other nations situated at various points along the technological and democratic spectra.

Divided into six chapters, this book provides two perspectives on each of our five case studies (India, Cuba, the United States, Israel and Germany) followed by polling data collected on demographics, digital access and political engagement from four of these countries.

The global political environment is constantly evolving, and it is clear that technology is accelerating that process for better and, in some cases, for worse. Disrupting Democracy attempts to sort through these changes to give policymakers and citizens information that will help them navigate this increasingly volatile world….(More)”.

The Engineers and the Political System

Curated on Posted on by Stefaan Verhulst

Aaron Timms at the Los Angeles Review of Books: “Engineers enjoy a prestige in China that connects them to political power far more directly than in the United States. ….America, by contrast, has historically been governed by lawyers. That remains true today: there are 218 lawyers in Congress and 208 former businesspeople, according to the Congressional Research Service, but only eight engineers. (Science is even more severely underrepresented, with just three members in the House.) It’s unlikely that that balance will tilt meaningfully in favor of STEM-ers in the near term. But in another sense, the growing cultural capital of the engineers will inevitably translate to political power, whatever its form.

The engineering profession today is broad, much broader than it was in 1921 when Thorstein Veblen published The Engineers and the Price System, his classic pamphlet on industrial sabotage and government by technocrats. Engineering has outgrown the four traditional branches (chemical, civil, electrical, mechanical) to include all the professions in which the laws of mathematics and science are applied to real-world problems…..In a way that was never the case for previous generations, engineering today is politics, and politics engineering. Power is coming for the engineers, but are the engineers ready for power?

…tech smarts do not port easily to politics. However violently Silicon Valley pushes the story that it’s here to fix things for all of us, building an algorithm and coming up with intelligent ways to improve society are not the same thing. The triumph of the engineers is that they’ve managed to convince so many people otherwise.

This victory is more than simply economic or mechanical; engineering has also come to permeate the language of politics itself. Zuckerberg’s doe-eyed both-sidesism is the latest expression of the idea, nourished through the Clinton years and the height of the evidence-based policy movement, that facts offer the surest solution to knotty political problems. This is, we already know, a temple built on sand, ignoring as it does the intractably political nature of politics; hence the failure of “figures” and “facts” and “evidence” to do anything to shift positions on gun reform or voter fraud. But it’s a temple with enduring bipartisan appeal, and the engineers have come along at the right moment to give it a fresh lick of paint. If thinking like an engineer is the new way to do business, engineerialism, in politics, is the new centrism — rule by experts remarketed for the innovation age. It might be generations before a Veblenian technocrat calls the White House home, but no presidency can match the power engineers already have — a power to define progress, a power without check….(More)”.

The citizen in the smart city. How the smart city could transform citizenship

Curated on Posted on by Stefaan Verhulst

Paper by Martijn de Waal and Marloes Dignum: “Smart city-policy makers and technology vendors are increasingly stating they want to bring about citizen-centered smart cities. Yet, it often remains unclear what exactly that means, and how citizens are envisaged as actors in smart cities. This article wants to contribute to this discussion by exploring the relation between smart cities and citizenship. It aims to do this by introducing a heuristic scheme that brings out the implied notions of citizenship in three distinct sets of smart city visions and practices: The Control Room envisages the city as a collection of infrastructures and services; The Creative City views the city from the perspective of (economic) geography and ponders on local and regional systems of innovation; The Smart Citizens discourse addresses the city as a political and civic community. These smart city discourses are mapped against two visions on citizenship and governance taken from political philosophy. A `republican’ perspective with strong presence in social-democratic countries is contrasted with a libertarian one, most prominent in Silicon Valley approaches to smart city technologies. This provides a scheme to reflect on potential benefits and downsides if a specific smart city discourse would develop. Instances of smart cities may promote notions of citizenship that are based on consumer choice and individual responsibility, alternatively they could also reinforce collective responsibilities towards the common good of society…(More)”.

Scientists can now figure out detailed, accurate neighborhood demographics using Google Street View photos

Curated on Posted on by Stefaan Verhulst

Christopher Ingraham at the Washington Post: “A team of computer scientists has derived accurate, neighborhood-level estimates of the racial, economic and political characteristics of 200 U.S. cities using an unlikely data source — Google Street View images of people’s cars.

Published this week in the Proceedings of the National Academy of Sciences, the report details how the scientists extracted 50 million photographs of street scenes captured by Google’s Street View cars in 2013 and 2014. They then trained a computer algorithm to identify the make, model and year of 22 million automobiles appearing in neighborhoods in those images, parked outside homes or driving down the street.

The vehicles seen in Street View images are often small or blurry, making precise identification a challenge. So the researchers had human experts identify a small subsample of the vehicles and compare those to the results churned out by their algorithm. They that the algorithm correctly identified whether a vehicle was U.S.- or foreign-made roughly 88 percent of the time, got the manufacturer right 66 percent of the time and nailed the exact model 52 percent of the time.

While far from perfect, the sheer size of the vehicle database means those numbers are still useful for real-world statistical applications, like drawing connections between vehicle preferences and demographic data. The 22 million vehicles in the database comprise roughly 8 percent of all vehicles in the United States. By comparison, the U.S. Census Bureau’s massive American Community Survey reaches only about 1.6 percent of American householdseach year, while the typical 1,000-person opinion poll includes just 0.0004 of American adults.

To test what this data set could be capable of, the researchers first paired the Zip code-level vehicle data with numbers on race, income and education from the American Community Survey. They did this for a random 15 percent of the Zip codes in their data set to create a “training set.” They then created another algorithm to go through the training set to see how vehicle characteristics correlated with neighborhood characteristics: What kinds of vehicles are disproportionately likely to appear in white neighborhoods, or black ones? Low-income vs. high-income? Highly-educated areas vs. less-educated ones?

That yielded a number of reliable correlations….(More)”.

How Muckrakers Use Crowdsourcing: Case Studies from ProPublica to The Guardian

Curated on Posted on by Stefaan Verhulst

Toby McIntosh at Global Investigative Journalism:”…Creative use of social media provides new ways for journalists not just to solicit tips, but also to tap readers’ expertise, opinions and personal experiences.

A stronger ethos of reader engagement is resulting in more sophisticated appeals from journalists for assistance with investigations, including:

  • Seeking tips on very defined topics
  • Asking readers to talk about their experiences on broad subjects
  • Inviting comments after publication

Here are examples of what your colleagues are doing:

Hey, Shell Employees!

Dutch reporter Jelmer Mommers of Dutch news site De Correspondent appealed directly to Shell employees for information in a lengthy blog post, as described in this article. The resulting investigation revealed that Shell had detailed knowledge of the dangers of climate change more than a quarter century ago.

Along the way, in what Jelmer calls “the most romantic moment,” came the surprise delivery of a box full of internal documents. De Correspondent’s emphasis on communicating with subscribers is described here.

Call for Childbirth Experiences

Getting reader input in advance was key to a major U.S. story on maternal health to which thousands of people contributed. ProPublica  engagement reporter Adriana Gallardo and her colleagues published a questionnaire in February of 2017 aimed at women who had experienced life-threatening complications in childbirth.

Using a variety of social media channels, Gallardo, along with ProPublica’s Nina Martin and NPR’s Renee Montagne, received several thousand responses. The personal stories fueled a series and the connections made are still being maintained for follow-up work. Read more in this this GIJN article.

Testimonials from Mexico’s Drug War

“Anyone’s Child Mexico” is a documentary about the families affected by Mexico’s drug war. To gather stories, the producers of the documentary publicized a free phone line through local partners and asked people across Mexico to call in and recount their stories.

Callers could also listen to other testimonials. With funding from the University of Bristol’s Brigstow Institute, producers Matthew Brown, Ewan Cass-Kavanagh, Mary Ryder and Jane Slater created a website to bring together audio, photos, video and text and tell harrowing stories of a country ravaged by violence….(More)”.

Use of the websites of parliaments to promote citizen deliberation in the process of public decision-making. Comparative study of ten countries

Curated on Posted on by Stefaan Verhulst

Santiago Giraldo Luquet in Communications and Society: “This study develops a longitudinal research (2010-2015) on 10 countries – 5 European countries (France, United Kingdom, Sweden, Italy and Spain) and 5 American countries (Argentina, Ecuador, Chile, Colombia and the USA). The aim is to compare how the parliaments use its official websites in order to promote the political participation process in the citizenship. The study focuses on the deliberation axe (Macintosh, 2004, Hagen, 2000, Vedel, 2003, 2007) and in the way that representative institutions define a digital strategy to create an online public sphere.

Starting with the recognition of Web 2.0 as a debate sphere and as a place of reconfiguration of the traditional –and utopian- Greek Agora, the study adopts the ‘deliberate’ political action axe to evaluate, qualitatively and quantitatively -using a content analysis methodology- the use of the Web 2.0 tools made by the legislative bodies of the analysed countries. The article shows how, which and what parliaments use Web 2.0 tools – integrated in their web page – as a scenario that allows deliberation at the different legislative processes that integrate the examined political systems. Finally, the comparative results show the main differences and similarities between the countries, as well as a tendency to reduce deliberation tools offering by representative institutions in the countries sampled…(More)”.

Science’s Next Frontier? It’s Civic Engagement

Curated on Posted on by Stefaan Verhulst

Louise Lief at Discover Magazine: “…As a lay observer who has explored scientists’ relationship to the public, I have often wondered why many scientists and scientific institutions continue to rely on what is known as the “deficit model” of science communication, despite its well-documented shortcomings and even a backfire effect. This approach views the public as  “empty vessels” or “warped minds” ready to be set straight with facts. Perhaps many scientists continue to use it because it’s familiar and mimics classroom instruction. But it’s not doing the job.

Scientists spend much of their time with the public defending science, and little time building trust.

Many scientists also give low priority to trust building. At the 2016 American Association for the Advancement of Science conference, Michigan State University professor John C. Besley showed these results (right) of a survey of scientists’ priorities for engaging with the public online.

Scientists are focusing on the frustrating, reactive task of defending science, spending little time establishing bonds of trust with the public, which comes in last as a professional priority. How much more productive their interactions with the public – and through them, policymakers — would be if establishing trust was a top priority!

There is evidence that the public is hungry for such exchanges. When Research!America asked the public in 2016 how important is it for scientists to inform elected officials and the public about their research and its impact on society, 84 percent said it was very or somewhat important — a number that ironically mirrors the percentage of Americans who cannot name a scientist….

This means scientists need to go even further, venturing into unfamiliar local venues where science may not be mentioned but where communities gather to discuss their problems. Interesting new opportunities to do this are emerging nation wide. In 2014 the Chicago Community Trust, one of the nation’s largest community foundations, launched a series of dinners across the city through a program called On the Table, to discuss community problems and brainstorm possible solutions. In 2014, the first year, almost 10,000 city residents participated. In 2017, almost 100,000 Chicago residents took part. Recently the Trust added a grants component to the program, awarding more than $135,000 in small grants to help participants translate their ideas into action….(More)”.

Open Data in Developing Economies: Toward Building an Evidence Base on What Works and How

Curated on Posted on by Stefaan Verhulst

New book by Stefaan Verhulst and Andrew Young: “Recent years have witnessed considerable speculation about the potential of open data to bring about wide-scale transformation. The bulk of existing evidence about the impact of open data, however, focuses on high-income countries. Much less is known about open data’s role and value in low- and middle-income countries, and more generally about its possible contributions to economic and social development.

Open Data in Developing Economies features in-depth case studies on how open data is having an impact across Screen Shot 2017-11-14 at 5.41.30 AMthe developing world-from an agriculture initiative in Colombia to data-driven healthcare
projects in Uganda and South Africa to crisis response in Nepal. The analysis built on these case studies aims to create actionable intelligence regarding:

(a) the conditions under which open data is most (and least) effective in development, presented in the form of a Periodic Table of Open Data;

(b) strategies to maximize the positive contributions of open data to development; and

(c) the means for limiting open data’s harms on developing countries.

Endorsements:

“An empirically grounded assessment that helps us move beyond the hype that greater access to information can improve the lives of people and outlines the enabling factors for open data to be leveraged for development.”-Ania Calderon, Executive Director, International Open Data Charter

“This book is compulsory reading for practitioners, researchers and decision-makers exploring how to harness open data for achieving development outcomes. In an intuitive and compelling way, it provides valuable recommendations and critical reflections to anyone working to share the benefits of an increasingly networked and data-driven society.”-Fernando Perini, Coordinator of the Open Data for Development (OD4D) Network, International Development Research Centre, Canada

Download full-text PDF – See also: http://odimpact.org/