Explore our articles

Stefaan Verhulst

Thesis by Denis Roio: “This thesis describes a practice based research journey across various projects dealing with the design of algorithms, to highlight the governance implications in design choices made on them. The research provides answers and documents methodologies to address the urgent need for more awareness of decisions made by algorithms about the social and economical context in which we live. Algorithms consitute a foundational basis across different fields of studies: policy making, governance, art and technology. The ability to understand what is inscribed in such algorithms, what are the consequences of their execution and what is the agency left for the living world is crucial. Yet there is a lack of interdisciplinary and practice based literature, while specialised treatises are too narrow to relate to the broader context in which algorithms are enacted.

This thesis advances the awareness of algorithms and related aspects of sovereignty through a series of projects documented as participatory action research. One of the projects described, Devuan, leads to the realisation of a new, worldwide renown operating system. Another project, “sup”, consists of a minimalist approach to mission critical software and literate programming to enhance security and reliability of applications. Another project, D-CENT, consisted in a 3 year long path of cutting edge research funded by the EU commission on the emerging dynamics of participatory democracy connected to the technologies adopted by citizen organizations.

My original contribution to knowledge lies within the function that the research underpinning these projects has on the ability to gain a better understanding of sociopolitical aspects connected to the design and management of algorithms. It suggests that we can improve the design and regulation of future public, private and common spaces which are increasingly governed by algorithms by understanding not only economical and legal implications, but also the connections between design choices and the sociopolitical context for their development and execution….(More)”.

Algorithmic Sovereignty

Colin Koopman in The New York Times: “…The challenge of designing ethics into data technologies is formidable. This is in part because it requires overcoming a century-long ethos of data science: Develop first, question later. Datafication first, regulation afterward. A glimpse at the history of data science shows as much.

The techniques that Cambridge Analytica uses to produce its psychometric profiles are the cutting edge of data-driven methodologies first devised 100 years ago. The science of personality research was born in 1917. That year, in the midst of America’s fevered entry into war, Robert Sessions Woodworth of Columbia University created the Personal Data Sheet, a questionnaire that promised to assess the personalities of Army recruits. The war ended before Woodworth’s psychological instrument was ready for deployment, but the Army had envisioned its use according to the precedent set by the intelligence tests it had been administering to new recruits under the direction of Robert Yerkes, a professor of psychology at Harvard at the time. The data these tests could produce would help decide who should go to the fronts, who was fit to lead and who should stay well behind the lines.

The stakes of those wartime decisions were particularly stark, but the aftermath of those psychometric instruments is even more unsettling. As the century progressed, such tests — I.Q. tests, college placement exams, predictive behavioral assessments — would affect the lives of millions of Americans. Schoolchildren who may have once or twice acted out in such a way as to prompt a psychometric evaluation could find themselves labeled, setting them on an inescapable track through the education system.

Researchers like Woodworth and Yerkes (or their Stanford colleague Lewis Terman, who formalized the first SAT) did not anticipate the deep consequences of their work; they were too busy pursuing the great intellectual challenges of their day, much like Mr. Zuckerberg in his pursuit of the next great social media platform. Or like Cambridge Analytica’s Christopher Wylie, the twentysomething data scientist who helped build psychometric profiles of two-thirds of all Americans by leveraging personal information gained through uninformed consent. All of these researchers were, quite understandably, obsessed with the great data science challenges of their generation. Their failure to consider the consequences of their pursuits, however, is not so much their fault as it is our collective failing.

For the past 100 years we have been chasing visions of data with a singular passion. Many of the best minds of each new generation have devoted themselves to delivering on the inspired data science promises of their day: intelligence testing, building the computer, cracking the genetic code, creating the internet, and now this. We have in the course of a single century built an entire society, economy and culture that runs on information. Yet we have hardly begun to engineer data ethics appropriate for our extraordinary information carnival. If we do not do so soon, data will drive democracy, and we may well lose our chance to do anything about it….(More)”.

How Democracy Can Survive Big Data

Sarah Holder at CityLab: “For most of human history, maps have been very exclusive,” said Marie Price, the first woman president of the American Geographical Society, appointed 165 years into its 167-year history. “Only a few people got to make maps, and they were carefully guarded, and they were not participatory.” That’s slowly changing, she said, thanks to democratizing projects like OpenStreetMap (OSM)….

But despite OSM’s democratic aims, and despite the long (albeit mostly hidden) history of lady cartographers, the OSM volunteer community is still composed overwhelmingly of men. A comprehensive statistical breakdown of gender equity in the OSM space has not yet been conducted, but Rachel Levine, a GIS operations and training coordinator with the American Red Cross, said experts estimate that only 2 to 5 percent of OSMers are women. The professional field of cartography is also male-dominated, as is the smaller subset of GIS professionals. While it would follow that the numbers of mappers of color and LGBTQ and gender-nonconforming mappers are similarly small, those statistics have gone largely unexamined….

When it comes to increasing access to health services, safety, and education—things women in many developing countries disproportionately lack—equitable cartographic representation matters. It’s the people who make the map who shape what shows up. On OMS, buildings aren’t just identified as buildings; they’re “tagged” with specifics according to mappers’ and editors’ preferences. “If two to five percent of our mappers are women, that means only a subset of that get[s] to decide what tags are important, and what tags get our attention,” said Levine.

Sports arenas? Lots of those. Strip clubs? Cities contain multitudes. Bars? More than one could possibly comprehend.

Meanwhile, childcare centers, health clinics, abortion clinics, and specialty clinics that deal with women’s health are vastly underrepresented. In 2011, the OSM community rejected an appeal to add the “childcare” tag at all. It was finally approved in 2013, and in the time since, it’s been used more than 12,000 times.

Doctors have been tagged more than 80,000 times, while healthcare facilities that specialize in abortion have been tagged only 10; gynecology, near 1,500; midwife, 233, fertility clinics, none. Only one building has been tagged as a domestic violence facility, and 15 as a gender-based violence facility. That’s not because these facilities don’t exist—it’s because the men mapping them don’t know they do, or don’t care enough to notice.

So much of the importance of mapping is about navigating the world safely. For women, especially women in less developed countries, that safety is harder to secure. “If we tag something as a public toilet, does that mean it has facilities for women? Does it mean the facilities are safe?” asked Levine. “When we’re tagging specifically, ‘This is a female toilet,’ that means somebody has gone in and said, ‘This is accessible to me.’ When women aren’t doing the tagging, we just get the toilet tag.”

“Women’s geography,” Price tells her students, is made up of more than bridges and tunnels. It’s shaped by asking things like: Where on the map do you feel safe? How would you walk from A to B in the city without having to look over your shoulder? It’s hard to map these intangibles—but not impossible….(More).

Who Maps the World?

BVBA Open Access Book: “The impact of globalization, of technological progress and of the insecurity that they cause is reflected in people’s decisions, and by the path that our society is following. This path that will decide our future, in the sense that it will determine our capability of facing the challenges and taking advantage of the opportunities offered up by the advances in science and technology.

In this book, we look at generalized subjects, taking in the transformation that computing and the greater availability of information brings to our perceptions and understanding of things, and in the social imaginaries, that shape our attitudes and reactions to the events that we observe.
All this underpins the changes in politics we are witnessing, the appearance of populist movements or, more generally, the lack of commitment or disaffection with political institutions and the values that support the existing democracies. In these arenas, the new digital media, new types of digital political activism, and the rise of movements that question the dominant economic and political paradigm all play a key role.

In the supranational and geopolitical level we discuss the importance of incorporating a feminist perspective to international relations (as well, of course, as to all the spheres of human activity); new types of warfare, in which neither the contenders, strategies or media resemble anything we knew before; the huge geopolitical challenge represented by the complex and diverse Arab Islamic question; the end of the brief unipolar world era, with the emergence of powers that question the United States’ hegemony, among which we highlight China; or the future role of Latin America in the global map.

Regarding the economic questions that are at the root of the current perplexity, insecurity and discontent, we examine the impact of globalization and technological change on growth, the welfare state and, above all, employment.

From this base, we look at which are the most suitable economic policies and forms of organization for harnessing the potential of the digital revolution, and also for minimizing the risks of a society with increasing inequality, with a huge number of jobs taken over by machines, or even the loss of control of individual or collective decisions.

This technological revolution will undoubtedly require a complex transition process, but we also have before us a wonderful opportunity to better tend to the needs and demands of people: with more growth, jobs and a fairer distribution of wealth, and a richer and fuller life for the whole of humanity….(More)”.

The Age of Perplexity: Rethinking the World we Knew

Springwise: “We have previously written about innovations that promote inclusion and equal rights such as edible pie charts that highlight gender inequality. Another example is a predictive text app that finds alternative words for gendered language. Now, NINA, created in Brazil, is an app for empowering women to report violence that occurs in public spaces. The project was shared to Red Bull Amaphiko, a platform for social entrepreneurs to share their work and stories.

A 2016 survey released by ActionAid and conducted by YouGov found that 86 percent of Brazilian women were victims of harassment in public spaces. Responding to these statistics, Simony César created project NINA two years ago to help tackle gender-based violence. The app collects data in real time, mapping locations in which cases of harassment have taken place. The launch and testing of the app took place on public transport. It saw 76 thousand users per day at 17 bus lines at the Federal University of Pernambuco (UFPE).

César states “The premise of NINA aims to empower women through an application that denounces the types of violence they suffer within public spaces”. It combats violence against women by making cases of harassment in the city locatable on a map. NINA can then use this data to find out which bus lines have the highest rate of harassment. It can also record the most common times that cases occur and store photographic records and short videos of harassers.

Another survey by ActionAid in March 2018 revealed that 64 percent of Brazilian women surveyed were victims of sexual harassment. These results demonstrate that the need for empowerment tools, such as NINA, is still necessary. The exposure of women to violence in public city spaces is a global issue and as a result, accessibility within cities is unequal based on gender….(More)”.

Empowerment tool for women maps cases of harassment

Handbook by Evan Selinger, Jules Polonetsky, and Omer Tene: “Businesses are rushing to collect personal data to fuel surging demand. Data enthusiasts claim personal information that’s obtained from the commercial internet, including mobile platforms, social networks, cloud computing, and connected devices, will unlock path-breaking innovation, including advanced data security. By contrast, regulators and activists contend that corporate data practices too often disempower consumers by creating privacy harms and related problems. As the Internet of Things matures and facial recognition, predictive analytics, big data, and wearable tracking grow in power, scale, and scope, a controversial ecosystem will exacerbate the acrimony over commercial data capture and analysis. The only productive way forward is to get a grip on the key problems right now and change the conversation….(More)”.

 

The Cambridge Handbook of Consumer Privacy

Eillie Anzilotti in Fast Company: “…While anyone who bikes or rides a bus in New York City knows intuitively that the lanes are often blocked, there’s been little data to back up that feeling apart from the fact that last year, the NYPD issues 24,000 tickets for vehicles blocking bus lanes, and around 79,000 to cars in the bike lane. By building the algorithm, Bell essentializes what engaged citizenship and productive use of open data looks like. The New York City Department of Transportation maintains several hundred video cameras throughout the city; those cameras feed images in real time to the DOT’s open-data portal. Bell downloaded a week’s worth of footage from that portal to analyze.

To build his computer algorithm to do the analysis, he fed around 2,000 images of buses, cars, pedestrians, and vehicles like UPS trucks into TensorFlow, Google’s open-source framework that the tech giant is using to train autonomous vehicles to recognize other road users. “Because of the push into AVs, machine learning in general and neural networks have made lots of progress, because they have to answer the same questions of: What is this vehicle, and what is it going to do?” Bell says. After several rounds of processing, Bell was able to come up with an algorithm that fairly faultlessly could determine if a vehicle at the bus stop was, in fact, a bus, or if it was something else that wasn’t supposed to be there.

As cities and governments, spurred by organizations like OpenGov, have moved to embrace transparency and open data, the question remains: So, what do you do with it?

For Bell, the answer is that citizens can use it to empower themselves. “I’m a little uncomfortable with cameras and surveillance in cities,” Bell says. “But agencies like the NYPD and DOT have already made the decision to put the cameras up. We don’t know the positive and negative outcomes if more and more data from cameras is opened to the public, but if the cameras are going in, we should know what data they’re collecting and be able to access it,” he says. He’s made his algorithm publicly available in the hopes that more people will use data to investigate the issue on their own streets, and perhaps in other cities….Bell is optimistic that open data can empower more citizens to identify issues in their own cities and bring a case for why they need to be addressed….(More)”.

AI And Open Data Show Just How Often Cars Block Bus And Bike Lanes

Michael David Thomas in Public Choice: “New justifications for government intervention based on behavioral psychology rely on a behavioral asymmetry between expert policymakers and market participants. Public choice theory applied the behavioral symmetry assumption to policy making in order to illustrate how special interests corrupt the suppositions of benevolence on the part of policy makers. Cognitive problems associated with market choices have been used to argue for even more intervention.

If behavioral symmetry is applied to the experts and not just to market participants, problems with this approach to public policy formation become clear. Manipulation, cognitive capture, and expert bias are among the problems associated with a behavioral theory of market failure. The application of behavioral symmetry to the expanding role of choice architecture will help to limit the bias in behavioral policy. Since experts are also subject to cognitive failures, policy must include an evaluation of expert error. Like the rent-seeking literature before it, a theory of cognitive capture points out the systematic problems with a theory of asymmetry between policy experts and citizens when it comes to policy making….(More)”.

Reapplying behavioral symmetry: public choice and choice architecture

Tafari Mbadiwe at The Atlantis: “For generations, the Maasai people of eastern Africa have passed down the story of a tireless old man. He lived alone and his life was not easy. He spent every day in the fields — tilling the land, tending the animals, and gathering water. The work was as necessary as it was exhausting. But the old man considered himself fortunate. He had a good life, and never really gave much thought to what was missing.

One morning the old man was greeted with a pleasant surprise. Standing in his kitchen was a young boy, perhaps seven or eight years old. The old man had never seen him before. The boy smiled but said nothing. The old man looked around. His morning breakfast had already been prepared, just as he liked it. He asked the boy’s name. “Kileken,” the boy replied. After some prodding, the boy explained that, before preparing breakfast, he had completed all of the old man’s work for the day. Incredulous, the old man stepped outside. Indeed, the fields had been tilled, the animals tended, and the water gathered. Astonishment written all over his face, the old man staggered back into the kitchen. “How did this happen? And how can I repay you?” The boy smiled again, this time dismissively. “I will accept no payment. All I ask is that you let me stay with you.” The old man knew better than to look a gift horse in the mouth.

Kileken and the old man soon became inseparable, and the farm grew lush and bountiful as it never had before. The old man could hardly remember what life was like before the arrival of his young comrade. There could be no doubt: With Kileken’s mysterious assistance, the old man was prospering. But he never quite understood why, or how, it had happened.

To an extent we have failed to fully acknowledge, decision-making algorithms have become our society’s collective Kileken. They show up unannounced and where we least expect them, promise and often deliver great things, and quickly come to be seen as indispensable. Their reach can’t be overestimated. They tell traders what stocks to buy and sell, determine how much our car insurance costs, influence which products Amazon shows us and how much we get charged for them, and interpret our Google searches and rank their results….(More)”.

Algorithmic Injustice

Report by the Centre for Public Impact: “…embarked upon a worldwide project to find out how governments can strengthen their legitimacy. Amidst the turbulence and unpredictability of recent years, there are many contemporary accounts of people feeling angry, cynical or ambivalent about government.

While much has been said about the personalities of leaders and the rise of populist parties, what’s less clear is what governments could really do to strengthen legitimacy, a concept most agree remains integral to worldwide stability and peace. To find out what legitimacy means to people today and how it could be strengthened, we decided to break out of the usual circles of influence and ensure our project heard directly from citizens from around the world. People were open and honest about the struggle for someone in government to understand and to listen. Some shed tears while others felt angry about how their voices and identities seemed undervalued. Everyone, however, wanted to show how it was still very possible to build a stronger relationship and understanding between governments and people, even if the day-to-day actions of government were not always popular.

The aim of this paper is not to provide the definitive model for legitimacy. Instead, we have sought to be open about what we heard, stay true to people’s views and shine a light on the common themes that could help governments have better conversations about building legitimacy into all their systems and with the support of their citizens.

We gathered case studies to show how this was already happening and found positive examples in places we didn’t expect. The importance of governments showing their human side – even in our age of AI and robotics – emerged as such a key priority, and is why we called this paper Finding a more human government.

This is a conversation that has only just begun. …. To see what others are saying, do take a look at our website www.findinglegitimacy.centreforpublicimpact.org”

Finding a more human government

Get the latest news right in you inbox

Subscribe to curated findings and actionable knowledge from The Living Library, delivered to your inbox every Friday