Assessing employer intent when AI hiring tools are biased

Curated on Posted on by Stefaan Verhulst

Report by Caitlin Chin at Brookings: “When it comes to gender stereotypes in occupational roles, artificial intelligence (AI) has the potential to either mitigate historical bias or heighten it. In the case of the Word2vec model, AI appears to do both.

Word2vec is a publicly available algorithmic model built on millions of words scraped from online Google News articles, which computer scientists commonly use to analyze word associations. In 2016, Microsoft and Boston University researchers revealed that the model picked up gender stereotypes existing in online news sources—and furthermore, that these biased word associations were overwhelmingly job related. Upon discovering this problem, the researchers neutralized the biased word correlations in their specific algorithm, writing that “in a small way debiased word embeddings can hopefully contribute to reducing gender bias in society.”

Their study draws attention to a broader issue with artificial intelligence: Because algorithms often emulate the training datasets that they are built upon, biased input datasets could generate flawed outputs. Because many contemporary employers utilize predictive algorithms to scan resumes, direct targeted advertising, or even conduct face- or voice-recognition-based interviews, it is crucial to consider whether popular hiring tools might be susceptible to the same cultural biases that the researchers discovered in Word2vec.

In this paper, I discuss how hiring is a multi-layered and opaque process and how it will become more difficult to assess employer intent as recruitment processes move online. Because intent is a critical aspect of employment discrimination law, I ultimately suggest four ways upon which to include it in the discussion surrounding algorithmic bias….(More)”

This report from The Brookings Institution’s Artificial Intelligence and Emerging Technology (AIET) Initiative is part of “AI and Bias,” a series that explores ways to mitigate possible biases and create a pathway toward greater fairness in AI and emerging technologies.

Civic tech, Data and Demos: exploring the interaction between democracy and technology

Curated on Posted on by Stefaan Verhulst

IAPP: “The French data protection authority, the CNIL, has published a report that explores emerging issues of data protection and freedoms in democracy, technology and citizen participation. The report discusses the emergence of civic technologies and data protection issues associated. The CNIL also uses the report to propose its recommendations for creating “an environment of trust” with civic tech “that allows everyone to exercise their citizenship while respecting their rights and freedoms.” Those recommendations include more implementation of EU General Data Protection Regulation principles and considerations for improved digital communication and participation….(More)”.

Exploring digital government transformation in the EU

Curated on Posted on by Stefaan Verhulst

Analysis of the state of the art and review of literature by Gianluca Misuraca et al: “This report presents the… results of the review of literature, based on almost 500 academic and grey literature sources, as well as the analysis of digital government policies in the EU Member States provide a synthetic overview of the main themes and topics of the digital government discourse.

The report depicts the variety of existing conceptualisations and definitions of the digital government phenomenon, measured and expected effects of the application of more disruptive innovations and emerging technologies in government, as well as key drivers and barriers for transforming the public sector. Overall, the literature review shows that many sources appear overly optimistic with regard to the impact of digital government transformation, although the majority of them are based on normative views or expectations, rather than empirically tested insights.

The authors therefore caution that digital government transformation should be researched empirically and with a due differentiation between evidence and hope. In this respect, the report paves the way to in-depth analysis of the effects that can be generated by digital innovation in public sector organisations. A digital transformation that implies the redesign of the tools and methods used in the machinery of government will require in fact a significant change in the institutional frameworks that regulate and help coordinate the governance systems in which such changing processes are implemented…(More)”.

Dreamocracy – Collective Intelligence for the Common Good

Curated on Posted on by Stefaan Verhulst

About: “Dreamocracy is a think-and-do-tank that fosters collective intelligence / creativity for the common good through analysis, advice to organisations, and by developing and implementing innovative stakeholder management experiments.  

Dreamocracy aims to contribute to democracy’s reinvention and future. As Harvard scholar Yascha Mounk stresses, democracy in many parts of the world is at risk of “deconsolidation.” Possible collapse is signalled by the convergence of people’s dissatisfaction with democracy; their willingness to consider non-democratic forms of government as possible alternatives; and the rise in populist parties, anti-system movements and demagogues in government.

In order to ensure a bright future for democracy in service to society, Dreamocracy believes collective intelligence done well is essential to address the following three terms of our proposed “trust-in-government equation”:

TRUST = Process legitimacy + Output legitimacy + Emotions legitimacy….(More)”.

Data Protection in the Humanitarian Sector – A Blockchain Approach

Curated on Posted on by Stefaan Verhulst

Report by Andrej Verity and Irene Solaiman: “Data collection and storage are becoming increasingly digital. In the humanitarian sector, data motivates action, informing organizations who then determine priorities and resource allocation in crises.

“Humanitarians are dependent on technology and on the Internet. When life-saving aid isn’t delivered on time and to the right beneficiaries, people can die.” -Brookings

In the age of information and cyber warfare, humanitarian organizations must take measures to protect civilians, especially those in critical and vulnerable positions.

“Data privacy and ensuring protection from harm, including the provision of data security, are therefore fundamentally linked—and neither can be realized without the other.” -The Signal Code

Information in the wrong hands can risk lives or even force aid organizations to shut down. For example, in 2009, Sudan expelled over a dozen international nongovernmental organizations (NGOs) that were deemed key to maintaining a lifeline to 4.7 million people in western Darfur. The expulsion occurred after the Sudanese Government collected Internet-accessible information that made leadership fear international criminal charges. Responsible data protection is a crucial component of cybersecurity. As technology develops, so do threats and data vulnerabilities. Emerging technologies such as blockchain provide further security to sensitive information and overall data storage. Still, with new technologies come considerations for implementation…(More)”.

Responsible Operations: Data Science, Machine Learning, and AI in Libraries

Curated on Posted on by Stefaan Verhulst

OCLC Research Position Paper by Thomas Padilla: “Despite greater awareness, significant gaps persist between concept and operationalization in libraries at the level of workflows (managing bias in probabilistic description), policies (community engagement vis-à-vis the development of machine-actionable collections), positions (developing staff who can utilize, develop, critique, and/or promote services influenced by data science, machine learning, and AI), collections (development of “gold standard” training data), and infrastructure (development of systems that make use of these technologies and methods). Shifting from awareness to operationalization will require holistic organizational commitment to responsible operations. The viability of responsible operations depends on organizational incentives and protections that promote constructive dissent…(More)”.

The most innovative political projects in Europe 2019

Curated on Posted on by Stefaan Verhulst

The Innovation in Politics Institute: “Since 2017, the Innovation in Politics Awards have been honouring successfully implemented political initiatives – regardless of party affiliation, political level or region. The aim is to strengthen, further develop and inspire democratic politics…

The winning projects by category are:

COOPERATIVE COUNCIL GRONINGEN: Trust is crucial in life – and in politics. The open citizens’ council in Groningen builds trust between citizens and politicians. When they sit shoulder to shoulder in the local council and decide together, a joint sense of responsibility quickly develops. The citizens are chosen at random in order to motivate a variety of people to participate. An evaluation by the University of Groningen showed increased trust on all sides, more active voting behaviour and a stronger community. …

SMART CITY BAD HERSFELD: The “Smart City Bad Hersfeld” project links public administration, citizens and businesses in the city to improve living and working conditions. With 30,000 inhabitants, it is the smallest city in Germany to have developed such a programme. A digital parking guidance system optimises the use of space and the finding of a parking space. Municipal charging stations for electric cars promote environmentally friendly transport. “Smartboxes” on main roads collect data on traffic noise and waste materials for effective environmental management. Free Internet in the city centre motivates everyone to use such services….(More)”

The Golden Age of Social Science

Curated on Posted on by Stefaan Verhulst

Essay by Anastasia Buyalskaya, Marcos Gallo and Colin Camerer: “In this short essay we argue that social science is entering a golden age, marked by explosive growth in new data and analytic methods, interdisciplinarity, and a recognition that both of those ingredients are necessary to solve hard problems. Two examples are given to illustrate these themes, which are behavioral economics and social networks. Numerous other specific study examples are then given. We also address the challenges that accompany the three positive trends, which include informatics, career incentives, and the search for unifying frameworks….(More)”.

Appropriate use of data in public space

Curated on Posted on by Stefaan Verhulst

Collection of Essays by NL Digital Government: “Smart cities are urban areas where large amounts of data are collected using sensors to enable a range of processes in the cities to run smoothly. However, the use of data is only legally and ethically allowed if the data is gathered and processed in a proper manner. It is not clear to many cities what data (personal or otherwise) about citizens may be gathered and processed, and under what conditions. The main question addressed by this essay concerns the degree to which data on citizens may be reused in the context of smart cities.

The emphasis here is on the reuse of data. Among the aspects featured are smart cities, the Internet of Things, big data, and nudging. Diferent types of data reuse will also be identifed using a typology that helps clarify and assess the desirability of data reuse. The heart of this essay is an examination of the most relevant legal and ethical frameworks for data reuse.

The most relevant legal frameworks are privacy and human rights, the protection of personal data and administrative law (in particular, the general principles of sound administration). The most relevant ethical frameworks are deontology, utilitarianism, and value ethics. The ethical perspectives ofer assessment frameworks that can be used within the legal frameworks, for drawing up codes of conduct, for example, and other forms of self-regulation. Observance of the legal and ethical frameworks referred to in this essay very probably means that data is being used and reused in an appropriate manner. Failure to observe these frameworks means that such use and reuse is not appropriate.

Four recommendations are made on the basis of these conclusions. Local authorities in smart cities must commit themselves to the appropriate reuse of data through public-private partnerships, actively involve citizens in their considerations of what factors are relevant, ensure transparency on data-related matters and in such considerations, and gradually continue the development of smart cities through pilot schemes….(More)”.

Artificial Intelligence and National Security

Curated on Posted on by Stefaan Verhulst

CRS Report: “Artificial intelligence (AI) is a rapidly growing field of technology with potentially significant implications for national security. As such, the U.S. Department of Defense (DOD) and other nations are developing AI applications for a range of military functions. AI research is underway in the fields of intelligence collection and analysis, logistics, cyber operations, information operations, command and control, and in a variety of semiautonomous and autonomous vehicles.

Already, AI has been incorporated into military operations in Iraq and Syria. Congressional action has the potential to shape the technology’s development further, with budgetary and legislative decisions influencing the growth of military applications as well as the pace of their adoption.

AI technologies present unique challenges for military integration, particularly because the bulk of AI development is happening in the commercial sector. Although AI is not unique in this regard, the defense acquisition process may need to be adapted for acquiring emerging technologies like AI. In addition, many commercial AI applications must undergo significant modification prior to being functional for the military.

A number of cultural issues also challenge AI acquisition, as some commercial AI companies are averse to partnering with DOD due to ethical concerns, and even within the department, there can be resistance to incorporating AI technology into existing weapons systems and processes.

Potential international rivals in the AI market are creating pressure for the United States to compete for innovative military AI applications. China is a leading competitor in this regard, releasing a plan in 2017 to capture the global lead in AI development by 2030. Currently, China is primarily focused on using AI to make faster and more well-informed decisions, as well as on developing a variety of autonomous military vehicles. Russia is also active in military AI development, with a primary focus on robotics.

Although AI has the potential to impart a number of advantages in the military context, it may also introduce distinct challenges. AI technology could, for example, facilitate autonomous operations, lead to more informed military decisionmaking, and increase the speed and scale of military action. However, it may also be unpredictable or vulnerable to unique forms of manipulation. As a result of these factors, analysts hold a broad range of opinions on how influential AI will be in future combat operations. While a small number of analysts believe that the technology will have minimal impact, most believe that AI will have at least an evolutionary—if not revolutionary—effect….(More)”.