Essays on collective intelligence


Thesis by Yiftach Nagar: “This dissertation consists of three essays that advance our understanding of collective-intelligence: how it works, how it can be used, and how it can be augmented. I combine theoretical and empirical work, spanning qualitative inquiry, lab experiments, and design, exploring how novel ways of organizing, enabled by advancements in information technology, can help us work better, innovate, and solve complex problems.

The first essay offers a collective sensemaking model to explain structurational processes in online communities. I draw upon Weick’s model of sensemaking as committed-interpretation, which I ground in a qualitative inquiry into Wikipedia’s policy discussion pages, in attempt to explain how structuration emerges as interpretations are negotiated, and then committed through conversation. I argue that the wiki environment provides conditions that help commitments form, strengthen and diffuse, and that this, in turn, helps explain trends of stabilization observed in previous research.

In the second essay, we characterize a class of semi-structured prediction problems, where patterns are difficult to discern, data are difficult to quantify, and changes occur unexpectedly. Making correct predictions under these conditions can be extremely difficult, and is often associated with high stakes. We argue that in these settings, combining predictions from humans and models can outperform predictions made by groups of people, or computers. In laboratory experiments, we combined human and machine predictions, and find the combined predictions more accurate and more robust than predictions made by groups of only people or only machines.

The third essay addresses a critical bottleneck in open-innovation systems: reviewing and selecting the best submissions, in settings where submissions are complex intellectual artifacts whose evaluation require expertise. To aid expert reviewers, we offer a computational approach we developed and tested using data from the Climate CoLab – a large citizen science platform. Our models approximate expert decisions about the submissions with high accuracy, and their use can save review labor, and accelerate the review process….(More)”

Kenyans have launched a campaign on Twitter to fix their roads


Lily Kuo in Quartz: “Traffic is a problem in Nairobi. A short commute can last for hours during morning or evening rush hour. Buses and motorbikes cut in and out of traffic, worsening congestion. It’s estimated that road congestion costs Kenya’s capital as much as $570,000 a day in lost productivity.

One of the reasons for the city’s bad traffic is the state of the roads: drivers swerve to avoid potholes, bumps, or breaks in the roads, causing a buildup of traffic. To help, an online campaign called “What is a Road” is crowdsourcing the location and condition of potholes around the city in an effort to push local officials to fix them.

Nairobians tweet a photo and location of a pothole under the hashtag #whatisaroad. Those reports are uploaded to a map, used to analyze where the city’s potholes are located and track which ones have been fixed. “We decided to take a more data driven approach to track progress, promises made and projects delivered,” says Muthuri Kinyamu, one of the organizers.

A map showing crowdsourced reports of potholes across Nairobi. (What Is a Road)

The campaign is also about addressing some of the fundamental problems that hold cities like Nairobi back. In Nairobi, branded the center of “Silicon Savannah” in recent years, there’s often more focus on entrepreneurship and innovation than resolving simpler problems like the state of the roads. …The

The campaign, started in August, will continue until January. Chris Orwa, a data analyst helping with the project, says that they can’t take credit for all the repairs they have been documented around the city, but they have noticed that roads are being fixed within days of a #Whatisaroad report. The average response time for fixing a road reported by a What is a Road user is three days, according to Orwa….(More)”

Crowdsourcing campaign rectifies translation errors


Springwise: “A few months ago, Seoul City launched a month long campaign during September and October asking people to help correct poorly translated street signs. For examples, the sign pictured below has incorrectly abbreviated “Bridge,” which should be corrected to “Brg.” Those who find mistakes can submit them via email, including a picture of the sign and location details. The initiative is targeting signs in English, Chinese and Japanese in public places such as subway stations, bus stops and tourist information sites. Seoul city is offering prizes to those who successfully spot mistakes. Top spotters receive a rewards of KRW 200,000 (around USD 180).

450bridgeerror

The scheme comes as part of a drive to improve the experience of tourists travelling to the South Korean capital. According to a Seoul city official, “Multilingual signs are important standards to assess a country’s competitiveness in the tourism business. We want to make sure that foreigners in Seoul suffer no inconvenience.”…(More)”

Crowdsourcing and cellphone data could help guide urban revitalization


Science Magazine: “For years, researchers at the MIT Media Lab have been developing a database of images captured at regular distances around several major cities. The images are scored according to different visual characteristics — how safe the depicted areas look, how affluent, how lively, and the like….Adjusted for factors such as population density and distance from city centers, the correlation between perceived safety and visitation rates was strong, but it was particularly strong for women and people over 50. The correlation was negative for people under 30, which means that males in their 20s were actually more likely to visit neighborhoods generally perceived to be unsafe than to visit neighborhoods perceived to be safe.

In the same paper, the researchers also identified several visual features that are highly correlated with judgments that a particular area is safe or unsafe. Consequently, the work could help guide city planners in decisions about how to revitalize declining neighborhoods.,,,

Jacobs’ theory, Hidalgo says, is that neighborhoods in which residents can continuously keep track of street activity tend to be safer; a corollary is that buildings with street-facing windows tend to create a sense of safety, since they imply the possibility of surveillance. Newman’s theory is an elaboration on Jacobs’, suggesting that architectural features that demarcate public and private spaces, such as flights of stairs leading up to apartment entryways or archways separating plazas from the surrounding streets, foster the sense that crossing a threshold will bring on closer scrutiny….(More)”

The openness buzz in the knowledge economy: Towards taxonomy


Paper by Anne Lundgren in “Environment and Planning C: Government and Policy”: “In the networked information and knowledge-based economy and society, the notions of ‘open’ and ‘openness’ are used in a variety of contexts; open source, open access, open economy, open government, open innovation – just to name a few. This paper aims at discussing openness and developing a taxonomy that may be used to analyse the concept of openness. Are there different qualities of openness? How are these qualities interrelated? What analytical tools may be used to understand openness? In this paper four qualities of openness recurrent in literature and debate are explored: accessibility, transparency, participation and sharing. To further analyse openness new institutional theory as interpreted by Williamson (2000) is used, encompassing four different institutional levels; cultural embeddedness, institutional environment, governance structure and resource allocations. At what institutional levels is openness supported and/or constrained? Accessibility as a quality of openness seems to have a particularly strong relation to the other qualities of openness, whereas the notions of sharing and collaborative economics seem to be the most complex and contested quality of openness in the knowledge-based economy. This research contributes to academia, policy and governance, as handling of challenges with regard to openness vs. closure in different contexts, territorial, institutional and/or organizational, demand not only a better understanding of the concept, but also tools for analysis….(More)”

Crowdsourcing Gun Violence Research


Penn Engineering: “Gun violence is often described as an epidemic, but as visible and shocking as shooting incidents are, epidemiologists who study that particular source of mortality have a hard time tracking them. The Centers for Disease Control is prohibited by federal law from conducting gun violence research, so there is little in the way of centralized infrastructure to monitor where, how,when, why and to whom shootings occur.

Chris Callison-Burch, Aravind K.Joshi Term Assistant Professor in Computer and InformationScience, and graduate studentEllie Pavlick are working to solve this problem.

They have developed the GunViolence Database, which combines machine learning and crowdsourcing techniques to produce a national registry of shooting incidents. Callison-Burch and Pavlick’s algorithm scans thousands of articles from local newspaper and television stations,determines which are about gun violence, then asks everyday people to pullout vital statistics from those articles, compiling that information into a unified, open database.

For natural language processing experts like Callison-Burch and Pavlick, the most exciting prospect of this effort is that it is training computer systems to do this kind of analysis automatically. They recently presented their work on that front at Bloomberg’s Data for Good Exchange conference.

The Gun Violence Database project started in 2014, when it became the centerpiece of Callison-Burch’s “Crowdsourcing and Human Computation”class. There, Pavlick developed a series of homework assignments that challenged undergraduates to develop a classifier that could tell whether a given news article was about a shooting incident.

“It allowed us to teach the things we want students to learn about datascience and natural language processing, while giving them the motivation to do a project that could contribute to the greater good,” says Callison-Burch.

The articles students used to train their classifiers were sourced from “TheGun Report,” a daily blog from New York Times reporters that attempted to catalog shootings from around the country in the wake of the Sandy Hook massacre. Realizing that their algorithmic approach could be scaled up to automate what the Times’ reporters were attempting, the researchers began exploring how such a database could work. They consulted with DouglasWiebe, a Associate Professor of Epidemiology in Biostatistics andEpidemiology in the Perelman School of Medicine, to learn more about what kind of information public health researchers needed to better study gun violence on a societal scale.

From there, the researchers enlisted people to annotate the articles their classifier found, connecting with them through Mechanical Turk, Amazon’scrowdsourcing platform, and their own website, http://gun-violence.org/…(More)”

Innovando para una mejor gestión: La contribución de los laboratorios de innovación pública


Paper by Acevedo, Sebastián; and Dassen, Nicolás for IDB: “Los cambios tecnológicos, económicos y sociales de los últimos años exigen gobiernos capaces de adaptarse a nuevos desafíos y a las crecientes demandas de la ciudadanía. En muchos países y en distintos niveles de gobierno, esto ha llevado a la creación de laboratorios de innovación, unidades cuyo objetivo es promover de diversos modos la innovación en el sector público. En este trabajo se analizan los roles y desafíos de los laboratorios latinoamericanos, contrastándolos con buenas prácticas y características que la literatura ha asociado a mayores niveles de innovación en el sector público y en otras organizaciones.

A partir de una encuesta a directores de laboratorios y dos estudios de casos, se describe el panorama de los laboratorios latinoamericanos y se discuten sus desafíos para: i) trabajar sobre temas centrales de la gestión, ii) conseguir la adopción de innovaciones y el escalamiento de las mismas y iii) asegurar la sostenibilidad de estas.

En particular, hay cuatro factores clave para su desempeño en esos aspectos: dos factores político-institucionales –el apoyo del liderazgo y las redes de política– y dos factores metodológicos –la adecuación técnica de las innovaciones y la construcción de un significado compartido sobre ellas–.

Además, se identifican dos diferencias principales entre la mayoría de los laboratorios relevados aquí y la experiencia de otras regiones, descripta por la literatura existente: un foco más intenso en temas de gobierno abierto y menos actividades para el testeo controlado de innovaciones, como experimentos aleatorios y evaluaciones de impacto. Finalmente, se presentan conclusiones y recomendaciones para la consolidación de los laboratorios como canales efectivos para gestionar innovaciones, manejando los riesgos inherentes, y modernizar la gestión… (More Español)

Open Innovation: Practices to Engage Citizens and Effectively Implement Federal Initiatives


United States Government Accountability Office: “Open innovation involves using various tools and approaches to harness the ideas, expertise, and resources of those outside an organization to address an issue or achieve specific goals. GAO found that federal agencies have frequently used five open innovation strategies to collaborate with citizens and external stakeholders, and encourage their participation in agency initiatives.

Screen Shot 2016-10-14 at 10.13.38 AM

GAO identified seven practices that agencies can use to effectively implement initiatives that involve the use of these strategies:

  • Select the strategy appropriate for the purpose of engaging the public and the agency’s capabilities.
  • Clearly define specific goals and performance measures for the initiative.
  • Identify and engage external stakeholders and potential partners.
  • Develop plans for implementing the initiative and recruiting participants.
  • Engage participants and partners while implementing the initiative.
  • Collect and assess relevant data and report results.
  • Sustain communities of interested partners and participants.

Aspects of these practices are illustrated by the 15 open innovation initiatives GAO reviewed at six selected agencies: the Departments of Energy, Health and Human Services, Housing and Urban Development, and Transportation (DOT); the Environmental Protection Agency; and the National Aeronautics and Space Administration (NASA).

For example:

• With the Asteroid Data Hunter challenge, NASA used a challenge and citizen science effort, beginning in 2014, to improve the accuracy of its asteroid detection program and develop an application for citizen scientists.

• Since 2009, DOT’s Federal Highway Administration has used an ideation initiative called Every Day Counts to identify innovations to improve highway project delivery. Teams of federal, state, local, and industry experts then implement the ideas chosen through this process….(More)”

Crowdsourcing investigative journalism


Convoca in Peru: “…collaborative effort is the essence of Convoca. We are a team of journalists and programmers who work with professionals from different disciplines and generations to expose facts that are hidden by networks of power and affect the life of citizens. We bet on the work in partnership to publish findings of high impact from Peru, where the Amazon survives in almost 60% of the country, in the middle of oil exploitation, minerals and criminal activities such as logging, illegal mining and human trafficking. Fifty percent of social conflicts have as epicenter extractives areas of natural resources where the population and communities with the highest poverty rates live.

Over one year and seven months, Convoca has uncovered facts of public relevance such as the patterns of corruption and secrecy networking with journalists from Latin America and the world. The series of reports with the BRIO platform revealed the cost overruns of highways and public works in Latin American countries in the hands of Brazilian companies financed by the National Bank of Economic and Social Development (BNDES), nowadays investigated in the most notorious corruption scandal in the region, ‘Lava Jato’. This research won the 2016 Journalistic Excellence Award granted by the Inter American Press Association (SIP). On a global scale, we dove into 11 million and a half files of the ‘Panama Papers’ with more than a hundred media and organizations led by the International Consortium of Investigative Journalists (ICIJ), which allowed to undress the world of tax havens where companies and characters hide their fortune.

Our work on extractive industries ‘Excesses unpunished’ won the most important award of data journalism in the world, the Data Journalism Awards 2016, and is a finalist of the Gabriel Garcia Marquez Award which recognized the best of journalism in Latin America. We invite you to be the voice of this effort to keep publishing new reports that allow citizens to make better decisions about their destinies and compel groups of power to come clean about their activities and fulfill their commitments. So join ConBoca: The Power of Citizens Call, our first fundraising campaign alongside our readers. We believe that journalism is a public service….(More)”

Participatory Budgeting in the United States: A Guide for Local Governments


Book by Victoria Gordon, Jeffery L. Osgood, Jr., Daniel Boden: “Although citizen engagement is a core public service value, few public administrators receive training on how to share leadership with people outside the government.Participatory Budgeting in the United States serves as a primer for those looking to understand a classic example of participatory governance, engaging local citizens in examining budgetary constraints and priorities before making recommendations to local government. Utilizing case studies and an original set of interviews with community members, elected officials, and city employees, this book provides a rare window onto the participatory budgeting process through the words and experiences of the very individuals involved. The central themes that emerge from these fascinating and detailed cases focus on three core areas: creating the participatory budgeting infrastructure; increasing citizen participation in participatory budgeting; and assessing and increasing the impact of participatory budgeting. This book provides students, local government elected officials, practitioners, and citizens with a comprehensive understanding of participatory budgeting and straightforward guidelines to enhance the process of civic engagement and democratic values in local communities….(More)”