Big Data for Social Good


Introduction to a Special Issue of the Journal “Big Data” by Catlett Charlie and Ghani Rayid: “…organizations focused on social good are realizing the potential as well but face several challenges as they seek to become more data-driven. The biggest challenge they face is a paucity of examples and case studies on how data can be used for social good. This special issue of Big Data is targeted at tackling that challenge and focuses on highlighting some exciting and impactful examples of work that uses data for social good. The special issue is just one example of the recent surge in such efforts by the data science community. …

This special issue solicited case studies and problem statements that would either highlight (1) the use of data to solve a social problem or (2) social challenges that need data-driven solutions. From roughly 20 submissions, we selected 5 articles that exemplify this type of work. These cover five broad application areas: international development, healthcare, democracy and government, human rights, and crime prevention.

“Understanding Democracy and Development Traps Using a Data-Driven Approach” (Ranganathan et al.) details a data-driven model between democracy, cultural values, and socioeconomic indicators to identify a model of two types of “traps” that hinder the development of democracy. They use historical data to detect causal factors and make predictions about the time expected for a given country to overcome these traps.

“Targeting Villages for Rural Development Using Satellite Image Analysis” (Varshney et al.) discusses two case studies that use data and machine learning techniques for international economic development—solar-powered microgrids in rural India and targeting financial aid to villages in sub-Saharan Africa. In the process, the authors stress the importance of understanding the characteristics and provenance of the data and the criticality of incorporating local “on the ground” expertise.

In “Human Rights Event Detection from Heterogeneous Social Media Graphs,” Chen and Neil describe efficient and scalable techniques to use social media in order to detect emerging patterns in human rights events. They test their approach on recent events in Mexico and show that they can accurately detect relevant human rights–related tweets prior to international news sources, and in some cases, prior to local news reports, which could potentially lead to more timely, targeted, and effective advocacy by relevant human rights groups.

“Finding Patterns with a Rotten Core: Data Mining for Crime Series with Core Sets” (Wang et al.) describes a case study with the Cambridge Police Department, using a subspace clustering method to analyze the department’s full housebreak database, which contains detailed information from thousands of crimes from over a decade. They find that the method allows human crime analysts to handle vast amounts of data and provides new insights into true patterns of crime committed in Cambridge…..(More)

Institutional isomorphism, policy networks, and the analytical depreciation of measurement indicators: The case of the EU e-government benchmarking


Paper by Cristiano Codagnone et al: “This article discusses the socio-political dimension of measurement in the context of benchmarking e-government within the European Union׳s Open Method of Coordination. It provides empirical evidence of how this has resulted in institutional isomorphism within the self-referential policy network community involved in the benchmarking process. It argues that the policy prominence retained by supply-side benchmarking of e-government has probably indirectly limited efforts made to measure and evaluate more tangible impacts. High scores in EU benchmarking have contributed to increasing the institutionally-perceived quality but not necessarily the real quality and utility of e-government services. The article concludes by outlining implications for policy and practical recommendations for filling the gaps identified in measurement and evaluation of e-government. It proposes a more comprehensive policy benchmarking framework, which aims to ensure a gradual improvement in measurement activities with indicators that reflect and follow the pace of change, align measurement activities to evaluation needs and, eventually, reduce measurement error….(More)”

Data democracy – increased supply of geospatial information and expanded participatory processes in the production of data


Paper by Max Craglia & Lea Shanley: “The global landscape in the supply, co-creation and use of geospatial data is changing very rapidly with new satellites, sensors and mobile devices reconfiguring the traditional lines of demand and supply and the number of actors involved. In this paper we chart some of these technology-led developments and then focus on the opportunities they have created for the increased participation of the public in generating and contributing information for a wide range of uses, scientific and non. Not all this information is open or geospatial, but sufficiently large portions of it are to make it one of the most significant phenomena of the last decade. In fact, we argue that while satellite and sensors have exponentially increased the volumes of geospatial information available, the participation of the public is transformative because it expands the range of participants and stakeholders in society using and producing geospatial information, with opportunities for more direct participation in science, politics and social action…(View full text)”

Crowdsourcing as a tool for political participation? – the case of Ugandawatch


Paper by Johan Hellström in the International Journal of Public Information Systems: “Uganda has democratic deficits where demand for democracy exceeds its supply. As a consequence it is argued that a segment of Ugandans might participate and honour the freedom to speak out, assemble, and associate given new opportunities outside the traditional political channels. With expanded mobile coverage and access to mobile devices and services in mind, and using the concept of open crowdsourcing, the platform UgandaWatch was launched prior to the 2011 general elections with the intention to meet the demand, to offer increased equality of political participation, and to advance efforts toward increased citizen engagement in Uganda. From a community informatics point of view, the study examined how and under what conditions access to ICT tools (mobile devices, networks, and a crowdsourcing platform) can be made usable and useful for people and communities for increased political participation in a given context. By combining the collection and analysis of quantitative (SMS-survey) and qualitative data (focus groups) through a mixed-method approach, this study answers the questions, What are the key factors that influence users’ willingness to use mobile phones and crowdsourcing platforms as a channel for political participation?, and What concerns do users have with respect to using mobile phones and crowdsourcing platforms in the participation process? The study shows that users participated because they hoped it would bring real change to Uganda’s electoral and political landscape, that it was a convenient channel to use (quick and easy) and that confidentiality was assured. The user concerns relate to costs, trust, and safety. Crowdsourcing offers an alternative channel and may substitute or supplement traditional means of political participation. It can increase participation in some groups, including among those who normally do not participate—something that increases equality of political participation in a positive direction….(More)”

Managerial Governance and Transparency in Public Sector to Improve Services for Citizens and Companies


Paper by Nunzio Casalino and Peter Bednar: “Recent debate and associated initiatives dealing with public sector innovation have mainly aimed at improving the effectiveness and efficiency of the delivery of public services and improved transparency and user friendliness. Beyond typical administrative reforms, innovation is expected to help address societal challenges such as the aging population, inclusion, health care, education, public safety, environment and greenhouse gas emissions reduction. The public sector consists of a complex open system of organizations with various tasks. Therefore, decision-making can be slower than in the private sector because of large chains of command. Innovations here will often have an impact across this complex organizational structure, and thus must be supported by a robust strategy. To strengthen democracy, promote government efficiency and effectiveness, discourage wastes and misuses of government resources, public administrations have to promote a new stronger level of openness in government. The purpose of this manuscript is to describe an innovative approach for the governance of public systems and services, currently applied in the Italian public administration domain, which could be easily replicated in other countries as well. Two initiatives, to collect and provide relevant public information gathered from different and heterogeneous public organizations, to improve government processes and increase quality of services for citizens and companies, are described. The cases adopted have been validated through a case analysis approach involving the Italian Agency for the public administration digitalization to understand new e-government scenarios within the context of governmental reforms heavily influenced by the principles of Open Government Model….(More)

Cities’ Open Government Data Heart Beat


Paper by Nahon, Karine and Peled, Alon and Shkabatur, Jennifer for The International Conference for E-Democracy & Open Government: “This paper develops and tests a theoretical model, which assesses the commitment of cities to the concept of open government data (OGD), according to three levels. Level 1, ‘Way of life,’ reflects a high commitment to OGD; Level 2, ‘On the Fence,’ represents either a low or erratic commitment to OGD; Level 3, ‘Lip Service,’ refers to either scarce or no commitment to OGD. These levels draw on four key dimensions: 1) Rhythm; 2) Span of Issues; 3) Disclosure; and 4) Feedback. We empirically examine this theoretical framework using longitudinal mixed-method analysis of the OGD behavior of 16 US cities for a period of four years, using a large novel corpus of municipal OGD metadata, as well as primary qualitative and secondary quantitative indicators. This methodology allows us to represent, for the first time, the evolving OGD commitment — or “OGD heart beat” — of cities….(More)”

Participatory Democracy’s Emerging Tools


, and (The GovLab) at Governing: “As we explore the role of new technologies in changing how government makes policies and delivers services, one form of technology is emerging that has the potential to foster decision-making that’s not only more effective but also more legitimate: platforms for organizing communication by groups across a distance….

Whether the goal is setting an agenda, brainstorming solutions, choosing a path forward and implementing it, or collaborating to assess what works, here are some examples of new tools for participatory democracy:

Agenda-setting and brainstorming: Loomio is an open-source tool designed to make it easy for small to medium-sized groups to make decisions together. Participants can start a discussion on a given topic and invite people into a conversation. As the conversation progresses, anyone can put a proposal to a vote. It is specifically designed to enable consensus-based decision-making.

Google Moderator is a service that uses crowdsourcing to rank user-submitted questions, suggestions and ideas. The tool manages feedback from a large number of people, any of whom who can submit a question or vote up or down on the top questions. The DeLib Dialogue App is a service from the United Kingdom that also allows participants to suggest ideas, refine them via comments and discussions, and rate them to bring the best ideas to the top. And Your Priorities is a service that enables citizens to voice, debate and prioritize ideas.

Voting: Democracy 2.1 and OpaVote are tools that allow people to submit ideas, debate them and then vote on them. Democracy 2.1 offers voters the additional option of casting up to four equally weighted “plus votes” and two “minus votes.” OpaVote is designed to enable elections where voters select a single candidate, employ ranked-choice or approval voting, or use any combination of voting methods.

Drafting: DemocracyOS was designed specifically to enable co-creation of legislation or policy proposals. With the tool, large numbers of users can build proposals, either from scratch or by branching off from existing drafts. Currently in use in several cities, it is designed to get citizen input into a process where final decision-making authority still rests with elected officials or civil servants. For drafting together, Hypothes.is is an annotation tool that can be used to collaboratively annotate documents.

Discussion and Q&A: Stack Exchange enables a community to set up its own free question-and-answer board. It is optimal when a group has frequent, highly granular, factual questions that might be answered by others using the service. ….(More)”

 

Encyclopedia of Social Network Analysis and Mining


“The Encyclopedia of Social Network Analysis and Mining (ESNAM) is the first major reference work to integrate fundamental concepts and research directions in the areas of social networks and  applications to data mining. While ESNAM  reflects the state-of-the-art in  social network research, the field  had its start in the 1930s when fundamental issues in social network research were broadly defined. These communities were limited to relatively small numbers of nodes (actors) and links. More recently the advent of electronic communication, and in particular on-line communities, have created social networks of hitherto unimaginable sizes. People around the world are directly or indirectly connected by popular social networks established using web-based platforms rather than by physical proximity.

Reflecting the interdisciplinary nature of this unique field, the essential contributions of diverse disciplines, from computer science, mathematics, and statistics to sociology and behavioral science, are described among the 300 authoritative yet highly readable entries. Students will find a world of information and insight behind the familiar façade of the social networks in which they participate. Researchers and practitioners will benefit from a comprehensive perspective on the methodologies for analysis of constructed networks, and the data mining and machine learning techniques that have proved attractive for sophisticated knowledge discovery in complex applications. Also addressed is the application of social network methodologies to other domains, such as web networks and biological networks….(More)”

‘Data.gov-in-a-box’: Delimiting transparency


New paper by Clare Birchall in the European Journal of Social Theory: “Given that the Obama administration still relies on many strategies we would think of as sitting on the side of secrecy, it seems that the only lasting transparency legacy of the Obama administration will be data-driven or e-transparency as exemplified by the web interface ‘data.gov’. As the data-driven transparency model is exported and assumes an ascendant position around the globe, it is imperative that we ask what kind of publics, subjects, and indeed, politics it will produce. Open government data is not just a matter concerning accountability but is seen as a necessary component of the new ‘data economy’. To participate and benefit from this info-capitalist-democracy, the data subject is called upon to be both auditor and entrepreneur. This article explores the implications of responsibilization, outsourcing, and commodification on the contract of representational democracy and asks if there are other forms of transparency that might better resist neoliberal formations and re-politicize the public sphere….(More)”

The Power of Heuristics


ideas42: “People are presented with many choices throughout their day, from what to have for lunch to where to go on vacation to how much money to save for emergencies. In many situations, this ability to choose enhances our lives. However, having too many choices can sometimes feel like a burden, especially if the choices are complex or the decisions we’re making are important. In these instances, we often make poor decisions, or sometimes even fail to choose at all. This can create real problems, for example when people fail to save enough for retirement or don’t make the right choices when it comes to staying healthy.
So why is it that so much effort has been spent trying to improve decision-making by giving people even more information about the choices available – often complicating the choice even further?
In a new paper by ideas42, ideas42 co-founder Antoinette Schoar of MIT’s Sloan School of Management, and ideas42’s Saugato Datta argue that this approach of providing more information to help individuals make better decisions is flawed, “since it does not take into account the psychological or behavioral barriers that prevent people from making better decisions.” The solution, they propose, is using effective rules of thumb, or ‘heuristics’, to “enable people to make ‘reasonably good’ decisions without needing to understand all the complex nuances of the situation.” The paper explores the effectiveness of heuristics as a tool to simplify information during decision-making and help people follow through on their intentions. The authors offer powerful examples of effective heuristics-based methods in three domains: financial education, agriculture, and medicine….(More)”