The Bottom of the Data Pyramid: Big Data and the Global South


Payal Arora at the International Journal of Communication: “To date, little attention has been given to the impact of big data in the Global South, about 60% of whose residents are below the poverty line. Big data manifests in novel and unprecedented ways in these neglected contexts. For instance, India has created biometric national identities for her 1.2 billion people, linking them to welfare schemes, and social entrepreneurial initiatives like the Ushahidi project that leveraged crowdsourcing to provide real-time crisis maps for humanitarian relief.

While these projects are indeed inspirational, this article argues that in the context of the Global South there is a bias in the framing of big data as an instrument of empowerment. Here, the poor, or the “bottom of the pyramid” populace are the new consumer base, agents of social change instead of passive beneficiaries. This neoliberal outlook of big data facilitating inclusive capitalism for the common good sidelines critical perspectives urgently needed if we are to channel big data as a positive social force in emerging economies. This article proposes to assess these new technological developments through the lens of databased democracies, databased identities, and databased geographies to make evident normative assumptions and perspectives in this under-examined context….(More)”.

Your Data Footprint Is Affecting Your Life In Ways You Can’t Even Imagine


Jessica Leber at Fast Co-Exist: “Cities have long seen the potential in big data to improve the government and the lives of citizens, and this is now being put into action in ways where governments touch citizens’ lives in very sensitive areas. New York City’s Department of Homelessness Services is mining apartment eviction filings, to see if they can understand who is at risk of becoming homeless and intervene early. And police departments all over the country have adopted predictive policing software that guides where officers should deploy, and at what time, leading to reduced crime in some cities.

In one study in Los Angeles, police officers deployed to certain neighborhoods by predictive policing software prevented 4.3 crimes per week, compared to 2 crimes per week when assigned to patrol a specific area by human crime analysts. Surely, a reduction in crime is a good thing. But community activists in places such as Bellingham, Washington, have grave doubts. They worry that outsiders can’t examine how the algorithms work, since the software is usually proprietary, and so citizens have no way of knowing what data the government is using to target them. They also worry that predictive policing is just exacerbating existing patterns of racial profiling. If the underlying crime data being used is the result of years of over-policing minority communities for minor offenses, then the predictions based on this biased data could create a feedback loop and lead to yet more over-policing.

At a smaller and more limited scale is the even more sensitive area of child protection services. Though the data isn’t really as “big” as in other examples, a few agencies are carefully exploring using statistical models to make decisions in several areas, such as which children in the system are most in danger of violence, which children are most in need of a trauma screening, and which are at risk of entering the criminal justice system. 

In Hillsborough County, Florida, where a series of child homicides occurred, a private provider selected to manage the county’s child welfare system in 2012 came in and analyzed the data. Cases with the highest probability of serious injury or death had a few factors in common, they found: a child under the age of three, a “paramour” in the home, a substance abuse or domestic violence history, and a parent previously in the foster care system. They identified nine practices to use in these cases and hired a software provider to create a dashboard that allowed real-time feedback and dashboards. Their success has led to the program being implemented statewide….

“I think the opportunity is a rich one. At the same time, the ethical considerations need to be guiding us,” says Jesse Russell, chief program officer at the National Council on Crime and Delinquency, who has followed the use of predictive analytics in child protective services. Officials, he says, are treading carefully before using data to make decisions about individuals, especially when the consequences of being wrong—such as taking a child out of his or her home unnecessarily—are huge. And while caseworker decision-making can be flawed or biased, so can the programs that humans design. When you rely too much on data—if the data is flawed or incomplete, as could be the case in predictive policing—you risk further validating bad decisions or existing biases….

On the other hand, big data does have the potential to vastly expand our understanding of who we are and why we do what we do. A decade ago, serious scientists would have laughed someone out of the room who proposed a study of “the human condition.” It is a topic so broad and lacking in measurability. But perhaps the most important manifestation of big data in people’s lives could come from the ability for scientists to study huge, unwieldy questions they couldn’t before.

A massive scientific undertaking to study the human condition is set to launch in January of 2017. The Kavli Human Project, funded by the Kavli Foundation, plans to recruit 10,000 New Yorkers from all walks of life to be measured for 10 years. And by measured, they mean everything: all financial transactions, tax returns, GPS coordinates, genomes, chemical exposure, IQ, bluetooth sensors around the house, who subjects text and call—and that’s just the beginning. In all, the large team of academics expect to collect about a billion data points per person per year at an unprecedented low cost for each data point compared to other large research surveys.

The hope is with so much continuous data, researchers can for the first time start to disentangle the complex, seemingly unanswerable questions that have plagued our society, from what is causing the obesity epidemic to how to disrupt the poverty to prison cycle….(More)

The Social Intranet: Insights on Managing and Sharing Knowledge Internally


Paper by Ines Mergel for IBM Center for the Business of Government: “While much of the federal government lags behind, some agencies are pioneers in the internal use of social media tools.  What lessons and effective practices do they have to offer other agencies?

Social intranets,” Dr. Mergel writes, “are in-house social networks that use technologies – such as automated newsfeeds, wikis, chats, or blogs – to create engagement opportunities among employees.”  They also include the use of internal profile pages that help people identify expertise and interest (similar to Facebook or LinkedIn profiles), and that are used in combination with other social Intranet tools such as on-line communities or newsfeeds.

The report documents four case studies of government use of social intranets – two federal government agencies (the Department of State and the National Aeronautics and Space Administration) and two cross-agency networks (the U.S. Intelligence Community and the Government of Canada).

The author observes: “Most enterprise social networking platforms fail,” but identifies what causes these failures and how successful social intranet initiatives can avoid that fate and thrive.  She offers a series of insights for successfully implementing social intranets in the public sector, based on her observations and case studies. …(More)”

Political Behavior and Big Data


Special issue of the International Journal of Sociology: “Interest in the use of “big data” in the social sciences is growing dramatically. Yet, adequate methodological research on what constitutes such data, and about their validity, is lacking. Scholars face both opportunities and challenges inherent in this new era of unprecedented quantification of information, including that related to political actions and attitudes. This special issue of the International Journal of Sociology addresses recent uses of “big data,” its multiple meanings, and the potential that this may have in building a stronger understanding of political behavior. We present a working definition of “big data” and summarize the major issues involved in their use. While the papers in this volume deal with various problems – how to integrate “big data” sources with cross-national survey research, the methodological challenges involved in building cross-national longitudinal network data of country memberships in international nongovernmental organizations, methods of detecting and correcting for source selection bias in event data derived from news and other online sources, the challenges and solutions to ex post harmonization of international social survey data – they share a common viewpoint. To make good on the substantive promise of “big data,” scholars need to engage with their inherent methodological problems. At this date, scholars are only beginning to identify and solve them….(More)”

UN statistics commission agrees starting point for SDG oversight


Emma Rumney at Public Finance: “The United Nations Statistical Commission agreed on a set of 230 preliminary indicators to measure progress towards the 17 Sustainable Development Goals published last September.

Wu Hongbo, under secretary general of the UN Department of Economic and Social Affairs, of which the UKSC is part, said “completing the indicator framework is not the end of the story – on the contrary, it is the beginning”.

Hongbo said it was necessary to acknowledge that developing a high-quality set of indicators is a technical and necessarily continuous process, “with refinements and improvements” made as “knowledge improves and new data sources become available”.

One challenge will entail the effective disaggregation of data, by income, sex, age, race, ethnicity, migratory status, disability, geographic location and more, to allow coverage of specific sectors of the population.

This will be essential if the SDGs are to be implemented successfully.

Hongbo said this will require “an unprecedented amount of data to be produced and analysed”, posing a significant challenge to national statistics systems in both the developing and developed world.

National and regional authorities will also have to develop their own indicators for regional, national and sub-national monitoring, as the global indicators won’t be able to account for different realities, capacities and levels of development.

The statistical commission will now submit its initial global indicator framework to the UN’s Economic and Social Council and General Assembly for adoption….(More)

See also:

Capitalizing on Creativity at Work: Fostering the Implementation of Creative Ideas in Organizations


Book by Miha Škerlavaj et al: “How does one implement highly creative ideas in the workplace? Though creativity fuels modern businesses and organizations, capitalizing on creativity is still a relatively unchartered territory. The crux of this issue is explored as contributors present and analyze remedies for capitalizing on highly creative ideas.

Editors Miha Škerlavaj, Matej ?erne, Anders Dysvik and Arne Carlsen have gathered a large network of contributors across four continents to craft this relevant, evidence-based and holistic text. Multiple levels, methods, approaches and perspectives are all considered while focusing on a single research question. Chapters feature a combination of research-based materials, stories and short cases to show what can be done to implement highly creative ideas in the workplace.

This extremely relevant subject will be of interest to a large number of organizations worldwide that are looking to tap into the potential of highly creative and possibly useful ideas to build their competitive advantage. Specifically, management consultants in Human Resource Management, innovation, creativity, coaching, and/or leadership will find this book useful. It can also be used in Innovation Management MSc and MBA courses, executive education courses, as well as for PhD researchers and innovation management scholars…. Contents: …

E. As Innovation Policy Makers

21. Adjusting National Innovation Policies to Support Open and Networked Innovation Systems

22. Governmental Ideation Systems

23. Creation of a Social Media Social Venture…(More)”

Crowdsourcing Site Works to Detect Spread of Zika


Suzanne Tracy at Scientific Computing Source: “Last month, the Flu Near You crowdsourcing tool expanded its data collection to include Zika, chikungunya and dengue symptoms, such as eye pain, yellow skin/eyes and joint/bone pain. Flu Near You is a free and anonymous Web site and mobile application that allows the public to report their health information by completing brief weekly surveys.

Created by epidemiologists at Harvard, Boston Children’s Hospital and The Skoll Global Threats Fund, the novel participatory disease surveillance tool is intended to complement existing surveillance systems by directly engaging the public in public health reporting. As such, it relies on voluntary participation from the general public, asking participants to take a few seconds each week to report whether they or their family members have been healthy or sick.

Using participant-reported symptoms, the site graphs and maps this information to provide local and national views of illness. Thousands of reports are analyzed and mapped to provide public health officials and researchers with real-time, anonymous information that could help prevent the next pandemic.

The survey, which launched in 2011, is conducted year-round for several reasons.

  • First, it is possible for an influenza outbreak to occur outside of the traditional flu season. For instance, the first wave of pandemic H1N1 hit in the spring of 2009. The project wants to capture any emerging outbreak, should something similar occur again.
  • Second, the project’s symptoms-based health forms allow it to monitor other diseases, such as the recently-added Zika, chikungunya and dengue, which may have different seasons than influenza….(More)

See also: http://flunearyou.org and video: Fight the flu. Save lives

How the FDA aims to speed review of medical devices


Kathleen Hickey at GCN: “The Food and Drug Administration is piloting a new system to speed up the premarket review process for new medical devices.

One of the main bottlenecks in the medical device review process is finding the right expert reviewer. Currently the FDA relies on “the usual suspects” – a core group of reviewers from the FDA Office of Device Evaluation (ODE), according to a GovLab report on the pilot program. However, this pool of experts is limited and may not include those with knowledge of the specific technologies in new medical devices. Finding qualified reviewers outside this core group can take as long as nine months.

To combat the issue, the Department of Health and Human Services is creating a network database of experts — HHS Profiles — based on a customized version of theHarvard Profiles Research Networking Software, a National Institutes of Health-funded open source tool for finding researchers with specific areas of expertise.

Potential expert reviewers create profiles in the system describing their skills and experience. The software then imports and analyzes reviewer contact information, publications and other data sources to create and maintain a searchable library of electronic resumes of HHS experts. Representatives of the Office for Device Evaluation can then search the profiles to identify the most qualified individuals to participate in the regulatory review of a given medical device.

The pilot will compare the efficacy of picking expert reviewers from profiles versus the current methods, including determining whether matching individuals based on their published articles and academic degrees is the best method for finding the right reviewer; the time required for the panel to meet and review a device; and safety outcomes – e.g. product recalls and adverse event reports.

The FDA anticipates the new platform will increase the speed and effectiveness of the medical device regulatory review process and expand the pool of reviewers. Currently the premarket approval review process, done exclusively by internal staff, takes an average of 266 days. Reviewing unique devices takes an average of 18 months.

The pilot program is being conducted this year in partnership with GovLab and its MacArthur Foundation Research Network on Opening Governance.  Funding is provided by the General Services Administration from its The Great Pitch investment contest….(More)”

Accelerating Discovery with New Tools and Methods for Next Generation Social Science


DARPA: “The explosive growth of global digital connectivity has opened new possibilities for designing and conducting social science research. Once limited by practical constraints to experiments involving just a few dozen participants—often university students or other easily available groups—or to correlational studies of large datasets without any opportunity for determining causation, scientists can now engage thousands of diverse volunteers online and explore an expanded range of important topics and questions. If new tools and methods for harnessing virtual or alternate reality and massively distributed platforms could be developed and objectively validated, many of today’s most important and vexing challenges in social science—such as identifying the primary drivers of social cooperation, instability and resilience—might be made more tractable, with benefits for domains as broad as national security, public health, and economics.

To begin to assess the research opportunities provided by today’s web-connected world and advanced technologies, DARPA today launched its Next Generation Social Science (NGS2) program. The program aims to build and evaluate new methods and tools to advance rigorous, reproducible social science studies at scales necessary to develop and validate causal models of human social behaviors. The program will draw upon and build across a wide array of disciplines—including social sciences like sociology, economics, political science, anthropology, and psychology, as well as information and computer sciences, physics, biology and math.

As an initial focus, NGS2 will challenge researchers to develop and use these new tools and methods to identify causal mechanisms of “collective identity” formation—how a group of individuals becomes a unified whole, and how under certain circumstances that community breaks down into a chaotic mix of disconnected individuals.

“Social science has done a remarkable job of helping us understand ourselves as the highly social creatures we are, but the field has long acknowledged and rued some frustrating research limitations, including technical and logistical limits to experimentally studying large, representative populations and the challenges of replicating key studies to better understand the limits of our knowledge,” said Adam Russell, DARPA program manager. “As a result, it’s been difficult for social scientists to determine what variables matter most in explaining their observations of human social systems and to move from documenting correlation to identifying causation.”

On top of those methodological and analytic limitations, Russell said, the field is inherently challenged because of its subject matter: human beings, with all their complex variability and seeming unpredictability. “Physicists have joked about how much more difficult their field would be if atoms or electrons had personalities, but that’s exactly the situation faced by social scientists,” he said.

By developing and applying new methods and models to larger, more diverse, and more representative groups of individuals—such as through web-based global gaming and alternate reality platforms—NGS2 seeks to validate new tools that may empower social science in the same way that sophisticated telescopes and microscopes have helped advance astronomy and biology….(More)”

Research and Evaluation of Participatory Budgeting in the U.S. and Canada


Public Agenda: “Communities across the country are experimenting with participatory budgeting (PB), a democratic process in which residents decide together how to spend part of a public budget. Learning more about how these community efforts are implemented and with what results will help improve and expand successful forms of participatory budgeting across the U.S. and Canada.

Public Agenda is supporting local evaluation efforts and sharing research on participatory budgeting. Specifically, we are:

  • Building a community of practice among PB evaluators and researchers.
  • Working with evaluators and researchers to make data and research findings comparable across communities that use participatory budgeting.
  • Developing key metrics and research tools to help evaluate participatory budgeting (download these documents here).
  • Publishing a “Year in Participatory Budgeting Research” review based on data, findings, experiences and challenges from sites in the U.S. and Canada.
  • Conducting original, independent research on elected officials’ views of and experiences with participatory budgeting.
  • Convening the North American Participatory Budgeting Research Board.

…Below, you will find evaluation tools and resources we developed in close collaboration with PB evaluators and researchers in the U.S. and Canada. We also included the local evaluation reports from communities around the U.S. and Canada using PB in budget decisions.

To be the first to hear about new PB resources and news, join our email list. We also invite you to email us to join our listserv and participate in discussion about evaluation and research of participatory budgeting in the U.S. and Canada.

New to PB and looking to introduce it to your community? You should start here instead! Once your PB effort is under way, come back to this page for tools to evaluate how you’re doing.

15 Key Metrics for Evaluating Participatory Budgeting: A Toolkit for Evaluators and Implementers

Evaluation is a critical component of any PB effort. Systematic and formal evaluation can help people who introduce, implement, participate in or otherwise have a stake in PB understand how participatory budgeting is growing, what its reach is, and how it’s impacting the community and beyond.

We developed the 15 Key Metrics for Evaluating Participatory Budgeting toolkit for people interested in evaluating PB efforts in their communities. It is meant to encourage and support some common research goals across PB sites and meaningfully inform local and national discussions about PB in the U.S. and Canada. It is the first iteration of such a toolkit and especially focused on providing practical and realistic guidance for the evaluation of new and relatively new PB processes.

Anyone involved in public engagement or participation efforts other than participatory budgeting may also be interested in reviewing the toolkit for research and evaluation ideas.

The toolkit requires registration before you can download.

The toolkit includes the following sections:

15 Key Metrics for Evaluating Participatory Budgeting: 15 indicators (“metrics”) that capture important elements of each community-based PB process and the PB movement in North America overall. Click here for a brief description of these metrics….(More)”