How Technology Can Help Solve Societal Problems


Barry LibertMegan Beck, Brian Komar and Josue Estrada at Knowledge@Wharton: “…nonprofit groups, academic institutions and philanthropic organizations engaged in social change are struggling to adapt to the new global, technological and virtual landscape.

Legacy modes of operation, governance and leadership competencies rooted in the age of physical realities continue to dominate the space. Further, organizations still operate in internal and external silos — far from crossing industry lines, which are blurring. And their ability to lead in a world that is changing at an exponential rate seems hampered by their mental models and therefore their business models of creating and sustaining value as well.

If civil society is not to get drenched and sink like a stone, it must start swimming in a new direction. This new direction starts with social organizations fundamentally rethinking the core assumptions driving their attitudes, behaviors and beliefs about creating long-term sustainable value for their constituencies in an exponentially networked world. Rather than using an organization-centric model, the nonprofit sector and related organizations need to adopt a mental model based on scaling relationships in a whole new way using today’s technologies — the SCaaP model.

Embracing social change as a platform is more than a theory of change, it is a theory of being — one that places a virtual network or individuals seeking social change at the center of everything and leverages today’s digital platforms (such as social media, mobile, big data and machine learning) to facilitate stakeholders (contributors and consumers) to connect, collaborate, and interact with each other to exchange value among each other to effectuate exponential social change and impact.

SCaaP builds on the government as a platform movement (Gov 2.0) launched by technologist Tim O’Reilly and many others. Just as Gov 2.0 was not about a new kind of government but rather, as O’Reilly notes, “government stripped down to its core, rediscovered and reimagined as if for the first time,” so it is with social change as a platform. Civil society is the primary location for collective action and SCaaP helps to rebuild the kind of participatory community celebrated by 19th century French historian Alexis de Tocqueville when he observed that Americans’ propensity for civic association is central to making our democratic experiment work. “Americans of all ages, all stations in life, and all types of disposition,” he noted, “are forever forming associations.”

But SCaaP represents a fundamental shift in how civil society operates. It is grounded in exploiting new digital technologies, but extends well beyond them to focus on how organizations think about advancing their core mission — do they go at it alone or do they collaborate as part of a network? SCaaP requires thinking and operating, in all things, as a network. It requires updating the core DNA that runs through social change organizations to put relationships in service of a cause at the center, not the institution. When implemented correctly, SCaaP will impact everything — from the way an organization allocates resources to how value is captured and measured to helping individuals achieve their full potential….(More)”.

Why big-data analysis of police activity is inherently biased


 and  in The Conversation: “In early 2017, Chicago Mayor Rahm Emanuel announced a new initiative in the city’s ongoing battle with violent crime. The most common solutions to this sort of problem involve hiring more police officers or working more closely with community members. But Emanuel declared that the Chicago Police Department would expand its use of software, enabling what is called “predictive policing,” particularly in neighborhoods on the city’s south side.

The Chicago police will use data and computer analysis to identify neighborhoods that are more likely to experience violent crime, assigning additional police patrols in those areas. In addition, the software will identify individual people who are expected to become – but have yet to be – victims or perpetrators of violent crimes. Officers may even be assigned to visit those people to warn them against committing a violent crime.

Any attempt to curb the alarming rate of homicides in Chicago is laudable. But the city’s new effort seems to ignore evidence, including recent research from members of our policing study team at the Human Rights Data Analysis Group, that predictive policing tools reinforce, rather than reimagine, existing police practices. Their expanded use could lead to further targeting of communities or people of color.

Working with available data

At its core, any predictive model or algorithm is a combination of data and a statistical process that seeks to identify patterns in the numbers. This can include looking at police data in hopes of learning about crime trends or recidivism. But a useful outcome depends not only on good mathematical analysis: It also needs good data. That’s where predictive policing often falls short.

Machine-learning algorithms learn to make predictions by analyzing patterns in an initial training data set and then look for similar patterns in new data as they come in. If they learn the wrong signals from the data, the subsequent analysis will be lacking.

This happened with a Google initiative called “Flu Trends,” which was launched in 2008 in hopes of using information about people’s online searches to spot disease outbreaks. Google’s systems would monitor users’ searches and identify locations where many people were researching various flu symptoms. In those places, the program would alert public health authorities that more people were about to come down with the flu.

But the project failed to account for the potential for periodic changes in Google’s own search algorithm. In an early 2012 update, Google modified its search tool to suggest a diagnosis when users searched for terms like “cough” or “fever.” On its own, this change increased the number of searches for flu-related terms. But Google Flu Trends interpreted the data as predicting a flu outbreak twice as big as federal public health officials expected and far larger than what actually happened.

Criminal justice data are biased

The failure of the Google Flu Trends system was a result of one kind of flawed data – information biased by factors other than what was being measured. It’s much harder to identify bias in criminal justice prediction models. In part, this is because police data aren’t collected uniformly, and in part it’s because what data police track reflect longstanding institutional biases along income, race and gender lines….(More)”.

What data do we want? Understanding demands for open data among civil society organisations in South Africa


Report by Kaliati, Andrew; Kachieng’a, Paskaliah and de Lanerolle, Indra: “Many governments, international agencies and civil society organisations (CSOs) support and promote open data. Most open government data initiatives have focused on supply – creating portals and publishing information. But much less attention has been given to demand – understanding data needs and nurturing engagement. This research examines the demand for open data in South Africa, and asks under what conditions meeting this demand might influence accountability. Recognising that not all open data projects are developed for accountability reasons, it also examines barriers to using government data for accountability processes. The research team identified and tested ‘use stories’ and ‘use cases’. How did a range of civil society groups with an established interest in holding local government accountable use – or feel that they could use – data in their work? The report identifies and highlights ten broad types of open data use, which they divided into two streams: ‘strategy and planning’ – in which CSOs used government data internally to guide their own actions; and ‘monitoring, mobilising and advocacy’ – in which CSOs undertake outward-facing activities….(More)”

Open data and the war on hunger – a challenge to be met


Diginomica: “Although the private sector is seen as the villain of the piece in some quarters, it actually has a substantial role to play in helping solve the problem of world hunger.

This is the view of Andre Laperriere, executive director of the Global Open Data for Agriculture and Nutrition (Godan) initiative, …

Laperriere himself heads up Godan’s small secretariat of five full-time equivalent employees who are based in Oxfordshire in the UK. The goal of the organisation, which currently has 511 members, is to encourage governmental, non-governmental (NGO) and private sector organisations to share open data about agriculture and nutrition. The idea is to make such information more available, accessible and usable in order to help tackle world food security in the face of mounting threats such as climate change.

But to do so, it is necessary to bring the three key actors originally identified by James Wolfensohn, former president of the World Bank, into play, believes Laperriere. He explains:

You have states, which generate and possess much of the data. There are citizens with lots of specific needs for which the data can be used, and there’s the private sector in between. It’s in the best position to exploit the data and use it to develop products that help meet the needs of the population. So the private sector is the motor of development and has a big role to play.

This is not least because NGOs, cooperatives and civil societies of all kinds often simply do not have the resources or technical knowledge to either find or deal with the massive quantities of open data that is released. Laperriere explains:

It’s a moral dilemma for a lot of research organisations. If, for example, they release 8,000 data sets about every kind of cattle disease, they’re doing so for the benefit of small farmers. But the only ones that can often do anything with it are the big companies as they have the appropriate skills. So the goal is the little guy rather than the big companies, but the alternative is not to release anything at all.

But for private sector businesses to truly get the most out of this open data as it is made available, Laperriere advocates getting together to create so-called pre-competition spaces. These spaces involve competitors collaborating in the early stages of commercial product development to solve common problems. To illustrate how such activity works, Laperriere cites his own past experience when working for a lighting company:

We were pushing fluorescent rather than incandescent lighting, but it contains mercury which pollutes, although it has a lower carbon footprint. It was also a lot more expensive. But we sat down together with the other manufacturers and shared our data to fix the problem together, which meant that everyone benefited by reducing the cost, the mercury pollution and the amount of energy consumed.

Next revolution

While Laperriere understands the fear of many organisations in potentially making themselves vulnerable to competition by disclosing their data, in reality, he attests, “it not the case”. Instead he points out:

If you release data in the right way to stimulate collaboration, it is positive economically and benefits both consumers and companies too as it helps reduce their costs and minimise other problems.

Due to growing amounts of government legislation and policies that require processed food manufacturers around the world to disclose product ingredients, he is, in fact, seeing rising interest in the approach not only among the manufacturers themselves but also among packaging and food preservation companies. The fact that agriculture and nutrition is a vast, complex area does mean there is still a long way to go, however….(More)”

Beyond Networks – Interlocutory Coalitions, the European and Global Legal Orders


Book by Gianluca Sgueo: “….explores the activism promoted by organised networks of civil society actors in opening up possibilities for more democratic supranational governance. It examines the positive and negative impact that such networks of civil society actors – named “interlocutory coalitions” – may have on the convergence of principles of administrative governance across the European legal system and other supranational legal systems.

The book takes two main controversial aspects into account: the first relates to the convergence between administrative rules pertaining to different supranational regulatory systems. Traditionally, the spread of methods of administrative governance has been depicted primarily against the background of the interactions between the domestic and the supranational arena, both from a top-down and bottom-up perspective. However, the exploration of interactions occurring at the supranational level between legal regimes is still not grounded on adequate empirical evidence. The second controversial aspect considered in this book consists of the role of civil society actors operating at the supranational level. In its discussion of the first aspect, the book focuses on the relations between the European administrative law and the administrative principles of law pertaining to other supranational regulatory regimes and regulators, including the World Bank, the International Monetary Fund, the World Trade Organization, the United Nations, the Organization for Economic Cooperation and Development, the Asian Development Bank, and the Council of Europe. The examination of the second aspect involves the exploration of the still little examined, but crucial, role of civil society organised networks in shaping global administrative law. These “interlocutory coalitions” include NGOs, think tanks, foundations, universities, and occasionally activists with no formal connections to civil society organisations. The book describes such interlocutory coalitions as drivers of harmonized principles of participatory democracy at the European and global levels. However, interlocutory coalitions show a number of tensions (e.g. the governability of coalitions, the competition among them) that may hamper the impact they have on the reconfiguration of individuals’ rights, entitlements and responsibilities in the global arena….(More)’

The Next Great Experiment


A collection of essays from technologists and scholars about how machines are reshaping civil society” in the Atlantic:” Technology is changing the way people think about—and participate in—democratic society. What does that mean for democracy?…

We are witnessing, on a massive scale, diminishing faith in institutions of all kinds. People don’t trust the government. They don’t trust banks and other corporations. They certainly don’t trust the news media.

At the same time, we are living through a period of profound technological change. Along with the rise of bioengineering, networked devices, autonomous robots, space exploration, and machine learning, the mobile internet is recontextualizing how we relate to one another, dramatically changing the way people seek and share information, and reconfiguring how we express our will as citizens in a democratic society.

But trust is a requisite for democratic governance. And now, many are growing disillusioned with democracy itself.

Disentangling the complex forces that are driving these changes can help us better understand what ails democracies today, and potentially guide us toward compelling solutions. That’s why we asked more than two dozen people who think deeply about the intersection of technology and civics to reflect on two straightforward questions: Is technology hurting democracy? And can technology help save democracy?

We received an overwhelming response. Our contributors widely view 2017 as a moment of reckoning. They are concerned with many aspects of democratic life and put a spotlight in particular on correcting institutional failures that have contributed most to inequality of access—to education, information, and voting—as well as to ideological divisiveness and the spread of misinformation. They also offer concrete solutions for how citizens, corporations, and governmental bodies can improve the free flow of reliable information, pull one another out of ever-deepening partisan echo chambers, rebuild spaces for robust and civil discourse, and shore up the integrity of the voting process itself.

Despite the unanimous sense of urgency, the authors of these essays are cautiously optimistic, too. Everyone who participated in this series believes there is hope yet—for democracy, and for the institutions that support it. They also believe that technology can help, though it will take time and money to make it so. Democracy can still thrive in this uncertain age, they argue, but not without deliberate and immediate action from the people who believe it is worth protecting.

We’ll publish a new essay every day for the next several weeks, beginning with Shannon Vallor’s “Lessons From Isaac Asimov’s Multivac.”…(More)”

The Global Open Data Index 2016/2017 – Advancing the State of Open Data Through Dialogue


Open Knowledge International: “The Global Open Data Index (GODI) is the annual global benchmark for publication of open government data, run by the Open Knowledge Network. Our crowdsourced survey measures the openness of government data according to the Open Definition.

By having a tool that is run by civil society, GODI creates valuable insights for government’s data publishers to understand where they have data gaps. It also shows how to make data more useable and eventually more impactful. GODI therefore provides important feedback that governments are usually lacking.

For the last 5 years we have been revising GODI methodology to fit the changing needs of the open data movement. This year, we changed our entire survey design by adding experimental questions to assess data findability and usability. We also improved our datasets definitions by looking at essential data points that can solve real world problems. Using more precise data definitions also increased the reliability of our cross-country comparison. See all about the GODI methodology here

In addition, this year shall be more than a mere measurement tool. We see it as a tool for conversation. To spark debate, we release GODI in two phases:

  1. The dialogue phase – We are releasing the data to the public after a rigorous review. Yet, like everyone, our work is not assessment in not always perfect. We give all users a chance to contest the index results for 30 days, starting May 2nd. In this period, users of the index can comment on our assessments through our Global Open Data Index forum. On June 2nd, we will review those comments and will change some index submissions if needed.
  2. The final results – on June 15 we will present the final results of the index. For the first time ever, we will also publish the GODI white paper. This paper will include our main findings and recommendations to advance open data publication….

… findings from this year’s GODI

  • GODI highlights data gaps. Open data is the final stage of an information production chain, where governments measure and collect data, process and share data internally, and publish this data openly. While being designed to measure open data, the Index also highlights gaps in this production chain. Does a government collect data at all? Why is data not collected? Some governments lack the infrastructure and resources to modernise their information systems; other countries do not have information systems in place at all.
  • Data findability is a major challenge. We have data portals and registries, but government agencies under one national government still publish data in different ways and different locations. Moreover, they have different protocols for license and formats. This has a hazardous impact – we may not find open data, even if it is out there, and therefore can’t use it. Data findability is a prerequisite for open data to fulfill its potential and currently most data is very hard to find.
  • A lot of ‘data’ IS online, but the ways in which it is presented are limiting their openness. Governments publish data in many forms, not only as tabular datasets but also visualisations, maps, graphs and texts. While this is a good effort to make data relatable, it sometimes makes the data very hard or even impossible for reuse. It is crucial for governments to revise how they produce and provide data that is in good quality for reuse in its raw form. For that, we need to be aware what is best raw data required which varies from data category to category.
  • Open licensing is a problem, and we cannot assess public domain status. Each year we find ourselves more confused about open data licences. On the one hand, more governments implement their unique open data license versions. Some of them are compliant with the Open Definition, but most are not officially acknowledged. On the other hand, some governments do not provide open licenses, but terms of use, that may leave users in the dark about the actual possibilities to reuse data. There is a need to draw more attention to data licenses and make sure data producers understand how to license data better….(More)”.

Beyond Civil Society: Activism, Participation, and Protest in Latin America


Book edited by Sonia  E. Alvarez, Jeffrey  W. Rubin, Millie Thayer, Gianpaolo Baiocchi, and Agustín Laó-Montes: “The contributors to Beyond Civil Society argue that the conventional distinction between civic and uncivic protest, and between activism in institutions and in the streets, does not accurately describe the complex interactions of forms and locations of activism characteristic of twenty-first-century Latin America. They show that most contemporary political activism in the region relies upon both confrontational collective action and civic participation at different moments. Operating within fluid, dynamic, and heterogeneous fields of contestation, activists have not been contained by governments or conventional political categories, but rather have overflowed their boundaries, opening new democratic spaces or extending existing ones in the process. These essays offer fresh insight into how the politics of activism, participation, and protest are manifest in Latin America today while providing a new conceptual language and an interpretive framework for examining issues that are critical for the future of the region and beyond. (Read the foreword by Arturo Escobar and introduction)…(More)”

The NGO-Academia interface: obstacles to collaboration, lessons from systems thinking and suggested ways forward


Duncan Green at LSE Impact Blog: “The case for partnership between international non-governmental organisations (INGOs) and academia to advance development knowledge is strong. INGOs bring presence on the ground – through their own operations or long-term local partnerships – and communication and advocacy skills (not always academics’ strong point). Academia contributes research skills and credibility, and a long-term reflective perspective that the more frenetic forms of operational work and activism often lack.

In practice, however, such partnerships have proven remarkably difficult, partly because INGOs and academia are too complementary – there is so little overlap between their respective worlds that it is often difficult to find ways to work together.

Obstacles to collaboration

  • Impact vs publication:…
  • Urgency vs “wait and see”: …
  • Status quo vs originality: …
  • Thinking vs talking: ….

Systems thinking approaches

Some of the problems that arise in the academic–INGO interface stem from overly linear approaches to what is, in effect, an ideas and knowledge ecosystem. In such contexts, systems thinking can help identify bottlenecks and suggest possible ways forward.

Getting beyond supply and demand to convening and brokering

Supply-driven is the norm in development research – “experts” churning out policy papers, briefings, books, blogs, etc. Being truly demand-driven is hard even to imagine – an NGO or university department submitting themselves to a public poll on what should be researched? But increasingly in areas such as governance or value chains, we try and move beyond both supply and demand to a convening/brokering role, bringing together different “unusual suspects”. What would that look like in research? Action research, with an agenda that emerges from an interaction between communities and researchers? Natural science seems further ahead on this point: when the Dutch National Research Agenda ran a nationwide citizen survey of research questions they wanted science to look at, 12,000 questions were submitted and clustered into 140 questions, under seven or eight themes. To the organisers’ surprise, many citizens asked quite deep questions.

Most studies identify a need for “knowledge brokers” not only to bridge the gap between the realms of science and policy, but also to synthesise and transform evidence into an effective and usable form for policy and practice. An essential feature of knowledge brokers is that they understand the cultures of both worlds. Often, this role is performed by third-sector organisations of various types (from lobbyists to thinktanks to respected research funders). Some academics can transcend this divide. A few universities employ specialist knowledge brokers but their long-term effectiveness is often constrained by low status, insecure contracts and lack of career pathways. Whoever plays this crucial intermediary role, it appears that it is currently under-resourced within and beyond the university system. In the development sector, the nearest thing to an embedded gateway is the Governance and Social Development Resource Centre (GSDRC), run by Birmingham University and the IDS and largely funded by the Department for International Development. It conducts literature and evidence reviews on a range of topics, drawing evidence from both academic literature and non-academic institutions….

Ways forward

Based on all of the above, a number of ideas emerge for consideration by academics, INGOs and funders of research.

Suggestions for academics

Comments on previous blog posts provided a wealth of practical advice to academics on how to work more productively with INGOs. These include the following:

  • Create research ideas and proposals collaboratively. This means talking to each other early on, rather than academics looking for NGOs to help their dissemination, or NGOs commissioning academics to undertake policy-based evidence making.
  • Don’t just criticise and point to gaps – understand the reasons for them (gaps in both NGO programmes and their research capacity) and propose solutions. Work to recognise practitioners’ strengths and knowledge.
  • Make research relevant to real people in communities. This means proper discussions and dialogue at design, research and analysis stages, disseminated drafts and discussing findings locally on publication.
  • Set up reflection spaces in universities where NGO practitioners can go to take time out and be supported to reflect on and write up their experiences, network with others, and gain new insights on their work.
  • Catalyse more exchange of personnel in both directions. Universities could replicate my own Professor in Practice position at the London School of Economics and Political Science, while INGOs could appoint honorary fellows, who could help guide their thinking in return for access to their work….(More)”.

Measuring results from open contracting in Ukraine


Kathrin Frauscher, Karolis Granickas and Leigh Manasco at the Open Contracting Partnership: “…Ukraine is one of our Showcase and Learning (S&L) projects, and we’ve already shared several stories about the success of Prozorro. Each S&L project tests specific theories of change and use cases. Through the Prozorro platform, Ukraine is revolutionizing procurement by digitizing the process and unlocking data to make it available to citizens, CSOs, government, and business. The theory of change for this S&L project hypothesizes that transparency and the implementation of the Open Contracting Data Standard (OCDS), combined with multi-stakeholder collaboration in the design, promotion and monitoring of the procurement system, is having an impact on value for money, fairness and integrity.

The reform introduced other innovations, including electronic reverse auctions and a centralized procurement database that integrates with private commercial platforms. We co-created a monitoring, evaluation, and learning (MEL) plan with our project partners to quantify and measure specific progress and impact indicators, while understanding that it is hard to attribute impacts to distinct aspects of the reform. The indicators featured in this blog are particularly related to our theory of change.

We are at a crucial moment in this S&L project as our first round of comprehensive MEL baseline and progress data are coming in. It’s a good time to reflect on key takeaways and challenges that arose when defining and analyzing these data, and how we are using them to inform the Prozorro reform.

Openness can result in more competition and competition saves money.

One of the benefits of open contracting appears to be improving market opportunity and efficiency. Market opportunity focuses on companies being able to compete for business on a level playing field.

From January 2015 to March 2017, the average number of bids per tender lot rose by 15%, demonstrating an increase in competition. Even more notable, the average number of unique suppliers during that same time grew by 45% for each procuring entity, meaning that agencies are now procuring from more and more diverse suppliers….

High levels of responsiveness can benefit procuring entities.

Those agencies that leverage their opportunities to interact with business and citizens throughout the contracting cycle, by actively responding to questions and complaints via the online platform, tend to conduct procurement more smoothly, without high levels of amendments or cancellations, than those who don’t. Tenders with a 100% response rate to feedback have a 66% success rate, while those with no response, show a 52% success rate. The portal provides procuring entities with the resources needed to address questions and problems, saving time, effort and money throughout the contracting process.

People are beginning to trust the public procurement process and data more.

According to a survey of 300 entrepreneurs conducted by USAID, most respondents believed that Prozorro significantly (27%) or partially (53%) reduces corruption. Additionally, fewer respondents who participated in procurement said they faced corruption when using the new platform (29%) compared to the old system (54%). These numbers only tell a part of the story, as we do not know what those outside of the procurement system think, but they are a necessary first step towards measuring increased levels of trust for the public procurement process. We will continue looking at trust as one of the proxies for health of an open procurement process.

Citizens are actively seeking out procurement information.

Google search hits grew from 680 in the month of January 2015 to more than 191,000 in the month of February 2017 (tracking 43 related keywords). This means the environment is shifting to one where people are recognizing that this data has value; that there is interest and demand for it. Implementing open contracting processes is just one part of what we want to see happen. We also strive to nurture an environment where open contracting data is seen as something that is worthwhile and necessary.

The newly established www.dozorro.org monitoring platform also shows promising results…..

The main one is feedback loops. We see that procuring entities’ responsiveness to general questions results in better quality procurement. We also see that only one out of three claims (request to a procuring entity to amend, cancel or modify a tender in question) is successfully resolved. In addition, there are some good individual examples, such as the ones in Dnypro and Kiev. While we do not know if these numbers and instances are sufficient for an effective institutional response mechanism, we do know that business and citizens have to trust redress mechanisms before using them. We will continue trying to identify the ideal level of institutional response to secure trust and develop better metrics to capture that….(More)”.