How Google and Facebook are finding victims of the Nepal earthquake


Caitlin Dewey in the Washington Post: “As the death toll from Saturday’s 7.8-magnitude Nepalese earthquake inches higher, help in finding and identifying missing persons has come from an unusual source: Silicon Valley tech giants.

Both Google and Facebook deployed collaborative, cellphone-based tools over the weekend to help track victims of the earthquake. In the midst of both company’s big push to bring Internet to the developing world, it’s an important illustration of exactly how powerful that connectivity could be. And yet, in a country like Nepal — where there are only 77 cellphone subscriptions per 100 people versus 96 in the U.S. and 125 in the U.K. — it’s also a reminder of how very far that effort still has to go.

Facebook Safety Check

Facebook’s Safety Check essentially lets users do two things, depending on where they are. Users in an area impacted by a natural disaster can log onto the site and mark themselves as “safe.” Meanwhile, users around the world can log into the site and check if any of their friends are in the impacted area. The tool was built by Japanese engineers in response to the 2011 earthquake and tsunami that devastated coastal Japan.

Facebook hasn’t publicized how many people have used the tool, though the network only has 4.4 million users in the country based on estimates by its ad platform. Notably, you must also a smartphone running the Facebook app to use this feature — and smartphone penetration in Nepal is quite low.

Google Person Finder

Like Safety Check, Google Person Finder is intended to connect people in a disaster area with friends and family around the world. Google’s five-year-old project also operates on a larger scale, however: It basically provides a massive, open platform to collaboratively track missing persons’ reports. Previously, Google’s deployed the tool to help victims in the wake of Typhoon Haiyan and the Boston bombing.

 

New surveys reveal dynamism, challenges of open data-driven businesses in developing countries


Alla Morrison at World Bank Open Data blog: “Was there a class of entrepreneurs emerging to take advantage of the economic possibilities offered by open data, were investors keen to back such companies, were governments tuned to and responsive to the demands of such companies, and what were some of the key financing challenges and opportunities in emerging markets? As we began our work on the concept of an Open Fund, we partnered with Ennovent (India), MDIF (East Asia and Latin America) and Digital Data Divide (Africa) to conduct short market surveys to answer these questions, with a focus on trying to understand whether a financing gap truly existed in these markets. The studies were fairly quick (4-6 weeks) and reached only a small number of companies (193 in India, 70 in Latin America, 63 in South East Asia, and 41 in Africa – and not everybody responded) but the findings were fairly consistent.

  • Open data is still a very nascent concept in emerging markets. and there’s only a small class of entrepreneurs/investors that is aware of the economic possibilities; there’s a lot of work to do in the ‘enabling environment’
    • In many regions the distinction between open data, big data, and private sector generated/scraped/collected data was blurry at best among entrepreneurs and investors (some of our findings consequently are better indicators of  data-driven rather than open data-driven businesses)
  • There’s a small but growing number of open data-driven companies in all the markets we surveyed and these companies target a wide range of consumers/users and are active in multiple sectors
    • A large percentage of identified companies operate in sectors with high social impact – health and wellness, environment, agriculture, transport. For instance, in India, after excluding business analytics companies, a third of data companies seeking financing are in healthcare and a fifth in food and agriculture, and some of them have the low-income population or the rural segment of India as an intended beneficiary segment. In Latin America, the number of companies in business services, research and analytics was closely followed by health, environment and agriculture. In Southeast Asia, business, consumer services, and transport came out in the lead.
    • We found the highest number of companies in Latin America and Asia with the following countries leading the way – Mexico, Chile, and Brazil, with Colombia and Argentina closely behind in Latin America; and India, Indonesia, Philippines, and Malaysia in Asia
  • An actionable pipeline of data-driven companies exists in Latin America and in Asia
    • We heard demand for different kinds of financing (equity, debt, working capital) but the majority of the need was for equity and quasi-equity in amounts ranging from $100,000 to $5 million USD, with averages of between $2 and $3 million USD depending on the region.
  • There’s a significant financing gap in all the markets
    • The investment sizes required, while they range up to several million dollars, are generally small. Analysis of more than 300 data companies in Latin America and Asia indicates a total estimated need for financing of more than $400 million
  • Venture capitals generally don’t recognize data as a separate sector and club data-driven companies with their standard information communication technology (ICT) investments
    • Interviews with founders suggest that moving beyond seed stage is particularly difficult for data-driven startups. While many companies are able to cobble together an initial seed round augmented by bootstrapping to get their idea off the ground, they face a great deal of difficulty when trying to raise a second, larger seed round or Series A investment.
    • From the perspective of startups, investors favor banal e-commerce (e.g., according toTech in Asia, out of the $645 million in technology investments made public across the region in 2013, 92% were related to fashion and online retail) or consumer service startups and ignore open data-focused startups even if they have a strong business model and solid key performance indicators. The space is ripe for a long-term investor with a generous risk appetite and multiple bottom line goals.
  • Poor data quality was the number one issue these companies reported.
    • Companies reported significant waste and inefficiency in accessing/scraping/cleaning data.

The analysis below borrows heavily from the work done by the partners. We should of course mention that the findings are provisional and should not be considered authoritative (please see the section on methodology for more details)….(More).”

Big Data for Social Good


Introduction to a Special Issue of the Journal “Big Data” by Catlett Charlie and Ghani Rayid: “…organizations focused on social good are realizing the potential as well but face several challenges as they seek to become more data-driven. The biggest challenge they face is a paucity of examples and case studies on how data can be used for social good. This special issue of Big Data is targeted at tackling that challenge and focuses on highlighting some exciting and impactful examples of work that uses data for social good. The special issue is just one example of the recent surge in such efforts by the data science community. …

This special issue solicited case studies and problem statements that would either highlight (1) the use of data to solve a social problem or (2) social challenges that need data-driven solutions. From roughly 20 submissions, we selected 5 articles that exemplify this type of work. These cover five broad application areas: international development, healthcare, democracy and government, human rights, and crime prevention.

“Understanding Democracy and Development Traps Using a Data-Driven Approach” (Ranganathan et al.) details a data-driven model between democracy, cultural values, and socioeconomic indicators to identify a model of two types of “traps” that hinder the development of democracy. They use historical data to detect causal factors and make predictions about the time expected for a given country to overcome these traps.

“Targeting Villages for Rural Development Using Satellite Image Analysis” (Varshney et al.) discusses two case studies that use data and machine learning techniques for international economic development—solar-powered microgrids in rural India and targeting financial aid to villages in sub-Saharan Africa. In the process, the authors stress the importance of understanding the characteristics and provenance of the data and the criticality of incorporating local “on the ground” expertise.

In “Human Rights Event Detection from Heterogeneous Social Media Graphs,” Chen and Neil describe efficient and scalable techniques to use social media in order to detect emerging patterns in human rights events. They test their approach on recent events in Mexico and show that they can accurately detect relevant human rights–related tweets prior to international news sources, and in some cases, prior to local news reports, which could potentially lead to more timely, targeted, and effective advocacy by relevant human rights groups.

“Finding Patterns with a Rotten Core: Data Mining for Crime Series with Core Sets” (Wang et al.) describes a case study with the Cambridge Police Department, using a subspace clustering method to analyze the department’s full housebreak database, which contains detailed information from thousands of crimes from over a decade. They find that the method allows human crime analysts to handle vast amounts of data and provides new insights into true patterns of crime committed in Cambridge…..(More)

UNESCO demonstrates global impact through new transparency portal


“Opendata.UNESCO.org  is intended to present comprehensive, quality and timely information about UNESCO’s projects, enabling users to find information by country/region, funding source, and sector and providing comprehensive project data, including budget, expenditure, completion status, implementing organization, project documents, and more. It publishes program and financial information that are in line with UN system-experience of the IATI (International Aid Transparency Initiative) standards and other relevant transparency initiatives. UNESCO is now part of more than 230 organizations that have published to the IATI Registry, which brings together donor and developing countries, civil society organizations and other experts in aid information who are committed to working together to increase the transparency of aid.

Since its creation 70 years ago, UNESCO has tirelessly championed the causes of education, culture, natural sciences, social and human sciences, communication and information, globally. For instance – started in March 2010, the program for the Enhancement of Literacy in Afghanistan (ELA) benefited from a $19.5 million contribution by Japan. It aimed to improve the level of literacy, numeracy and vocational skills of the adult population in 70 districts of 15 provinces of Afghanistan. Over the next three years, until April 2013, the ELA programme helped some 360,000 adult learners in General Literacy compotency. An interactive map allows for an easy identification of UNESCO’s high-impact programs, and up-to-date information of current and future aid allocations within and across countries.

Public participation and interactivity are key to the success of any open data project. http://Opendata.UNESCO.org will evolve as Member States and partners will get involved, by displaying data on their own websites and sharing data among different networks, building and sharing applications, providing feedback, comments, and recommendations. …(More)”

2015 Edelman Trust Barometer


The 2015 Edelman Trust Barometer shows a global decline in trust over the last year, and the number of countries with trusted institutions has fallen to an all-time low among the informed public.

Among the general population, the trust deficit is even more pronounced, with nearly two-thirds of countries falling into the distruster category.
In the last year, trust has declined for three of the four institutions measured. NGOs continue to be the most trusted institution, but trust in NGOs declined from 66 to 63 percent. Sixty percent of countries now distrust media. Trust in government increased slightly, driven by big gains in India, Russia and Indonesia but government is still distrusted in 19 of the 27 markets surveyed. And trust in business is below 50 percent in half of those markets.
 

Why Is Democracy Performing So Poorly?


Essay by Francis Fukuyama in the Journal of Democracy: “The Journal of Democracy published its inaugural issue a bit past the midpoint of what Samuel P. Huntington labeled the “third wave” of democratization, right after the fall of the Berlin Wall and just before the breakup of the former Soviet Union. The transitions in Southern Europe and most of those in Latin America had already happened, and Eastern Europe was moving at dizzying speed away from communism, while the democratic transitions in sub-Saharan Africa and the former USSR were just getting underway. Overall, there has been remarkable worldwide progress in democratization over a period of almost 45 years, raising the number of electoral democracies from about 35 in 1970 to well over 110 in 2014.
But as Larry Diamond has pointed out, there has been a democratic recession since 2006, with a decline in aggregate Freedom House scores every year since then. The year 2014 has not been good for democracy, with two big authoritarian powers, Russia and China, on the move at either end of Eurasia. The “Arab Spring” of 2011, which raised expectations that the Arab exception to the third wave might end, has degenerated into renewed dictatorship in the case of Egypt, and into anarchy in Libya, Yemen, and also Syria, which along with Iraq has seen the emergence of a new radical Islamist movement, the Islamic State in Iraq and Syria (ISIS).
It is hard to know whether we are experiencing a momentary setback in a general movement toward greater democracy around the world, similar to a stock-market correction, or whether the events of this year signal a broader shift in world politics and the rise of serious alternatives to democracy. In either case, it is hard not to feel that the performance of democracies around the world has been deficient in recent years. This begins with the most developed and successful democracies, those of the United States and the European Union, which experienced massive economic crises in the late 2000s and seem to be mired in a period of slow growth and stagnating incomes. But a number of newer democracies, from Brazil to Turkey to India, have also been disappointing in their performance in many respects, and subject to their own protest movements.
Spontaneous democratic movements against authoritarian regimes continue to arise out of civil society, from Ukraine and Georgia to Tunisia and Egypt to Hong Kong. But few of these movements have been successful in leading to the establishment of stable, well-functioning democracies. It is worth asking why the performance of democracy around the world has been so disappointing.
In my view, a single important factor lies at the core of many democratic setbacks over the past generation. It has to do with a failure of institutionalization—the fact that state capacity in many new and existing democracies has not kept pace with popular demands for democratic accountability. It is much harder to move from a patrimonial or neopatrimonial state to a modern, impersonal one than it is to move from an authoritarian regime to one that holds regular, free, and fair elections. It is the failure to establish modern, well-governed states that has been the Achilles heel of recent democratic transitions… (More)”

The smartest cities rely on citizen cunning and unglamorous technology


at the Guardian: “We are lucky enough to live at a time in which a furious wave of innovation is breaking across the cities of the global south, spurred on both by the blistering pace of urbanisation, and by the rising popular demand for access to high-quality infrastructure that follows in its wake.
From Porto Alegre’s participatory budgeting and the literally destratifying cable cars of Caracas, to Nairobi’s “digital matatus” and the repurposed bus-ferries of Manila, the communities of the south are responsible for an ever-lengthening parade of social and technical innovations that rival anything the developed world has to offer for ingenuity and practical utility.
Nor is India an exception to this tendency. Transparent Chennai’s participatory maps and the work of the Mumbai-based practices CRIT and URBZ are better-known globally, but it is the tactics of daily survival devised by the unheralded multitude that really inspire urbanists. These techniques maximise the transactive capacity of the urban fabric, wrest the very last increment of value from the energy invested in the production of manufactured goods, and allow millions to eke a living, however precarious, from the most unpromising of circumstances. At a time of vertiginously spiralling economic and environmental stress globally, these are insights many of us in the developed north would be well advised to attend to – and by no means merely the poorest among us.
But, for whatever reason, this is not the face of urban innovation official India wants to share with the world – perhaps small-scale projects or the tactics of the poor simply aren’t dramatic enough to convey the magnitude and force of national ambition. We hear, instead, of schemes like Palava City, a nominally futuristic vision of digital technology minutely interwoven into the texture of everday urban life. Headlines were made around the planet this year when Narendra Modi’s government announced it had committed to building no fewer than 100 similarly “smart” cities….(More).”

Crowdsourcing Data to Fight Air Pollution


Jason Brick at PSFK: “Air pollution is among the most serious environmental problems of the modern age. Although pollution in developed nations like the USA and Germany has fallen since the 1980s, air quality in growing technological countries — especially in the BRIC (Brazil, Russia, India and China) group — grows worse with each year. In 2012, 3.7 million people died as a direct result of problems caused by chronic exposure to bad air, and tens of millions more were made ill.
There is no easy solution to such a complex and widespread problem, but Breathe offers a fix for one aspect and solves it in two ways.
The first way is the device itself: a portable plastic brick smaller than a bar of soap that monitors the presence and concentration of toxic gases and other harmful substances in the air, in real time throughout your day. It records the quality and, if it reaches unacceptably dangerous levels, warns you immediately with an emergency signal. Plug the device into your smart phone, and it keeps a record of air quality by time and location you can use to avoid the most polluted times of day and places in your area.
The second solution is the truly innovative aspect of this project. Via the Breathe app, any user who wants to can add her data to a central database that keeps statistics worldwide. Individuals can then use that data to plan vacations, time outdoor activities or schedule athletic events. Given enough time, Breathe could accumulate enough data to be used to affect policy by identifying the most polluted areas in a city, county or nation so the authorities can work on a more robust solution….(More)”

Launching “Map the Banks” campaign to map the global financial industry


OpenCorporates: “Today, we are happy to announce the launch of our latest campaign: Map the Banks – possibly first ever global sprint to scrape a single class of data from every jurisdiction in the world. For this campaign, we are focussing on how the financial industry is licenced to operate.
The financial crisis cost the world 4 trillion dollars. Before we can disrupt the industry, we need to map it. The financial crisis revealed the damage done by our lack of understanding of the influence and size of banks and financial companies. We no longer want to be in the dark. Citizens and regulators have to take control back by having open and free access to this information. We are taking up the challenge of collecting every banking and financial licence in the world so we can work towards a better banking system, that works for the good of society. We’re joined in this mission by Civio, OpenNorth & many more… (Interested in being a partner? Email us!)
Collecting this data could answer questions like:

  • Which companies have debt collection operations in other jurisdictions? Even with the small amount of data already collected, we know there are at least 178 financial services companies from India that operate in the US.
  • Which countries have the most financial services outsourced to them?
  • What companies are licenced to operate in the largest number of countries worldwide?
  • Which US bank has the most consumer credit licences in Asia?
  • Which organisations appear to operate like financial services companies, yet aren’t regulated as such?
  • Where are credit unions being dissolved or created the fastest?

HOW TO GET INVOLVED…”

The Global Open Data Index 2014


Open Knowledge Foundation: “The Global Open Data Index ranks countries based on the availability and accessibility of information in ten key areas, including government spending, election results, transport timetables, and pollution levels.
The UK tops the 2014 Index retaining its pole position with an overall score of 96%, closely followed by Denmark and then France at number 3 up from 12th last year. Finland comes in 4th while Australia and New Zealand share the 5th place. Impressive results were seen from India at #10 (up from #27) and Latin American countries like Colombia and Uruguay who came in joint 12th .
Sierra Leone, Mali, Haiti and Guinea rank lowest of the countries assessed, but there are many countries where the governments are less open but that were not assessed because of lack of openness or a sufficiently engaged civil society.
Overall, whilst there is meaningful improvement in the number of open datasets (from 87 to 105), the percentage of open datasets across all the surveyed countries remained low at only 11%.
Even amongst the leaders on open government data there is still room for improvement: the US and Germany, for example, do not provide a consolidated, open register of corporations. There was also a disappointing degree of openness around the details of government spending with most countries either failing to provide information at all or limiting the information available – only two countries out of 97 (the UK and Greece) got full marks here. This is noteworthy as in a period of sluggish growth and continuing austerity in many countries, giving citizens and businesses free and open access to this sort of data would seem to be an effective means of saving money and improving government efficiency.
Explore the Global Open Data Index 2014 for yourself!”