Open Data in Southeast Asia


Book by Manuel Stagars: “This book explores the power of greater openness, accountability, and transparency in digital information and government data for the nations of Southeast Asia. The author demonstrates that, although the term “open data” seems to be self-explanatory, it involves an evolving ecosystem of complex domains. Through empirical case studies, this book explains how governments in the ASEAN may harvest the benefits of open data to maximize their productivity, efficiency and innovation. The book also investigates how increasing digital divides in the population, boundaries to civil society, and shortfalls in civil and political rights threaten to arrest open data in early development, which may hamper post-2015 development agendas in the region. With robust open data policies and clear roadmaps, member states of the ASEAN can harvest the promising opportunities of open data in their particular developmental, institutional and legal settings. Governments, policy makers, entrepreneurs and academics will gain a clearer understanding of the factors that enable open data from this timely research….(More)”

Civic Data Initiatives


Burak Arikan at Medium: “Big data is the term used to define the perpetual and massive data gathered by corporations and governments on consumers and citizens. When the subject of data is not necessarily individuals but governments and companies themselves, we can call it civic data, and when systematically generated in large amounts, civic big data. Increasingly, a new generation of initiatives are generating and organizing structured data on particular societal issues from human rights violations, to auditing government budgets, from labor crimes to climate justice.

These civic data initiatives diverge from the traditional civil society organizations in their outcomes,that they don’t just publish their research as reports, but also open it to the public as a database.Civic data initiatives are quite different in their data work than international non-governmental organizations such as UN, OECD, World Bank and other similar bodies. Such organizations track social, economical, political conditions of countries and concentrate upon producing general statistical data, whereas civic data initiatives aim to produce actionable data on issues that impact individuals directly. The change in the GDP value of a country is useless for people struggling for free transportation in their city. Incarceration rate of a country does not help the struggle of the imprisoned journalists. Corruption indicators may serve as a parameter in a country’s credit score, but does not help to resolve monopolization created with public procurement. Carbon emission statistics do not prevent the energy deals between corrupt governments that destroy the nature in their region.

Needless to say, civic data initiatives also differ from governmental institutions, which are reluctant to share any more that they are legally obligated to. Many governments in the world simply dump scanned hardcopies of documents on official websites instead of releasing machine-readable data, which prevents systematic auditing of government activities.Civic data initiatives, on the other hand, make it a priority to structure and release their data in formats that are both accessible and queryable.

Civic data initiatives also deviate from general purpose information commons such as Wikipedia. Because they consistently engage with problems, closely watch a particular societal issue, make frequent updates,even record from the field to generate and organize highly granular data about the matter….

Several civic data initiatives generate data on variety of issues at different geographies, scopes, and scales. The non-exhaustive list below have information on founders, data sources, and financial support. It is sorted according to each initiative’s founding year. Please send your suggestions to contact at graphcommons.com. See more detailed information and updates on the spreadsheet of civic data initiatives.

Open Secrets tracks data about the money flow in the US government, so it becomes more accessible for journalists, researchers, and advocates.Founded as a non-profit in 1983 by Center for Responsive Politics, gets support from variety of institutions.

PolitiFact is a fact-checking website that rates the accuracy of claims by elected officials and others who speak up in American politics. Uses on-the-record interviews as its data source. Founded in 2007 as a non-profit organization by Tampa Bay Times. Supported by Democracy Fund, Bill &Melinda Gates Foundation, John S. and James L. Knight Foundation, FordFoundation, Knight Foundation, Craigslist Charitable Fund, and the CollinsCenter for Public Policy…..

La Fabrique de La loi (The Law Factory) maps issues of local-regional socio-economic development, public investments, and ecology in France.Started in 2014, the project builds a database by tracking bills from government sources, provides a search engine as well as an API. The partners of the project are CEE Sciences Po, médialab Sciences Po, RegardsCitoyens, and Density Design.

Mapping Media Freedom identifies threats, violations and limitations faced by members of the press throughout European Union member states,candidates for entry and neighbouring countries. Initiated by Index onCensorship and European Commission in 2004, the project…(More)”

Transparency and the open society: Practical lessons for effective policy


Book by Roger Taylor and Tim Kelsey: “Greater transparency is increasingly seen as the answer to a wide range of social issues by governments, NGOs and businesses around the world. However, evidence of its impact is mixed. Using case studies from around the world including India, Tanzania, the UK and US, Transparency and the open society surveys the adoption of transparency globally, providing an essential framework for assessing its likely performance as a policy and the steps that can be taken to make it more effective. It addresses the role of transparency in the context of growing use by governments and businesses of surveillance and database driven decision making. The book is written for anyone involved in the use of transparency whether campaigning from outside or working inside government or business to develop policies….(More)”

Transforming governance: how can technology help reshape democracy?


Research Briefing by Matt Leighninger: “Around the world, people are asking how we can make democracy work in new and better ways. We are frustrated by political systems in which voting is the only legitimate political act, concerned that many republics don’t have the strength or appeal to withstand authoritarian figures, and disillusioned by the inability of many countries to address the fundamental challenges of health, education and economic development.

We can no longer assume that the countries of the global North have ‘advanced’ democracies, and that the nations of the global South simply need to catch up. Citizens of these older democracies have increasingly lost faith in their political institutions; Northerners cherish their human rights and free elections, but are clearly looking for something more. Meanwhile, in the global South, new regimes based on a similar formula of rights and elections have proven fragile and difficult to sustain. And in Brazil, India and other Southern countries, participatory budgeting and other valuable democratic innovations have emerged. The stage is set for a more equitable, global conversation about what we mean by democracy.

How can we adjust our democratic formulas so that they are more sustainable, powerful, fulfilling – and, well, democratic? Some of the parts of this equation may come from the development of online tools and platforms that help people to engage with their governments, with organisations and institutions, and with each other. Often referred to collectively as ‘civic technology’ or ‘civic tech’, these tools can help us map public problems, help citizens generate solutions, gather input for government, coordinate volunteer efforts, and help neighbours remain connected. If we want to create democracies in which citizens have meaningful roles in shaping public decisions and solving public problems, we should be asking a number of questions about civic tech, including:

  • How can online tools best support new forms of democracy?
  • What are the examples of how this has happened?
  • What are some variables to consider in comparing these examples?
  • How can we learn from each other as we move forward?

This background note has been developed to help democratic innovators explore these questions and examine how their work can provide answers….(More)”

Are we too obsessed with data?


Lauren Woodman of Nethope:” Data: Everyone’s talking about it, everyone wants more of it….

Still, I’d posit that we’re too obsessed with data. Not just us in the humanitarian space, of course, but everyone. How many likes did that Facebook post get? How many airline miles did I fly last year? How many hours of sleep did I get last week?…

The problem is that data by itself isn’t that helpful: information is.

We need to develop a new obsession, around making sure that data is actionable, that it is relevant in the context in which we work, and on making sure that we’re using the data as effectively as we are collecting it.

In my talk at ICT4D, I referenced the example of 7-Eleven in Japan. In the 1970s, 7-Eleven in Japan became independent from its parent, Southland Corporation. The CEO had to build a viable business in a tough economy. Every month, each store manager would receive reams of data, but it wasn’t effective until the CEO stripped out the noise and provided just four critical data points that had the greatest relevance to drive the local purchasing that each store was empowered to do on their own.

Those points – what sold the day before, what sold the same day a year ago, what sold the last time the weather was the same, and what other stores sold the day before – were transformative. Within a year, 7-Eleven had turned a corner, and for 30 years, remained the most profitable retailer in Japan. It wasn’t about the Big Data; it was figuring out what data was relevant, actionable and empowered local managers to make nimble decisions.

For our sector to get there, we need to do the front-end work that transforms our data into information that we can use. That, after all, is where the magic happens.

A few examples provide more clarity as to why this is so critical.

We know that adaptive decision-making requires access to real-time data. By knowing what is happening in real-time, or near-real-time, we can adjust our approaches and interventions to be most impactful. But to do so, our data has to be accessible to those that are empowered to make decisions. To achieve that, we have to make investments in training, infrastructure, and capacity-building at the organizational level.  But in the nonprofit sector, such investments are rarely supported by donors and beyond the limited unrestricted funding available to most most organizations. As a result, the sector has, so far, been able to take only limited steps towards effective data usage, hampering our ability to transform the massive amounts of data we have into useful information.

Another big question about data, and particularly in the humanitarian space, is whether it should be open, closed or somewhere in between. Privacy is certainly paramount, and for types of data, the need for close protection is very clear. For many other data, however, the rules are far less clear. Every country has its own rules about how data can and cannot be used or shared, and more work is needed to provide clarity and predictability so that appropriate data-sharing can evolve.

And perhaps more importantly, we need to think about not just the data, but the use cases.  Most of us would agree, for example, that sharing information during a crisis situation can be hugely beneficial to the people and the communities we serve – but in a world where rules are unclear, that ambiguity limits what we can do with the data we have. Here again, the context in which data will be used is critically important.

Finally, all of in the sector have to realize that the journey to transforming data into information is one we’re on together. We have to be willing to give and take. Having data is great; sharing information is better. Sometimes, we have to co-create that basis to ensure we all benefit….(More)”

Is artificial intelligence key to dengue prevention?


BreakDengue: “Dengue fever outbreaks are increasing in both frequency and magnitude. Not only that, the number of countries that could potentially be affected by the disease is growing all the time.

This growth has led to renewed efforts to address the disease, and a pioneering Malaysian researcher was recently recognized for his efforts to harness the power of big data and artificial intelligence to accurately predict dengue outbreaks.

Dr. Dhesi Baha Raja received the Pistoia Alliance Life Science Award at King’s College London in April of this year, for developing a disease prediction platform that employs technology and data to give people prior warning of when disease outbreaks occur.The medical doctor and epidemiologist has spent years working to develop AIME (Artificial Intelligence in Medical Epidemiology)…

it relies on a complex algorithm, which analyses a wide range of data collected by local government and also satellite image recognition systems. Over 20 variables such as weather, wind speed, wind direction, thunderstorm, solar radiation and rainfall schedule are included and analyzed. Population models and geographical terrain are also included. The ultimate result of this intersection between epidemiology, public health and technology is a map, which clearly illustrates the probability and location of the next dengue outbreak.

The ground-breaking platform can predict dengue fever outbreaks up to two or three months in advance, with an accuracy approaching 88.7 per cent and within a 400m radius. Dr. Dhesi has just returned from Rio de Janeiro, where the platform was employed in a bid to fight dengue in advance of this summer’s Olympics. In Brazil, its perceived accuracy was around 84 per cent, whereas in Malaysia in was over 88 per cent – giving it an average accuracy of 86.37 per cent.

The web-based application has been tested in two states within Malaysia, Kuala Lumpur, and Selangor, and the first ever mobile app is due to be deployed across Malaysia soon. Once its capability is adequately tested there, it will be rolled out globally. Dr. Dhesi’s team are working closely with mobile digital service provider Webe on this.

By making the app free to download, this will ensure the service becomes accessible to all, Dr Dhesi explains.
“With the web-based application, this could only be used by public health officials and agencies. We recognized the need for us to democratize this health service to the community, and the only way to do this is to provide the community with the mobile app.”
This will also enable the gathering of even greater knowledge on the possibility of dengue outbreaks in high-risk areas, as well as monitoring the changing risks as people move to different areas, he adds….(More)”

Refugees and the Technology of Exile


David Lepeska in Wilson Quaterly: “While working for a Turkish tech firm, Akil learned how to program for mobile phones, and decided to make a smartphone app to help Syrians get all the information they need to build new lives in Turkey. In early 2014, he and a friend launched Gherbtna, named for an Arabic word referring to the loneliness of foreign exile….

About one-tenth of the 2.7 million Syrians in Turkey live in refugee camps. The rest fend for themselves, mostly in big cities. Now that they look set to stay in Turkey for some time, their need to settle and build stable, secure lives is much more acute. This may explain why downloads of Gherbtna more than doubled in the past six months. “We started this project to help people, and when we have reached all Syrian refugees, to help them find jobs, housing, whatever they need to build a new life in Turkey, then we have achieved our goal,” said Akil. “Our ultimate dream for Gherbtna is to reach all refugees around the world, and help them.”

Humanity is currently facing its greatest refugee crisis since World War II, with more than 60 million people forced from their homes. Much has been written about their use of technology — how Google Maps, WhatsApp, Facebook, and other tools have proven invaluable to the displaced and desperate. But helping refugees find their way, connect with family, or read the latest updates about route closings is one thing. Enabling them to grasp minute legal details, find worthwhile jobs and housing, enroll their children in school, and register for visas and benefits when they don’t understand the local tongue is another.

Due to its interpretation of the 1951 Geneva Convention on refugees, Ankara does not categorize Syrians in Turkey as refugees, nor does it accord them the pursuant rights and advantages. Instead, it has given them the unusual legal status of temporary guests, which means that they cannot apply for asylum and that Turkey can send them back to their countries of origin whenever it likes. What’s more, the laws and processes that apply to Syrians have been less than transparent and have changed several times. Despite all this — or perhaps because of it — government outreach has been minimal. Turkey has spent some $10 billion on refugees, and it distributes Arabic-language brochures at refugee camps and in areas with many Syrian residents. Yet it has created no Arabic-language website, app, or other online tool to communicate the relevant laws, permits, and legal changes to Syrians and other refugees.

Independent apps targeting these hurdles have begun to proliferate. Gherbtna’s main competitor in Turkey is the recently launched Alfanus (“Lantern” in Arabic), which its Syrian creators call an “Arab’s Guide to Turkey.” Last year, Souktel, a Palestinian mobile solutions firm, partnered with the international arm of the American Bar Association to launch a text-message service that provides legal information to Arabic speakers in Turkey. Norway is running a competition to develop a game-based learning app to educate Syrian refugee children. German programmers created Germany Says Welcome and the similar Welcome App Dresden. And Akil’s tech firm, Namaa Solutions, recently launched Tarjemly Live, a live translation app for English, Arabic, and Turkish.

But the extent to which these technologies have succeeded — have actually helped Syrians adjust and build new lives in Turkey, in particular — is in doubt. Take Gherbtna. The app has nine tools, including Video, Laws, Alerts, Find a Job, and “Ask me.” It offers restaurant and job listings; advice on getting a residence permit, opening a bank account, or launching a business; and much more. Like Souktel, Gherbtna has partnered with the American Bar Association to provide translations of Turkish laws. The app has been downloaded about 50,000 times, or by about 5 percent of Syrians in Turkey. (It is safe to assume, however, that a sizable percentage of refugees do not have smartphones.) Yet among two dozen Gherbtna users recently interviewed in Gaziantep and Istanbul — two Turkish cities with the most dense concentration of Syrians — most found it lacking. Many appreciate Gherbtna’s one-stop-shop appeal, but find little cause to keep using it. ”…(More)”

Soon Your City Will Know Everything About You


Currently, the biggest users of these sensor arrays are in cities, where city governments use them to collect large amounts of policy-relevant data. In Los Angeles, the crowdsourced traffic and navigation app Waze collects data that helps residents navigate the city’s choked highway networks. In Chicago, an ambitious program makes public data available to startups eager to build apps for residents. The city’s 49th ward has been experimenting with participatory budgeting and online votingto take the pulse of the community on policy issues. Chicago has also been developing the “Array of Things,” a network of sensors that track, among other things, the urban conditions that affect bronchitis.

Edmonton uses the cloud to track the condition of playground equipment. And a growing number of countries have purpose-built smart cities, like South Korea’s high tech utopia city of Songdo, where pervasive sensor networks and ubiquitous computing generate immense amounts of civic data for public services.

The drive for smart cities isn’t restricted to the developed world. Rio de Janeiro coordinates the information flows of 30 different city agencies. In Beijing and Da Nang (Vietnam), mobile phone data is actively tracked in the name of real-time traffic management. Urban sensor networks, in other words, are also developing in countries with few legal protections governing the usage of data.

These services are promising and useful. But you don’t have to look far to see why the Internet of Things has serious privacy implications. Public data is used for “predictive policing” in at least 75 cities across the U.S., including New York City, where critics maintain that using social media or traffic data to help officers evaluate probable cause is a form of digital stop-and-frisk. In Los Angeles, the security firm Palantir scoops up publicly generated data on car movements, merges it with license plate information collected by the city’s traffic cameras, and sells analytics back to the city so that police officers can decide whether or not to search a car. In Chicago, concern is growing about discriminatory profiling because so much information is collected and managed by the police department — an agency with a poor reputation for handling data in consistent and sensitive ways. In 2015, video surveillance of the police shooting Laquan McDonald outside a Burger King was erased by a police employee who ironically did not know his activities were being digitally recorded by cameras inside the restaurant.

Since most national governments have bungled privacy policy, cities — which have a reputation for being better with administrative innovations — will need to fill this gap. A few countries, such as Canada and the U.K., have independent “privacy commissioners” who are responsible for advocating for the public when bureaucracies must decide how to use or give out data. It is pretty clear that cities need such advocates too.

What would Urban Privacy Commissioners do? They would teach the public — and other government staff — about how policy algorithms work. They would evaluate the political context in which city agencies make big data investments. They would help a city negotiate contracts that protect residents’ privacy while providing effective analysis to policy makers and ensuring that open data is consistently serving the public good….(more)”.

Real-Time Data Can Improve Traffic Management in Major Cities


World Bank: “Traffic management agencies and city planners will soon have access to real-time data to better manage traffic flows on the streets of Cebu City and Metro Manila.

Grab, The World Bank, and the Department of Transportation and Communications (DOTC) launched today the OpenTraffic initiative, which will help address traffic congestion and road safety challenges.

Grab is the leading ride-hailing platform in Southeast Asia and operates in 30 cities across six countries – Singapore, Indonesia, Philippines, Malaysia, Thailand, and Vietnam.

Grab and the World Bank have been developing free, open-source tools that translate Grab’s voluminous driver GPS data into traffic statistics, including speeds, flows, and intersection delays. These statistics power big data open source tools such as OpenTraffic, for analysing traffic speeds and flows, and DRIVER, for identifying road incident blackspots and improving emergency response. Grab and the World Bank plan to make OpenTraffic available to other Southeast Asian city governments in the near future.

“Using big data is one of the potential solutions to the challenges faced by our transport systems. Through this we can provide accurate, real-time information for initiatives that can help alleviate traffic congestion and improve road safety,” said DOTC Secretary Joseph Emilio A. Abaya.

Last month, the World Bank and DOTC helped train more than 200 government staff from the agency, the Philippine National Police (PNP), the Metro Manila Development Authority (MMDA), the Department of Public Works and Highways (DPWH), and the Cebu City Transportation Office on the use of the OpenTraffic platform….In the near future, traffic statistics derived through OpenTraffic will be fed into another application called “DRIVER” or Data for Road Incident Visualization, Evaluation, and Reporting for road incident recording and analysis. This application, developed by the World Bank, will help engineering units to prioritize crash-prone areas for interventions and improve emergency response….(More)”

If you build it… will they come?


Laura Bacon at Omidyar Network: “What do datasets on Danish addresses, Indonesian elections, Singapore Dengue Fever, Slovakian contracts, Uruguayan health service provision, and Global weather systems have in common? Read on to learn more…

On May 12, 2016, more than 40 nations’ leaders gathered in London for an Anti-Corruption Summit, convened by UK Prime Minister David Cameron. Among the commitments made, 40 countries pledged to make their procurement processes open by default, with 14 countries specifically committing to publish to the Open Contracting Data Standard.

This conference and these commitments can be seen as part of a larger global norm toward openness and transparency, also embodied by the Open Government Partnership, Open Data Charter, and increasing numbers of Open Data Portals.

As government data is increasingly published openly in the public domain, valid questions have been raised about what impact the data will have: As governments release this data, will it be accessed and used? Will it ultimately improve lives, root out corruption, hold answers to seemingly intractable problems, and lead to economic growth?*

Omidyar Network — having supported several Open Data organizations and platforms such as Open Data Institute, Open Knowledge, and Web Foundation — sought data-driven answers to these questions. After a public call for proposals, we selected NYU’s GovLab to conduct research on the impact open data has already had. Not the potential or prospect of impact, but past proven impact. The GovLab research team, led by Stefaan Verhulst, investigated a variety of sectors — health, education, elections, budgets, contracts, etc. — in a variety of locations, spanning five continents.

Their findings are promising and exciting, demonstrating that open data is changing the world by empowering people, improving governance, solving public problems, and leading to innovation. A summary is contained in thisKey Findings report, and is accompanied by many open data case studies posted in this Open Data Impact Repository.

Of course, stories such as this are not 100% rosy, and the report is clear about the challenges ahead. There are plenty of cases in which open data has had minimal impact. There are cases where there was negative impact. And there are obstacles to open data reaching its full potential: namely, open data projects that don’t respond to citizens’ questions and needs, a lack of technical capacity on either the data provider and data user side, inadequate protections for privacy and security, and a shortage of resources.

But this research holds good news: Danish addresses, Indonesian elections,Singapore Dengue Fever, Slovakian contracts, Uruguayan health service provision, Global weather systems, and others were all opened up. And all changed the world by empowering citizens, improving governance, solving public problems, and leading to innovation. Please see this report for more….(More)”

See also odimpact.org