Open data and (15 million!) new measures of democracy


Joshua Tucker in the Washington Post: “Last month the University of Gothenberg’s V-Dem Institute released a new“Varieties of Democracy” dataset. It provides about 15 million data points on democracy, including 39 democracy-related indices. It can be accessed at v-dem.net along with supporting documentation. I asked Staffan I. Lindberg, Director of the V-Dem Institute and one of the directors of the project, a few questions about the new data. What follows is a lightly edited version of his answers.


Women’s Political Empowerment Index for Southeast Asia (Data: V-Dem data version 5; Figure V-Dem Institute, University of Gothenberg, Sweden)

Joshua Tucker: What is democracy, and is it even really to have quantitative measures on democracy?

Staffan Lindberg: There is no consensus on the definition of democracy and how to measure it. The understanding of what a democracy really is varies across countries and regions. This motivates the V-Dem approach not to offer one standard definition of the concept but instead to distinguish among five principles different versions of democracy: Electoral, Liberal, Participatory, Deliberative, and Egalitarian democracy. All of these principles have played prominent roles in current and historical discussions about democracy. Our measurement of these principles are based on two types of data, factual data collected by assisting researchers and survey responses by country experts, which are combined using a rather complex measurement model (which is a“custom-designed Bayesian ordinal item response theory model”, for details see the V-Dem Methodology document)….(More)

Dive Against Debris: Employing 25,600 scuba divers to collect data


DataDrivenJournalism: “In 2011, the team at Project AWARE launched the Dive Against Debris program with the objective of better documenting the amount of marine debris found in the world’s oceans. This global citizen science program trains volunteer scuba divers from across the globe to conduct underwater surveys, generating quantitative data on the debris they see. After cleaning this data for quality assurance, it is then published on their interactive Dive Against Debris Map. This data and visualization informs the team’s advocacy work, ultimately seeking to generate changes in policy.

The impact of marine debris is devastating, killing marine life and changing their habitats and ecosystems. Animals are extremely vulnerable to ingestion or entanglement which leads to death, as they are unable to distinguish between what is trash and what is not.

Beyond this, as microscopic pieces of plastic enter the food chain, most seafood ingested by humans also likely contains marine debris.

Project AWARE is a growing movement of scuba divers protecting the ocean, with a long history of working on the marine debris issue. Through its work, the Project AWARE team found that there was a significant lack of data available regarding underwater marine debris.

To remedy this, the Dive Against Debris program was launched in 2011. The programs seeks to collect and visualise data generated by their volunteers, then use this data to influence policy changes and raise social awareness around the world. This data collection is unique in that it focuses exclusively on yielding data about the types and quantities of marine debris items found beneath in the ocean, an issue Hannah Pragnell-Raasch, a Program Specialist with Project AWARE, told us “has previously been disregarded as out of sight, out of mind, as the everyday person is not exposed to the harmful impacts.”

To date, Dive Against Debris surveys have been conducted in over 50 countries, with the top reporting countries being the United States, Thailand and Greece. As more divers get involved with Dive Against Debris, Project AWARE continues to bring visibility to the problem of marine debris and helps to identify target areas for waste prevention efforts.

datadebrismap.png

 

….

Anyone can take part in a Dive Against Debris survey, as long as they are a certified diver. As described in their “Action Zone”, scuba divers can either “join” or “create” an action. To further support the program, Project AWARE launched the Dive Against Debris Distinctive Specialty, a course of divers, which “aims to equip students (scuba divers) with the skills and knowledge necessary to conduct their own Dive Against Debris Surveys.”

Before the data appears on the interactive Dive Against Debris Map, it goes through a quality review in order to ensure data integrity. The survey leader at Project AWARE corrects any data inconsistencies. Then, as the focus is exclusively on what is found underwater, all land data is removed. Project AWARE Aware aims to create “an accurate perspective about underwater marine debris, that policy-makers simply cannot ignore”…. Explore the Dive Against Debris project here…. (More)

Translator Gator


Yulistina Riyadi & Lalitia Apsar at Global Pulse: “Today Pulse Lab Jakarta launches Translator Gator, a new language game to support research initiatives in Indonesia. Players can earn phone credit by translating words between English and six common Indonesian languages. The database of keywords generated by the game will be used by researchers on topics ranging from computational social science to public policy.

Translator Gator is inspired by the need to socialise the 17 Sustainable Development Goals (SDGs), currently being integrated into the Government of Indonesia’s programme, and the need to better monitor progress against the varied indicators. Thus, Translator Gator will raise awareness of the SDGs and develop a taxonomy of keywords to inform research.

An essential element of public policy research is to pay attention to citizens’ feedback, both active and passive, for instance, citizens’ complaints to governments through official channels and on social media. To do this in a computational manner, researchers need a set of keywords, or ‘taxonomy’, by topic or government priorities for example.

But given the rich linguistic and cultural diversity in Indonesia, this poses some difficulties in that many languages and dialects are used in different provinces and islands. On social media, such variations – including jargon – make building a list of keywords more challenging as words, context and, by extension, meaning change from region to region. …(More)”

Idea to retire: Leaders can’t take risks or experiment


David Bray at TechTank: “Technology is rapidly changing our world. Traditionally, a nation’s physical borders could mark the beginning of their sovereign space, but in the early to mid-20th century airplanes challenged this notion. Later on, space-based satellites began flying in space above all nations. By the early 21st century, smartphone technologies costing $100 or so gave individuals computational capabilities that dwarfed the multi-million dollar computers operated by large nation-states just three decades earlier.

In this period of exponential change, all of us across the public sector must work together, enabling more inclusive work across government workers, citizen-led contributions, and public-private partnerships. Institutions must empower positive change agents on the inside of public service to pioneer new ways of delivering superior results. Institutions must also open their data for greater public interaction, citizen-led remixing, and discussions.

All together, these actions will transform public service to truly be “We the (mobile, data-enabled, collaborative) People” working to improve our world. These actions all begin creating creative spaces that allow public service professionals the opportunities to experiment and explore new ways of delivering superior results to the public.

21st Century Reality #1: Public service must include workspaces for those who want to experiment and explore new ways of delivering results.

The world we face now is dramatically different then the world of 50, 100, or 200 years ago. More technological change is expected to occur in the next five years than the last 15 years combined. Advances in technology have blurred what traditionally was considered government, and consequentially we must experiment and explore new ways of delivering results.

21st Century Reality #2: Public service agencies need, within reason, to be allowed to have things fail, and be allowed to take risks.

The words “expertise” and “experiments” have the same etymological root, which is “exper,” meaning “out of danger.” Whereas the motto in Silicon Valley and other innovation hubs around the world might be “fail fast and fail often,” such a model is not going to work for public service, where certain endeavors absolutely must succeed and cannot waste taxpayer funds.

The only way public sector technologists will gain the expertise needed to respond to and take advantage of the digital disruptions occurring globally will be to do “dangerous experiments” as positive change agents akin to what entrepreneurs in Silicon Valley also do….

21st Century Reality #3: Public service cannot be done solely by government professionals in a top-down fashion.

With the communication capabilities provided by smartphones, social media, and freely available apps, individual members of the public can voluntarily access, analyze, remix, and choose to contribute data and insights to better inform public service. Recognizing this shift from top-down to bottom-up activities represents the first step to the resiliency of our legacy institutions….

Putting a cultural shift into practice

Senior executives need to shift from managing those who report to them to championing and creating spaces for creativity within their organizations. Within any organization, change agents should be able to approach an executive, pitch new ideas, bring data to support these ideas, and if a venture is approved move forward with speed to transform public service away from our legacy approaches….

The work of public service also can be done by public-private partnerships acting beyond their own corporate interests to benefit the nation and local communities. Historically the U.S. has lagged other nations, like Singapore or the U.K., in exploring new innovative forms of public-private partnerships. This could change by examining the pressing issues of the day and considering how the private sector might solve challenging issues, or complement the efforts of government professionals. This could include rotations of both government and private sector professionals as part of public-private partnerships to do public service that now might be done more collaboratively, effectively, and innovatively using alternative forms of organizational design and delivery.

If public service returns to first principles – namely, what “We the People” choose to do together – new forms of organizing, collaborating, incentivizing, and delivering results will emerge. Our exponential era requires such transformational partnerships for the future ahead….(More)”

Design-Led Innovation in the Public Sector


Manuel Sosa at INSEAD Knowledge: “When entering a government permit office, virtually everyone would prepare themselves for a certain amount of boredom and confusion. But resignation may well turn to surprise or even shock, if that office is Singapore’s Employment Pass Service Centre (EPSC), where foreign professionals go to receive their visa to work in the city-state. The ambience more closely resembles a luxury hotel lobby than a grim government agency, an impression reinforced by the roaming reception managers who greet arriving applicants, directing them to a waiting area with upholstered chairs and skyline views.

In a new case study, “Designing the Employment Pass Service Centre for the Ministry of Manpower, Singapore”, Prof. Michael Pich and I explore how even public organizations are beginning to use design to find and tap into innovation opportunities where few have thought to look. In the case of Singapore’s Ministry of Manpower (MOM), a design-led transformation of a single facility was the starting point of a drastic reconsideration of what a government agency could be.

Efficiency is not enough

Prior to opening the EPSC in July 2009, MOM’s Work Pass Division (WPD) had developed hyper-efficient methods to process work permits for foreign workers, who comprise approximately 40 percent of Singapore’s workforce. In fact, it was generally considered the most efficient department of its kind in the world. After 9/11, a mandatory-fingerprinting policy for white-collar workers was introduced, necessitating a standalone centre. The agency saw this as an opportunity to raise the efficiency bar even further.

Giving careful consideration to every aspect of the permit-granting process, the project team worked with a local vendor to overhaul the existing model. The proposal they ultimately presented to MOM assured almost unheard-of waiting times, as well as a more aesthetically pleasing look and feel….

Most public-sector organisations’ prickly interactions with the public can be explained with the simple fact that they lack competition. Government bodies are generally monopolies dispensing necessities, so on the whole they don’t feel compelled to agonise over their public face.

MOM and the Singapore government had a different idea. Aware that they were competing with other countries for top global talent, they recognised that the permit-granting process, in a very real sense, set the tone for foreign professionals’ entire experience of Singapore. Expats would be unlikely to remember precisely how long it took to get processed, but the quality of the service received would resonate in their minds and affect their impression of the country as a whole.

IDEO typically begins by concentrating on the user experience. In this case, in addition to observing and identifying what goes through the mind of a typical applicant during his or her journey in the existing system, the observation stage included talking to foreigners who were arriving in Singapore about their experience. IDEO discovered that professionals newly arrived in Singapore were embarking on an entirely new chapter of their lives, with all the expected stresses. The last thing they needed was more stress when receiving their permit. Hence, the EPSC entry hall is airy and free of clutter to create a sense of calm. The ESPC provides toys to keep kids entertained while their parents meet with agents and register for work passes. Visitors are always called by name, not number. Intimidating interview rooms were done away with in favour of open cabanas….In its initial customer satisfaction survey in 2010, the EPSC scored an average rating of 5.7 out of 6….(More)”

Humanity 360: World Humanitarian Data and Trends 2015


OCHA: “WORLD HUMANITARIAN DATA AND TRENDS

Highlights major trends, challenges and opportunities in the nature of humanitarian crises, showing how the humanitarian landscape is evolving in a rapidly changing world.

EXPLORE...

LEAVING NO ONE BEHIND: HUMANITARIAN EFFECTIVENESS IN THE AGE OF THE SUSTAINABLE DEVELOPMENT GOALS

Exploring what humanitarian effectiveness means in today’s world ‐ better meeting the needs of people in crisis, better moving people out of crisis.

EXPLORE

TOOLS FOR DATA COORDINATION AND COLLECTION

 

Initial Conditions Matter: Social Capital and Participatory Development


Paper by Lisa A. Cameron et al: “Billions of dollars have been spent on participatory development programs in the developing world. These programs give community members an active decision-making role. Given the emphasis on community involvement, one might expect that the effectiveness of this approach would depend on communities’ pre-existing social capital stocks. Using data from a large randomised field experiment of Community-Led Total Sanitation in Indonesia, we find that villages with high initial social capital built toilets and reduced open defecation, resulting in substantial health benefits. In villages with low initial stocks of social capital, the approach was counterproductive – fewer toilets were built than in control communities and social capital suffered….(More)”

Playing ‘serious games,’ adults learn to solve thorny real-world problems


Lawrence Susskind and Ella Kim in The Conversation: “…We have been testing the use of role-playing games to promote collaborative decision-making by nations, states and communities. Unlike online computer games, players in role-playing games interact face-to-face in small groups of six to eight. The games place them in a hypothetical setting that simulates a real-life problem-solving situation. People are often assigned roles that are very different from their real-life roles. This helps them appreciate how their political adversaries view the problem.

Players receive briefing materials to read ahead of time so they can perform their assigned roles realistically. The idea is to reenact the tensions that actual stakeholders will feel when they are making real-life decisions. In the game itself, participants are asked to reach agreement in their roles in 60-90 minutes. (Other games, like the Mercury Game or the Chlorine Game, take longer to play.) If multiple small groups play the game at the same time, the entire room – which may include 100 tables of game players or more – can discuss the results together. In these debriefings, the most potent learning often occurs when players hear about creative moves that others have used to reach agreement.

It can take up to several months to design a game. Designers start by interviewing real-life decision makers to understand how they view the problem. Game designers must also synthesize a great deal of scientific and technical information to present it in the game in a form that anyone can understand. After the design phase, games have to be tested and refined before they are ready for play.

Research shows that this immersive approach to learning is particularly effective for adults. Our own research shows that elected and appointed officials, citizen advocates and corporate leaders can absorb a surprising amount of new scientific information when it is embedded in a carefully crafted role-playing game. In one study of more than 500 people in four New England coastal communities, we found that a significant portion of game players (1) changed their minds about how urgent a threat climate change is; (2) became more optimistic about their local government’s ability to reduce climate change risks; and (3) became more confident that conflicting groups would be able to reach agreement on how to proceed with climate adaptation….

Our conclusion is that “serious games” can prepare citizens and officialsto participate successfully in science-based problem-solving. In related research in Ghana and Vietnam, we found that role-playing games had similarly valuable effects. While the agreements reached in games do not necessarily indicate what actual agreements may be reached, they can help officials and stakeholder representatives get a much clearer sense of what might be possible.

We believe that role-playing games can be used in a wide range of situations. We have designed games that have been used in different parts of the world to help all kinds of interest groups work together to draft new environmental regulations. We have brought together adversaries in energy facility siting and waste cleanup disputes to play a game prior to facing off against each other in real life. This approach has also facilitated decisions in regional economic development disputes, water allocation disputes in an international river basin and disputes among aboriginal communities, national governments and private industry….(More)”

Forging Trust Communities: How Technology Changes Politics


Book by Irene S. Wu: “Bloggers in India used social media and wikis to broadcast news and bring humanitarian aid to tsunami victims in South Asia. Terrorist groups like ISIS pour out messages and recruit new members on websites. The Internet is the new public square, bringing to politics a platform on which to create community at both the grassroots and bureaucratic level. Drawing on historical and contemporary case studies from more than ten countries, Irene S. Wu’s Forging Trust Communities argues that the Internet, and the technologies that predate it, catalyze political change by creating new opportunities for cooperation. The Internet does not simply enable faster and easier communication, but makes it possible for people around the world to interact closely, reciprocate favors, and build trust. The information and ideas exchanged by members of these cooperative communities become key sources of political power akin to military might and economic strength.

Wu illustrates the rich world history of citizens and leaders exercising political power through communications technology. People in nineteenth-century China, for example, used the telegraph and newspapers to mobilize against the emperor. In 1970, Taiwanese cable television gave voice to a political opposition demanding democracy. Both Qatar (in the 1990s) and Great Britain (in the 1930s) relied on public broadcasters to enhance their influence abroad. Additional case studies from Brazil, Egypt, the United States, Russia, India, the Philippines, and Tunisia reveal how various technologies function to create new political energy, enabling activists to challenge institutions while allowing governments to increase their power at home and abroad.

Forging Trust Communities demonstrates that the way people receive and share information through network communities reveals as much about their political identity as their socioeconomic class, ethnicity, or religion. Scholars and students in political science, public administration, international studies, sociology, and the history of science and technology will find this to be an insightful and indispensable work….(More)”

Jakarta’s Participatory Budget


Ramda Yanurzha in GovInsider: “…This is a map of Musrenbang 2014 in Jakarta. Red is a no-go, green means the proposal is approved.

To give you a brief background, musrenbang is Indonesia’s flavor of participatory, bottom-up budgeting. The idea is that people can propose any development for their neighbourhood through a multi-stage budgeting process, thus actively participating in shaping the final budget for the city level, which will then determine the allocation for each city at the provincial level, and so on.

The catch is, I’m confident enough to say that not many people (especially in big cities) are actually aware of this process. While civic activists tirelessly lament that the process itself is neither inclusive nor transparent, I’m leaning towards a simpler explanation that most people simply couldn’t connect the dots.

People know that the public works agency fixed that 3-foot pothole last week. But it’s less clear how they can determine who is responsible for fixing a new streetlight in that dark alley and where the money comes from. Someone might have complain to the neighbourhood leader (Pak RT) and somehow the message gets through, but it’s very hard to trace how it got through. Just keep complaining to the black box until you don’t have to. There are very few people (mainly researchers) who get to see the whole picture.

This has now changed because the brand-new Jakarta open data portal provides musrenbang data from 2009. Who proposed what to whom, for how much, where it should be implemented (geotagged!), down to kelurahan/village level, and whether the proposal is accepted into the final city budget. For someone who advocates for better availability of open data in Indonesia and is eager to practice my data wrangling skill, it’s a goldmine.

Diving In

data screenshot
All the different units of goods proposed.

The data is also, as expected, incredibly messy. While surprisingly most of the projects proposed are geotagged, there are a lot of formatting inconsistencies that makes the clean up stage painful. Some of them are minor (m? meter? meter2? m2? meter persegi?) while others are perplexing (latitude: -6,547,843,512,000  –  yes, that’s a value of more than a billion). Annoyingly, hundreds of proposals point to the center of the National Monument so it’s not exactly a representative dataset.

For fellow data wranglers, pull requests to improve the data are gladly welcome over here. Ibam generously wrote an RT extractor to yield further location data, and I’m looking into OpenStreetMap RW boundary data to create a reverse geocoder for the points.

A couple hours of scrubbing in OpenRefine yields me a dataset that is clean enough for me to generate the CartoDB map I embedded at the beginning of this piece. More precisely, it is a map of geotagged projects where each point is colored depending on whether it’s rejected or accepted.

Numbers and Patterns

40,511 proposals, some of them merged into broader ones, which gives us a grand total of 26,364 projects valued at over IDR 3,852,162,060,205, just over $250 million at the current exchange rate. This amount represents over 5% of Jakarta’s annual budget for 2015, with projects ranging from a IDR 27,500 (~$2) trash bin (that doesn’t sound right, does it?) in Sumur Batu to IDR 54 billion, 1.5 kilometer drainage improvement in Koja….(More)”