Growing Data Collection Inspires Openness at NGA


at Secrecy News: “A flood of information from the ongoing proliferation of space-based sensors and ground-based data collection devices is promoting a new era of transparency in at least one corner of the U.S. intelligence community.

The “explosion” of geospatial information “makes geospatial intelligence increasingly transparent because of the huge number and diversity of commercial and open sources of information,” said Robert Cardillo, director of the National Geospatial-Intelligence Agency (NGA), in a speech last month.

Hundreds of small satellites are expected to be launched within the next three years — what Mr. Cardillo called a “darkening of the skies” — and they will provide continuous, commercially available coverage of the entire Earth’s surface.

“The challenges of taking advantage of all of that data are daunting for all of us,” Mr. Cardillo said.

Meanwhile, the emerging “Internet of Things” is “spreading rapidly as more people carry more handheld devices to more places” generating an abundance of geolocation data.

This is, of course, a matter of intelligence interest since “Every local, regional, and global challenge — violent extremism in the Middle East and Africa, Russian aggression, the rise of China, Iranian and North Korean nuclear weapons, cyber security, energy resources, and many more — has geolocation at its heart.”

Consequently, “We must open up GEOINT far more toward the unclassified world,” Director Cardillo said in another speech last week.

“In the past, we have excelled in our closed system. We enjoyed a monopoly on sources and methods. That monopoly has long since ended. Today and in the future, we must thrive and excel in the open.”

So far, NGA has already distinguished itself in the area of disaster relief, Mr. Cardillo said.

“Consider Team NGA’s response to the Ebola crisis. We are the first intelligence agency to create a World Wide Web site with access to our relevant unclassified content. It is open to everyone — no passwords, no closed groups.”

NGA provided “more than a terabyte of up-to-date commercial imagery.”

“You can imagine how important it is for the Liberian government to have accurate maps of the areas hardest hit by the Ebola epidemic as well as the medical and transportation infrastructure to combat the disease,” Mr. Cardillo said.

But there are caveats. Just because information is unclassified does not mean that it is freely available.

“Although 99 percent of all of our Ebola data is unclassified, most of that is restricted by our agreements [with commercial providers],” Mr. Cardillo said. “We are negotiating with many sources to release more data.”

Last week, Director Cardillo announced a new project called GEOINT Pathfinder that will attempt “to answer key intelligence questions using only unclassified data.”….(More)

Big Data for Social Good


Introduction to a Special Issue of the Journal “Big Data” by Catlett Charlie and Ghani Rayid: “…organizations focused on social good are realizing the potential as well but face several challenges as they seek to become more data-driven. The biggest challenge they face is a paucity of examples and case studies on how data can be used for social good. This special issue of Big Data is targeted at tackling that challenge and focuses on highlighting some exciting and impactful examples of work that uses data for social good. The special issue is just one example of the recent surge in such efforts by the data science community. …

This special issue solicited case studies and problem statements that would either highlight (1) the use of data to solve a social problem or (2) social challenges that need data-driven solutions. From roughly 20 submissions, we selected 5 articles that exemplify this type of work. These cover five broad application areas: international development, healthcare, democracy and government, human rights, and crime prevention.

“Understanding Democracy and Development Traps Using a Data-Driven Approach” (Ranganathan et al.) details a data-driven model between democracy, cultural values, and socioeconomic indicators to identify a model of two types of “traps” that hinder the development of democracy. They use historical data to detect causal factors and make predictions about the time expected for a given country to overcome these traps.

“Targeting Villages for Rural Development Using Satellite Image Analysis” (Varshney et al.) discusses two case studies that use data and machine learning techniques for international economic development—solar-powered microgrids in rural India and targeting financial aid to villages in sub-Saharan Africa. In the process, the authors stress the importance of understanding the characteristics and provenance of the data and the criticality of incorporating local “on the ground” expertise.

In “Human Rights Event Detection from Heterogeneous Social Media Graphs,” Chen and Neil describe efficient and scalable techniques to use social media in order to detect emerging patterns in human rights events. They test their approach on recent events in Mexico and show that they can accurately detect relevant human rights–related tweets prior to international news sources, and in some cases, prior to local news reports, which could potentially lead to more timely, targeted, and effective advocacy by relevant human rights groups.

“Finding Patterns with a Rotten Core: Data Mining for Crime Series with Core Sets” (Wang et al.) describes a case study with the Cambridge Police Department, using a subspace clustering method to analyze the department’s full housebreak database, which contains detailed information from thousands of crimes from over a decade. They find that the method allows human crime analysts to handle vast amounts of data and provides new insights into true patterns of crime committed in Cambridge…..(More)

UNESCO demonstrates global impact through new transparency portal


“Opendata.UNESCO.org  is intended to present comprehensive, quality and timely information about UNESCO’s projects, enabling users to find information by country/region, funding source, and sector and providing comprehensive project data, including budget, expenditure, completion status, implementing organization, project documents, and more. It publishes program and financial information that are in line with UN system-experience of the IATI (International Aid Transparency Initiative) standards and other relevant transparency initiatives. UNESCO is now part of more than 230 organizations that have published to the IATI Registry, which brings together donor and developing countries, civil society organizations and other experts in aid information who are committed to working together to increase the transparency of aid.

Since its creation 70 years ago, UNESCO has tirelessly championed the causes of education, culture, natural sciences, social and human sciences, communication and information, globally. For instance – started in March 2010, the program for the Enhancement of Literacy in Afghanistan (ELA) benefited from a $19.5 million contribution by Japan. It aimed to improve the level of literacy, numeracy and vocational skills of the adult population in 70 districts of 15 provinces of Afghanistan. Over the next three years, until April 2013, the ELA programme helped some 360,000 adult learners in General Literacy compotency. An interactive map allows for an easy identification of UNESCO’s high-impact programs, and up-to-date information of current and future aid allocations within and across countries.

Public participation and interactivity are key to the success of any open data project. http://Opendata.UNESCO.org will evolve as Member States and partners will get involved, by displaying data on their own websites and sharing data among different networks, building and sharing applications, providing feedback, comments, and recommendations. …(More)”

New portal to crowdsource captions, transcripts of old photos, national archives


Irene Tham at The Straits Times: “Wanted: history enthusiasts to caption old photographs and transcribe handwritten manuscripts that contain a piece of Singapore’s history.

They are invited to contribute to an upcoming portal that will carry some 3,000 unidentified photographs dating back to the late 1800s, and 3,000 pages of Straits Settlement records including letters written during Sir Stamford Raffles’ administration of Singapore.

These are collections from the Government and individuals waiting to be “tagged” on the new portal – The Citizen Archivist Project at www.nas.gov.sg/citizenarchivist….

Without tagging – such as by photo captioning and digital transcription – these records cannot be searched. There are over 140,000 photos and about one million pages of Straits Settlements Records in total that cannot be searched today.

These records date back to the 1800s, and include letters written during Sir Stamford Raffles’ administration in Singapore.

“The key challenge is that they were written in elaborate cursive penmanship which is not machine-readable,” said Dr Yaacob, adding that the knowledge and wisdom of the public can be tapped on to make these documents more accessible.

Mr Arthur Fong (West Coast GRC) had asked how the Government could get young people interested in history, and Dr Yaacob said this initiative was something they would enjoy.

Portal users must first log in using their existing Facebook, Google or National Library Board accounts. Contributions will be saved in users’ profiles, automatically created upon signing in.

Transcript contributions on the portal work in similar ways to Wikipedia; contributed text will be uploaded immediately on the portal.

However, the National Archives will take up to three days to review photo caption contributions. Approved captions will be uploaded on its website at www.nas.gov.sg/archivesonline….(More)”

The Ubiquitous Internet: User and Industry Perspectives


New book edited by Anja Bechmann, and Stine Lomborg: “This book presents state of the art theoretical and empirical research on the ubiquitous internet: its everyday users and its economic stakeholders. The book offers a 360-degree media analysis of the contemporary terrain of the internet by examining both user and industry perspectives and their relation to one another. Contributors consider user practices in terms of internet at your fingertips—the abundance, free flow, and interconnectivity of data. They then consider industry’s use of user data and standards in commodification and value-creation…. Introduction Part I: Users and Usage Patterns 1. Next Generation Users: Changing Access to the Internet Grant Blank and William H. Dutton 2. The Internet in My Pocket Stine Lomborg 3. Managing the Interoperable Self Anja Bechmann 4. The Dynamics of Real-Time Contentious Politics: How Ubiquitous Internet Shapes and Transforms Popular Protest in China Jun Liu Part II: Commercialization, Standards, and Politics 5. Histories of Ubiquitous Web Standardization Indrek Ibrus 6. Mobile Internet: The Politics of Code and Networks Lela Mosemghvdlishvili 7. Predictive Algorithms and Personalization Services on Social Network Sites: Implications for Users and Society Robert Bodle 8. The Digital Transformation of Physical Retailing: Sellers, Customers, and the Ubiquitous Internet Joseph Turow Conclusion…(More)

One State Wants To Let You Carry Your Driver’s License On Your Phone


at Singularity Hub: “There’s now a technology to replace almost everything in your wallet. Your cash, credit cards, and loyalty programs are all on their way to becoming obsolete. Money can now be sent via app, text, e-mail — it can even be sent via Snapchat. But you can’t leave your wallet home just yet. That’s because there is one item that remains largely unchanged: your driver’s license.

If the Iowa Department of Motor Vehicles has its way, that may no longer be the case. According to an article in the Des Moines Register, the agency is in the early stages of developing mobile software for just this purpose. The app would store a resident’s personal information, whatever is already on the physical licenses, and also include a scannable bar code. The plans are for the app to include a two-step verification process including some type of biometric or pin code. At this time, it appears that specific implementation details are still being worked out.

The governments of the United Kingdom and United Arab Emirates had both previously announced their own attempts to experiment with the concept. It’s becoming increasingly common to see mobile versions of other documents. Over 30 states now allow motorists to show electronic proof of insurance. It only follows that the driver’s license would be next. But the considerations around that document are different — it is perhaps the most regulated and important document that a person carries….(More)”

Data Mining Reveals a Global Link Between Corruption and Wealth


Emerging Technology From the arXiv: “Social scientists have never understood why some countries are more corrupt than others. But the first study that links corruption with wealth could help change that…One question that social scientists and economists have long puzzled over is how corruption arises in different cultures and why it is more prevalent in some countries than others. But it has always been difficult to find correlations between corruption and other measures of economic or social activity.
Michal Paulus and Ladislav Kristoufek at Charles University in Prague, Czech Republic, have for the first time found a correlation between the perception of corruption in different countries and their economic development.
The data they use comes from Transparency International, a nonprofit campaigning organisation based in Berlin, Germany, and which defines corruption as the misuse of public power for private benefit. Each year, this organization publishes a global list of countries ranked according to their perceived levels of corruption. The list is compiled using at least three sources of information but does not directly measure corruption, because of the difficulties in gathering such data.
Instead, it gathers information from a wide range of sources such as the African Development Bank and the Economist Intelligence Unit. But it also places significant weight on the opinions of experts who are asked to assess corruption levels.
The result is the Corruption Perceptions Index ranking countries between 0 (highly corrupt) to 100 (very clean). In 2014, Denmark occupied of the top spot as the world’s least corrupt nation while Somalia and North Korea prop up the table in an unenviable tie for the most corrupt countries on the planet.
Paulus and Kristoufek use this data to search for find clusters of countries that share similar properties using a new generation of cluster-searching algorithms. And they say that the 134 countries they study fall neatly into four groups which are clearly correlated with the wealth of the nations within them….Ref: arxiv.org/abs/1502.00104  Worldwide Clustering Of The Corruption Perception”

Training the next generation of public leaders


Thanks to the generous support of the Knight Foundation, this term the Governance Lab Academy – a training program designed to promote civic engagement and innovation – is launching a series of online coaching programs.
Geared to the teams and individuals inside and outside of government planning to undertake a new project or trying to figure out how to make an existing project even more effective and scalable, these programs are designed to help participants working in civic engagement and innovation develop effective projects from idea to implementation.
Convened by leading experts in their fields, coaching programs meet exclusively online once a week for four weeks or every other week for eight weeks. They include frequent and constructive feedback, customized and original learning materials, peer-to-peer support, mentoring by topic experts and individualized coaching from those with policy, technology, and domain expertise.
There is no charge to participants but each program is limited to 8-10 project teams or individuals.
You can see the current roster of programs below and check out the website for more information (including FAQs), to sign up and to suggest a new program.

Faculty includes: 

  • Brian Behlendorf, Managing Director at Mithril Capital Management and Co-Founder Apache
  • Alexandra Clare, Founder of Iraq Re:Coded
  • Brian Forde, Senior Former Advisor to the U.S. CTO, White House Office of Science Technology and Policy
  • Francois Grey,  Coordinator of the Citizen Cyberscience Centre, Geneva
  • Gavin Hayman, Executive Director of the Open Contracting Partnership
  • Clay Johnson, CEO of The Department for Better Technology and Former Presidential Innovation Fellow
  • Benjamin Kallos, New York City Council Member and Chair of the Committee on Governmental Operations of the New York City Council
  • Karim Lakhani, Lumry Family Associate Professor of Business Administration at the Harvard Business School
  • Amen Ra Mashariki, Chief Analytics Officer of New York City
  • Geoff Mulgan, Chief Executive of NESTA
  • Miriam Nisbet,  Former Director of the Office of Government Information Services
  • Beth Noveck, Founder and CEO of The GovLab
  • Tiago Peixoto, Open Government Specialist at The World Bank
  • Arnaud Sahuguet, Chief Technology Officer of The GovLab
  • Joeri van den Steenhoven, Co-Founder and Chief Research and Development Officer of MaRS Solutions Lab
  • Stefaan Verhulst, Co-Founder and Chief Research and Development Officer of The GovLab

2015 Edelman Trust Barometer


The 2015 Edelman Trust Barometer shows a global decline in trust over the last year, and the number of countries with trusted institutions has fallen to an all-time low among the informed public.

Among the general population, the trust deficit is even more pronounced, with nearly two-thirds of countries falling into the distruster category.
In the last year, trust has declined for three of the four institutions measured. NGOs continue to be the most trusted institution, but trust in NGOs declined from 66 to 63 percent. Sixty percent of countries now distrust media. Trust in government increased slightly, driven by big gains in India, Russia and Indonesia but government is still distrusted in 19 of the 27 markets surveyed. And trust in business is below 50 percent in half of those markets.
 

Schemes used by South Australia to include citizens in policy making


Joshua Chambers at Future Gov Asia: “…South Australia has pioneered a number of innovative methods to try to include its residents in policymaking. …The highest profile participatory programme run by the state government is the Citizens’ Jury initiative, …The Citizens’ Jury takes a randomly selected, representative group of citizens through a process to hear arguments and evidence much like a jury in a trial, before writing an independent report which makes recommendations to government.
There were 37 members of the jury, hearing evidence on Thursday evenings and Saturdays over a five week period. They heard from motorists associations, cycling associations, and all sorts of other interested groups.
They used Basecamp software to ensure that jurors stayed connected when not at meetings, hosting discussions in a private space to consider the evidence they heard. …The jurors prepared 21 recommendations, ranging from decreasing speed in the city to a schools programme…. The Government supports the majority of the recommendations and will investigate the remaining three.
The government has also committed to provide jurors with an update every 6 months on the progress being made in this area.
Lessons and challenges
As would be expected with an innovative new scheme, it hasn’t always been smooth. One lesson learned from the first initiative was that affected agencies need to be engaged in advance, and briefed throughout the process, so that they can prepare their responses and resources. ….
Aside from the Citizens’ Jury, the Government of South Australia is also pioneering other approaches to include citizens in policy making. Fund My Idea is a crowdsourcing site that allows citizens to propose new projects. …(More)”