Index: Privacy and Security


The Living Library Index – inspired by the Harper’s Index – provides important statistics and highlights global trends in governance innovation. This installment focuses on privacy and security and was originally published in 2014.

Globally

  • Percentage of people who feel the Internet is eroding their personal privacy: 56%
  • Internet users who feel comfortable sharing personal data with an app: 37%
  • Number of users who consider it important to know when an app is gathering information about them: 70%
  • How many people in the online world use privacy tools to disguise their identity or location: 28%, or 415 million people
  • Country with the highest penetration of general anonymity tools among Internet users: Indonesia, where 42% of users surveyed use proxy servers
  • Percentage of China’s online population that disguises their online location to bypass governmental filters: 34%

In the United States

Over the Years

  • In 1996, percentage of the American public who were categorized as having “high privacy concerns”: 25%
    • Those with “Medium privacy concerns”: 59%
    • Those who were unconcerned with privacy: 16%
  • In 1998, number of computer users concerned about threats to personal privacy: 87%
  • In 2001, those who reported “medium to high” privacy concerns: 88%
  • Individuals who are unconcerned about privacy: 18% in 1990, down to 10% in 2004
  • How many online American adults are more concerned about their privacy in 2014 than they were a year ago, indicating rising privacy concerns: 64%
  • Number of respondents in 2012 who believe they have control over their personal information: 35%, downward trend for 7 years
  • How many respondents in 2012 continue to perceive privacy and the protection of their personal information as very important or important to the overall trust equation: 78%, upward trend for seven years
  • How many consumers in 2013 trust that their bank is committed to ensuring the privacy of their personal information is protected: 35%, down from 48% in 2004

Privacy Concerns and Beliefs

  • How many Internet users worry about their privacy online: 92%
    • Those who report that their level of concern has increased from 2013 to 2014: 7 in 10
    • How many are at least sometimes worried when shopping online: 93%, up from 89% in 2012
    • Those who have some concerns when banking online: 90%, up from 86% in 2012
  • Number of Internet users who are worried about the amount of personal information about them online: 50%, up from 33% in 2009
    • Those who report that their photograph is available online: 66%
      • Their birthdate: 50%
      • Home address: 30%
      • Cell number: 24%
      • A video: 21%
      • Political affiliation: 20%
  • Consumers who are concerned about companies tracking their activities: 58%
    • Those who are concerned about the government tracking their activities: 38%
  • How many users surveyed felt that the National Security Association (NSA) overstepped its bounds in light of recent NSA revelations: 44%
  • Respondents who are comfortable with advertisers using their web browsing history to tailor advertisements as long as it is not tied to any other personally identifiable information: 36%, up from 29% in 2012
  • Percentage of voters who do not want political campaigns to tailor their advertisements based on their interests: 86%
  • Percentage of respondents who do not want news tailored to their interests: 56%
  • Percentage of users who are worried about their information will be stolen by hackers: 75%
    • Those who are worried about companies tracking their browsing history for targeted advertising: 54%
  • How many consumers say they do not trust businesses with their personal information online: 54%
  • Top 3 most trusted companies for privacy identified by consumers from across 25 different industries in 2012: American Express, Hewlett Packard and Amazon
    • Most trusted industries for privacy: Healthcare, Consumer Products and Banking
    • Least trusted industries for privacy: Internet and Social Media, Non-Profits and Toys
  • Respondents who admit to sharing their personal information with companies they did not trust in 2012 for reasons such as convenience when making a purchase: 63%
  • Percentage of users who say they prefer free online services supported by targeted ads: 61%
    • Those who prefer paid online services without targeted ads: 33%
  • How many Internet users believe that it is not possible to be completely anonymous online: 59%
    • Those who believe complete online anonymity is still possible: 37%
    • Those who say people should have the ability to use the Internet anonymously: 59%
  • Percentage of Internet users who believe that current laws are not good enough in protecting people’s privacy online: 68%
    • Those who believe current laws provide reasonable protection: 24%

Security Related Issues

  • How many have had an email or social networking account compromised or taken over without permission: 21%
  • Those who have been stalked or harassed online: 12%
  • Those who think the federal government should do more to act against identity theft: 74%
  • Consumers who agree that they will avoid doing business with companies who they do not believe protect their privacy online: 89%
    • Among 65+ year old consumers: 96%

Privacy-Related Behavior

  • How many mobile phone users have decided not to install an app after discovering the amount of information it collects: 54%
  • Number of Internet users who have taken steps to remove or mask their digital footprint (including clearing cookies, encrypting emails, and using virtual networks to mask their IP addresses): 86%
  • Those who have set their browser to disable cookies: 65%
  • Number of users who have not allowed a service to remember their credit card information: 73%
  • Those who have chosen to block an app from accessing their location information: 53%
  • How many have signed up for a two-step sign-in process: 57%
  • Percentage of Gen-X (33-48 year olds) and Millennials (18-32 year olds) who say they never change their passwords or only change them when forced to: 41%
    • How many report using a unique password for each site and service: 4 in 10
    • Those who use the same password everywhere: 7%

Sources

The Unwisdom of Crowds




Anne Applebaum on why people-powered revolutions are overrated in the New Republic: “..Yet a successful street revolution, like any revolution, is never guaranteed to leave anything positive in its aftermath—or anything at all. In the West, we often now associate protests with progress, or at least we assume that big crowds—the March on Washington, Paris in 1968—are the benign face of social change. But street revolutions are not always progressive, positive, or even important. Some replace a corrupt tyranny with violence and a political vacuum, which is what happened in Libya. Ukraine’s own Orange Revolution of 2004–2005 produced a new group of leaders who turned out to be just as incompetent as their predecessors. Crowds can be bullying, they can become violent, and they can give rise to extremists: Think Tehran 1979, or indeed Petrograd 1917.
The crowd may not even represent the majority. Because a street revolution makes good copy, and because it provides great photographs, we often mistakenly confuse “people power” with democracy itself. In fact, the creation of democratic institutions—courts, legal systems, bills of rights—is a long and tedious process that often doesn’t interest foreign journalists at all. Tunisia’s ratification of a new constitution earlier this year represented the most significant achievement of the Arab Spring to date, but the agonizing negotiations that led up to that moment were hard for outsiders to understand—and not remotely telegenic
Equally, it is a dangerous mistake to imagine that “people power” can ever be a substitute for actual elections. On television, a demonstration can loom larger than it should. In both Thailand and Turkey, an educated middle class has recently taken to the streets to protest against democratically elected leaders who have grown increasingly corrupt and autocratic, but who might well be voted back into office tomorrow. In Venezuela, elections are not fair and the media is not free, but the president is supported by many Venezuelans who still have faith in his far-left rhetoric, however much his policies may be damaging the country. Demonstrations might help bring change in some of these countries, but if the change is to be legitimate—and permanent—the electorate will eventually have to endorse it.
As we often forget, some of the most successful transitions to democracy did not involve crowds at all. Chile became a democracy because its dictator, Augusto Pinochet, decided it would become one. In early 1989, well before mass demonstrations in Prague or Berlin, the leaders of the Polish opposition sat down at a large round table with their former jailers and negotiated their way out of communism. There are no spectacular photographs of these transitions, and many people found them unsatisfying, even unjust. But Chile and Poland remain democracies today, not least because their new leaders came to power without any overt opposition from the old regime.
It would be nice if these kinds of transitions were more common, but not every dictator is willing to smooth the path toward change. For that reason, the post-revolutionary moment is often more important than the revolution itself, for this is when the emotion of the mob has to be channeled rapidly—immediately—into legitimate institutions. Not everybody finds this easy. In the wake of the Egyptian revolution, demonstrators found it difficult to abandon Tahrir Square. “We won’t leave because we have to make sure this country is set on the right path,” one protester said at the time. In fact, he should already have been at home, back in his neighborhood, perhaps creating the grassroots political party that might have given Egyptians a real alternative to the Muslim Brotherhood…”

New Field Guide Explores Open Data Innovations in Disaster Risk and Resilience


Worldbank: “From Indonesia to Bangladesh to Nepal, community members armed with smartphones and GPS systems are contributing to some of the most extensive and versatile maps ever created, helping inform policy and better prepare their communities for disaster risk.
In Jakarta, more than 500 community members have been trained to collect data on thousands of hospitals, schools, private buildings, and critical infrastructure. In Sri Lanka, government and academic volunteers mapped over 30,000 buildings and 450 km of roadways using a collaborative online resource called OpenStreetMaps.
These are just a few of the projects that have been catalyzed by the Open Data for Resilience Initiative (OpenDRI), developed by the World Bank’s Global Facility for Disaster Reduction and Recovery (GFDRR). Launched in 2011, OpenDRI is active in more than 20 countries today, mapping tens of thousands of buildings and urban infrastructure, providing more than 1,000 geospatial datasets to the public, and developing innovative application tools.
To expand this work, the World Bank Group has launched the OpenDRI Field Guide as a showcase of successful projects and a practical guide for governments and other organizations to shape their own open data programs….
The field guide walks readers through the steps to build open data programs based on the OpenDRI methodology. One of the first steps is data collation. Relevant datasets are often locked because of proprietary arrangements or fragmented in government bureaucracies. The field guide explores tools and methods to enable the participatory mapping projects that can fill in gaps and keep existing data relevant as cities rapidly expand.

GeoNode: Mapping Disaster Damage for Faster Recovery
One example is GeoNode, a locally controlled and open source cataloguing tool that helps manage and visualize geospatial data. The tool, already in use in two dozen countries, can be modified and easily be integrated into existing platforms, giving communities greater control over mapping information.
GeoNode was used extensively after Typhoon Yolanda (Haiyan) swept the Philippines with 300 km/hour winds and a storm surge of over six meters last fall. The storm displaced nearly 11 million people and killed more than 6,000.
An event-specific GeoNode project was created immediately and ultimately collected more than 72 layers of geospatial data, from damage assessments to situation reports. The data and quick analysis capability contributed to recovery efforts and is still operating in response mode at Yolandadata.org.
InaSAFE: Targeting Risk Reduction
A sister project, InaSAFE, is an open, easy-to-use tool for creating impact assessments for targeted risk reduction. The assessments are based on how an impact layer – such as a tsunami, flood, or earthquake – affects exposure data, such as population or buildings.
With InaSAFE, users can generate maps and statistical information that can be easily disseminated and even fed back into projects like GeoNode for simple, open source sharing.
The initiative, developed in collaboration with AusAID and the Government of Indonesia, was put to the test in the 2012 flood season in Jakarta, and its successes provoked a rapid national rollout and widespread interest from the international community.
Open Cities: Improving Urban Planning & Resilience
The Open Cities project, another program operating under the OpenDRI platform, aims to catalyze the creation, management and use of open data to produce innovative solutions for urban planning and resilience challenges across South Asia.
In 2013, Kathmandu was chosen as a pilot city, in part because the population faces the highest mortality threat from earthquakes in the world. Under the project, teams from the World Bank assembled partners and community mobilizers to help execute the largest regional community mapping project to date. The project surveyed more than 2,200 schools and 350 health facilities, along with road networks, points of interest, and digitized building footprints – representing nearly 340,000 individual data nodes.”

After the Protests


Zeynep Tufekc in the New York Times on why social media is fueling a boom-and-bust cycle of political: “LAST Wednesday, more than 100,000 people showed up in Istanbul for a funeral that turned into a mass demonstration. No formal organization made the call. The news had come from Twitter: Berkin Elvan, 15, had died. He had been hit in the head by a tear-gas canister on his way to buy bread during the Gezi protests last June. During the 269 days he spent in a coma, Berkin’s face had become a symbol of civic resistance shared on social media from Facebook to Instagram, and the response, when his family tweeted “we lost our son” and then a funeral date, was spontaneous.

Protests like this one, fueled by social media and erupting into spectacular mass events, look like powerful statements of opposition against a regime. And whether these take place in Turkey, Egypt or Ukraine, pundits often speculate that the days of a ruling party or government, or at least its unpopular policies, must be numbered. Yet often these huge mobilizations of citizens inexplicably wither away without the impact on policy you might expect from their scale.

This muted effect is not because social media isn’t good at what it does, but, in a way, because it’s very good at what it does. Digital tools make it much easier to build up movements quickly, and they greatly lower coordination costs. This seems like a good thing at first, but it often results in an unanticipated weakness: Before the Internet, the tedious work of organizing that was required to circumvent censorship or to organize a protest also helped build infrastructure for decision making and strategies for sustaining momentum. Now movements can rush past that step, often to their own detriment….

But after all that, in the approaching local elections, the ruling party is expected to retain its dominance.

Compare this with what it took to produce and distribute pamphlets announcing the Montgomery bus boycott in 1955. Jo Ann Robinson, a professor at Alabama State College, and a few students sneaked into the duplicating room and worked all night to secretly mimeograph 52,000 leaflets to be distributed by hand with the help of 68 African-American political, religious, educational and labor organizations throughout the city. Even mundane tasks like coordinating car pools (in an era before there were spreadsheets) required endless hours of collaborative work.

By the time the United States government was faced with the March on Washington in 1963, the protest amounted to not just 300,000 demonstrators but the committed partnerships and logistics required to get them all there — and to sustain a movement for years against brutally enforced Jim Crow laws. That movement had the capacity to leverage boycotts, strikes and demonstrations to push its cause forward. Recent marches on Washington of similar sizes, including the 50th anniversary march last year, also signaled discontent and a desire for change, but just didn’t pose the same threat to the powers that be.

Social media can provide a huge advantage in assembling the strength in numbers that movements depend on. Those “likes” on Facebook, derided as slacktivism or clicktivism, can have long-term consequences by defining which sentiments are “normal” or “obvious” — perhaps among the most important levers of change. That’s one reason the same-sex marriage movement, which uses online and offline visibility as a key strategy, has been so successful, and it’s also why authoritarian governments try to ban social media.

During the Gezi protests, Prime Minister Recep Tayyip Erdogan called Twitter and other social media a “menace to society.” More recently, Turkey’s Parliament passed a law greatly increasing the government’s ability to censor online content and expand surveillance, and Mr. Erdogan said he would consider blocking access to Facebook and YouTube. It’s also telling that one of the first moves by President Vladimir V. Putin of Russia before annexing Crimea was to shut down the websites of dissidents in Russia.
Media in the hands of citizens can rattle regimes. It makes it much harder for rulers to maintain legitimacy by controlling the public sphere. But activists, who have made such effective use of technology to rally supporters, still need to figure out how to convert that energy into greater impact. The point isn’t just to challenge power; it’s to change it.”

Why the wealthiest countries are also the most open with their data


Emily Badger in the Washington Post: “The Oxford Internet Institute this week posted a nice visualization of the state of open data in 70 countries around the world, reflecting the willingness of national governments to release everything from transportation timetables to election results to machine-readable national maps. The tool is based on the Open Knowledge Foundation’s Open Data Index, an admittedly incomplete but telling assessment of who willingly publishes updated, accurate national information on, say, pollutants (Sweden) and who does not (ahem, South Africa).

Oxford Internet Institute
Tally up the open data scores for these 70 countries, and the picture looks like this, per the Oxford Internet Institute (click on the picture to link through to the larger interactive version):
Oxford Internet Institute
…With apologies for the tiny, tiny type (and the fact that many countries aren’t listed here at all), a couple of broad trends are apparent. For one, there’s a prominent global “openness divide,” in the words of the Oxford Internet Institute. The high scores mostly come from Europe and North America, the low scores from Asia, Africa and Latin America. Wealth is strongly correlated with “openness” by this measure, whether we look at World Bank income groups or Gross National Income per capita. By the OII’s calculation, wealth accounts for about a third of the variation in these Open Data Index scores.
Perhaps this is an obvious correlation, but the reasons why open data looks like the luxury of rich economies are many, and they point to the reality that poor countries face a lot more obstacles to openness than do places like the United States. For one thing, openness is also closely correlated with Internet penetration. Why open your census results if people don’t have ways to access it (or means to demand it)? It’s no easy task to do this, either.”

The intelligent citizen


John Bell in AlJazeera: “A quarter century after the demise of the Soviet Union, is the Western model of government under threat? …. The pressures are coming from several directions.
All states are feeling the pressure from unregulated global flows of capital that create obscene concentrations of wealth, and an inability of the nation-state to respond.Relatedly, citizens either ignore or distrust traditional institutions, and ethnic groups demand greater local autonomy.
A recent Pew survey shows that Americans aged 18-33 mostly identify as political independents and distrust institutions. The classic model is indeed frayed, and new developments have made it feel like very old cloth.
One natural reflex is to assert even greater control, a move suited to the authoritarians, such as China, Russia or General Abdel Fattah al-Sisi‘s Egypt: Strengthen the nation by any means to withstand the pressures. The reality, however, is that all systems, democracies or otherwise, were designed for an industrial age, and the management of an anonymous mass, and cannot cope with globalised economics and the information world of today.
The question remains: What can effectively replace the Western model? The answer may not lie only in the invention of new structures, but in the improvement of a key component found in all: The citizen.
The citizen today is mostly a consumer, focused on the purchase of goods or services, or the insistent consumption of virtual information, often as an ersatz politics. Occasionally, when a threat rises, he or she also becomes a demandeur of absolute security from the state. Indeed, some are using the new technologies for democratic purposes, they are better informed, criticise abuse or corruption, and organise and rally movements.
But, the vast majority is politically disengaged and cynical of political process; many others are too busy trying to survive to even care. A grand apathy has set in, the stage left vacant for a very few extremists, or pied pipers of the old tunes of nationalisms and tribal belonging disguised as leaders. The citizen is either invisible in this circus, an endangered species in the 21st century, or increasingly drawn to dark and polarising forces.
Some see the glass as half full and believe that technology and direct democracy can bridge the gaps. Indeed, the internet provides a plethora of information and a greater sense of empowerment. Lesser-known protests in Bosnia have led to direct democracy plenums, and the Swiss do revert to national referenda. However, whether direct or representative, democracy will still depend on the quality of the citizen, and his or her decisions.
Opinion, dogma and bias
Opinion, dogma and bias remain common political operating system and, as a result, our politics are still an unaffordable game of chance. The optimists may be right, but discussions in social media on issues ranging from Ukraine to gun control reveal more deep bias and the lure of excitement than the pursuit of a constructive answer.
People crave excitement in their politics. Whether it is through asserting their own opinion or in battling others, politics offers a great ground for this high. The cost, however, comes in poor judgment and dangerous decisions. George W. Bush was elected twice, Vladimir Putin has much support, climate change is denied, and an intoxicated Mayor of Toronto, Rob Ford, may be re-elected.
Few are willing to admit their role in this state of affairs, but they will gladly see the ill in others. Even fewer, including often myself, will admit that they don’t really know how to think through a challenge, political or otherwise. This may seem absurd, thinking feels as natural as walking, but the formation of political opinion is a complex affair, a flawed duet between our minds and outside input. Media, government propaganda, family, culture, and our own unique set of personal experiences, from traumas to chance meetings, all play into the mix. High states of emotion, “excitement”, also weigh in, making us dumb and easily manipulated….
This step may also be a precursor for another that involves the ordinary person. Today being a citizen involves occasional voting, politics as spectator sport, and, among some, being a watchdog against corruption or street activism. What may be required is more citizens’ participation in local democracy, not just in assemblies or casting votes, but in local management and administration.
This will help people understand the complexities of politics, gain greater responsibility, and mitigate some of the vices of centralisation and representative democracy. It may also harmonise with the information age, where everyone, it seems, wishes to be empowered.
Do people have time in their busy lives? A rotational involvement in local affairs can help solve this, and many might even find the engagement enjoyable. This injection of a real citizen into the mix may improve the future of politics while large institutions continue to hum their tune.
In the end, a citizen who has responsibility for his actions can probably make any structure work, while rejecting any that would endanger his independence and dignity. The rise of a more intelligent and committed citizen may clarify politics, improve liberal democracies, and make populism and authoritarianism less appealing and likely paths.”

Social Media as Government Watchdog


Gordon Crovitz in the Wall Street Journal: “Two new data points for the debate on whether greater access to the Internet leads to more freedom and fewer authoritarian regimes:

According to reports last week, Facebook plans to buy a company that makes solar-powered drones that can hover for years at high altitudes without refueling, which it would use to bring the Internet to parts of the world not yet on the grid. In contrast to this futuristic vision, Russia evoked land grabs of the analog Soviet era by invading Crimea after Ukrainians forced out Vladimir Putin‘s ally as president.
Internet idealists can point to another triumph in helping bring down Ukraine’s authoritarian government. Ukrainian citizens ignored intimidation including officious text messages: “Dear subscriber, you are registered as a participant in a mass disturbance.” Protesters made the most of social media to plan demonstrations and avoid attacks by security forces.
But Mr. Putin quickly delivered the message that social media only goes so far against a fully committed authoritarian. His claim that he had to invade to protect ethnic Russians in Crimea was especially brazen because there had been no loud outcry, on social media or otherwise, among Russian speakers in the region.
A new book reports the state of play on the Internet as a force for freedom. For a decade, Emily Parker, a former Wall Street Journal editorial-page writer and State Department staffer, has researched the role of the Internet in China, Cuba and Russia. The title of her book, “Now I Know Who My Comrades Are,” comes from a blogger in China who explained to Ms. Parker how the Internet helps people discover they are not alone in their views and aspirations for liberty.
Officials in these countries work hard to keep critics isolated and in fear. In Russia, Ms. Parker notes, there is also apathy because the Putin regime seems so entrenched. “Revolutions need a spark, often in the form of a political or economic crisis,” she observes. “Social media alone will not light that spark. What the Internet does create is a new kind of citizen: networked, unafraid, and ready for action.”
Asked about lessons from the invasion of Crimea, Ms. Parker noted that the Internet “chips away at Russia’s control over information.” She added: “Even as Russian state media tries to shape the narrative about Ukraine, ordinary Russians can go online to seek the truth.”
But this same shared awareness may also be accelerating a decline in U.S. influence. In the digital era, U.S. failure to make good on its promises reduces the stature of Washington faster than similar inaction did in the past.
Consider the Hungarian uprising of 1956, the first significant rebellion against Soviet control. The U.S. secretary of state, John Foster Dulles, said: “To all those suffering under communist slavery, let us say you can count on us.” Yet no help came as Soviet tanks rolled into Budapest, tens of thousands were killed, and the leader who tried to secede from the Warsaw Pact, Imre Nagy, was executed.
There were no Facebook posts or YouTube videos instantly showing the result of U.S. fecklessness. In the digital era, scenes of Russian occupation of Crimea are available 24/7. People can watch Mr. Putin’s brazen press conferences and see for themselves what he gets away with.
The U.S. stood by as Syrian civilians were massacred and gassed. There was instant global awareness when President Obama last year backed down from enforcing his “red line” when the Syrian regime used chemical weapons. American inaction in Syria sent a green light for Mr. Putin and others around the world to act with impunity.
Just in recent weeks, Iran tried to ship Syrian rockets to Gaza to attack Israel; Moscow announced it would use bases in Cuba, Venezuela and Nicaragua for its navy and bombers; and China budgeted a double-digit increase in military spending as President Obama cut back the U.S. military.
All institutions are more at risk in this era of instant communication and awareness. Reputations get lost quickly, whether it’s a misstep by a company, a gaffe by a politician, or a lack of resolve by an American president.
Over time, the power of the Internet to bring people together will help undermine authoritarian governments. But as Mr. Putin reminds us, in the short term a peaceful world depends more on a U.S. resolute in using its power and influence to deter aggression.”

Are Cities Losing Control Over 'Smart' Initiatives?


Opinion by Alex Marshall in GovTech: “From the thermostats on our walls to the sensors under the asphalt of our streets, digital technology – the so-called Internet of things – is pervading and infecting every aspect of our lives.
As this technology comes to cities, whether lazy suburban ones or frenetic urban centers, it is increasingly wearing the banner of “Smart Cities.” Like those other S-words and phrases, such as smart growth and sustainability, a smart city can be just about anything to anybody, and therein lies both its utility and danger. I use the term to mean the marrying of our places with the telecommunications revolution that has took hold over the last half century, including the silicon chip, the Internet, the fiber optic line and broadband networks.
Because this transformation is so broad and deep, it’s impossible to list or even dream of all the different ways we will reshape our communities, any more than we could 100 years ago name all the ways the then-new technologies of electricity or phone service would be employed. But we can list some of the ways digital technologies are being used right now. It’s sensors in sewers, face-recognizing cameras in plazas, and individual streetlights being controlled through a dial in an office at City Hall. It’s entire new cities arising out of the ground, like Songdo in South Korea or others in the Middle East….
But as wondrous as these new technologies are, we should remember an old truth: Whether it’s the silicon chip or the entire Internet, they are just tools that deliver power and possibilities to whoever wields them. So, it’s important to know and to think about who will and should control these tools. A policeman can use street cameras with facial recognition software to look for a thief, or a dictator can use them to hunt for dissidents. So far, different cities even within the same country are answering that question differently.”

This algorithm can predict a revolution


Russell Brandom at the Verge: “For students of international conflict, 2013 provided plenty to examine. There was civil war in Syria, ethnic violence in China, and riots to the point of revolution in Ukraine. For those working at Duke University’s Ward Lab, all specialists in predicting conflict, the year looks like a betting sheet, full of predictions that worked and others that didn’t pan out.

Guerrilla campaigns intensified, proving out the prediction

When the lab put out their semiannual predictions in July, they gave Paraguay a 97 percent chance of insurgency, largely based on reports of Marxist rebels. The next month, guerrilla campaigns intensified, proving out the prediction. In the case of China’s armed clashes between Uighurs and Hans, the models showed a 33 percent chance of violence, even as the cause of each individual flare-up was concealed by the country’s state-run media. On the other hand, the unrest in Ukraine didn’t start raising alarms until the action had already started, so the country was left off the report entirely.

According to Ward Lab’s staff, the purpose of the project isn’t to make predictions but to test theories. If a certain theory of geopolitics can predict an uprising in Ukraine, then maybe that theory is onto something. And even if these specialists could predict every conflict, it would only be half the battle. “It’s a success only if it doesn’t come at the cost of predicting a lot of incidents that don’t occur,” says Michael D. Ward, the lab’s founder and chief investigator, who also runs the blog Predictive Heuristics. “But it suggests that we might be on the right track.”

If a certain theory of geopolitics can predict an uprising in Ukraine, maybe that theory is onto something

Forecasting the future of a country wasn’t always done this way. Traditionally, predicting revolution or war has been a secretive project, for the simple reason that any reliable prediction would be too valuable to share. But as predictions lean more on data, they’ve actually become harder to keep secret, ushering in a new generation of open-source prediction models that butt against the siloed status quo.

Will this country’s government face an acute existential threat in the next six months?

The story of automated conflict prediction starts at the Defense Advance Research Projects Agency, known as the Pentagon’s R&D wing. In the 1990s, DARPA wanted to try out software-based approaches to anticipating which governments might collapse in the near future. The CIA was already on the case, with section chiefs from every region filing regular forecasts, but DARPA wanted to see if a computerized approach could do better. They looked at a simple question: will this country’s government face an acute existential threat in the next six months? When CIA analysts were put to the test, they averaged roughly 60 percent accuracy, so DARPA’s new system set the bar at 80 percent, looking at 29 different countries in Asia with populations over half a million. It was dubbed ICEWS, the Integrated Conflict Early Warning System, and it succeeded almost immediately, clearing 80 percent with algorithms built on simple regression analysis….

On the data side, researchers at Georgetown University are cataloging every significant political event of the past century into a single database called GDELT, and leaving the whole thing open for public research. Already, projects have used it to map the Syrian civil war and diplomatic gestures between Japan and South Korea, looking at dynamics that had never been mapped before. And then, of course, there’s Ward Lab, releasing a new sheet of predictions every six months and tweaking its algorithms with every development. It’s a mirror of the same open-vs.-closed debate in software — only now, instead of fighting over source code and security audits, it’s a fight over who can see the future the best.”

The Problem With Serious Games–Solved


Emerging Technology From the arXiv:” Serious games are becoming increasingly popular but the inability to generate realistic new content has hampered their progress. Until now.

Here’s an imaginary scenario: you’re a law enforcement officer confronted with John, a 21-year-old male suspect who is accused of breaking into a private house on Sunday evening and stealing a laptop, jewellery and some cash. Your job is to find out whether John has an alibi and if so whether it is coherent and believable.
That’s exactly the kind of scenario that police officers the world over face on a regular basis. But how do you train for such a situation? How do you learn the skills necessary to gather the right kind of information?
An increasingly common way of doing this is with serious games, those designed primarily for purposes other than entertainment. In the last 10 years or so, medical, military and commercial organisations all over the world began to experiment with game-based scenarios that are designed to teach people how to perform their jobs and tasks in realistic situations.
But there is a problem with serious games which require realistic interaction is with another person. It’s relatively straightforward to design one or two scenarios that are coherent, lifelike and believable but it’s much harder to generate them continually on an ongoing basis.
Imagine in the example above, that John is a computer-generated character. What kind of activities could he describe that would serve as a believable, coherent alibi for Sunday evening? And how could he do it a thousand times, each describing a different realistic alibi. Therein lies the problem.
Today, Sigal Sina at Bar-Ilan University in Israel, and a couple pals, say they’ve solved this probelm. These guys have come up with a novel way of generating ordinary, realistic scenarios that can be cut and pasted into a serious game to serve exactly this purpose. The secret sauce in their new approach is to crowdsource the new scenarios from real people using Amazon’s Mechanical Turk service.
The approach is straightforward. Sina and co simply ask Turkers to answer a set of questions asking what they did during each one-hour period throughout various days, offering bonuses to those who provide the most varied detail.
They then analyse the answers, categorising activities by factors such as the times they are performed, the age and sex of the person doing it, the number of people involved and so on.
This then allows a computer game to cut and paste activities into the action at appropriate times. So for example, the computer can select an appropriate alibi for John on a Sunday evening by choosing an activity described by a male Turker for the same time while avoiding activitiesthat a woman might describe for a Friday morning, which might otherwise seem unbelievable. The computer also changes certain details in the narrative, such as names, locations and so on to make the narrative coherent with John’s profile….
That solves a significant problem with serious games. Until now, developers have had to spend an awful lot of time producing realistic content, a process known as procedural content generation. That’s always been straightforward for things like textures, models and terrain in game settings. Now, thanks to this new crowdsourcing technique, it can be just as easy for human interactions in serious games too.
Ref:  arxiv.org/abs/1402.5034 : Using the Crowd to Generate Content for Scenario-Based Serious-Games”