Big Data. Big Obstacles.


Dalton Conley et al. in the Chronicle of Higher Education: “After decades of fretting over declining response rates to traditional surveys (the mainstay of 20th-century social research), an exciting new era would appear to be dawning thanks to the rise of big data. Social contagion can be studied by scraping Twitter feeds; peer effects are tested on Facebook; long-term trends in inequality and mobility can be assessed by linking tax records across years and generations; social-psychology experiments can be run on Amazon’s Mechanical Turk service; and cultural change can be mapped by studying the rise and fall of specific Google search terms. In many ways there has been no better time to be a scholar in sociology, political science, economics, or related fields.

However, what should be an opportunity for social science is now threatened by a three-headed monster of privatization, amateurization, and Balkanization. A coordinated public effort is needed to overcome all of these obstacles.

While the availability of social-media data may obviate the problem of declining response rates, it introduces all sorts of problems with the level of access that researchers enjoy. Although some data can be culled from the web—Twitter feeds and Google searches—other data sit behind proprietary firewalls. And as individual users tune up their privacy settings, the typical university or independent researcher is increasingly locked out. Unlike federally funded studies, there is no mandate for Yahoo or Alibaba to make its data publicly available. The result, we fear, is a two-tiered system of research. Scientists working for or with big Internet companies will feast on humongous data sets—and even conduct experiments—and scholars who do not work in Silicon Valley (or Alley) will be left with proverbial scraps….

To address this triple threat of privatization, amateurization, and Balkanization, public social science needs to be bolstered for the 21st century. In the current political and economic climate, social scientists are not waiting for huge government investment like we saw during the Cold War. Instead, researchers have started to knit together disparate data sources by scraping, harmonizing, and geo­coding any and all information they can get their hands on.

Currently, many firms employ some well-trained social and behavioral scientists free to pursue their own research; likewise, some companies have programs by which scholars can apply to be in residence or work with their data extramurally. However, as Facebook states, its program is “by invitation only and requires an internal Facebook champion.” And while Google provides services like Ngram to the public, such limited efforts at data sharing are not enough for truly transparent and replicable science….(More)”

 

Contest Aims to Harness Low-Cost Devices to Help the Poor


Steve Lohr in the New York Times: “The timing and technology are right to bring the power of digital sensing to the poor to improve health, safety and education.

That is the animating assumption behind a new project announced on Tuesday. The initiative is led by Unicef and ARM, the British chip designer whose microprocessors power most smartphones and tablets. They are being joined by Frog, the San Francisco-based product strategy and design firm, along with people described as coaches and advisers from companies and organizations including Google, Orange, Singularity University, the Red Cross and the Senseable City Lab at the Massachusetts Institute of Technology.

The long-term ambition is to jump-start an industrial ecosystem for sensing and data technology that serves the needs of mothers and children in developing nations.

The project, called Wearables for Good, is beginning with a contest to generate ideas. Applications can be submitted online on the project’s website until August 4. Two winners will be selected in the fall. Each will receive $15,000, and assistance and advice from ARM, Frog and others on translating their ideas into a product and perhaps a company.

The online application lists the required characteristics for device ideas. They should be, according to the form, “cost-effective, rugged and durable, low-power and scalable.” The form offers no price limits, but it is safe to assume the project is looking for devices priced far less than an Apple Watch or a Fitbit device.

…. the Wearables for Good project goes further, focusing less on aggregated data and more on personal monitoring. “This is the next level of what we’re doing,” said Erica Kochi, co-founder of Unicef Innovation, which pursues technology initiatives that advance the agency’s goals….(More)”

From Paint to Pixels


Jacoba Urist at the Atlantic: “A growing number of artists are using data from self-tracking apps in their pieces, showing that creative work is as much a product of its technology as of its time….A growing community of “data artists” is creating conceptual works using information collected by mobile apps, GPS trackers, scientists, and more.

Data artists generally fall into two groups: those who work with large bodies of scientific data and those who are influenced by self-tracking. The Boston-based artist Nathalie Miebach falls into the former category: She transforms weather patterns into complex sculptures and musical scores. Similarly, David McCandless, who believes the world suffers from a “data glut,” turns military spending budgets into simple, striking diagrams. On one level, the genre aims to translate large amounts of information into some kind of aesthetic form. But a number of artists, scholars, and curators also believe that working with this data isn’t just a matter of reducing human beings to numbers, but also of achieving greater awareness of complex matters in a modern world….

Current tools make self-tracking more efficient than ever, but data artists are hardly the first to express themselves through their daily activities—or to try to find meaning within life’s monotony. The Italian Mannerist painter Jacopo Pontormo kept records of his daily life from January 1554 to October 1556. In it, he detailed the amount of food he ate, the weather, symptoms of illness, friends he visited, even his bowel movements. In the 1970s, the Japanese conceptualistOn Kawara produced his self-observation series, I Got Up, I Went, and I Met(recently shown at the Guggenheim), in which he painstakingly records the rhythms of his day. Kawara stamped postcards with the time he awoke, traced his daily trips onto photocopied maps, and listed the names of people he encountered for nearly 12 years….(More)

How to Get People to Pitch In


Erez Yoeli, Syon Bhanot, Gordon Kraft-Todd And David Rand in The New York Times: “…The “Pigouvian” approach to encouraging cooperation, named after the economist who first suggested it nearly a century ago, is to change the price — i.e., the personal cost of cooperating: Make water more expensive, tax carbon or pay people to vaccinate their kids.

But Californians are stubbornly unresponsive to higher water prices. Estimates suggest that a 10 percent increase in price would result in reductions in water use of 2 to 4 percent. That’s not nothing, but it implies that huge, politically infeasible price increases would be needed to address the state’s needs.

This problem isn’t unique to Californians and their effort to save water. In a recent review of field experiments that promote cooperation in the journal Current Opinion in Behavioral Sciences, we found that changing the material costs and benefits of cooperation often doesn’t work. Researchers have tried various forms of payments — paying cash, handing out T-shirts — and they’ve tried providing information on how to cooperate, with only limited success.

What does consistently work may be surprising: interventions based not on money, but on leveraging social concerns.

There are two ways to do this, both building on people’s desire for others to think highly of them. One is to make people’s cooperative (or selfish) choices more observable to others, like neighbors or co-workers. The second works in the opposite direction, providing people with information about how others around them are behaving (this is called a “descriptive social norm”).

To see how this might work, consider the California drought. The state could set up a website where homeowners pledge publicly to reduce their water consumption by 15 percent. Those who do would get a lawn sign that would say something like, “My lawn is yellow because I took a pledge to help California. Join me at yellowlawns.ca.gov.”

And what about norms? Innovative companies and public utilities are already on the case. A San Francisco-based firm, WaterSmart Software, sends mailers that allow homeowners to compare their water use to their neighbors’. Estimates suggest that these mailers reduce water use by 2 to 5 percent — the same as a 10 percent price increase.

Why do social interventions work? Research on the evolution of cooperation provides an answer. Beyond helping our families — the people to whom we’re genetically related — making others better off is not our main motivation to give. Instead, we cooperate because it makes us look good. This can be going on consciously or, more often, subconsciously (a gut feeling of guilt when your neighbor sees you turning on your sprinkler).

When your choices are observable by others, it makes it possible for good actions to benefit your reputation. Similarly, norms make you feel you’re expected to cooperate in a given situation, and that people may think poorly of you if they learn you are not doing your part….(More)”

Chicago uses new technology to solve this very old urban problem


 at Fortune: “Chicago has spent 12 years collecting data on resident complaints. Now the city is harnessing that data to control the rat population, stopping infestations before residents spot rats in the first place.

For the past three years, Chicago police have been analyzing 911 calls to better predict crime patterns across the city and, in one case, actually forecasted a shootout minutes before it occurred.

Now, the city government is turning its big data weapons on the city’s rat population.

The city has 12 years of data on the resident complaints, ranging from calls about rodent sitting to graffiti. Those clusters of data lead the engineers to where the rats can potentially breed. The report is shared with the city’s sanitation team, which later cleans up the rat-infested areas.

“We discovered really interesting relationship that led to developing an algorithm about rodent prediction,” says Brenna Berman, Chicago’s chief information officer. “It involved 31 variables related to calls about overflowing trash bins and food poisoning in restaurants.”

The results, Berman says, are 20% more efficient versus the old responsive model.

Governing cities in the 21st century is a difficult task. It needs a political and economic support. In America, it was only in the early 1990s—when young adults started moving from the suburbs back to the cities—that the academic and policy consensus shifted back toward urban centers. Since then, cities are facing an influx of new residents, overwhelming the service providing agencies. To meet that demand amid the recent budget sequestration, cities like New York, San Francisco, Philadelphia, and Chicago are constantly elevating the art of governance through innovative policies.

Due to this new model, in Chicago, you might not even spot a rat. The city’s Department of Innovation and Technology analyzes big chunks of data to an extent where the likelihood of a rodent infestation is thwarted seven days ahead of resident rat-sightings…(More)”

Detroit Revitalizes City with 311 App


Jason Shueh at Government Technology: “In the wake of the Detroit bankruptcy, blight sieged parts of the city as its populous exited. The fallouts were typical. There was a run of vandalism, thefts, arson and graffiti. Hard times pushed throngs of looters into scores of homes to scavenge for anything that wasn’t bolted down — and often, even for the things that were…. For solutions, Detroit Mayor Mike Duggan and DWSD’s CIO Dan Rainey partnered with SeeClickFix. The company, based in New Haven, Conn., is known for its mobile platform that’s embedded itself as a conduit between city service departments and citizen non-emergency — or 311 — requests. Duggan saw the platform as an opportune answer to address more than a single issue. Instead, the mayor asked how the app could be integrated throughout the city. Potholes, downed trees, graffiti, missing signage, streetlight outages — the mayor wanted a bundled solution to handle an array of common challenges.

Improve Detroit was his answer. The city app, officially available since April, allows citizens to report problems using photos, location data and by request type. Notifications on progress follow and residents can even pay utility bills through the app. For departments, it’s ingrained into work orders and workflows, while analytics provide data for planning, and filters permit a deep-dive analysis….

improve detroit app

Detroit now sits among many metropolitan cities pioneering such 311 apps. San Francisco, New York, Los Angeles, Philadelphia and Chicago are just a few of them. And there are a host of equally adroit tech providers supplying and supporting the apps — companies like Salesforce, CitySourced, PublicStuff, Fix 311 and others. Some cities have even developed their own apps through their internal IT departments.

What’s unique in Detroit is the city’s ambition to leverage a 311 app against major blight while the city works to demolish more than 20,000 abandoned homes — susceptible to fire, flooding, pest infestations and criminal activity. Beyond this, Lingholm said the initiative doubles as a tool to rejuvenate public trust. Data from the app is fed to the city’s new open data portal, and departments have set goals to ensure responsiveness….(More)

What’s gone wrong with democracy


Essay in The Economist: “Democracy was the most successful political idea of the 20th century. Why has it run into trouble, and what can be done to revive it?….

Even those lucky enough to live in mature democracies need to pay close attention to the architecture of their political systems. The combination of globalisation and the digital revolution has made some of democracy’s most cherished institutions look outdated. Established democracies need to update their own political systems both to address the problems they face at home, and to revitalise democracy’s image abroad. Some countries have already embarked upon this process. America’s Senate has made it harder for senators to filibuster appointments. A few states have introduced open primaries and handed redistricting to independent boundary commissions. Other obvious changes would improve matters. Reform of party financing, so that the names of all donors are made public, might reduce the influence of special interests. The European Parliament could require its MPs to present receipts with their expenses. Italy’s parliament has far too many members who are paid too much, and two equally powerful chambers, which makes it difficult to get anything done.

But reformers need to be much more ambitious. The best way to constrain the power of special interests is to limit the number of goodies that the state can hand out. And the best way to address popular disillusion towards politicians is to reduce the number of promises they can make. The key to a healthier democracy, in short, is a narrower state—an idea that dates back to the American revolution. “In framing a government which is to be administered by men over men”, Madison argued, “the great difficulty lies in this: you must first enable the government to control the governed; and in the next place oblige it to control itself.” The notion of limited government was also integral to the relaunch of democracy after the second world war. The United Nations Charter (1945) and the Universal Declaration of Human Rights (1948) established rights and norms that countries could not breach, even if majorities wanted to do so.

These checks and balances were motivated by fear of tyranny. But today, particularly in the West, the big dangers to democracy are harder to spot. One is the growing size of the state. The relentless expansion of government is reducing liberty and handing ever more power to special interests. The other comes from government’s habit of making promises that it cannot fulfil, either by creating entitlements it cannot pay for or by waging wars that it cannot win, such as that on drugs. Both voters and governments must be persuaded of the merits of accepting restraints on the state’s natural tendency to overreach. Giving control of monetary policy to independent central banks tamed the rampant inflation of the 1980s, for example. It is time to apply the same principle of limited government to a broader range of policies. Mature democracies, just like nascent ones, require appropriate checks and balances on the power of elected government….

Several places are making progress towards getting this mixture right. The most encouraging example is California. Its system of direct democracy allowed its citizens to vote for contradictory policies, such as higher spending and lower taxes, while closed primaries and gerrymandered districts institutionalised extremism. But over the past five years California has introduced a series of reforms, thanks in part to the efforts of Nicolas Berggruen, a philanthropist and investor. The state has introduced a “Think Long” committee to counteract the short-term tendencies of ballot initiatives. It has introduced open primaries and handed power to redraw boundaries to an independent commission. And it has succeeded in balancing its budget—an achievement which Darrell Steinberg, the leader of the California Senate, described as “almost surreal”.

Similarly, the Finnish government has set up a non-partisan commission to produce proposals for the future of its pension system. At the same time it is trying to harness e-democracy: parliament is obliged to consider any citizens’ initiative that gains 50,000 signatures. But many more such experiments are needed—combining technocracy with direct democracy, and upward and downward delegation—if democracy is to zigzag its way back to health.

John Adams, America’s second president, once pronounced that “democracy never lasts long. It soon wastes, exhausts and murders itself. There never was a democracy yet that did not commit suicide.” He was clearly wrong. Democracy was the great victor of the ideological clashes of the 20th century. But if democracy is to remain as successful in the 21st century as it was in the 20th, it must be both assiduously nurtured when it is young—and carefully maintained when it is mature….(More)

Digital Democracy


Digital Democracy is a product of the Institute for Advanced Technology and Public Policy. The new online platform features a searchable database of California state legislative committees hearings, allowing the user to search videos by keyword, topic, speaker or date. Digital Democracy is a first of its kind tool because it will transcribe all legislative hearing videos and will make the transcriptions available to users in their searchable entirety. These data rich transcripts represent an entirely new data set that is currently unavailable to the public. Additionally, sophisticated meta tags attached to the transcripts will enable users to run in depth analytics to identify trends and relationships. A robust database of all speakers will track individual participants’ testimony, positions, and donation and gift histories.

This project is pushing beyond the technical challenges of providing mere access to information, instead focusing on how this new data set can be meaningfully interpreted and acted upon. Tools within the system will allow a user to quickly and easily search, locate, view, clip, and share this information and opinions on Facebook, Twitter, YouTube, Google+, and other social media platforms. The video clips will provide dynamic content for grassroots mobilizers, online media outlets, bloggers, professional associations, and government watchdogs.

Digital Democracy has been deployed as a one year beta to provide searchable video files of available California state committee hearings for the 2015 legislative year….(More)”

Cops Increasingly Use Social Media to Connect, Crowdsource


Sara E. Wilson at GovTech: “Law enforcement has long used public tip lines and missing persons bulletins to recruit citizens in helping solve crime and increasing public safety. Though the need for police departments to connect with their communities is nothing new, the array of technologies available to do so is growing all the time — as are the ways in which departments use those technologies.

In fact, 81 percent of law enforcement professionals use sites such as Facebook and Twitter on the job. And 25 percent use it daily.

Much of law enforcement is crowdsourced — Amber alerts are pushed to smartphones, seeking response from citizens; officers push wanted information and crime tips to users on Facebook and Twitter in the hopes they can help; and some departments create apps to streamline the information sharing.

Take the Johns Creek, Ga., Police Department, which has deployed a tool that allows additional citizen engagement and crowdsourcing…..Using a mobile app — the SunGard Public Sector P2C Converge app, which is branded specifically for Johns Creek PD as JCPD4Me — the department can more smoothly manage public safety announcements and other social media interactions….

Another tool cops use for communicating with citizens is Nixle, which lets agencies publish alerts, advisories, community information and traffic news. Citizens register for free and receive credible, neighborhood-level public safety information via text message and email in real time.

The Oakland, Calif., Police Department (OPD) uses the platform to engage with citizens — an April 17, 2015 post on Oakland PD’s Nixle Community feed informs readers that the department’s Special Victims Section, which is working to put an end to sex trafficking in the city, arrested five individuals for solicitation of prostitution. Since Jan. 1, 2015, OPD has arrested 70 individuals from 27 cities across the state for solicitation of prostitution.

Nixle allows two-way communication as well — the Tip Watch function allows anonymous tipsters to send information to Oakland PD in three ways (text, phone, Web). Now OPD can issue a passcode to tipsters for two-way, anonymous communication to help gather more information.

On the East Coast, the Peabody, Mass., Police Department has used the My Police Department (MyPD) app by WiredBlue, which lets citizens submit tips and feedback directly to the department, since its creation….

During the high-profile manhunt for the Boston Marathon bombers in 2013, the FBI asked the public for eyewitness photo and video evidence. The response from the public was so overwhelming that the server infrastructure couldn’t handle the massive inflow of data.

This large-scale crowdsourcing and data dilemma inspired a new product: the Los Angeles Sheriff’s Department’s Large Emergency Event Digital Information Repository (LEEDIR). Developed by CitizenGlobal Inc. and Amazon Web Services, LEEDIR pairs an app with cloud storage to help police use citizens’ smartphones as tools to gather and investigate evidence. Since its creation, the repository was used in Santa Barbara, Calif., in 2014 to investigate riots in Isla Vista.

Proponents of LEEDIR say the crowdsourcing system gives authorities a secure, central repository for the countless electronic tips that can come in during a crisis. Critics, however, claim that privacy issues come into play with this kind of policing. …(More)”

Worldwide accessibility map is crowdsourced by users


Springwise: “There are a growing number of apps such as Handimap and Blue Badge Style which offer city guides for users in wheelchairs — informing them which venues are accessible and which do not have disabled facilities. AXS Map does the same, but utilizes crowdsourced information to cover a much wider range of places and venues.

AXS Map is a free app, hailing from Canada, which aims to make the world a more accessible place for those with mobility problems. Users can access the platform via smartphone or desktop: they can browse any given area for accessible restaurants, shops, public restrooms or anything else via the searchable map. The database is made up of crowdsourced reviews submitted by the users themselves and includes ratings and information about entryways and restrooms.

The organization also host Mapathons, which aim to get new communities in towns and cities which are not yet covered involved: participants are encouraged to form teams and compete to see who can rate the most venues in a given area. Mapathons have taken place all over the USA and there are upcoming events in New York and Istanbul. Where should the AXS Mappers head next?” (More: AXS Map)