Why Google’s Waze Is Trading User Data With Local Governments

Curated on Posted on by Stefaan Verhulst

Parmy Olson at Forbes: “In Rio de Janeiro most eyes are on the final, nail-biting matches of the World Cup. Over in the command center of the city’s department of transport though, they’re on a different set of screens altogether.

Planners there are watching the aggregated data feeds of thousands of smartphones being walked or driven around a city, thanks to two popular travel apps, Waze and Moovit.

The goal is traffic management, and it involves swapping data for data. More cities are lining up to get access, and while the data the apps are sharing is all anonymous for now, identifying details could get more specific if cities like what they see, and people become more comfortable with being monitored through their smartphones in return for incentives.

Rio is the first city in the world to collect real-time data both from drivers who use the Waze navigation app and pedestrians who use the public-transportation app Moovit, giving it an unprecedented view on thousands of moving points across the sprawling city. Rio is also talking to the popular cycling app Strava to start monitoring how cyclists are moving around the city too.

All three apps are popular, consumer services which, in the last few months, have found a new way to make their crowdsourced data useful to someone other than advertisers. While consumers use Waze and Moovit to get around, both companies are flipping the use case and turning those millions of users into a network of sensors that municipalities can tap into for a better view on traffic and hazards. Local governments can also use these apps as a channel to send alerts.

On an average day in June, Rio’s transport planners could get an aggregated view of 110,000 drivers (half a million over the course of the month), and see nearly 60,000 incidents being reported each day – everything from built-up traffic, to hazards on the road, Waze says. Till now they’ve been relying on road cameras and other basic transport-department information.

What may be especially tantalizing for planners is the super-accurate read Waze gets on exactly where drivers are going, by pinging their phones’ GPS once every second. The app can tell how fast a driver is moving and even get a complete record of their driving history, according to Waze spokesperson Julie Mossler. (UPDATE: Since this story was first published Waze has asked to clarify that it separates users’ names and their 30-day driving info. The driving history is categorized under an alias.)

This passively-tracked GPS data “is not something we share,” she adds. Waze, which Google bought last year for $1.3 billion, can turn the data spigots on and off through its application programing interface (API).

Waze has been sharing user data with Rio since summer 2013 and it just signed up the State of Florida. It says more departments of transport are in the pipeline.

But none of these partnerships are making Waze any money. The app’s currency of choice is data. “It’s a two-way street,” says Mossler. “Literally.”

In return for its user updates, Waze gets real-time information from Rio on highways, from road sensors and even from cameras, while Florida will give the app data on construction projects or city events.

Florida’s department of transport could not be reached for comment, but one of its spokesmen recently told a local news station: “We’re going to share our information, our camera images, all of our information that comes from the sensors on the roadway, and Waze is going to share its data with us.”…

To get Moovit’s data, municipalities download a web interface that gives them an aggregated view of where pedestrians using Moovit are going. In return, the city feeds Moovit’s database with a stream of real-time GPS data for buses and trains, and can issue transport alerts to Moovit’s users. Erez notes the cities aren’t allowed to make “any sort of commercial approach to the users.”

Erez may be saving that for advertisers, an avenue he says he’s still exploring. For now getting data from cities is the bigger priority. It gives Moovit “a competitive advantage,” he says.

Cycling app Strava also recently started sharing its real-time user data as part of a paid-for service called Strava Metro.

Municipalities pay 80 cents a year for every Strava member being tracked. Metro only launched in May, but it already counts the state of Oregon; London, UK; Glasgow, Scotland; Queensland, Austalia and Evanston, Illinois as customers.
….
Privacy advocates will naturally want to keep a wary eye on what data is being fed to cities, and that it doesn’t leak or get somehow misused by City Hall. The data-sharing might not be ubiquitous enough for that to be a problem yet, and it should be noted that any kind of deal making with the public sector can get wrapped up in bureaucracy and take years to get off the ground.

For now Waze says it’s acting for the public good….(More)

The perils of extreme democracy

Curated on Posted on by Stefaan Verhulst

The Economist: “California cannot pass timely budgets even in good years, which is one reason why its credit rating has, in one generation, fallen from one of the best to the absolute worst among the 50 states. How can a place which has so much going for it—from its diversity and natural beauty to its unsurpassed talent clusters in Silicon Valley and Hollywood—be so poorly governed? ….But as our special report this week argues, the main culprit has been direct democracy: recalls, in which Californians fire elected officials in mid-term; referendums, in which they can reject acts of their legislature; and especially initiatives, in which the voters write their own rules. Since 1978, when Proposition 13 lowered property-tax rates, hundreds of initiatives have been approved on subjects from education to the regulation of chicken coops.

This citizen legislature has caused chaos. Many initiatives have either limited taxes or mandated spending, making it even harder to balance the budget. Some are so ill-thought-out that they achieve the opposite of their intent: for all its small-government pretensions, Proposition 13 ended up centralising California’s finances, shifting them from local to state government. Rather than being the curb on elites that they were supposed to be, ballot initiatives have become a tool of special interests, with lobbyists and extremists bankrolling laws that are often bewildering in their complexity and obscure in their ramifications. And they have impoverished the state’s representative government. Who would want to sit in a legislature where 70-90% of the budget has already been allocated?

This has been a tragedy for California, but it matters far beyond the state’s borders. Around half of America’s states and an increasing number of countries have direct democracy in some form (article). Next month Britain will have its first referendum for years (on whether to change its voting system), and there is talk of voter recalls for aberrant MPs. The European Union has just introduced the first supranational initiative process. With technology making it ever easier to hold referendums and Western voters ever more angry with their politicians, direct democracy could be on the march.

And why not? There is, after all, a successful model: in Switzerland direct democracy goes back to the Middle Ages at the local level and to the 19th century at the federal. This mixture of direct and representative democracy seems to work well. Surely it is just a case of California (which explicitly borrowed the Swiss model) executing a good idea poorly?

Not entirely. Very few people, least of all this newspaper, want to ban direct democracy. Indeed, in some cases referendums are good things: they are a way of holding a legislature to account. In California reforms to curb gerrymandering and non-partisan primaries, both improvements, have recently been introduced by initiatives; and they were pushed by Arnold Schwarzenegger, a governor elected through the recall process. But there is a strong case for proceeding with caution, especially when it comes to allowing people to circumvent a legislature with citizen-made legislation.

The debate about the merits of representative and direct democracy goes back to ancient times. To simplify a little, the Athenians favoured pure democracy (“people rule”, though in fact oligarchs often had the last word); the Romans chose a republic, as a “public thing”, where representatives could make trade-offs for the common good and were accountable for the sum of their achievements. America’s Founding Fathers, especially James Madison and Alexander Hamilton, backed the Romans. Indeed, in their guise of “Publius” in the “Federalist Papers”, Madison and Hamilton warn against the dangerous “passions” of the mob and the threat of “minority factions” (ie, special interests) seizing the democratic process.

Proper democracy is far more than a perpetual ballot process. It must include deliberation, mature institutions and checks and balances such as those in the American constitution. Ironically, California imported direct democracy almost a century ago as a “safety valve” in case government should become corrupt. The process began to malfunction only relatively recently. With Proposition 13, it stopped being a valve and instead became almost the entire engine.

….More important, direct democracy must revert to being a safety valve, not the engine. Initiatives should be far harder to introduce. They should be shorter and simpler, so that voters can actually understand them. They should state what they cost, and where that money is to come from. And, if successful, initiatives must be subject to amendment by the legislature. Those would be good principles to apply to referendums, too….(More)”

Mission Control: A History of the Urban Dashboard

Curated on Posted on by Stefaan Verhulst

Shannon Mattern at Places: “We know what rocket science looks like in the movies: a windowless bunker filled with blinking consoles, swivel chairs, and shirt-sleeved men in headsets nonchalantly relaying updates from “Houston” to outer space. Lately, that vision of Mission Control has taken over City Hall. NASA meets Copacabana, proclaimed the New York Times, hailing Rio de Janeiro’s Operations Center as a “potentially lucrative experiment that could shape the future of cities around the world.” The Times photographed an IBM executive in front of a seemingly endless wall of screens integrating data from 30 city agencies, including transit video, rainfall patterns, crime statistics, car accidents, power failures, and more. 1

Futuristic control rooms have proliferated in dozens of global cities. Baltimore has its CitiStat Room, where department heads stand at a podium before a wall of screens and account for their units’ performance.  The Mayor’s office in London’s City Hall features a 4×3 array of iPads mounted in a wooden panel, which seems an almost parodic, Terry Gilliam-esque take on the Brazilian Ops Center. Meanwhile, British Prime Minister David Cameron commissioned an iPad app – the “No. 10 Dashboard” (a reference to his residence at 10 Downing Street) – which gives him access to financial, housing, employment, and public opinion data. As The Guardian reported, “the prime minister said that he could run government remotely from his smartphone.”

This is the age of Dashboard Governance, heralded by gurus like Stephen Few, founder of the “visual business intelligence” and “sensemaking” consultancy Perceptual Edge, who defines the dashboard as a “visual display of the most important information needed to achieve one or more objectives; consolidated and arranged on a single screen so the information can be monitored at a glance.” A well-designed dashboard, he says — one that makes proper use of bullet graphs, sparklines, and other visualization techniques informed by the “brain science” of aesthetics and cognition — can afford its users not only a perceptual edge, but a performance edge, too. The ideal display offers a big-picture view of what is happening in real time, along with information on historical trends, so that users can divine the how and why and redirect future action. As David Nettleton emphasizes, the dashboard’s utility extends beyond monitoring “the current situation”; it also “allows a manager to … make provisions, and take appropriate actions.”….

The dashboard market now extends far beyond the corporate world. In 1994, New York City police commissioner William Bratton adapted former officer Jack Maple’s analog crime maps to create the CompStat model of aggregating and mapping crime statistics. Around the same time, the administrators of Charlotte, North Carolina, borrowed a business idea — Robert Kaplan’s and David Norton’s “total quality management” strategy known as the “Balanced Scorecard” — and began tracking performance in five “focus areas” defined by the City Council: housing and neighborhood development, community safety, transportation, economic development, and the environment. Atlanta followed Charlotte’s example in creating its own city dashboard.

In 1999, Baltimore mayor Martin O’Malley, confronting a crippling crime rate and high taxes, designed CitiStat, “an internal process of using metrics to create accountability within his government.” (This rhetoric of data-tested internal “accountability” is prevalent in early dashboard development efforts.) The project turned to face the public in 2003, when Baltimore launched a website of city operational statistics, which inspired DCStat (2005), Maryland’s StateStat (2007), and NYCStat (2008). Since then, myriad other states and metro areas — driven by a “new managerialist” approach to urban governance, committed to “benchmarking” their performance against other regions, and obligated to demonstrate compliance with sustainability agendas — have developed their own dashboards.

The Open Michigan Mi Dashboard is typical of these efforts. The state website presents data on education, health and wellness, infrastructure, “talent” (employment, innovation), public safety, energy and environment, financial health, and seniors. You (or “Mi”) can monitor the state’s performance through a side-by-side comparison of “prior” and “current” data, punctuated with a thumbs-up or thumbs-down icon indicating the state’s “progress” on each metric. Another click reveals a graph of annual trends and a citation for the data source, but little detail about how the data are actually derived. How the public is supposed to use this information is an open question….(More)”

Using open legislative data to map bill co-sponsorship networks in 15 countries

Curated on Posted on by Stefaan Verhulst

François Briatte at OpeningParliament.org: “A few years back, Kamil Gregor published a post under the title “Visualizing politics: Network analysis of bill sponsors”. His post, which focused on the lower chamber of the Czech Parliament, showed how basic social network analysis can support the exploration of parliamentary work, by revealing the ties that members of parliament create between each other through the co-sponsorship of private bills….In what follows, I would like to quickly report on a small research project that I have developed over the years, under the name “parlnet”.

Legislative data on bill co-sponsorship

This project looks at bill co-sponsorship networks in European countries. Many parliaments allow their members to co-sponsor each other’s private bills, which makes it possible to represent these parliaments as collaborative networks, where a tie exists between two MPs if they have co-sponsored legislation together.

This idea is not new: it was pioneered by James Fowler in the United States, and has been the subject of extensive research in American politics, both on the U.S. Congress and on state legislatures. Similar research also exists on the bill co-sponsorship networks of parliaments in Argentina, Chile andRomania.

Inspired by this research and by Baptiste Coulmont’s visualisation of the French lower chamber, I surveyed the parliamentary websites of the following countries:

  • all 28 current members of the European Union ;
  • 4 members of the EFTA: Iceland, Liechtenstein, Norway, and Switzerland

This search returned 19 parliamentary chambers from 15 countries for which it was (relatively) easy to extract legislative data, either through open data portals like data.riksdagen.se in Sweden ordata.stortinget.no in Norway, or from official parliamentary websites directly….After splitting the data into legislative periods separated by nationwide elections, I was able to draw a large collection of networks showing bill co-sponsorship in these 19 chambers….In this graph, each point (or node) is a Belgian MP, and each tie between two MPs indicates that they have co-sponsored at least one bill together. The colors and abbreviations used in the graph are party-related codes, which combine information on the parliamentary group and linguistic community of each MP.Because this kind of graph can be interesting to explore in more detail, I have also built interactive visualizations out of them, in order to show more detailed information on the MPs who participate in bill cosposorship…

The parlnet project was coded in R, and its code is public so that it might benefit from external contributions. The list of countries and chambers that it covers is not exhaustive: in some cases like Portugal, I simply failed to retrieve the data. More talented coders might therefore be able to add to the current database.

Bill cosponsorship networks illustrate how open legislative data provided by parliaments can be turned into interactive tools that easily convey some information about parliamentary work, including, but not limited to:

  • the role of parliamentary party leaders in managing the legislation produced by their groups
  • the impact of partisan discipline and ideology on legislative collaboration between MPs
  • the extent of cross-party cooperation in various parliamentary environments and chambers… (More)

The Data Disclosure Decision

Curated on Posted on by Stefaan Verhulst

“The CIO Council Innovation Committee has released its first Open Data case study, The Data Disclosure Decision, showcasing the Department of Education (Education) Disclosure Review Board.
The Department of Education is a national warehouse for open data across a decentralized educational system, managing and exchanging education related data from across the country. Education collects large amounts of aggregate data at the state, district, and school level, disaggregated by a number of demographic variables. A majority of the data Education collects is considered personally identifiable information (PII), making data disclosure avoidance plans a mandatory component of Education’s data releases. With their expansive data sets and a need to protect sensitive information, Education quickly realized the need to organize and standardize their data disclosure protocol.
Education formally established the Data Disclosure Board with Secretary of Education Arne Duncan signing their Charter in August 2013. Since its inception, the Disclosure Review Board has recognized substantial successes and has greatly increased the volume and quality of data being released. Education’s Disclosure Review Board is continually learning through its open data journey and improving their approach through cultural change and leadership buy-in.
Learn more about Education’s Data Review Board’s story by reading The Data Disclosure Decision where you will find the full account of their experience and what they learned along the way. Read The Data Disclosure Decision “

Apple’s ResearchKit Is a New Way to Do Medical Research

Curated on Posted on by Stefaan Verhulst

Wired: “….Apple announced a new software framework it hopes will help turn the 700 million iPhones in users’ hands into medical diagnostic tools.

ResearchKit is an open-source framework that lets medical researchers create diagnostic apps that tap into the screens and accelerometers on the iPhone, as well as data from HealthKit apps. The first five apps built with ResearchKit are available today, and they’re built to help diagnose various disorders.

Apple Senior Vice President of Operations Jeff Williams detailed some of the specialized applications available at launch. They include the mPower app, which is built to gauge the effects of Parkinsons’ Disease and was developed in conjunction with the University of Rochester, Xuanwu Hospital at Capital Medical University in Beijing, and Sage Bionetworks.

On stage, Williams demoed tests within the app that could measure hand tremors by using an iPhone touchscreen, vocal trembling using the microphone, and a walking balance test.

Williams said he hopes ResearchKit can help address a few problems with medical research in its current state, such as limited patient participation, infrequent data sampling, and one-way communication from the patient to a medical professional. The ResearchKit apps are designed to be more interactive and allow a patient to control when and with whom to share data.

Along with the mPower demo, Williams mentioned a few more apps that will be available immediately for iOS: a diabetes-diagnostic app from Massachusetts General Hospital; an app to diagnose heart disease from Stanford and the University of Oxford; an Asthma Health app from Mount Sinai Hospital and Weill Cornell Medical College; and an app to help victims of breast cancer made by the Dana-Farber Cancer Institute, UCLA School of Public Health, Penn Medicine, and Sage Bionetworks.

Williams also stressed that customers would be able to control the data shared by each ResearchKit app, and that sensitive data would only be visible by medical researchers….(More)”

How Open Is University Data?

Curated on Posted on by Stefaan Verhulst

Daniel Castro  at GovTech: “Many states now support open data, or data that’s made freely available without restriction in a nonproprietary, machine-readable format, to increase government transparency, improve public accountability and participation, and unlock opportunities for civic innovation. To date, 10 states have adopted open data policies, via executive order or legislation, and 24 states have built open data portals. But while many agencies have joined the open data movement, state colleges and universities have largely ignored this opportunity. To remedy this, policymakers should consider how to extend open data policies to state colleges and universities.

There are many potential benefits of open data for higher education. First, it can help prospective students and their parents better understand the value of different degree programs. One way to control rising higher ed costs is to create more informed consumers. The feds are already pushing for such changes. President Obama and Education Secretary Arne Duncan called for schools to make more information publicly available about the costs of obtaining a college degree, and the White House launched the College Scorecard, an online tool to compare data about the average tuition cost, size of loan payments and loan default rate for different schools.

But students deserve more detailed information. Prospective students should be able to decide where to attend and what to study based on historical data like program costs, percentage of students completing the program and how long they take to do so, and what kind of earning power they have after graduating.

Second, open data can aid better fiscal oversight and accountability of university operations. In 2014, states provided about $76 billion in support for higher ed, yet few colleges and universities have adopted open data policies to increase the transparency of their budgets. Contrast this with California cities like Oakland, Palo Alto and Los Angeles, which created online tools to let others explore and visualize their budgets. Additional oversight, including from the public, could help reduce fraud, waste and abuse in higher education, save taxpayers money and create more opportunities for public participation in state budgeting.

Third, open data can be a valuable resource for producing innovations that make universities a better place to work and study. Large campuses are basically small cities, and many cities have found open data useful for improving public safety and optimizing transportation services. Universities hold much untapped data: course catalogs, syllabi, bus schedules, campus menus, campus directories, faculty evaluations, etc. Creating portals to release these data sets and building application programming interfaces to access this information would give developers direct access to data that students, faculty, alumni and other stakeholders could use to build apps and services to improve the college experience….(More)”

Tweets Can Predict Health Insurance Exchange Enrollment

Curated on Posted on by Stefaan Verhulst

PennMedicine: “An increase in Twitter sentiment (the positivity or negativity of tweets) is associated with an increase in state-level enrollment in the Affordable Care Act’s (ACA) health insurance marketplaces — a phenomenon that points to use of the social media platform as a real-time gauge of public opinion and provides a way for marketplaces to quickly identify enrollment changes and emerging issues. Although Twitter has been previously used to measure public perception on a range of health topics, this study, led by researchers at the Perelman School of Medicine at the University of Pennsylvania and published online in the Journal of Medical Internet Research, is the first to look at its relationship with the new national health insurance marketplace enrollment.

The study examined 977,303 ACA and “Obamacare”-related tweets — along with those directed toward the Twitter handle for HealthCare.gov and the 17 state-based marketplace Twitter accounts — in March 2014, then tested a correlation of Twitter sentiment with marketplace enrollment by state. Tweet sentiment was determined using the National Research Council (NRC) sentiment lexicon, which contains more than 54,000 words with corresponding sentiment weights ranging from positive to negative. For example, the word “excellent” has a positive sentiment weight, and is more positive than the word “good,” but the word “awful” is negative. Using this lexicon, researchers found that a .10 increase in the sentiment of tweets was associated with a nine percent increase in health insurance marketplace enrollment at the state level. While a .10 increase may seem small, these numbers indicate a significant correlation between Twitter sentiment and enrollment based on a continuum of sentiment scores that were examined over a million tweets.

“The correlation between Twitter sentiment and the number of eligible individuals who enrolled in a marketplace plan highlights the potential for Twitter to be a real-time monitoring strategy for future enrollment periods,” said first author Charlene A. Wong, MD, a Robert Wood Johnson Foundation Clinical Scholar and Fellow in Penn’s Leonard Davis Institute of Health Economics. “This would be especially valuable for quickly identifying emerging issues and making adjustments, instead of having to wait weeks or months for that information to be released in enrollment reports, for example.”…(More)”

Encyclopedia of Social Network Analysis and Mining

Curated on Posted on by Stefaan Verhulst

“The Encyclopedia of Social Network Analysis and Mining (ESNAM) is the first major reference work to integrate fundamental concepts and research directions in the areas of social networks and  applications to data mining. While ESNAM  reflects the state-of-the-art in  social network research, the field  had its start in the 1930s when fundamental issues in social network research were broadly defined. These communities were limited to relatively small numbers of nodes (actors) and links. More recently the advent of electronic communication, and in particular on-line communities, have created social networks of hitherto unimaginable sizes. People around the world are directly or indirectly connected by popular social networks established using web-based platforms rather than by physical proximity.

Reflecting the interdisciplinary nature of this unique field, the essential contributions of diverse disciplines, from computer science, mathematics, and statistics to sociology and behavioral science, are described among the 300 authoritative yet highly readable entries. Students will find a world of information and insight behind the familiar façade of the social networks in which they participate. Researchers and practitioners will benefit from a comprehensive perspective on the methodologies for analysis of constructed networks, and the data mining and machine learning techniques that have proved attractive for sophisticated knowledge discovery in complex applications. Also addressed is the application of social network methodologies to other domains, such as web networks and biological networks….(More)”

Citizens Connect

Curated on Posted on by Stefaan Verhulst

Harvard Business School Case Study by Mitchell Weiss: “Funding to scale Citizens Connect, Boston’s 311 app, is both a blessing and a burden and tests two public entrepreneurs. In 2012, the Commonwealth of Massachusetts provides Boston’s Mayor’s Office of New Urban Mechanics with a grant to scale Citizens Connect across the state. The money gives two co-creators of Citizens Connect, Chris Osgood and Nigel Jacob, a chance to grow their vision for citizen-engaged governance and civic innovation, but it also requires that the two City of Boston leaders sit on a formal selection committee that pits their original partner, Connected Bits, against another player that might meet the specific requirements for delivering a statewide version. The selection and scaling process raise questions beyond just which partner to choose. What would happen to the Citizens Connect brand as Osgood and Jacob’s product spreads across the state? Who could help scale their work best then nationally? Which business models were best positioned to drive that growth? What intellectual property arrangements would best enable it? And what role should the two city employees have, anyway, in scaling Citizens Connect outside of Boston in the first place? These questions hung in the air as they pondered the one big one about passing over Connected Bits for another partner: should they?…(More)”