Open Data Beyond the Big City


at PBS MediaShift: “…Open data is the future — of how we govern, of how public services are delivered, of how governments engage with those that they serve. And right now, it is unevenly distributed. I think there is a strong argument to be made that data standards can provide a number of benefits to small and midsized municipal governments and could provide a powerful incentive for these governments to adopt open data.
One way we can use standards to drive the adoption of open data is to partner with companies like YelpZillowGoogle and others that can use open data to enhance their services. But how do we get companies with 10s and 100s of millions of users to take an interest in data from smaller municipal governments?
In a word – standards.

Why do we care about cities?

When we talk about open data, it’s important to keep in mind that there is a lot of good work happening at the federal, state and local levels all over the country — plenty of states and even counties doing good things on the open data front, but for me it’s important to evaluate where we are on open data with respect to cities.
States typically occupy a different space in the service delivery ecosystem than cities, and the kinds of data that they typically make available can be vastly different from city data. State capitals are often far removed from our daily lives and we may hear about them only when a budget is adopted or when the state legislature takes up a controversial issue.
In cities, the people that represent and serve us us can be our neighbors — the guy behind you at the car wash, or the woman who’s child is in you son’s preschool class. Cities matter.
As cities go, we need to consider carefully that importance of smaller cities — there are a lot more of them than large cities and a non-trivial number of people live in them….”

The View From Your Window Is Worth Cash to This Company


Eric Jaffe in Atlantic CityLab: “A city window overlooking the street has always been a score in its own right, what with so many apartments stuck opening onto back alleys and dumpsters and fire escapes. And now, a company wants to straight up monetize the view. New York startup Placemeter is paying city residents up to $50 a month for street views captured via old smartphones. The idea is to quantify sidewalk life in the service of making the city a more efficient place.

“Measuring data about how the city moves in real time, being able to make predictions on that, is definitely a good way to help cities work better,” says founder Alex Winter. “That’s the vision of Placemeter—to build a data platform where anyone at any time can know how busy the city is, and use that.”
Here’s how it works: City residents send Placemeter a little information about where they live and what they see from their window. In turn, Placemeter sends participants a kit (complete with window suction cup) to convert their unused smartphone into a street sensor, and agrees to pay cash so long as the device stays on and collects data. The more action outside—the more shops, pedestrians, traffic, and public space—the more the view is worth.
On the back end, Placemeter converts the smartphone images into statistical data using proprietary computer vision. The company first detects moving objects (the green splotches in the video below) and classifies them either as people or as 11 types of vehicles or other common urban elements, such as food carts. A second layer of analysis connects this movement with behavioral patterns based on the location—how many cars are speeding down a street, for instance, or how many people are going into a store….
Efforts to quantify city life with big data aren’t new, but where Placemeter’s clear advance is its ability to count pedestrians. Cities often track sidewalk traffic with little more than a hired hand and a manual clicker and spot locations. With its army of smartphone eyes, Placemeter promises a much wider net of real-time data dynamic enough to recognize not only that a person exists but also that person’s behavior, from walking speed to retail interest to general interaction with streets or public spaces…”

Google’s Waze announces government data exchange program with 10 initial partners


Josh Ong at TheNextWeb blog: “Waze today announced “Connected Citizens,” a new government partnership program that will see both parties exchange data in order to improve traffic conditions.

For the program, Waze will provide real-time anonymized crowdsourced traffic data to government departments in exchange for information on public projects like construction, road sensors, and pre-planned road closures.

The first 10 partners include:

  • Rio de Janeiro, Brazil
  • Barcelona, Spain and the Government of Catalonia
  • Jakarta, Indonesia
  • Tel Aviv, Israel
  • San Jose, Costa Rica
  • Boston, USA
  • State of Florida, USA
  • State of Utah, USA
  • Los Angeles County
  • The New York Police Department (NYPD)

Waze has also signed on five other government partners and has received applications from more than 80 municipal groups. The company ran an initial pilot program in Rio de Janeiro where it partnered with the city’s traffic control center to supplement the department’s sensor data with reports from Waze users.

At an event celebrating the launch, Di-Ann Eisnor, head of Growth at Waze noted that the data exchange will only include public alerts, such as accidents and closures.

We don’t share anything beyond that, such as where individuals are located and who they are,” she said.

Eisnor also made it clear that Waze isn’t selling the data. GPS maker TomTom came under fire several years ago after customers learned that the company had sold their data to police departments to help find the best places to put speed traps.

“We keep [the data] clean by making sure we don’t have a business model around it,” Eisnor added.

Waze will requires that new Connected Citizens partners “prove their dedication to citizen engagement and commit to use Waze data to improve city efficiency.”…”

Paris awaits result of referendum on how to spend €20m of city budget


in The Guardian: “Given €20m (£15.5m) of taxpayers’ money, what would Parisians do to improve their city? The final answer is expected after voting closes on Wednesday in the French capital’s first “participatory budget”.
City-dwellers of all ages and nationalities were given the chance to choose from 15 projects, including walls of vegetation, pop-up swimming pools and mini “learning gardens” in schools. The most popular will be included in the 2015 city’s spending plan. Work will begin on them in January.
The city’s mayor, Anne Hidalgo, said allowing people to decide the destination of 5% of the city hall investment budget every year from now until 2020 was “handing the keys of the budget to the citizens”.
Parisians were given a week to vote, either online or at mairies (council buildings) in each of the city’s 20 arrondissements.
As voting ended on Wednesday, the most popular choices reflected concern with the environment and the shortage of green spaces in the city centre, and a desire to breathe new life into its gloomiest corners.
A €2m project to cover at least 40 “blind” walls with plants to cheer up local areas and create a “microclimate and biodiversity” had received the most votes.
The second most popular was a €1.5m scheme to use derelict and abandoned areas around and under the périphérique – the city’s ring road – for concerts, exhibitions, film projections and other community events.
Third was a €1m project to introduce “learning gardens” in all infant and primary schools….
There are similar “participative democracy” schemes in hundreds of cities, including Toronto, Canada, and Porto Alegre in Brazil, which was the first to introduce it, in 1989, as well as in smaller communes in France. However, nowhere else is believed to have allotted such a significant sum of public money.
Hidalgo said the idea was “a new tool for citizens to participate allowing all Parisians to propose and choose projects that will make the Paris of tomorrow. They can have a real effect on local life. I see it as a major democratic innovation.”

A Vision for Happier Cities


Post by at the Huffington Post:“…Governments such as Bhutan and Venezuela are creating departments of happiness, and in both the US and UK, ‘nudge’ teams have been set up to focus on behavioral psychology. This gets more interesting when we bring in urban planning and neuroscience research, which shows that community aesthetics are a key contributor to our happiness at the same time positive emotions can change our thoughts, and lead to changes in our behaviors.
It was only after moving to New York City that I realized all my experiences… painting, advising executive boards, creative workshops, statistics and writing books about organizational change…gave me a unique set of tools to create the Dept. of Well Being and start a global social impact initiative, which is powered by public art installations entitled Happy Street Signs™.
New York City got the first Happy Street Signs last November. I used my paintings containing positive phrases like “Honk Less Love More” and “New York Loves You” to manufacture 200 government-specification street signs. They were then installed by a team of fifty volunteers around Manhattan and Brooklyn in 90 minutes. Whilst it was unofficial, the objective was to generate smiles for New Yorkers and then survey reactions. We got clipboards out and asked over 600 New Yorkers if they liked the Happy Street Signs and if they wanted more: 92.5 percent of those people said yes!…”

Uncovering State And Local Gov’s 15 Hidden Successes


Emily Jarvis at GovLoop: “From garbage trucks to vacant lots, cities and states are often tasked with the thankless job of cleaning up a community’s mess. These are tasks that are often overlooked, but are critical to keeping a community vibrant.
But even in these sometimes thankless jobs, there are real innovations happening. Take Miami-Dade County where they are using hybrid garbage trucks to save the community millions of dollars in fuel every year and make the environment a little cleaner. Or head over to Milwaukee where the city is turning vacant and abandoned lots into urban farms.
There are just two of the fifteen examples, GovLoop uncovered in our new guide, From the State House to the County Clerk – 15 Challenges and Success Stories.
We have broken the challenges into four categories:

  • Internal Best Practices
  • Tech Challenges
  • Health and Safety
  • Community Engagement and Outreach

Here’s another example, the open data movement has the potential to effect governing and civic engagement at the state and local government levels. But today very few agencies are actively providing open data. In fact, only 46 U.S. cities and counties have open data sites. One of the cities on the leading edge of the open data movement is Fort Worth, Texas.

“When I came into office, that was one of my campaign promises, that we would get Fort Worth into this century on technology and that we would take a hard look at open records requests and requests for data,” Mayor Betsy Price said in an interview with the Star-Telegram. “It goes a lot further to being transparent and letting people participate in their government and see what we are doing. It is the people’s data, and it should be easy to access.”

The website, data.fortworthtexas.gov, offers data and documents such as certificates of occupancy, development permits and residential permits for download in several formats, including Excel and PDF. Not all datasets are available yet — the city said its priority was to put the most-requested data on the portal first. Next up? Crime data, code violations, restaurant ratings and capital projects progress.

City officials’ ultimate goal is to create and adopt a full open data policy. As part of the launch, they are also looking for local software developers and designers who want to help guide the open data initiative. Those interested in participating can sign up online to receive more information….”

Data-based Civic Participation


New workshop paper by C. A. Le Dantec in  HCOMP 2014/Citizen + X: Workshop on Volunteer-based Crowdsourcing in Science, Public Health and Government, Pittsburgh, PA. November 2, 2014:  “Within the past five years, a new form of technology -mediated public participation that experiments with crowdsourced data production in place of community discourse has emerged. Examples of this class of system include SeeClickFix, PublicStuff, and Street Bump, each of which mediate feedback about local neighborhood issues and help communities mobilize resources to address those issues. The experiments being playing out by this new class of services are derived from a form of public participation built on the ideas of smart cities where residents and physical environments are instrumented to provide data to improve operational efficiency and sustainability (Caragliu, Del Bo, and Nijkamp 2011). Ultimately, smart cities is the application to local government all the efficiencies that computing has always promised—efficiencies of scale, of productivity, of data—minus the messiness and contention of citizenship that play out through more traditional modes of public engagement and political discourse.
The question then, is what might it look like to incorporate more active forms of civic participation and issue advocacy in an app- and data-driven world? To begin to explore this question, my students and I have developed a smartphone app as part of a larger regional planning partnership with the City of Atlanta and the Atlanta Regional Commission. The app, called Cycle Atlanta, enables cyclists to record their ride data —where they have gone, why they went there, what kind of cyclist they are— in an effort to both generate data for planners developing new bicycling infrastructure and to broaden public participation and input in the creation of those plans…”
 

Plenario


About Plenario: “Plenario makes it possible to rethink the way we use open data. Instead of being constrained by the data that is accessible and usable, let’s start by formulating our questions and then find the data to answer them. Plenario makes this easy by tying together all datasets on one map and one timeline—because in the real world, everything affects everything else…
The problem
Over the past few years, levels of government from the federal administration to individual municipalities like the City of Chicago have begun embracing open data, releasing datasets publicly for free. This movement has vastly increased the amount of data available, but existing platforms and technologies are designed mainly to view and access individual datasets one at a time. This restriction contradicts decades of research contending that no aspect of the urban landscape is truly isolated; in today’s cities, everything is connected to everything else.
Furthermore, researchers are often limited in the questions they can ask by the data available to answer them. It is not uncommon to spend 75% of one’s time locating, downloading, cleaning, and standardizing the relevant datasets—leaving precious little resources for the important work.
What we do
Plenario is designed to take us from “spreadsheets on the web”1 to truly smart open data. This rests on two fundamental breakthroughs:

1)  Allow users to assemble and download data from multiple, independent data sources, such as two different municipal data portals, or the federal government and a privately curated dataset.
2)  Unite all datasets along a single spatial and temporal index, making it possible to do complex aggregations with one query.

With these advances, Plenario allows users to study regions over specified time periods using all relevant data, regardless of original source, and represent the data as a single time series. By providing a single, centralized hub for open data, the Plenario platform enables urban scientists to ask the right questions with as few constraints as possible….
being implemented by the Urban Center for Computation and Data and DataMade

CityBeat: Visualizing the Social Media Pulse of the City


CityBeat is a an academic research project set to develop an application that sources, monitors and analyzes hyper-local information from multiple social media platforms such as Instagram and Twitter in real time.

This project was led by researchers at the Jacobs Institute at Cornell Tech,  in collaboration with the The New York World (Columbia Journalism School), Rutgers University, NYU, and Columbia University….

If you are interested in the technical details, we have published several papers detailing the process of building CityBeat. Enjoy your read!

Xia C., Schwartz, R., Xie K., Krebs A., Langdon A., Ting J. and Naaman M., CityBeat: Real-time Social Media Visualization of Hyper-local City Data. In Proceedings, WWW 2014, Seoul, Korea, April 2014. [PDF]

Xie K., Xia C., Grinberg N., Schwartz R., and Naaman M., Robust detection of hyper-local events from geotagged social media data. In Proceedings of the 13th Workshop on Multimedia Data Mining in KDD, 2013. [PDF]

Schwartz, R., Naaman M., Matni, Z. (2013) Making Sense of Cities Using Social Media: Requirements for Hyper-Local Data Aggregation Tools. In Proceedings, WCMCW at ICWSM 2013, Boston, USA, July 2013. [PDF]

Smart Inclusive Cities: How New Apps, Big Data, and Collaborative Technologies Are Transforming Immigrant Integration


New report by Meghan Benton for the Migration Policy Institute: “The spread of smartphones—cellphones with high-speed Internet access and geolocation technology—is transforming urban life. While many smartphone apps are largely about convenience, policymakers are beginning to explore their potential to address social challenges from disaster response to public health. And cities, in North America and Europe alike, are in the vanguard in exploring creative uses for these apps, including how to improve engagement.
For disadvantaged and diverse populations, accessing city services through a smartphone can help overcome language or literacy barriers and thus increase interactions with city officials. For those with language needs, smartphones allow language training to be accessed anywhere and at any time. More broadly, cities have begun mining the rich datasets that smartphones collect, to help attune services to the needs of their whole population. A new crop of social and civic apps offer new tools to penetrate hard-to-reach populations, including newly arrived and transient groups.
While these digital developments offer promising opportunities for immigrant integration efforts, smartphone apps’ potential to address social problems should not be overstated. In spite of potential shortcomings, since immigrant integration requires a multipronged policy response, any additional tools—especially inexpensive ones—should be examined.
This report explores the kinds of opportunities smartphones and apps are creating for the immigrant integration field. It provides a first look at the opportunities and tradeoffs that smartphones and emerging technologies offer for immigrant integration, and how they might deepen—or weaken—city residents’ sense of belonging…” (Download Report)