Visualizing 3 Billion Tweets


9080460045_cb6c84283e_bEric Gundersen from Mapbox: “This is a look at 3 billion tweets – every geotagged tweet since September 2011, mapped, showing facets of Twitter’s ecosystem and userbase in incredible new detail, revealing demographic, cultural, and social patterns down to city level detail, across the entire world. We were brought in by the data team at Gnip, who have awesome APIs and raw access to the Twitter firehose, and together Tom and data artist Eric Fischer used our open source tools to visualize the data and build interfaces that let you explore the stories of space, language, and access to technology.
This is big data, and there’s a significant level of geographic overlap between tweets, so Eric wrote an open-source tool that de-duplicated 2.7 billion overlapping datapoints, leaving 280 million unique locations…”
 

When Ordinary Americans Accomplish What the Government Can’t




in The National Journal: “Washington may be paralyzed by partisanship, but across the country, grassroots innovators are crafting solutions to our problems….This special issue of National Journal celebrates these pragmatic problem-solvers in business, the civic sector, local government, and partnerships that creatively combine all three. At a time of endemic stalemate in the nation’s capital, think of it as a report from the America that works (to borrow a recent phrase from The Economist)….
Another significant message is that the communications revolution, by greatly accelerating the sharing of ideas, has produced a “democratization of innovation,” as author Vijay Vaitheeswaran put it in his 2012 book, Need, Speed, and Greed. This dynamic has simultaneously allowed breakthroughs to disseminate faster than ever and empowered more people inside companies and communities to tackle problems previously left to elites. “One of the most interesting stories in social change today is how much creative problem-solving is emerging from citizens scattered far and wide who are taking it upon themselves to fix things and who, in many cases, are outperforming traditional organizations,” David Bornstein, founder of the Dowser.org website that tracks social innovation, wrote in The New York Times last year. Our honoree Eric Greitens, the former Navy SEAL who founded The Mission Continues for other post-9/11 veterans, personifies this trend. Across the categories, many honorees insist they have pursued new approaches in part because they could no longer wait for Washington to address the problems they face. In a world where barriers to the dispersal of ideas are crumbling, waiting for elites to propose answers may soon seem as outdated as waiting for a dial-up connection to the Internet.
The third conclusion limits the first two. Even many of the most dynamic grassroots innovations will remain isolated islands of excellence in this continent-sized society without energy and amplification from the top. Donald Kettl, dean of the University of Maryland’s School of Public Policy, notes the federal government is unavoidably a major force on many of the challenges facing America, particularly reforming education, health care, and training; developing regional economic strategies; and providing physical and digital infrastructure. Washington need not direct or control the response to these problems, but change on a massive scale is always harder without stronger signals and incentives than the federal government has provided in recent years. “It is possible to feed change aggressively from the bottom,” Kettl says. “[But] the federal government, for better or worse, inevitably is involved…. There’s a natural limit in what’s possible to bubble up from the bottom….
Special issue at https://web.archive.org/web/2013/http://www.nationaljournal.com/back-in-business ”
 
 

Data-Smart City Solutions


Press Release: “Today the Ash Center for Democratic Governance and Innovation at Harvard Kennedy School announced the launch of Data-Smart City Solutions, a new initiative aimed at using big data and analytics to transform the way local government operates. Bringing together leading industry, academic, and government officials, the initiative will offer city leaders a national depository of cases and best practice examples where cities and private partners use analytics to solve city problems. Data-Smart City Solutions is funded by Bloomberg Philanthropies and the John D. and Catherine T. MacArthur Foundation.

Data-Smart City Solutions highlights best practices, curates resources, and supports cities embarking on new data projects. The initiative’s website contains feature-length articles on how data drives innovation in different policy areas, profile pieces on municipal leaders at the forefront of implementing data analytics in their cities, and resources for interested officials to begin data projects in their own communities.
Recent articles include an assessment of Boston’s Adopt-a-Hydrant program as a potential harbinger of future city work promoting civic engagement and infrastructure maintenance, and a feature on how predictive technology is transforming police work. The site also spotlights municipal use of data such as San Francisco’s efforts to integrate data from different social service departments to better identify and serve at-risk youth. In addition to visiting the initiative’s website, Data-Smart City Solutions’ work is chronicled in their newsletter as well as on their Twitter page.”

5 Lessons from Gov 2.0


in GovTech: “Although government 2.0 has been around since Bill Eggers’ 2005 book Government 2.0, the term truly took over in 2008. After President Barack Obama’s 2008 election, his first memorandum in office was the Open Government Directive with its three pillars of creating a more transparent, participatory and collaborative government. This framework quickly spread from federal government down to state and local government and across the nation.
So fast-forward five years and let’s ask what have we learned.
1. It’s about mission problems…
2. It’s about sustainability…
3. It’s about human capital…
4. It’s not static…
5. It’s more than open data…
Overall, a lot of progress has been made in five years. Besides the items above, it’s a cultural and mindset shift that we are seeing grow throughout government each year. Individuals and agencies are focusing on how to make important systemic change with new technology and approaches to improve government”

Colab: Winner of the 2013 AppMyCity! Prize


CaptureAtlantic Cities: “Colab, a Brazilian mobile application designed to encourage better citizenship, is the winner of the 2013 AppMyCity! Prize for the year’s best urban app.
The app’s five founders, Bruno Aracaty, Gustavo Maia, Paulo Pandolfi, Josemando Sobral and Vitor Guedes, from Recife and São Paulo, claimed the $5,000 prize last week at the annual New Cities Summit in São Paulo. Colab competed against two other finalists, BuzzJourney, from Kfar-Saba, Israel, and PublicStuff, from New York City. All three finalists presented their project to the international audience at the New Cities Summit. The audience then voted to determine the winner.
Colab utilizes photos and geolocation to connect citizens to cities based on three pillars of interaction: reporting daily urban issues; elaborating on and proposing new projects and solutions; and evaluating public services….
In total, the New Cities Foundation received 98 submissions for the AppMyCity! Prize 2013. A panel of judges chose the finalists out of ten semi-finalists, based on ability to create widespread impact and helpful user interface”

The five elements of an open source city


Jason Hibbets in Open Source.com: “How can you apply the concepts of open source to a living, breathing city? An open source city is a blend of open culture, open government policies, and economic development. I derived these characteristics based on my experiences and while writing my book, The foundation for an open source city.  Characteristics such as collaboration, participation, transparency, rapid prototyping, and many others can be applied to any city that wants to create an open source culture. Let’s take a look at these characteristics in more detail.

Five characteristics of an open source city

  1. Fostering a culture of citizen participation
  2. Having an effective open government policy
  3. Having an effective open data initiative
  4. Promoting open source user groups and conferences
  5. Being a hub for innovation and open source businesses

In my book, I take a look at how these five principles are being actively applied in Raleigh, North Carolina. I also incorporate other experiences from my open government adventures such as CityCamps and my first Code for America Summit. Although Raleigh is the case study, the book is a guide for how cities across the country, and world, can implement the open source city brand.”

Checkbook NYC advances civic open source


Karl Fogel at OpenSource.com: “New York City Comptroller John Liu is about to do something we need to see more often in government. This week, his office is open sourcing the code behind Checkbook NYC, the citywide financial transparency site—but the open-sourcing itself is not what I’m referring to. After all, lots of governments open source code these days.
Checkbook NYCRather, the release of the Checkbook NYC code, planned for this Thursday, is significant because of a larger initiative that accompanies it. Long before the code release, the Comptroller’s Office started a serious planning process to ensure that the code could be easily adopted by other municipalities, supported by other vendors, and eventually become a long-term multi-stakeholder project—in other words, the very model that advocates of civic open source always cheer for but only rarely see happen in practice.
I have no knowledge (and do not claim) that this is the first instance of a government agency doing such long-range planning for an open source release. But it will at least be an important instance: CheckbookNYC.com is the main financial transparency site for the largest city in the United States, a city with an annual budget of $70 billion. Giving other cities a chance to offer the same user interface and API support, at a fraction of what it would have cost to build it themselves, is already good news. But it’s even more important to show that the project is a safe long-term bet, both for those considering adoption and those considering participation in development.”

First, they gave us targeted ads. Now, data scientists think they can change the world


in Gigaom: “The best minds of my generation are thinking about how to make people click ads … That sucks.” – Jeff Hammerbacher, co-founder and chief scientist, Cloudera
Well, something has to pay the bills. Thankfully, there’s also a sweeping trend in the data science world right now around bringing those skills to bear on some really meaningful problems, …
We’ve already covered some of these efforts, including the SumAll Foundation’s work on modern-day slavery and future work on child pornography. Closely related is the effort — led by Google.org’s deep pockets — to create an international hotline network for reporting human trafficking and collecting data. Microsoft, in particular Microsoft Research’s danah boyd, has been active in helping fight child exploitation using technology.
This week, I came across two new efforts on different ends of the spectrum. One is ActivityInfo, which describes itself on its website as “an online humanitarian project monitoring tool” — developed by Unicef and a consulting firm called BeDataDriven — that “helps humanitarian organizations to collect, manage, map and analyze indicators….
The other effort I came across is DataKind, specifically its work helping the New York City Department of Parks and Recreations, or NYC Parks, quantify the benefits of a strategic tree-pruning program. Founded by renowned data scientists Drew Conway and Jake Porway (who’s also the host of the National Geographic channel’s The Numbers Game), DataKind exists for the sole purpose of helping non-profit organizations and small government agencies solve their most-pressing data problems.”

OECD: Open Government – Data Towards Empirical Analysis of Open Government Data Initiatives


OECDiLibrary: “Open Government Data (OGD) initiatives, and in particular the development of OGD portals, have proliferated since the mid-2000s both at central and local government levels in OECD and non OECD countries. Understanding the preconditions that enable the efficient and effective implementation of these initiatives is essential for achieving their overall objectives. This is especially true in terms of the role played by OGD in relation to Open Government policies in general.
This paper highlights the main principles, concepts and criteria framing open government data initiatives and the issues challenging their implementation. It underlines the opportunities that OGD and data analytics may offer policy makers, while providing a note of caution on the challenges this agenda poses for the public sector.
Finally, the overall analysis of key concepts and issues aims to pave the way for an empirical analysis of OGD initiatives. So far, little has been done to analyse and prove the impact and accrued value of these initiatives. The paper suggests a methodology comprising an analytical framework for OGD initiatives (to be applied to ex post and ex ante analysis of initiatives) and a related set of data to be collected across OECD countries. The application of the analytical framework and the collection of data would enable the acquisition of a solid body of evidence that could ultimately lead to mapping initiatives across OECD countries (i.e. a typography of initiatives) and developing a common set of metrics to consistently assess impact and value creation within and across countries.”