From Faith-Based to Evidence-Based: The Open Data 500 and Understanding How Open Data Helps the American Economy


Beth Noveck in Forbes: “Public funds have, after all, paid for their collection, and the law says that federal government data are not protected by copyright. By the end of 2009, the US and the UK had the only two open data one-stop websites where agencies could post and citizens could find open data. Now there are over 300 such portals for government data around the world with over 1 million available datasets. This kind of Open Data — including weather, safety and public health information as well as information about government spending — can serve the country by increasing government efficiency, shedding light on regulated industries, and driving innovation and job creation.

It’s becoming clear that open data has the potential to improve people’s lives. With huge advances in data science, we can take this data and turn it into tools that help people choose a safer hospital, pick a better place to live, improve the performance of their farm or business by having better climate models, and know more about the companies with whom they are doing business. Done right, people can even contribute data back, giving everyone a better understanding, for example of nuclear contamination in post-Fukushima Japan or incidences of price gouging in America’s inner cities.

The promise of open data is limitless. (see the GovLab index for stats on open data) But it’s important to back up our faith with real evidence of what works. Last September the GovLab began the Open Data 500 project, funded by the John S. and James L. Knight Foundation, to study the economic value of government Open Data extensively and rigorously.  A recent McKinsey study pegged the annual global value of Open Data (including free data from sources other than government), at $3 trillion a year or more. We’re digging in and talking to those companies that use Open Data as a key part of their business model. We want to understand whether and how open data is contributing to the creation of new jobs, the development of scientific and other innovations, and adding to the economy. We also want to know what government can do better to help industries that want high quality, reliable, up-to-date information that government can supply. Of those 1 million datasets, for example, 96% are not updated on a regular basis.

The GovLab just published an initial working list of 500 American companies that we believe to be using open government data extensively.  We’ve also posted in-depth profiles of 50 of them — a sample of the kind of information that will be available when the first annual Open Data 500 study is published in early 2014. We are also starting a similar study for the UK and Europe.

Even at this early stage, we are learning that Open Data is a valuable resource. As my colleague Joel Gurin, author of Open Data Now: the Secret to Hot Start-Ups, Smart Investing, Savvy Marketing and Fast Innovation, who directs the project, put it, “Open Data is a versatile and powerful economic driver in the U.S. for new and existing businesses around the country, in a variety of ways, and across many sectors. The diversity of these companies in the kinds of data they use, the way they use it, their locations, and their business models is one of the most striking things about our findings so far.” Companies are paradoxically building value-added businesses on top of public data that anyone can access for free….”

FULL article can be found here.

Entrepreneurs Shape Free Data Into Money


Angus Loten in the Wall Street Journal: “More cities are putting information on everything from street-cleaning schedules to police-response times and restaurant inspection reports in the public domain, in the hope that people will find a way to make money off the data.
Supporters of such programs often see them as a local economic stimulus plan, allowing software developers and entrepreneurs in cities ranging from San Francisco to South Bend, Ind., to New York, to build new businesses based on the information they get from government websites.
When Los Angeles Mayor Eric Garcetti issued an executive directive last month to launch the city’s open-data program, he cited entrepreneurs and businesses as important beneficiaries. Open-data promotes innovation and “gives companies, individuals, and nonprofit organizations the opportunity to leverage one of government’s greatest assets: public information,” according to the Dec. 18 directive.
A poster child for the movement might be 34-year-old Matt Ehrlichman of Seattle, who last year built an online business in part using Seattle work permits, professional licenses and other home-construction information gathered up by the city’s Department of Planning and Development.
While his website is free, his business, called Porch.com, has more than 80 employees and charges a $35 monthly fee to industry professionals who want to boost the visibility of their projects on the site.
The site gathers raw public data—such as addresses for homes under renovation, what they are doing, who is doing the work and how much they are charging—and combines it with photos and other information from industry professionals and homeowners. It then creates a searchable database for users to compare ideas and costs for projects near their own neighborhood.
…Ian Kalin, director of open-data services at Socrata, a Seattle-based software firm that makes the back-end applications for many of these government open-data sites, says he’s worked with hundreds of companies that were formed around open data.
Among them is Climate Corp., a San Francisco-based firm that collects weather and yield-forecasting data to help farmers decide when and where to plant crops. Launched in 2006, the firm was acquired in October by Monsanto Co. MON -2.90% , the seed-company giant, for $930 million.
Overall, the rate of new business formation declined nationally between 2006 and 2010. But according to the latest data from the Ewing Marion Kauffman Foundation, an entrepreneurship advocacy group in Kansas City, Mo., the rate of new business formation in Seattle in 2011 rose 9.41% in 2011, compared with the national average of 3.9%.
Other cities where new business formation was ahead of the national average include Chicago, Austin, Texas, Baltimore, and South Bend, Ind.—all cities that also have open-data programs. Still, how effective the ventures are in creating jobs is difficult to gauge.
One wrinkle: privacy concerns about the potential for information—such as property tax and foreclosure data—to be misused.
Some privacy advocates fear that government data that include names, addresses and other sensitive information could be used by fraudsters to target victims.”

The Emergence Of The Connected City


Glen Martin at Forbes: “If the modern city is a symbol for randomness — even chaos — the city of the near future is shaping up along opposite metaphorical lines. The urban environment is evolving rapidly, and a model is emerging that is more efficient, more functional, more — connected, in a word.
This will affect how we work, commute, and spend our leisure time. It may well influence how we relate to one another, and how we think about the world. Certainly, our lives will be augmented: better public transportation systems, quicker responses from police and fire services, more efficient energy consumption. But there could also be dystopian impacts: dwindling privacy and imperiled personal data. We could even lose some of the ferment that makes large cities such compelling places to live; chaos is stressful, but it can also be stimulating.
It will come as no surprise that converging digital technologies are driving cities toward connectedness. When conjoined, ISM band transmitters, sensors, and smart phone apps form networks that can make cities pretty darn smart — and maybe more hygienic. This latter possibility, at least, is proposed by Samrat Saha of the DCI Marketing Group in Milwaukee. Saha suggests “crowdsourcing” municipal trash pick-up via BLE modules, proximity sensors and custom mobile device apps.
“My idea is a bit tongue in cheek, but I think it shows how we can gain real efficiencies in urban settings by gathering information and relaying it via the Cloud,” Saha says. “First, you deploy sensors in garbage cans. Each can provides a rough estimate of its fill level and communicates that to a BLE 112 Module.”
As pedestrians who have downloaded custom “garbage can” apps on their BLE-capable iPhone or Android devices pass by, continues Saha, the information is collected from the module and relayed to a Cloud-hosted service for action — garbage pick-up for brimming cans, in other words. The process will also allow planners to optimize trash can placement, redeploying receptacles from areas where need is minimal to more garbage-rich environs….
Garbage can connectivity has larger implications than just, well, garbage. Brett Goldstein, the former Chief Data and Information Officer for the City of Chicago and a current lecturer at the University of Chicago, says city officials found clear patterns between damaged or missing garbage cans and rat problems.
“We found areas that showed an abnormal increase in missing or broken receptacles started getting rat outbreaks around seven days later,” Goldstein said. “That’s very valuable information. If you have sensors on enough garbage cans, you could get a temporal leading edge, allowing a response before there’s a problem. In urban planning, you want to emphasize prevention, not reaction.”
Such Cloud-based app-centric systems aren’t suited only for trash receptacles, of course. Companies such as Johnson Controls are now marketing apps for smart buildings — the base component for smart cities. (Johnson’s Metasys management system, for example, feeds data to its app-based Paoptix Platform to maximize energy efficiency in buildings.) In short, instrumented cities already are emerging. Smart nodes — including augmented buildings, utilities and public service systems — are establishing connections with one another, like axon-linked neurons.
But Goldstein, who was best known in Chicago for putting tremendous quantities of the city’s data online for public access, emphasizes instrumented cities are still in their infancy, and that their successful development will depend on how well we “parent” them.
“I hesitate to refer to ‘Big Data,’ because I think it’s a terribly overused term,” Goldstein said. “But the fact remains that we can now capture huge amounts of urban data. So, to me, the biggest challenge is transitioning the fields — merging public policy with computer science into functional networks.”…”

Open Government Strategy Continues with US Currency Production API


Eric Carter in the ProgrammableWeb: “Last year, the Executive branch of the US government made huge strides in opening up government controlled data to the developer community. Projects such as the Open Data Policy and the Machine Readable Executive Order have led the US government to develop an API strategy. Today, ProgrammableWeb takes a look at another open government API: the Annual Production Figures of United States Currency API.

The US Treasury’s Bureau of Engraving and Printing (BEP) provides the dataset available through the Production Figures API. The data available consists of the number of $1, $5, $10, $20, $50, $100 notes printed each year from 1980 to 2012. With this straightforward, seemingly basic set of data available, the question becomes: “Why is this data useful“? To answer this, one should consider the purpose of the Executive Order:

“Openness in government strengthens our democracy, promotes the delivery of efficient and effective services to the public, and contributes to economic growth. As one vital benefit of open government, making information resources easy to find, accessible, and usable can fuel entrepreneurship, innovation, and scientific discovery that improves Americans’ lives and contributes significantly to job creation.”

The API uses HTTP and can return requests in XML, JSON, or CSV data formats. As stated, the API retrieves the number of bills of a designated currency for the desired year. For more information and code samples, visit the API docs.”
 

E-government research in the United States


Paper by JT Snead, E Wright in Government Information Quarterly: “The purpose of this exploratory study is to review scholarly publications and assess egovernment research efforts as a field of study specific to the United States e-government environment. Study results reveal that researchers who focus on the U.S. e-government environment assess specific e-government topics at the federal, state, and local levels; however, there are gaps in the research efforts by topic areas and across different levels of government, which indicate opportunities for future areas of research. Results also find that a multitude of methodology approaches are used to assess e-government. Issues, however, exist that include lack of or weak presentations of methodologies in publications, few studies include multi-method evaluation approaches for data collection and analysis efforts, and few studies take a theory-based approach to understanding the U.S. e-government environment.”

Protecting personal data in E-government: A cross-country study


Paper by Yuehua Wu in Government Information Quarterly: “This paper presents the findings of a comparative study of laws and policies employed to protect personal data processed in the context of e-government in three countries (the United States, Germany, and China) with rather different approaches. Drawing on governance theory, the paper seeks to document the mechanisms utilized and to understand the factors that shape the governance modes adopted. The cases reveal that national government regulations have not kept pace with technological change and with the current information practices of the public sector. Nonetheless, traditional government regulation remains the major governance mode for the issue under discussion. Self-regulation and code-based regulation serve supplementary roles to traditional government regulation. National context is found to impact the form and level of data protection and the choice of governance modes.”

Introduction to Linked Open Data (LOD)


Paper by Ivan Herman, presented at the International Conference on Dublin Core and Metadata Applications 2013: “The goal of the tutorial is to introduce the audience into the basics of the technologies used for Linked Data. This includes RDF, RDFS, main elements of SPARQL, SKOS, and OWL. Some general guidelines on publishing data as Linked Data will also be provided, as well as real-life usage examples of the various technologies.”

Full Text: PDF (Description)  |  PDF (Presentation)

A permanent hacker space in the Brazilian Congress


Blog entry by Dan Swislow at OpeningParliament: “On December 17, the presidency of the Brazilian Chamber of Deputies passed a resolution that creates a permanent Laboratório Ráquer or “Hacker Lab” inside the Chamber—a global first.
Read the full text of the resolution in Portuguese.
The resolution mandates the creation of a physical space at the Chamber that is “open for access and use by any citizen, especially programmers and software developers, members of parliament and other public workers, where they can utilize public data in a collaborative fashion for actions that enhance citizenship.”
The idea was born out of a week-long, hackathon (or “hacker marathon”) event hosted by the Chamber of Deputies in November, with the goal of using technology to enhance the transparency of legislative work and increase citizen understanding of the legislative process. More than 40 software developers and designers worked to create 22 applications for computers and mobile devices. The applications were voted on and the top three awarded prizes.
The winner was Meu Congress, a website that allows citizens to track the activities of their elected representatives, and monitor their expenses. Runner-ups included Monitora, Brasil!, an Android application that allows users to track proposed bills, attendance and the Twitter feeds of members; and Deliberatório, an online card game that simulates the deliberation of bills in the Chamber of Deputies.
The hackathon engaged the software developers directly with members and staff of the Chamber of Deputies, including the Chamber’s President, Henrique Eduardo Alves. Hackathon organizer Pedro Markun of Transparencia Hacker made a formal proposal to the President of the Chamber for a permanent outpost, where, as Markun said in an email, “we could hack from inside the leviathan’s belly.”
The Chamber’s Director-General has established nine staff positions for the Hacker Lab under the leadership of the Cristiano Ferri Faria, who spoke with me about the new project.
Faria explained that the hackathon event was a watershed moment for many public officials: “For 90-95% of parliamentarians and probably 80% of civil servants, they didn’t know how amazing a simple app, for instance, can make it much easier to analyze speeches.” Faria pointed to one of the hackathon contest entries, Retórica Parlamentar, which provides an interactive visualization of plenary remarks by members of the Chamber. “When members saw that, they got impressed and wondered, ‘There’s something new going on and we need to understand it and support it.’”

The GovLab Index: Open Data


Please find below the latest installment in The GovLab Index series, inspired by Harper’s Index. “The GovLab Index: Open Data — December 2013” provides an update on our previous Open Data installment, and highlights global trends in Open Data and the release of public sector information. Previous installments include Measuring Impact with Evidence, The Data Universe, Participation and Civic Engagement and Trust in Institutions.
Value and Impact

  • Potential global value of open data estimated by McKinsey: $3 trillion annually
  • Potential yearly value for the United States: $1.1 trillion 
  • Europe: $900 billion
  • Rest of the world: $1.7 trillion
  • How much the value of open data is estimated to grow per year in the European Union: 7% annually
  • Value of releasing UK’s geospatial data as open data: 13 million pounds per year by 2016
  • Estimated worth of business reuse of public sector data in Denmark in 2010: more than €80 million a year
  • Estimated worth of business reuse of public sector data across the European Union in 2010: €27 billion a year
  • Total direct and indirect economic gains from easier public sector information re-use across the whole European Union economy, as of May 2013: €140 billion annually
  • Economic value of publishing data on adult cardiac surgery in the U.K., as of May 2013: £400 million
  • Economic value of time saved for users of live data from the Transport for London apps, as of May 2013: between £15 million and £58 million
  • Estimated increase in GDP in England and Wales in 2008-2009 due to the adoption of geospatial information by local public services providers: +£320m
  • Average decrease in borrowing costs in sovereign bond markets for emerging market economies when implementing transparent practices (measured by accuracy and frequency according to IMF policies, across 23 countries from 1999-2002): 11%
  • Open weather data supports an estimated $1.5 billion in applications in the secondary insurance market – but much greater value comes from accurate weather predictions, which save the U.S. annually more than $30 billion
  • Estimated value of GPS data: $90 billion

Efforts and Involvement

  • Number of U.S. based companies identified by the GovLab that use government data in innovative ways: 500
  • Number of open data initiatives worldwide in 2009: 2
  • Number of open data initiatives worldwide in 2013: over 300
  • Number of countries with open data portals: more than 40
  • Countries who share more information online than the U.S.: 14
  • Number of cities globally that participated in 2013 International Open Data Hackathon Day: 102
  • Number of U.S. cities with Open Data Sites in 2013: 43
  • U.S. states with open data initiatives: 40
  • Membership growth in the Open Government Partnership in two years: from 8 to 59 countries
  • Number of time series indicators (GDP, foreign direct investment, life expectancy, internet users, etc.) in the World Bank Open Data Catalog: over 8,000
  • How many of 77 countries surveyed by the Open Data Barometer have some form of Open Government Data Initiative: over 55%
  • How many OGD initiatives have dedicated resources with senior level political backing: over 25%
  • How many countries are in the Open Data Index: 70
    • How many of the 700 key datasets in the Index are open: 84
  • Number of countries in the Open Data Census: 77
    • How many of the 727 key datasets in the Census are open: 95
  • How many countries surveyed have formal data policies in 2013: 55%
  • Those who have machine-readable data available: 25%
  • Top 5 countries in Open Data rankings: United Kingdom, United States, Sweden, New Zealand, Norway
  • The different levels of Open Data Certificates a data user or publisher can achieve “along the way to world-class open data”: 4 levels, Raw, Pilot, Standard and Expert
  • The number of data ecosystems categories identified by the OECD: 3, data producers, infomediaries, and users

Examining Datasets
FULL VERSION AT http://thegovlab.org/govlab-index-open-data-updated/
 

Building Creative Commons: The Five Pillars Of Open Source Finance


Brett Scott: “This is an article about Open Source Finance. It’s an idea I first sketched out at a talk I gave at the Open Data Institute in London. By ‘Open Source Finance’, I don’t just mean open source software programmes. Rather, I’m referring to something much deeper and broader. It’s a way of framing an overall change we might want to see in the financial system….

You can thus take on five conceptually separate, but mutualistic roles: Producer, consumer, validator, community member, or (competitive or complementary) breakaway. And these same five elements can underpin a future system of Open Source Finance. I’m framing this as an overall change we might want to see in the financial system, but perhaps we are already seeing it happening. So let’s look briefly at each pillar in turn.
Pillar 1: Access to the means of financial production
Very few of us perceive ourselves as offering financial services when we deposit our money in banks. Mostly we perceive ourselves as passive recipients of services. Put another way, we frequently don’t imagine we have the capability to produce financial services, even though the entire financial system is foundationally constructed from the actions of small-scale players depositing money into banks and funds, buying the products of companies that receive loans, and culturally validating the money system that the banks uphold. Let’s look though, at a few examples of prototypes that are breaking this down:

  1. Peer-to-peer finance models: If you decide to lend money to your friend, you directly perceive yourself as offering them a service. P2P finance platforms extend that concept far beyond your circle of close contacts, so that you can directly offer a financial service to someone who needs it. In essence, such platforms offer you access to an active, direct role in producing financial services, rather than an indirect, passive one.
  2. There are many interesting examples of actual open source financial software aimed at helping to fulfil the overall mission of an open source financial system. Check out Mifos and Cyclos, and Hamlets (developed by Community Forge’s Matthew Slater and others), all of which are designed to help people set up their own financial institutions
  3. Alternative currencies: There’s a reason why the broader public are suddenly interested in understanding Bitcoin. It’s a currency that people have produced themselves. As a member of the Bitcoin community, I am much more aware of my role in upholding – or producing – the system, than I am when using normal money, which I had no conscious role in producing. The scope toinvent your own currency goes far beyond crypto-currencies though: local currencies, time-banks, and mutual credit systems are emerging all over
  4. The Open Bank Project is trying to open up banks to third party apps that would allow a depositor to have much greater customisability of their bank account. It’s not aimed at bypassing banks in the way that P2P is, but it’s seeking to create an environment where an ecosystem of alternative systems can plug into the underlying infrastructure provided by banks

Pillar 2: Widespread distribution
Financial intermediaries like banks and funds serve as powerful gatekeepers to access to financing. To some extent this is a valid role – much like a publisher or music label will attempt to only publish books or music that they believe are high quality enough – but on the other hand, this leads to excessive power vested in the intermediaries, and systematic bias in what gets to survive. When combined with a lack of democratic accountability on the part of the intermediaries, you can have whole societies held hostage to the (arbitrary) whims, prejudices and interests of such intermediaries. Expanding access to financial services is thus a big front in the battle for financial democratisation. In addition to more traditional means to buildingfinancial inclusion – such as credit unions and microfinance – here are two areas to look at:

  • Crowdfunding: In the dominant financial system, you have to suck up to a single set of gatekeepers to get financing, hoping they won’t exclude you. Crowdfunding though, has expanded access to receiving financial services to a whole host of people who previously wouldn’t have access, such as artists, small-scale filmmakers, activists, and entrepreneurs with no track record. Crowdfunding can serve as a micro redistribution system in society, offering people a direct way to transfer wealth to areas that traditional welfare systems might neglect
  • Mobile banking: This is a big area, with important implications for international development and ICT4D. Check out innovations like M-Pesain Kenya, a technology to use mobile phones as proto-bank accounts. This in itself doesn’t necessarily guarantee inclusion, but it expands potential access to the system to people that most banks ignore

Pillar 3: The ability to monitor
Do you know where the money in the big banks goes? No, of course not. They don’t publish it, under the guise of commercial secrecy and confidentiality. It’s like they want to have their cake and eat it: “We’ll act as intermediaries on your behalf, but don’t ever ask for any accountability”. And what about the money in your pension fund? Also very little accountability. The intermediary system is incredibly opaque, but attempts to make it more transparent are emerging. Here are some examples:

  • Triodos Bank and Charity Bank are examples of banks that publish exactly what projects they lend to. This gives you the ability to hold them to account in a way that no other bank will allow you to do
  • Corporations are vehicles for extracting value out of assets and then distributing that value via financial instruments to shareholders and creditors. Corporate structures though, including those used by banks themselves, have reached a level of complexity approaching pure obsfucation. There can be no democratic accountability when you can’t even see who owns what, and how the money flows. Groups likeOpenCorporates and Open Oil though, are offering new open data tools to shine a light on the shadowy world of tax havens, ownership structures and contracts
  • Embedded in peer-to-peer models is a new model of accountability too. When people are treated as mere account numbers with credit scores by banks, the people in return feel little accountability towards the banks. On the other hand, if an individual has directly placed trust in me, I feel much more compelled to respect that

Pillar 4: An ethos of non-prescriptive DIY collaboration
At the heart of open source movements is a deep DIY ethos. This is in part about the sheer joy of producing things, but also about asserting individual power over institutionalised arrangements and pre-established officialdom. Alongside this, and deeply tied to the DIY ethos, is the search to remove individual alienation: You are not a cog in a wheel, producing stuff you don’t have a stake in, in order to consume stuff that you don’t know the origins of. Unalienated labour includes the right to produce where you feel most capable or excited.
This ethos of individual responsibility and creativity stands in contrast to the traditional passive frame of finance that is frequently found on both the Right and Left of the political spectrum. Indeed, the debates around ‘socially useful finance’ are seldom about reducing the alienation of people from their financial lives. They’re mostly about turning the existing financial sector into a slightly more benign dictatorship. The essence of DIY though, is to band together, not via the enforced hierarchy of the corporation or bureaucracy, but as part of a likeminded community of individuals creatively offering services to each other. So let’s take a look at a few examples of this

  1. BrewDog’s ‘Equity for Punks‘ share offering is probably only going to attract beer-lovers, but that’s the point – you get together as a group who has a mutual appreciation for a project, and you finance it, and then when you’re drinking the beer you’ll know you helped make it happen in a small way
  2. Community shares offer local groups the ability to finance projects that are meaningful to them in a local area. Here’s one for a solar co-operative, a pub, and a ferry boat service in Bristol
  3. We’ve already discussed how crowdfunding platforms open access to finance to people excluded from it, but they do this by offering would-be crowdfunders the chance to support things that excite them. I don’t have much cash, so I’m not in a position to actively finance people, but in my Indiegogo profile you can see I make an effort helping to publicise campaigns that I want to receive financing

Pillar 5: The right to fork
The right to dissent is a crucial component of a democratic society. But for dissent to be effective, it has to be informed and constructive, rather than reactive and regressive. There is much dissent towards the current financial system, but while people are free to voice their displeasure, they find it very difficult to actually act on their displeasure. We may loathe the smug banking oligopoly, but we’re frequently compelled to use them.
Furthermore, much dissent doesn’t have a clear vision of what alternative is sought. This is partially due to the fact that access to financial ‘source code’ is so limited. It’s hard to articulate ideas about what’s wrong when one cannot articulate how the current system operates. Most financial knowledge is held in proprietary formulations and obscure jargon-laden language within the financial sector, and this needs to change. It’s for this reason that I’m building the London School of Financial Activism, so ordinary people can explore the layers of financial code, from the deepest layer – the money itself – and then on to the institutions, instruments and networks that move it around….”