The data gold rush


Neelie KROES (European Commission):  “Nearly 200 years ago, the industrial revolution saw new networks take over. Not just a new form of transport, the railways connected industries, connected people, energised the economy, transformed society.
Now we stand facing a new industrial revolution: a digital one.
With cloud computing its new engine, big data its new fuel. Transporting the amazing innovations of the internet, and the internet of things. Running on broadband rails: fast, reliable, pervasive.
My dream is that Europe takes its full part. With European industry able to supply, European citizens and businesses able to benefit, European governments able and willing to support. But we must get all those components right.
What does it mean to say we’re in the big data era?
First, it means more data than ever at our disposal. Take all the information of humanity from the dawn of civilisation until 2003 – nowadays that is produced in just two days. We are also acting to have more and more of it become available as open data, for science, for experimentation, for new products and services.
Second, we have ever more ways – not just to collect that data – but to manage it, manipulate it, use it. That is the magic to find value amid the mass of data. The right infrastructure, the right networks, the right computing capacity and, last but not least, the right analysis methods and algorithms help us break through the mountains of rock to find the gold within.
Third, this is not just some niche product for tech-lovers. The impact and difference to people’s lives are huge: in so many fields.
Transforming healthcare, using data to develop new drugs, and save lives. Greener cities with fewer traffic jams, and smarter use of public money.
A business boost: like retailers who communicate smarter with customers, for more personalisation, more productivity, a better bottom line.
No wonder big data is growing 40% a year. No wonder data jobs grow fast. No wonder skills and profiles that didn’t exist a few years ago are now hot property: and we need them all, from data cleaner to data manager to data scientist.
This can make a difference to people’s lives. Wherever you sit in the data ecosystem – never forget that. Never forget that real impact and real potential.
Politicians are starting to get this. The EU’s Presidents and Prime Ministers have recognised the boost to productivity, innovation and better services from big data and cloud computing.
But those technologies need the right environment. We can’t go on struggling with poor quality broadband. With each country trying on its own. With infrastructure and research that are individual and ineffective, separate and subscale. With different laws and practices shackling and shattering the single market. We can’t go on like that.
Nor can we continue in an atmosphere of insecurity and mistrust.
Recent revelations show what is possible online. They show implications for privacy, security, and rights.
You can react in two ways. One is to throw up your hands and surrender. To give up and put big data in the box marked “too difficult”. To turn away from this opportunity, and turn your back on problems that need to be solved, from cancer to climate change. Or – even worse – to simply accept that Europe won’t figure on this mapbut will be reduced to importing the results and products of others.
Alternatively: you can decide that we are going to master big data – and master all its dependencies, requirements and implications, including cloud and other infrastructures, Internet of things technologies as well as privacy and security. And do it on our own terms.
And by the way – privacy and security safeguards do not just have to be about protecting and limiting. Data generates value, and unlocks the door to new opportunities: you don’t need to “protect” people from their own assets. What you need is to empower people, give them control, give them a fair share of that value. Give them rights over their data – and responsibilities too, and the digital tools to exercise them. And ensure that the networks and systems they use are affordable, flexible, resilient, trustworthy, secure.
One thing is clear: the answer to greater security is not just to build walls. Many millennia ago, the Greek people realised that. They realised that you can build walls as high and as strong as you like – it won’t make a difference, not without the right awareness, the right risk management, the right security, at every link in the chain. If only the Trojans had realised that too! The same is true in the digital age: keep our data locked up in Europe, engage in an impossible dream of isolation, and we lose an opportunity; without gaining any security.
But master all these areas, and we would truly have mastered big data. Then we would have showed technology can take account of democratic values; and that a dynamic democracy can cope with technology. Then we would have a boost to benefit every European.
So let’s turn this asset into gold. With the infrastructure to capture and process. Cloud capability that is efficient, affordable, on-demand. Let’s tackle the obstacles, from standards and certification, trust and security, to ownership and copyright. With the right skills, so our workforce can seize this opportunity. With new partnerships, getting all the right players together. And investing in research and innovation. Over the next two years, we are putting 90 million euros on the table for big data and 125 million for the cloud.
I want to respond to this economic imperative. And I want to respond to the call of the European Council – looking at all the aspects relevant to tomorrow’s digital economy.
You can help us build this future. All of you. Helping to bring about the digital data-driven economy of the future. Expanding and depening the ecosystem around data. New players, new intermediaries, new solutions, new jobs, new growth….”

The myth of the keyboard warrior: public participation and 38 Degrees


James Dennis in Open Democracy: “A cursory glance at the comment section of the UK’s leading newspapers suggests that democratic engagement is at an all time low; we are generation apathetic. In their annual health check, the Audit of Political Engagement, the Hansard Society paint a bleak picture of participation trends in Britain. Only 41% of those surveyed are committed to voting in the next General Election. Moreover, less than 1% of the population is a member of a political party. However, 38 Degrees, the political activist movement, bucks these downward trends. In the four years since their foundation in 2009, 38 Degrees have amassed a membership of 1.8 million individuals—more than three times the entire combined memberships of all of Britain’s political parties.

The organisation is not without its critics, however. Earlier this week, during a debate in House of Commons on the Care Bill, David T. C. Davies MP cast doubt on the authenticity of the organisation’s ethos, “People. Power. Change”, claiming that:

These people purport to be happy-go-lucky students. They are always on first name terms; Ben and Fred and Rebecca and Sarah and the rest of it. The reality is that it is a hard-nosed left-wing Labour-supporting organisation with links to some very wealthy upper middle-class socialists, despite the pretence that it likes to give out.

Likewise, in a comment piece for The Guardian, Oscar Rickett argued that the form of participation cultivated by 38 Degrees is not beneficial to our civic culture as it encourages fragmented, issue-driven collective action in which “small urges are satisfied with the implication that they are bringing about large change”.
However, given the lack of empirical research undertaken on 38 Degrees, such criticisms are often anecdotal or campaign-specific. So here are just a couple of the significant findings emerging from my ongoing research.

New organisations

38 Degrees bears little resemblance to the organisational models that we’ve become accustomed to. Unlike political parties or traditional pressure groups, 38 Degrees operates on a more level playing field. Members are central to the key decisions that are made before and during a campaign and the staff facilitate these choices. Essentially, the organisation acts as a conduit for its membership, removing the layers of elite-level decision-making that characterised political groups in the twentieth century.
38 Degrees seeks to structure grassroots engagement in two ways. Firstly, the group fuses a vast range of qualitative and quantitative data sources from its membership to guide their campaign decisions and strategy. By using digital media, members are able to express their opinion very quickly on an unprecedented scale. One way in which they do this is through ad-hoc surveys of their members to decide on key strategic decisions, such as their survey regarding the decision to campaign against plans by the NHS to compile a database of medical records for potential use by private firms. In just 24 hours the group had a response from 137,000 of it’s members, with 93 per cent backing their plans to organise a mass opt out.
Secondly, the group offers the platform Campaigns By You, which provides members with the technological opportunities to structure and undertake their own campaigns, retaining complete autonomy over the decision-making process. In both cases, albeit to a differing degree, it is the mass of individual participants that direct the group strategy, with 38 Degrees offering the technological capacity to structure this. 38 Degrees assimilates the fragmented, competing individual voices of its membership, and offers cohesive, collective action.
David Karpf proposes that we consider this phenomenon as characteristic of new type of organisation. These new organisations challenge our traditional understanding of collective action as they are structurally fluid. 38 Degrees relies on central staff to structure the wants and needs of their membership. However, this doesn’t necessarily lead to a regimented hierarchy. Pablo Gerbaudo describes this as ‘soft leadership’ where the central staff act as choreographers, organising and structuring collective action whilst minimising their encroachment on the will of individual members. …
In conclusion, the successes of 38 Degrees, in terms of mobilising public participation, come down to how the organisation maximises the membership’s sense of efficacy, the feeling that each individual member has, or can have, an impact.
By providing influence over the decision-making process, either explicitly or implicitly, members become more than just cheerleaders observing elites from the sidelines; they are active and involved in the planning and execution of public participation.”

Personal Data for the Public Good


Final report on “New Opportunities to Enrich Understanding of Individual and Population Health” of the health data exploration project: “Individuals are tracking a variety of health-related data via a growing number of wearable devices and smartphone apps. More and more data relevant to health are also being captured passively as people communicate with one another on social networks, shop, work, or do any number of activities that leave “digital footprints.”
Almost all of these forms of “personal health data” (PHD) are outside of the mainstream of traditional health care, public health or health research. Medical, behavioral, social and public health research still largely rely on traditional sources of health data such as those collected in clinical trials, sifting through electronic medical records, or conducting periodic surveys.
Self-tracking data can provide better measures of everyday behavior and lifestyle and can fill in gaps in more traditional clinical data collection, giving us a more complete picture of health. With support from the Robert Wood Johnson Foundation, the Health Data Exploration (HDE) project conducted a study to better understand the barriers to using personal health data in research from the individuals who track the data about their own personal health, the companies that market self-track- ing devices, apps or services and aggregate and manage that data, and the researchers who might use the data as part of their research.
Perspectives
Through a series of interviews and surveys, we discovered strong interest in contributing and using PHD for research. It should be noted that, because our goal was to access individuals and researchers who are already generating or using digital self-tracking data, there was some bias in our survey findings—participants tended to have more educa- tion and higher household incomes than the general population. Our survey also drew slightly more white and Asian participants and more female participants than in the general population.
Individuals were very willing to share their self-tracking data for research, in particular if they knew the data would advance knowledge in the fields related to PHD such as public health, health care, computer science and social and behavioral science. Most expressed an explicit desire to have their information shared anonymously and we discovered a wide range of thoughts and concerns regarding thoughts over privacy.
Equally, researchers were generally enthusiastic about the potential for using self-tracking data in their research. Researchers see value in these kinds of data and think these data can answer important research questions. Many consider it to be of equal quality and importance to data from existing high quality clinical or public health data sources.
Companies operating in this space noted that advancing research was a worthy goal but not their primary business concern. Many companies expressed interest in research conducted outside of their company that would validate the utility of their device or application but noted the critical importance of maintaining their customer relationships. A number were open to data sharing with academics but noted the slow pace and administrative burden of working with universities as a challenge.
In addition to this considerable enthusiasm, it seems a new PHD research ecosystem may well be emerging. Forty-six percent of the researchers who participated in the study have already used self-tracking data in their research, and 23 percent of the researchers have already collaborated with application, device, or social media companies.
The Personal Health Data Research Ecosystem
A great deal of experimentation with PHD is taking place. Some individuals are experimenting with personal data stores or sharing their data directly with researchers in a small set of clinical experiments. Some researchers have secured one-off access to unique data sets for analysis. A small number of companies, primarily those with more of a health research focus, are working with others to develop data commons to regularize data sharing with the public and researchers.
SmallStepsLab serves as an intermediary between Fitbit, a data rich company, and academic research- ers via a “preferred status” API held by the company. Researchers pay SmallStepsLab for this access as well as other enhancements that they might want.
These promising early examples foreshadow a much larger set of activities with the potential to transform how research is conducted in medicine, public health and the social and behavioral sciences.
Opportunities and Obstacles
There is still work to be done to enhance the potential to generate knowledge out of personal health data:

  • Privacy and Data Ownership: Among individuals surveyed, the dominant condition (57%) for making their PHD available for research was an assurance of privacy for their data, and over 90% of respondents said that it was important that the data be anonymous. Further, while some didn’t care who owned the data they generate, a clear majority wanted to own or at least share owner- ship of the data with the company that collected it.
  • InformedConsent:Researchersareconcerned about the privacy of PHD as well as respecting the rights of those who provide it. For most of our researchers, this came down to a straightforward question of whether there is informed consent. Our research found that current methods of informed consent are challenged by the ways PHD are being used and reused in research. A variety of new approaches to informed consent are being evaluated and this area is ripe for guidance to assure optimal outcomes for all stakeholders.
  • Data Sharing and Access: Among individuals, there is growing interest in, as well as willingness and opportunity to, share personal health data with others. People now share these data with others with similar medical conditions in online groups like PatientsLikeMe or Crohnology, with the intention to learn as much as possible about mutual health concerns. Looking across our data, we find that individuals’ willingness to share is dependent on what data is shared, how the data will be used, who will have access to the data and when, what regulations and legal protections are in place, and the level of compensation or benefit (both personal and public).
  • Data Quality: Researchers highlighted concerns about the validity of PHD and lack of standard- ization of devices. While some of this may be addressed as the consumer health device, apps and services market matures, reaching the optimal outcome for researchers might benefit from strategic engagement of important stakeholder groups.

We are reaching a tipping point. More and more people are tracking their health, and there is a growing number of tracking apps and devices on the market with many more in development. There is overwhelming enthusiasm from individuals and researchers to use this data to better understand health. To maximize personal data for the public good, we must develop creative solutions that allow individual rights to be respected while providing access to high-quality and relevant PHD for research, that balance open science with intellectual property, and that enable productive and mutually beneficial collaborations between the private sector and the academic research community.”

The intelligent citizen


John Bell in AlJazeera: “A quarter century after the demise of the Soviet Union, is the Western model of government under threat? …. The pressures are coming from several directions.
All states are feeling the pressure from unregulated global flows of capital that create obscene concentrations of wealth, and an inability of the nation-state to respond.Relatedly, citizens either ignore or distrust traditional institutions, and ethnic groups demand greater local autonomy.
A recent Pew survey shows that Americans aged 18-33 mostly identify as political independents and distrust institutions. The classic model is indeed frayed, and new developments have made it feel like very old cloth.
One natural reflex is to assert even greater control, a move suited to the authoritarians, such as China, Russia or General Abdel Fattah al-Sisi‘s Egypt: Strengthen the nation by any means to withstand the pressures. The reality, however, is that all systems, democracies or otherwise, were designed for an industrial age, and the management of an anonymous mass, and cannot cope with globalised economics and the information world of today.
The question remains: What can effectively replace the Western model? The answer may not lie only in the invention of new structures, but in the improvement of a key component found in all: The citizen.
The citizen today is mostly a consumer, focused on the purchase of goods or services, or the insistent consumption of virtual information, often as an ersatz politics. Occasionally, when a threat rises, he or she also becomes a demandeur of absolute security from the state. Indeed, some are using the new technologies for democratic purposes, they are better informed, criticise abuse or corruption, and organise and rally movements.
But, the vast majority is politically disengaged and cynical of political process; many others are too busy trying to survive to even care. A grand apathy has set in, the stage left vacant for a very few extremists, or pied pipers of the old tunes of nationalisms and tribal belonging disguised as leaders. The citizen is either invisible in this circus, an endangered species in the 21st century, or increasingly drawn to dark and polarising forces.
Some see the glass as half full and believe that technology and direct democracy can bridge the gaps. Indeed, the internet provides a plethora of information and a greater sense of empowerment. Lesser-known protests in Bosnia have led to direct democracy plenums, and the Swiss do revert to national referenda. However, whether direct or representative, democracy will still depend on the quality of the citizen, and his or her decisions.
Opinion, dogma and bias
Opinion, dogma and bias remain common political operating system and, as a result, our politics are still an unaffordable game of chance. The optimists may be right, but discussions in social media on issues ranging from Ukraine to gun control reveal more deep bias and the lure of excitement than the pursuit of a constructive answer.
People crave excitement in their politics. Whether it is through asserting their own opinion or in battling others, politics offers a great ground for this high. The cost, however, comes in poor judgment and dangerous decisions. George W. Bush was elected twice, Vladimir Putin has much support, climate change is denied, and an intoxicated Mayor of Toronto, Rob Ford, may be re-elected.
Few are willing to admit their role in this state of affairs, but they will gladly see the ill in others. Even fewer, including often myself, will admit that they don’t really know how to think through a challenge, political or otherwise. This may seem absurd, thinking feels as natural as walking, but the formation of political opinion is a complex affair, a flawed duet between our minds and outside input. Media, government propaganda, family, culture, and our own unique set of personal experiences, from traumas to chance meetings, all play into the mix. High states of emotion, “excitement”, also weigh in, making us dumb and easily manipulated….
This step may also be a precursor for another that involves the ordinary person. Today being a citizen involves occasional voting, politics as spectator sport, and, among some, being a watchdog against corruption or street activism. What may be required is more citizens’ participation in local democracy, not just in assemblies or casting votes, but in local management and administration.
This will help people understand the complexities of politics, gain greater responsibility, and mitigate some of the vices of centralisation and representative democracy. It may also harmonise with the information age, where everyone, it seems, wishes to be empowered.
Do people have time in their busy lives? A rotational involvement in local affairs can help solve this, and many might even find the engagement enjoyable. This injection of a real citizen into the mix may improve the future of politics while large institutions continue to hum their tune.
In the end, a citizen who has responsibility for his actions can probably make any structure work, while rejecting any that would endanger his independence and dignity. The rise of a more intelligent and committed citizen may clarify politics, improve liberal democracies, and make populism and authoritarianism less appealing and likely paths.”

Practices of Freedom: Decentred Governance, Conflict and Democratic Participation


New book by Steven Griggs,Aletta J. Norval, and Hendrik Wagenaar: “The shift from government to governance has become a starting point for many studies of contemporary policy-making and democracy. Practices of Freedom takes a different approach, calling into question this dominant narrative and taking the variety, hybridity and dispersion of social and political practices as its focus of analysis. Bringing together leading scholars in democratic theory and critical policy studies, it draws upon new understandings of radical democracy, practice and interpretative analysis to emphasise the productive role of actors and political conflict in the formation and reproduction of contemporary forms of democratic governance. Integrating theoretical dialogues with detailed empirical studies, this book examines spaces for democratisation, institutional design, democratic criteria and learning, whilst mobilising the frameworks of agonistic and aversive democracy, informality and decentred legitimacy in cases from youth engagement to the Israeli-Palestinian conflict.

  • Integrates topics including democratic theory, policy theory and social conflict to offer an interdisciplinary perspective on governance
  • Challenges assumptions about contemporary governance, reconnecting its practices with the wider civil society in which they are embedded
  • Detailed case studies of decentred governance illustrate theoretical points in real-world situations”

Online tools for engaging citizens in the legislative process


Andrew Mandelbaum  from OpeningParliament.org: “Around the world, parliaments, governments, civil society organizations, and even individual parliamentarians, are taking measures to make the legislative process more participatory. Some are creating their own tools — often open source, which allows others to use these tools as well — that enable citizens to markup legislation or share ideas on targeted subjects. Others are purchasing and implementing tools developed by private companies to good effect. In several instances, these initiatives are being conducted through collaboration between public institutions and civil society, while many compliment online and offline experiences to help ensure that a broader population of citizens is reached.
The list below provides examples of some of the more prominent efforts to engage citizens in the legislative process.
Brazil
Implementer: Brazilian Chamber of Deputies
Website: http://edemocracia.camara.gov.br/
Additional Information: OpeningParliament.org Case Study
Estonia
Implementer: Estonian President & Civil Society
Project Name: Rahvakogu (The People’s Assembly)
Website: http://www.rahvakogu.ee/
Additional InformationEnhancing Estonia’s Democracy Through Rahvakogu
Finland
Implementer: Finnish Parliament
Project Name: Inventing Finland again! (Keksitään Suomi uudelleen!)
Website: http://www.suomijoukkoistaa.fi/
Additional Information: Democratic Participation and Deliberation in Crowdsourced Legislative Processes: The Case of the Law on Off-Road Traffic in Finland
France
Implementer: SmartGov – Démocratie Ouverte
Website: https://www.parlement-et-citoyens.fr/
Additional Information: OpeningParliament Case Study
Italy
Implementer: Government of Italy
Project Name: Public consultation on constitutional reform
Website: http://www.partecipa.gov.it/
Spain
Implementer: Basque Parliament
Website: http://www.adi.parlamentovasco.euskolegebiltzarra.org/es/
Additional Information: Participation in Parliament
United Kingdom
Implementer: Cabinet Office
Project Name: Open Standards Consultation
Website: http://consultation.cabinetoffice.gov.uk/openstandards/
Additional Information: Open Policy Making, Open Standards Consulation; Final Consultation Documents
United States
Implementer: OpenGov Foundation
Project Name: The Madison Project
Tool: The Madison Project

New Journal Helps Behavioral Scientists Find Their Way to Washington


The PsychReport: “When it comes to being heard in Washington, classical economists have long gotten their way. Behavioral scientists, on the other hand, haven’t proved so adept at getting their message across.

It isn’t for lack of good ideas. Psychology’s applicability has been gaining momentum in recent years, namely in the U.K.’s Behavioral Insights Team, which has helped prove the discipline’s worth to policy makers. The recent (but not-yet-official) announcement that the White House is creating a similar team is another major endorsement of behavioral science’s value.

But when it comes to communicating those ideas to the public in general, psychologists and other behavioral scientists can’t name so many successes. Part of the problem is PR know-how: writing for a general audience, publicizing good ideas, reaching-out to decision makers. Another is incentive: academics need to publish, and many times publishing means producing long, dense, jargon-laden articles for peer-reviewed journals read by a rarified audience of other academics. And then there’s time, or lack of it.

But a small group of prominent behavioral scientists is working to help other researchers find their way to Washington. The brainchild of UCLA’s Craig Fox and Duke’s Sim Sitkin, Behavioral Science & Policy is a peer-reviewed journal set to launch online this fall and in print early next year, whose mission is to influence policy and practice through promoting high-quality behavioral science research. Articles will be brief, well written, and will all provide straightforward, applicable policy recommendations that serve the public interest.

“What we’re trying to do is create policies that are mindful of how individuals, groups, and organizations behave. How can you create smart policies if you don’t do that?”

In bringing behavioral science to the capital, Fox echoed a similar motivation as David Halpern of the Behavioral Insights Team.

“What we’re trying to do is create policies that are mindful of how individuals, groups, and organizations behave. How can you create smart policies if you don’t do that?” Fox said. “Because after all, all policies affect individuals, groups, and/or organizations.”

Fox has already assembled an impressive team of scientists from around the country for the journal’s advisory board including Richard Thaler and Cass Sunstein, authors of Nudge which helped inspire the creation of the Behavioral Insights Team, The New York Times columnist David Brooks, and Nobel Prize Winner Daniel Kahneman. They’ve created a strong partnership with the prestigious think tank Brookings Institute, who will serve as their publishing partner and who they plan will also co-host briefings for policy makers in Washington…”

Open Data is a Civil Right


Yo Yoshida, Founder & CEO, Appallicious in GovTech: “As Americans, we expect a certain standardization of basic services, infrastructure and laws — no matter where we call home. When you live in Seattle and take a business trip to New York, the electric outlet in the hotel you’re staying in is always compatible with your computer charger. When you drive from San Francisco to Los Angeles, I-5 doesn’t all-of-a-sudden turn into a dirt country road because some cities won’t cover maintenance costs. If you take a 10-minute bus ride from Boston to the city of Cambridge, you know the money in your wallet is still considered legal tender.

But what if these expectations of consistency were not always a given? What if cities, counties and states had absolutely zero coordination when it came to basic services? This is what it is like for us in the open data movement. There are so many important applications and products that have been built by civic startups and concerned citizens. However, all too often these efforts are confided to city limits, and unavailable to anyone outside of them. It’s time to start reimagining the way cities function and how local governments operate. There is a wealth of information housed in local governments that should be public by default to help fuel a new wave of civic participation.
Appallicious’ Neighborhood Score provides an overall health and sustainability score, block-by-block for every neighborhood in the city of San Francisco. The first time metrics have been applied to neighborhoods so we can judge how government allocates our resources, so we can better plan how to move forward. But, if you’re thinking about moving to Oakland, just a subway stop away from San Francisco and want to see the score for a neighborhood, our app can’t help you, because that city has yet to release the data sets we need.
In Contra Costa County, there is the lifesaving PulsePoint app, which notifies smartphone users who are trained in CPR when someone nearby may be in need of help. This is an amazing app—for residents of Contra Costa County. But if someone in neighboring Alameda County needs CPR, the app, unfortunately, is completely useless.
Buildingeye visualizes planning and building permit data to allow users to see what projects are being proposed in their area or city. However, buildingeye is only available in a handful of places, simply because most cities have yet to make permits publicly available. Think about what this could do for the construction sector — an industry that has millions of jobs for Americans. Buildingeye also gives concerned citizens access to public documents like never before, so they can see what might be built in their cities or on their streets.
Along with other open data advocates, I have been going from city-to-city, county-to-county and state-to-state, trying to get governments and departments to open up their massive amounts of valuable data. Each time one city, or one county, agrees to make their data publicly accessible, I can’t help but think it’s only a drop in the bucket. We need to think bigger.
Every government, every agency and every department in the country that has already released this information to the public is a case study that points to the success of open data — and why every public entity should follow their lead. There needs to be a national referendum that instructs that all government data should be open and accessible to the public.
Last May, President Obama issued an executive order requiring that going forward, any data generated by the federal government must be made available to the public in open, machine-readable formats. In the executive order, Obama stated that, “openness in government strengthens our democracy, promotes the delivery of efficient and effective services to the public, and contributes to economic growth.”
If this is truly the case, Washington has an obligation to compel local and state governments to release their data as well. Many have tried to spur this effort. California Lt. Gov. Gavin Newsom created the Citizenville Challenge to speed up adoption on the local level. The U.S. Conference of Mayors has also been vocal in promoting open data efforts. But none of these initiatives could have the same effect of a federal mandate.
What I am proposing is no small feat, and it won’t happen overnight. But there should be a concerted effort by those in the technology industry, specifically civic startups, to call on Congress to draft legislation that would require every city in the country to make their data open, free and machine readable. Passing federal legislation will not be an easy task — but creating a “universal open data” law is possible. It would require little to no funding, and it is completely nonpartisan. It’s actually not a political issue at all; it is, for lack of a better word, and administrative issue.
Often good legislation is blocked because lawmakers and citizens are concerned about project funding. While there should be support to help cities and towns achieve the capability of opening their data, a lot of the time, they don’t need it. In 2009, the city and county of San Francisco opened up its data with zero dollars. Many other cities have done the same. There will be cities and municipalities that will need financial assistance to accomplish this. But it is worth it, and it will not require a significant investment for a substantial return. There are free online open data portals, like ckan, dkan and a new effort from Accela, CivicData.com, to centralize open data efforts.
When the UK Government recently announced a £1.5 million investment to support open data initiatives, its Cabinet Office Minister said, “We know that it creates a more accountable, efficient and effective government. Open Data is a raw material for economic growth, supporting the creation of new markets, business and jobs and helping us compete in the global race.”
We should not fall behind these efforts. There is too much at stake for our citizens, not to mention our economy. A recent McKinsey report found that making open data has the potential to create $3 trillion in value worldwide.
Former Speaker Tip O’Neil famously said, “all politics are local.” But we in the civic startup space believe all data is local. Data is reporting potholes in your neighborhood and identifying high crime areas in your communities. It’s seeing how many farmers’ markets there are in your town compared to liquor stores. Data helps predict which areas of a city are most at risk during a heat wave and other natural disasters. A federal open data law would give the raw material needed to create tools to improve the lives of all Americans, not just those who are lucky enough to live in a city that has released this information on its own.
It’s a different way of thinking about how a government operates and the relationship it has with its citizens. Open data gives the public an amazing opportunity to be more involved with governmental decisions. We can increase accountability and transparency, but most importantly we can revolutionize the way local residents communicate and work with their government.
Access to this data is a civil right. If this is truly a government by, of and for the people, then its data needs to be available to all of us. By opening up this wealth of information, we will design a better government that takes advantage of the technology and skills of civic startups and innovative citizens….”

Intelligent Demand: Policy Rationale, Design and Potential Benefits


New OECD paper: “Policy interest in demand-side initiatives has grown in recent years. This may reflect an expectation that demand-side policy could be particularly effective in steering innovation to meet societal needs. In addition, owing to constrained public finances in most OECD countries, the possibility that demand-side policies might be less expensive than direct support measures is attractive. Interest may also reflect some degree of disappointment with the outcomes of traditional supply-side measures. This paper reviews demand-side innovation policies, their rationales and importance across countries, different approaches to their design, the challenges entailed in their implementation and evaluation, and good practices. Three main forms of demand-side policy are considered: innovation-oriented public procurement, innovation-oriented regulations, and standards. Emphasis is placed on innovation-oriented public procurement.”

Procurement and Civic Innovation


Derek Eder: “Have you ever used a government website and had a not-so-awesome experience? In our slick 2014 world of Google, Twitter and Facebook, why does government tech feel like it’s stuck in the 1990s?
The culprit: bad technology procurement.
Procurement is the procedure a government follows to buy something–letting suppliers know what they want, asking for proposals, restricting what kinds of proposal they will consider, limiting what kinds of firms they will do business with, and deciding if what they got what they paid for.
The City of Chicago buys technology about the same way that they buy health insurance, a bridge, or anything else in between. And that’s the problem.
Chicago’s government has a long history of corruption, nepotism and patronage. After each outrage, new rules are piled upon existing rules to prevent that crisis from happening again. Unfortunately, this accumulation of rules does not just protect against the bad guys, it also forms a huge barrier to entry for technology innovators.
So, the firms that end up building our city’s digital public services tend to be good at picking their way through the barriers of the procurement process, not at building good technology. Instead of making government tech contracting fair and competitive, procurement has unfortunately had the opposite effect.
So where does this leave us? Despite Chicago’s flourishing startup scene, and despite having one of the country’s largest community of civic technologists, the Windy City’s digital public services are still terribly designed and far too expensive to the taxpayer.

The Technology Gap

The best way to see the gap between Chicago’s volunteer civic tech community and the technology that the City pays is to look at an entire class of civic apps that are essentially facelifts on existing government websites….
You may have noticed an increase in quality and usability between these three civic apps and their official government counterparts.
Now consider this: all of the government sites took months to build and cost hundreds of thousands of dollars. Was My Car Towed, 2nd City Zoning and CrimeAround.us were all built by one to two people in a matter of days, for no money.
Think about that for a second. Consider how much the City is overpaying for websites its citizens can barely use. And imagine how much better our digital city services would be if the City worked with the very same tech startups they’re trying to nurture.
Why do these civic apps exist? Well, with the City of Chicago releasing hundreds of high quality datasets on their data portal over the past three years (for which they should be commended), a group of highly passionate and skilled technologists have started using their skills to develop these apps and many others.
It’s mostly for fun, learning, and a sense of civic duty, but it demonstrates there’s no shortage of highly skilled developers who are interested in using technology to make their city a better place to live in…
Two years ago, in the Fall of 2011, I learned about procurement in Chicago for the first time. An awesome group of developers, designers and I had just built ChicagoLobbyists.org – our very first civic app – for the City of Chicago’s first open data hackathon….
Since then, the City has often cited ChicagoLobbyists.org as evidence of the innovation-sparking potential of open data.
Shortly after our site launched, a Request For Proposals, or RFP, was issued by the City for an ‘Online Lobbyist Disclosure System.’
Hey! We just built one of those! Sure, we would need to make some updates to it—adding a way for lobbyists to log in and submit their info—but we had a solid start. So, our scrappy group of tech volunteers decided to respond to the RFP.
After reading all 152 pages of the document, we realized we had no chance of getting the bid. It was impossible for the ChicagoLobbyists.org group to meet the legal requirements (as it would have been for any small software shop):

  • audited financial statements for the past 3 years
  • an economic disclosure statement (EDS) and affidavit
  • proof of $500k workers compensation and employers liability
  • proof of $2 million in professional liability insurance”