Concerns about opening up data, and responses which have proved effective


Google doc by Christopher Gutteridge, University of Southampton and Alexander Dutton, University of Oxford:  “This document is inspired by the open data excuses bingo card. Someone asked for what responses have proved effective. This document is a work in progress based on our experience. Carly Strasser has also written at the Data Pub blog about these issues from an Open Science and research data perspective. You may also be interested in How to make a business case for open data, published by the ODI.
We’ll get spam…
Terrorists might use the data…
People will contact us to ask about stuff…
People will misinterpret the data…
It’s too big…
It’s not very interesting…
We might want to use it in a research paper…
There’s no API to that system…
We’re worried about the Data Protection Act…
We’re not sure that we own it…
I don’t mind making it open, but I worry someone else might object…
It’s too complicated…
Our data is embarrassingly bad…
It’s not a priority and we’re busy…
Our lawyers want to make a custom license…
It changes too quickly…
There’s already a project in progress which sounds similar…
Some of what you asked for is confidential…
I don’t own the data, so can’t give you permission…
We don’t have that data…
That data is already published via (external organisation X)….
We can’t provide that dataset because one part is not possible…
What if something breaks and the open version becomes out of date?…
We can’t see the benefit…
What if we want to sell access to this data…?
If we publish this data, people might sue us…
We want people to come direct to us so we know why they want the data…

Open Government and Its Constraints


Blog entry by Panthea Lee: “Open government” is everywhere. Search the term and you’ll find OpenGovernment.orgOpenTheGovernment.orgOpen Government InitiativeOpen Gov Hub and the Open Gov Foundation; you’ll find open government initiatives for New York CityBostonKansasVirginiaTennessee and the list goes on; you’ll find dedicated open government plans for the White HouseState DepartmentUSAIDTreasuryJustice DepartmentCommerceEnergy and just about every other major federal agency. Even the departments of Defense and Homeland Security are in on open government.
And that’s just in the United States.
There is Open Government AfricaOpen Government in the EU and Open Government Data. The World Bank has an Open Government Data Toolkit and recently announced a three-year initiative to help developing countries leverage open data. And this week, over 1,000 delegates from over 60 countries are in London for the annual meeting of the Open Government Partnership, which has grown from 8 to 60 member states in just two years….
Many of us have no consensus or clarity on just what exactly “open government” iswhat we hope to achieve from it or how to measure our progress. Too often, our initiatives are designed through the narrow lenses of our own biases and without a concrete understanding of those they are intended for — both those in and out of government.
If we hope to realize the promise of more open governments, let’s be clear about the barriers we face so that we may start to overcome them.
Barrier 1: “Open Gov” is…?
Open government is… not new, for starters….
Barrier 2: Open Gov is Not Inclusive
The central irony of open government is that it’s often not “open” at all….
Barrier 3: Open Gov Lacks Empathy
Open government practitioners love to speak of “the citizen” and “the government.” But who exactly are these people? Too often, we don’t really know. We are builders, makers and creators with insufficient understanding of whom we are building, making and creating for…On the flip side, who do we mean by “the government?” And why, gosh darn it, is it so slow to innovate? Simply put, “the government” is comprised of individual people working in environments that are not conducive to innovation….
For open government to realize its potential, we must overcome these barriers.”

Mozilla Location Service: crowdsourcing data to help devices find your location without GPS


“The Mozilla Location Service is an experimental pilot project to provide geolocation lookups based on publicly observable cell tower and WiFi access point information. Currently in its early stages, it already provides basic service coverage of select locations thanks to our early adopters and contributors.
A world map showing areas with location data. Map data provided by mapbox / OpenStreetMap.
While many commercial services exist in this space, there’s currently no large public service to provide this crucial part of any mobile ecosystem. Mobile phones with a weak GPS signal and laptops without GPS hardware can use this service to quickly identify their approximate location. Even though the underlying data is based on publicly accessible signals, geolocation data is by its very nature personal and privacy sensitive. Mozilla is committed to improving the privacy aspects for all participants of this service offering.
If you want to help us build our service, you can install our dedicated Android MozStumbler and enjoy competing against others on our leaderboard or choose to contribute anonymously. The service is evolving rapidly, so expect to see a more full featured experience soon. For an overview of the current experience, you can head over to the blog of Soledad Penadés, who wrote a far better introduction than we did.
We welcome any ideas or concerns about this project and would love to hear any feedback or experience you might have. Please contact us either on our dedicated mailing list or come talk to us in our IRC room #geo on Mozilla’s IRC server.
For more information please follow the links on our project page.”

Scientific Humanities


New course by Bruno Latour: “Scientific humanities” means the extension of interpretative skills to the discoveries made by science and to technical innovations. The course will equip future citizens with the means to be at ease with many issues that straddle the distinctions between science, morality, politics and society.
The course provides concepts and methods to :

  • learn the basics of the field called “science and technology studies”, a vast corpus of literature developed over the last forty years to give a realistic description of knowledge production
  • handle the flood of different opinions about contentious issues and order the various positions by using the tools now available through digital media
  • comment on those different pieces of news in a more articulated way through a specifically designed blog.

Course Format : the course is organized in 8 sequences It displays multimedia contents (images, video, original documents)
Bruno Latour was trained as a philosopher and an anthropologist. From 1982 to 2006, he has been professor at the CSI (Ecole des mines) in Paris. He is now professor at Sciences Po where he created the medialab in 2009. He became famous for his social studies of science and technology. He developed with others a widely known theory called “Actor Network Theory”.
http://www.bruno-latour.fr/

IRM releases United States report for public comment


“The Open Government Partnership’s Independent Reporting Mechanism (IRM) has launched its eighth progress reports for public comment; this one is on the United States and can be found below….
The United States’ action plan was highly varied and, in many respects, ambitious and innovative and significant progress was made on most of the commitments. While OGP implementation in the United States drew inspiration from an unprecedented consultation on open government during the implementation of the 2009 Open Government Directive, the dedicated public consultation for the OGP action plan was more limited and arguably more targeted.
Several of the commitments in the action plan focused on improving transparency; however, open government progress has been relatively slower in controversial areas such as national security, ethics reform, declassification of documents, and Freedom of Information Act reform.
The United States completed half of the commitments in its action plan, while the other half saw limited or substantial progress.
Due to the nature of the US government, wherein federal agencies are to some degree independent of the White House, much of the best participation took place within agencies. There were several notable examples of participation and collaboration at this level, including the commitments around the Extractive Industries Transparency Initiative, the National Dialogue on Federal Website Policy, and NASA’s Space Apps competition.
This report is a draft for public comment.  All interested parties are encouraged to comment on this blog or to send public comments to [email protected] until November 14. Comments will be collated and published, except where the requestor asks to be anonymous. Where substantive factual errors are identified, comments will be integrated into a final version of the report.”
 

United States IRM Report

Residents remix their neighborhood’s streets through platform


Springwise: “City residents may not have degrees in urban planning, but their everyday use of high streets, parks and main roads means they have some valuable input into what’s best for their local environment. A new website called Streetmix is helping to empower citizens, enabling them to become architects with an easy-to-use street-building platform.
Developed by Code for America, the site greets users with a colorful cartoon representation of a typical street, split into segments of varying widths. Designers can then swap and change each piece into road, cycle paths, pedestrian areas, bus stops, bike racks and other amenities, as well as alter their dimensions. Users can create their own perfect high street or use the exact measurements of their own neighborhood to come up with new propositions for planned construction work. Indeed, Streetmix has already found use among residents and organizations to demonstrate how to better use the local space available. Kansas City’s Bike Walk KC has utilized the platform to show how new bike lanes could figure in an upcoming study of traffic flow in the region, while New Zealand’s Transport Blog has presented several alternatives to current street layouts in Auckland.
Streetmix is an easy-to-use visualization tool that can help amateurs present their ideas to local authorities in a more coherent way, potentially increasing the chances of politicians hearing calls for change. Are there other ways to help laymen express complex ideas more eloquently?”
Spotted by Murtaza Patel, written by Springwise

You Can Predict What Government Agencies Will Buy; For Real!


Jen Clement at GovLoop: “Two great free government-run websites that show how federal government agencies are spending their money are USASpending.gov and FedBizOpps.gov. Each site allows you to research how the government has spent its procurement dollars in the last several years, and can give business owners a snapshot of what industry segments and what type of commercial products and services offer the best contracting opportunities so vendors can conduct their target business analysis and approach a select group of potential buyers.

SmartProcure offers a unique service that allows you to search thousands and thousands of government purchase orders, providing you ability to predict purchasing opportunity in the future. SmartProcure lets you search specifically for a product or service you sell and show you exactly which government agencies have bought that product or service, how much they paid, and which vendors (your competitors) they’ve purchased from. In addition to purchasing histories you’ll have access to powerful market analysis tools to help you conduct thorough competitive and market intelligence reviews to find the right niches for your business to take advantage of.  Whether it is federal, state, or local governments, a snapshot into the past can help determine the future…
For more helpful tips visit:  https://ow133.infusionsoft.com/go/blog/jc/

Out in the Open: Hackers Bring Lawmaking Into the 21st Century


Wired: “Have you ever thought you could do a better job writing the laws of our country than those jokers on Capitol Hill? Or have you at least felt the urge to scratch a few lines out of a bill and replace them with something else? Here’s your chance.
Every bill currently being debated in the U.S. House of Representatives is available from a single website, and anyone can comment on the legislation or annotate it.
The site is powered by Madison Project, an open source software platform for writing, publishing, and annotating legislation. Like the site itself, the software was created by the OpenGov Foundation, a non-partisan, nonprofit organization co-founded by Rep. Darrell Issa, a Republican from California….
Any government agency or advocacy group can use Madison to gather public feedback on legislation. It’s slated to be used in Baltimore and San Francisco, where everything from building codes to LSD laws will be open to public comment. Meanwhile, CrunchGov, a tech politics site run by the blog TechCrunch, and a lobbying firm called the Internet Association use Madison to gather policy ideas from the public.1
Madison is a lot like a wiki or content management system such as Drupal and WordPress, but instead of juggling blog posts or technical documentation, its users manage policy.
For now, the San Francisco and Baltimore sites only let you comment on laws using Disqus (Kraft describes this as a “baby step” toward a full Madison roll-out). And though the CrunchGov and House of Representatives site let you edit policy as well, the changes you make to a bill or law can’t yet be shared with others. Kraft says future versions will include tools for sharing custom versions of a law and a Wikipedia-style system for tracking changes. He also says it will integrate with GitHub, a site originally designed for software developers to share and collaborate on code but now used for a wide variety of other purposes, from wedding planning to public policy.”

GitHub and Government


New site: “Make government better, together. Stories of open source, open data, and open government.
This site is an open source effort to showcase best practices of open sourcing government. See something that you think could be better? Want to submit your own story? Simply fork the project and submit a pull request.

Ready to get started on GitHub? Here are some ideas that are easy to get your feet wet with.

Feedback Repository

GitHub’s about connecting with developers. Whether you’re an API publishing pro, or just getting started, creating a “feedback” repository can go a long way to connect your organization with the community. Get feedback from current and potential data consumers by creating a specific repository for them to contribute ideas and suggestions for types of data or other information they’d like to see opened. Here’s how:

  1. Create a new repository
    • Choose your organization as the Owner
    • Name the repository “feedback” or similar
    • Click the checkbox to automatically create a README.md file
  2. Set up your Readme
    • Click README.md within your newly created repository
    • Click Edit
    • Introduce yourself, describe why you’ve joined GitHub, what you’re hoping to do and what you’d like to learn from the development community. Encourage them to leave feedback through issues on the repository.

Sample text for your README.md:

# City of Gotham Feedback
We've just joined GitHub and want to know what data would be interesting to our development community?
Leave us comments via issues!

Open source a Dataset

Open sourcing a dataset can be as simple as uploading a .csv to GitHub and letting people know about it. Rather than publishing data as a zip file on your website or an FTP server, you can add the files through the GitHub.com web interface, or via the GitHub for Windows or GitHub for Mac native clients. Create a new repository to store your datasets – in many cases, it’s as easy as drag, drop, sync.
GitHub can host any file type (although open, non-binary files like .csvs tend to work best). Plus, GitHub supports rendering certain open data formats interactively such as the popular geospacial .geojson format. Once uploaded, citizens can view the files, and can even open issues or submit pull requests with proposed fixes.

Explore Open Source Civic Apps

There are many open source applications freely available on GitHub that were built just for government. Check them out, and see if it fits a need. Here are some examples:

  • Adopt-a – This open source web app was created for the City of Boston in 2011 by Code for America fellows. It allows residents to “adopt” a hydrant and make sure it’s clear of snow in the winter so that emergency crews can locate them when needed. It has since been adopted in Chicago (for sidewalks), Seattle (for storm drains), and Honolulu (for tsunami sirens).
  • StreetMix – Another creation of Code for America fellows (2013) this website, www.streetmix.net, allows anyone to create street sections in a way that is not only beautiful but educational, too. No downloading, no installing, no paying – make and save your creations right at the website. Great for internal or public community planning meetings.
  • We The PeopleWe The People, the White House’s petitions application hosted at petitions.whitehouse.gov is a Drupal module to allow citizens to submit and digitally sign petitions.

Open source something small

Chances are you’ve got something small you can open source. Check in with your web or new media team, and see if they’ve got something they’ve been dying to share or blog about, no matter how small. It can be snippet of analytics code, or maybe a small script used internally. It doesn’t even have to be code.
Post your website’s privacy policy, comment moderation policy, or terms of service and let the community weigh in before your next edit. No matter how small it is, getting your first open source project going is a great first step.

Improve an existing project

Does you agency use an existing open source project to conduct its own business? Open an issue on the project’s repository with a feature request or a bug you spot. Better yet, fork the project, and submit your improvements. Even if it’s one or two lines of code, such examples are great to blog about to showcase your efforts.
Don’t forget, this site is an open source project, too. Making an needed edit is another great way to get started.”

Five Ways to Make Government Procurement Better


Mark Headd at Civic Innovations:  “Nothing in recent memory has focused attention on the need for wholesale reform of the government IT procurement system more than the troubled launch of healthcare.gov.
There has been a myriad of blog posts, stories and articles written in the last few weeks detailing all of the problems that led to the ignominious launch of the website meant to allow people to sign up for health care coverage.
Though the details of this high profile flop are in the latest headlines, the underlying cause has been talked about many times before – the process by which governments contract with outside parties to obtain IT services is broken…
With all of this in mind, here are – in no particular order – five suggested changes that can be adopted to improve the government procurement process.
Raise the threshold on simplified / streamlined procurement
Many governments use a separate, more streamlined process for smaller projects that do not require a full RFP (in the City of Philadelphia, professional services projects that do not exceed $32,000 annually go through this more streamlined bidding process). In Philadelphia, we’ve had great success in using these smaller projects to test new ideas and strategies for partnering with IT vendors. There is much we can learn from these experiments, and a modest increase to enable more experimentation would allow governments to gain valuable new insights.
Narrowing the focus of any enhanced thresholds for streamlined budding to web-based projects would help mitigate risk and foster a quicker process for testing new ideas.
Identify clear standards for projects
Having a clear set of vendor-agnostic IT standards to use when developing RFPs and in performing work can make a huge difference in how a project turns out. Clearly articulating standards for:

  • The various components that a system will use.
  • The environment in which it will be housed.
  • The testing it must undergo prior to final acceptance.

…can go a long way to reduce the risk an uncertainly inherent in IT projects.
It’s worth noting that most governments probably already have a set of IT standards that are usually made part of any IT solicitation. But these standards documents can quickly become out of date – they must undergo constant review and refinement. In addition, many of the people writing these standards may confuse a specific vendor product or platform with a true standard.
Require open source
Requiring that IT projects be open source during development or after completion can be an effective way to reduce risk on an IT project and enhance transparency. This is particularly true of web-based projects.
In addition, government RFPs should encourage the use of existing open source tools – leveraging existing software components that are in use in similar projects and maintained by an active community – to foster external participation by vendors and volunteers alike. When governments make the code behind their project open source, they enable anyone that understands software development to help make them better.
Develop a more robust internal capacity for IT project management and implementation
Governments must find ways to develop the internal capacity for developing, implementing and managing technology projects.
Part of the reason that governments make use of a variety of different risk mitigation provisions in public bidding is that there is a lack of people in government with hands on experience building or maintaining technology. There is a dearth of makers in government, and there is a direct relationship between the perceived risk that governments take on with new technology projects and the lack of experienced technologists working in government.
Governments need to find ways to develop a maker culture within their workforces and should prioritize recruitment from the local technology and civic hacking communities.
Make contracting, lobbying and campaign contribution data public as open data
One of the more disheartening revelations to come out of the analysis of healthcare.gov implementation is that some of the firms that were awarded work as part of the project also spent non-trivial amounts of money on lobbying. It’s a good bet that this kind of thing also happens at the state and local level as well.
This can seriously undermine confidence in the bidding process, and may cause many smaller firms – who lack funds or interest in lobbying elected officials – to simply throw up their hands and walk away.
In the absence of statutory or regulatory changes to prevent this from happening, governments can enhance the transparency around the bidding process by working to ensure that all contracting data as well as data listing publicly registered lobbyists and contributions to political campaigns is open.
Ensuring that all prospective participants in the public bidding process have confidence that the process will be fair and transparent is essential to getting as many firms to participate as possible – including small firms more adept at agile software development methodologies. More bids typically equates to higher quality proposals and lower prices.
None of the changes list above will be easy, and governments are positioned differently in how well they may achieve any one of them. Nor do they represent the entire universe of things we can do to improve the system in the near term – these are items that I personally think are important and very achievable.
One thing that could help speed the adoption of these and other changes is the development of robust communication framework between government contracting and IT professionals in different cities and different states. I think a “Municipal Procurement Academy” could go a long way toward achieving this.”