How open data can help shape the way we analyse electoral behaviour


Harvey Lewis (Deloitte), Ulrich Atz, Gianfranco Cecconi, Tom Heath (ODI) in The Guardian: Even after the local council elections in England and Northern Ireland on 22 May, which coincided with polling for the European Parliament, the next 12 months remain a busy time for the democratic process in the UK.
In September, the people of Scotland make their choice in a referendum on the future of the Union. Finally, the first fixed-term parliament in Westminster comes to an end with a general election in all areas of Great Britain and Northern Ireland in May 2015.
To ensure that as many people as possible are eligible and able to vote, the government is launching an ambitious programme of Individual Electoral Registration (IER) this summer. This will mean that the traditional, paper-based approach to household registration will shift to a tailored and largely digital process more in-keeping with the data-driven demands of the twenty-first century.
Under IER, citizens will need to provide ‘identifying information’, such as date of birth or national insurance number, when applying to register.

Ballots: stuck in the past?

However, despite the government’s attempts through IER to improve the veracity of information captured prior to ballots being posted, little has changed in terms of the vision for capturing, distributing and analysing digital data from election day itself.

Advertisement

Indeed, paper is still the chosen medium for data collection.
Digitising elections is fraught with difficulty, though. In the US, for example, the introduction of new voting machines created much controversy even though they are capable of providing ‘near-perfect’ ballot data.
The UK’s democratic process is not completely blind, though. Numerous opinion surveys are conducted both before and after polling, including the long-running British Election Study, to understand the shifting attitudes of a representative cross-section of the electorate.
But if the government does not retain in sufficient geographic detail digital information on the number of people who vote, then how can it learn what is necessary to reverse the long-running decline in turnout?

The effects of lack of data

To add to the debate around democratic engagement, a joint research team, with data scientists from Deloitte and the Open Data Institute (ODI), have been attempting to understand what makes voters tick.
Our research has been hampered by a significant lack of relevant data describing voter behaviour at electoral ward level, as well as difficulties in matching what little data is available to other open data sources, such as demographic data from the 2011 Census.
Even though individual ballot papers are collected and verified for counting the number of votes per candidate – the primary aim of elections, after all – the only recent elections for which aggregate turnout statistics have been published at ward level are the 2012 local council elections in England and Wales. In these elections, approximately 3,000 wards from a total of over 8,000 voted.
Data published by the Electoral Commission for the 2013 local council elections in England and Wales purports to be at ward level but is, in fact, for ‘county electoral divisions’, as explained by the Office for National Statistics.
Moreover, important factors related to the accessibility of polling stations – such as the distance from main population centres – could not be assessed because the location of polling stations remains the responsibility of individual local authorities – and only eight of these have so far published their data as open data.
Given these fundamental limitations, drawing any robust conclusions is difficult. Nevertheless, our research shows the potential for forecasting electoral turnout with relatively few census variables, the most significant of which are age and the size of the electorate in each ward.

What role can open data play?

The limited results described above provide a tantalising glimpse into a possible future scenario: where open data provides a deeper and more granular understanding of electoral behaviour.
On the back of more sophisticated analyses, policies for improving democratic engagement – particularly among young people – have the potential to become focused and evidence-driven.
And, although the data captured on election day will always remain primarily for the use of electing the public’s preferred candidate, an important secondary consideration is aggregating and publishing data that can be used more widely.
This may have been prohibitively expensive or too complex in the past but as storage and processing costs continue to fall, and the appetite for such knowledge grows, there is a compelling business case.
The benefits of this future scenario potentially include:

  • tailoring awareness and marketing campaigns to wards and other segments of the electorate most likely to respond positively and subsequently turn out to vote
  • increasing the efficiency with which European, general and local elections are held in the UK
  • improving transparency around the electoral process and stimulating increased democratic engagement
  • enhancing links to the Government’s other significant data collection activities, including the Census.

Achieving these benefits requires commitment to electoral data being collected and published in a systematic fashion at least at ward level. This would link work currently undertaken by the Electoral Commission, the ONS, Plymouth University’s Election Centre, the British Election Study and the more than 400 local authorities across the UK.”

How to treat government like an open source project


Ben Balter in OpenSource.com: “Open government is great. At least, it was a few election cycles ago. FOIA requests, open data, seeing how your government works—it’s arguably brought light to a lot of not-so-great practices, and in many cases, has spurred citizen-centric innovation not otherwise imagined before the information’s release.
It used to be that sharing information was really, really hard. Open government wasn’t even a possibility a few hundred years ago. Throughout the history of communication tools—be it the printing press, fax machine, or floppy disks—new tools have generally done three things: lowered the cost to transmit information, increased who that information could be made available to, and increase how quickly that information could be distributed. But, printing presses and fax machines have two limitations: they are one way and asynchronous. They let you more easily request, and eventually see how the sausage was made but don’t let you actually take part in the sausage-making. You may be able to see what’s wrong, but you don’t have the chance to make it better. By the time you find out, it’s already too late.
As technology allows us to communicate with greater frequency and greater fidelity, we have the chance to make our government not only transparent, but truly collaborative.

So, how do we encourage policy makers and bureaucrats to move from open government to collaborative government, to learn open source’s lessons about openness and collaboration at scale?
For one, we geeks can help to create a culture of transparency and openness within government by driving up the demand side of the equation. Be vocal, demand data, expect to see process, and once released, help build lightweight apps. Show potential change agents in government that their efforts will be rewarded.
Second, it’s a matter of tooling. We’ve got great tools out there—things like Git that can track who made what change when and open standards like CSV or JSON that don’t require proprietary software—but by-and-large they’re a foreign concept in government, at least among those empowered to make change. Command line interfaces with black background and green text can be intimidating to government bureaucrats used to desktop publishing tools. Make it easier for government to do the right thing and choose open standards over proprietary tooling.”
Last, be a good open source ambassador. Help your home city or state get involved with open source. Encourage them to take their first step (be it consuming open source, publishing, or collaborating with the public), teach them what it means to do things in the open, And when they do push code outside the firewall, above all, be supportive. We’re in this together.
As technology makes it easier to work together, geeks can help make our government not just open, but in fact collaborative. Government is the world’s largest and longest running open source project (bugs, trolls, and all). It’s time we start treating it like one.

Citizen participation and technology


ICTlogy: “The recent, rapid rise in the use of digital technology is changing relationships between citizens, organizations and public institutions, and expanding political participation. But while technology has the potential to amplify citizens’ voices, it must be accompanied by clear political goals and other factors to increase their clout.
Those are among the conclusions of a new NDI study, “Citizen Participation and Technology,” that examines the role digital technologies – such as social media, interactive websites and SMS systems – play in increasing citizen participation and fostering accountability in government. The study was driven by the recognition that better insights are needed into the relationship between new technologies, citizen participation programs and the outcomes they aim to achieve.
Using case studies from countries such as Burma, Mexico and Uganda, the study explores whether the use of technology in citizen participation programs amplifies citizen voices and increases government responsiveness and accountability, and whether the use of digital technology increases the political clout of citizens.
The research shows that while more people are using technology—such as social media for mobile organizing, and interactive websites and text messaging systems that enable direct communication between constituents and elected officials or crowdsourcing election day experiences— the type and quality of their political participation, and therefore its impact on democratization, varies. It also suggests that, in order to leverage technology’s potential, there is a need to focus on non-technological areas such as political organizing, leadership skills and political analysis.
For example, the “2% and More Women in Politics” coalition led by Mexico’s National Institute for Women (INMUJERES) used a social media campaign and an online petition to call successfully for reforms that would allocate two percent of political party funding for women’s leadership training. Technology helped the activists reach a wider audience, but women from the different political parties who made up the coalition might not have come together without NDI’s role as a neutral convener.
The study, which was conducted with support from the National Endowment for Democracy, provides an overview of NDI’s approach to citizen participation, and examines how the integration of technologies affects its programs in order to inform the work of NDI, other democracy assistance practitioners, donors, and civic groups.

Observations:

Key findings:

  1. Technology can be used to readily create spaces and opportunities for citizens to express their voices, but making these voices politically stronger and the spaces more meaningful is a harder challenge that is political and not technological in nature.
  2. Technology that was used to purposefully connect citizens’ groups and amplify their voices had more political impact.
  3. There is a scarcity of data on specific demographic groups’ use of, and barriers to technology for political participation. Programs seeking to close the digital divide as an instrument of narrowing the political divide should be informed by more research into barriers to access to both politics and technology.
  4. There is a blurring of the meaning between the technologies of open government data and the politics of open government that clouds program strategies and implementation.
  5. Attempts to simply crowdsource public inputs will not result in users self-organizing into politically influential groups, since citizens lack the opportunities to develop leadership, unity, and commitment around a shared vision necessary for meaningful collective action.
  6. Political will and the technical capacity to engage citizens in policy making, or providing accurate data on government performance are lacking in many emerging democracies. Technology may have changed institutions’ ability to respond to citizen demands but its mere presence has not fundamentally changed actual government responsiveness.”

Online and social media data as a flawed continuous panel survey


Fernando Diaz, Michael Gamon, Jake Hofman, Emre Kıcıman, and David Rothschild from Microsoft Research: “There is a large body of research on utilizing online activity to predict various real world outcomes, ranging from outbreaks of influenza to outcomes of elections. There is considerably less work, however, on using this data to understand topic-specific interest and opinion amongst the general population and specific demographic subgroups, as currently measured by relatively expensive surveys. Here we investigate this possibility by studying a full census of all Twitter activity during the 2012 election cycle along with comprehensive search history of a large panel of internet users during the same period, highlighting the challenges in interpreting online and social media activity as the results of a survey. As noted in existing work, the online population is a non-representative sample of the offline world (e.g., the U.S. voting population). We extend this work to show how demographic skew and user participation is non-stationary and unpredictable over time. In addition, the nature of user contributions varies wildly around important events. Finally, we note subtle problems in mapping what people are sharing or consuming online to specific sentiment or opinion measures around a particular topic. These issues must be addressed before meaningful insight about public interest and opinion can be reliably extracted from online and social media data…”

 

Politics or technology – which will save the world?


David Runciman in the Guardian: (Politics by David Runciman is due from Profile ..It is the first in a series of “Ideas in Profile”) “The most significant revolution of the 21st century so far is not political. It is the information technology revolution. Its transformative effects are everywhere. In many places, rapid technological change stands in stark contrast to the lack of political change. Take the United States. Its political system has hardly changed at all in the past 25 years. Even the moments of apparent transformation – such as the election of Obama in 2008 – have only reinforced how entrenched the established order is: once the excitement died away, Obama was left facing the same constrained political choices. American politics is stuck in a rut. But the lives of American citizens have been revolutionised over the same period. The birth of the web and the development of cheap and efficient devices through which to access it have completely altered the way people connect with each other. Networks of people with shared interests, tastes, concerns, fetishes, prejudices and fears have sprung up in limitless varieties. The information technology revolution has changed the way human beings befriend each other, how they meet, date, communicate, medicate, investigate, negotiate and decide who they want to be and what they want to do. Many aspects of our online world would be unrecognisable to someone who was transplanted here from any point in the 20th century. But the infighting and gridlock in Washington would be all too familiar.
This isn’t just an American story. China hasn’t changed much politically since 4 June 1989, when the massacre in Tiananmen Square snuffed out a would-be revolution and secured the current regime’s hold on power. But China itself has been totally altered since then. Economic growth is a large part of the difference. But so is the revolution in technology. A country of more than a billion people, nearly half of whom still live in the countryside, has been transformed by the mobile phone. There are currently over a billion phones in use in China. Ten years ago, fewer than one in 10 Chinese had access to one; today there is nearly one per person. Individuals whose horizons were until very recently constrained by physical geography – to live and die within a radius of a few miles from your birthplace was not unusual for Chinese peasants even into this century – now have access to the wider world. For the present, though maybe not for much longer, the spread of new technology has helped to stifle the call for greater political change. Who needs a political revolution when you’ve got a technological one?

Advertisement

Technology has the power to make politics seem obsolete. The speed of change leaves government looking slow, cumbersome, unwieldy and often irrelevant. It can also make political thinking look tame by comparison with the big ideas coming out of the tech industry. This doesn’t just apply to far‑out ideas about what will soon be technologically possible: intelligent robots, computer implants in the human brain, virtual reality that is indistinguishable from “real” reality (all things that Ray Kurzweil, co-founder of the Google-sponsored Singularity University, thinks are coming by 2030). In this post-ideological age some of the most exotic political visions are the ones that emerge from discussions about tech. You’ll find more radical libertarians and outright communists among computer scientists than among political scientists. Advances in computing have thrown up fresh ways to think about what it means to own something, what it means to share something and what it means to have a private life at all. These are among the basic questions of modern politics. However, the new answers rarely get expressed in political terms (with the exception of occasional debates about civil rights for robots). More often they are expressions of frustration with politics and sometimes of outright contempt for it. Technology isn’t seen as a way of doing politics better. It’s seen as a way of bypassing politics altogether.
In some circumstances, technology can and should bypass politics. The advent of widespread mobile phone ownership has allowed some of the world’s poorest citizens to wriggle free from the trap of failed government. In countries that lack basic infrastructure – an accessible transport network, a reliable legal system, a usable banking sector – phones enable people to create their own networks of ownership and exchange. In Africa, a grassroots, phone-based banking system has sprung up that for the first time permits money transfers without the physical exchange of cash. This makes it possible for the inhabitants of desperately poor and isolated rural areas to do business outside of their local communities. Technology caused this to happen; government didn’t. For many Africans, phones are an escape route from the constrained existence that bad politics has for so long mired them in.
But it would be a mistake to overstate what phones can do. They won’t rescue anyone from civil war. Africans can use their phones to tell the wider world of the horrors that are still taking place in some parts of the continent – in South Sudan, in Eritrea, in the Niger Delta, in the Central African Republic, in Somalia. Unfortunately the world does not often listen, and nor do the soldiers who are doing the killing. Phones have not changed the basic equation of political security: the people with the guns need a compelling reason not to use them. Technology by itself doesn’t give them that reason. Equally, technology by itself won’t provide the basic infrastructure whose lack it has provided a way around. If there are no functioning roads to get you to market, a phone is a godsend when you have something to sell. But in the long run, you still need the roads. In the end, only politics can rescue you from bad politics…”

What happened to the idea of the Great Society?


John Micklethwait and Adrian Wooldridge in the Financial Times: “Most of the interesting experiments in government are taking place far from Washington: in Singapore, which delivers much better public services at a fraction of the cost; in Brazil, with its “conditional” welfare payments, dependent on behaviour; in Scandinavia, where “socialist” Sweden has cut state spending from 67 per cent of GDP in 1993 to 49 per cent, introduced school vouchers and brought entitlements into balance by raising the retirement age. In the US, the dynamic bits of government are in its cities, where pragmatic mayors are experimenting with technology.
What will replace the Great Society? For Republicans, the answer looks easy: just shrink government. But this gut instinct runs up against two big problems. The assumption that government is evil means they never take it seriously (Singapore has a tiny state but pays its best civil servants $2m a year). And, in practice, American conservatives are addicted to Big Government: hence the $1.3tn of exemptions in the US tax code, most of which are in effect a welfare state for the rich.
For Democrats, the problem is even worse. Having become used to promising ever more entitlements to voters, they face a series of unedifying choices: whether to serve society at large (by making schools better) or to protect public sector unions (teachers account for many of their activists); and whether to offer ever less generous universal benefits to the entire population or to target spending on the disadvantaged.
This is where the politics of the future will be fought, on both sides of the Atlantic. It will not be as inspiring as the Great Society. It will be about slimming and modernising government, tying pensions to life expectancy and unleashing technology on the public sector.
But what the US – and Europe – needs is cool-headed pragmatism. Government is neither a monster nor a saviour but an indispensable part of a decent society that, like most organisations, works best when it focuses on doing a few things well.”

A civic-social platform for a new kind of citizen duty


Dirk Jan van der Wal at OpenSource.com: “In the Netherlands a community of civil servants has developed an open source platform for collaboration within the public sector. What began as a team of four has grown to over 75,000 registered users. What happened? And, why was open source key to the project’s success?
Society is rapidly changing. One change is the tremendous development of Internet and Web-based tools. These tools have opened up new ways for collaboration and sharing information. This is a big change for our society and democracy, having an impact on our politics. How does government change along with it?
A need to change the way government organizations worked and civil servants interacted too could not be ignored. Take for example, politicians resigning because of one tweet! Meanwhile, government organizations continually face the challenge of doing more with less funds. I think this increased the need to cooperate and share knowledge; it was not longer feasible for smaller communities to maintain knowledge on their own.
The question became: How do we cooperate in an efficient manner?
In the Netherlands, we have over 500 different government organizations: departments, city councils, provinces, and so on. All these organizations have their own information and communications technology (ICT) environment. So, with a growing network and discussions around multiple themes, it became clear that one of the basic requirements for cooperating efficiently is having a government-wide platform for people to communicate and work from.
So, a small team of four started Pleio for Dutch civil servants and citizens to meet each other, have discussions, and work together on things that matter to them.
(Pleio translates loosely in English to “government square.”)
As in real life, citizens and government officials work together across various teams, groups, and networks to think about and do work on projects that matter. Using the Pleio online platform, citizens and government officials can find and then engage with the right people to collaborate on a project or problem…”

Global democracy and the democratic minimum: Why a procedural account alone is insufficient


Paper by Klaus Dingwerth in the European Journal of International Relations: “In this critical comment on the global democracy debate, I take stock of contemporary proposals for democratizing global governance. In the first part of the article, I show that, empirically, many international institutions are now evaluated in terms of their democratic credentials. At the same time, the notions of democracy that underpin such evaluations are often very formalistic. They focus on granting access to civil society organizations, making policy-relevant documents available online or establishing global parliamentary assemblies to give citizens a voice in the decision-making of international organizations. In the second part, I challenge this focus on formal procedures and argue that a normatively persuasive conception of global democracy would shift our focus to areas such as health, education and subsistence. Contrary to much contemporary thinking about global democracy, I thus defend the view that the institutions we have are sufficiently democratic. What is needed are not better procedures, but investments that help the weaker members of global society to make effective use of the democracy-relevant institutions that exist in contemporary international politics”

Free Online Lawmaking Platform for Washington, D.C.


OpenGov Foundation: “At-Large Councilmember David Grosso and The OpenGov Foundation today launched the beta version of MadisonDC, a free online lawmaking tool that empowers citizens to engage directly with their elected officials – and the policymaking process itself – by commenting on, proposing changes to, and debating real D.C. Council legislation.  Grosso is the first-ever District elected official to give citizens the opportunity to log on and legislate, putting him at the forefront of a nation-wide movement reinventing local legislatures with technology.  Three bills are now open for crowdsourcing on MadisonDC: a plan to fully legalize marijuana, a proposal to make zoning laws more friendly to urban farmers, and legislation to create open primary elections….
MadisonDC is the District of Columbia’s version of the freeMadison software that reinvents government for the Internet Age.  Madison 1.0 powered the American people’s successful defense of Internet freedom from Congressional threats.  It delivered the first crowdsourced bill in the history of the U.S. Congress.  And now, the non-partisan, non-profit OpenGov Foundation has released Madison 2.0, empowering you to participate in your government, efficiently access your elected officials, and hold them accountable.”

How Big Data Could Undo Our Civil-Rights Laws


Virginia Eubanks in the American Prospect: “From “reverse redlining” to selling out a pregnant teenager to her parents, the advance of technology could render obsolete our landmark civil-rights and anti-discrimination laws.
Big Data will eradicate extreme world poverty by 2028, according to Bono, front man for the band U2. But it also allows unscrupulous marketers and financial institutions to prey on the poor. Big Data, collected from the neonatal monitors of premature babies, can detect subtle warning signs of infection, allowing doctors to intervene earlier and save lives. But it can also help a big-box store identify a pregnant teenager—and carelessly inform her parents by sending coupons for baby items to her home. News-mining algorithms might have been able to predict the Arab Spring. But Big Data was certainly used to spy on American Muslims when the New York City Police Department collected license plate numbers of cars parked near mosques, and aimed surveillance cameras at Arab-American community and religious institutions.
Until recently, debate about the role of metadata and algorithms in American politics focused narrowly on consumer privacy protections and Edward Snowden’s revelations about the National Security Agency (NSA). That Big Data might have disproportionate impacts on the poor, women, or racial and religious minorities was rarely raised. But, as Wade Henderson, president and CEO of the Leadership Conference on Civil and Human Rights, and Rashad Robinson, executive director of ColorOfChange, a civil rights organization that seeks to empower black Americans and their allies, point out in a commentary at TPM Cafe, while big data can change business and government for the better, “it is also supercharging the potential for discrimination.”
In his January 17 speech on signals intelligence, President Barack Obama acknowledged as much, seeking to strike a balance between defending “legitimate” intelligence gathering on American citizens and admitting that our country has a history of spying on dissidents and activists, including, famously, Dr. Martin Luther King, Jr. If this balance seems precarious, it’s because the links between historical surveillance of social movements and today’s uses of Big Data are not lost on the new generation of activists.
“Surveillance, big data and privacy have a historical legacy,” says Amalia Deloney, policy director at the Center for Media Justice, an Oakland-based organization dedicated to strengthening the communication effectiveness of grassroots racial justice groups. “In the early 1960s, in-depth, comprehensive, orchestrated, purposeful spying was used to disrupt political movements in communities of color—the Yellow Peril, the American Indian Movement, the Brown Berets, or the Black Panthers—to create fear and chaos, and to spread bias and stereotypes.”
In the era of Big Data, the danger of reviving that legacy is real, especially as metadata collection renders legal protection of civil rights and liberties less enforceable….
Big Data and surveillance are unevenly distributed. In response, a coalition of 14 progressive organizations, including the ACLU, ColorOfChange, the Leadership Conference on Civil and Human Rights, the NAACP, National Council of La Raza, and the NOW Foundation, recently released five “Civil Rights Principles for the Era of Big Data.” In their statement, they demand:

  • An end to high-tech profiling;
  • Fairness in automated decisions;
  • The preservation of constitutional principles;
  • Individual control of personal information; and
  • Protection of people from inaccurate data.

This historic coalition aims to start a national conversation about the role of big data in social and political inequality. “We’re beginning to ask the right questions,” says O’Neill. “It’s not just about what can we do with this data. How are communities of color impacted? How are women within those communities impacted? We need to fold these concerns into the national conversation.”