Big Data Becomes a Mirror


Book Review of ‘Uncharted,’ by Erez Aiden and Jean-Baptiste Michel in the New York Times: “Why do English speakers say “drove” rather than “drived”?

As graduate students at the Harvard Program for Evolutionary Dynamics about eight years ago, Erez Aiden and Jean-Baptiste Michel pondered the matter and decided that something like natural selection might be at work. In English, the “-ed” past-tense ending of Proto-Germanic, like a superior life form, drove out the Proto-Indo-European system of indicating tenses by vowel changes. Only the small class of verbs we know as irregular managed to resist.

To test this evolutionary premise, Mr. Aiden and Mr. Michel wound up inventing something they call culturomics, the use of huge amounts of digital information to track changes in language, culture and history. Their quest is the subject of “Uncharted: Big Data as a Lens on Human Culture,” an entertaining tour of the authors’ big-data adventure, whose implications they wildly oversell….

Invigorated by the great verb chase, Mr. Aiden and Mr. Michel went hunting for bigger game. Given a large enough storehouse of words and a fine filter, would it be possible to see cultural change at the micro level, to follow minute fluctuations in human thought processes and activities? Tiny factoids, multiplied endlessly, might assume imposing dimensions.

By chance, Google Books, the megaproject to digitize every page of every book ever printed — all 130 million of them — was starting to roll just as the authors were looking for their next target of inquiry.

Meetings were held, deals were struck and the authors got to it. In 2010, working with Google, they perfected the Ngram Viewer, which takes its name from the computer-science term for a word or phrase. This “robot historian,” as they call it, can search the 30 million volumes already digitized by Google Books and instantly generate a usage-frequency timeline for any word, phrase, date or name, a sort of stock-market graph illustrating the ups and downs of cultural shares over time.

Mr. Aiden, now director of the Center for Genome Architecture at Rice University, and Mr. Michel, who went on to start the data-science company Quantified Labs, play the Ngram Viewer (books.google.com/ngrams) like a Wurlitzer…

The Ngram Viewer delivers the what and the when but not the why. Take the case of specific years. All years get attention as they approach, peak when they arrive, then taper off as succeeding years occupy the attention of the public. Mentions of the year 1872 had declined by half in 1896, a slow fade that took 23 years. The year 1973 completed the same trajectory in less than half the time.

“What caused that change?” the authors ask. “We don’t know. For now, all we have are the naked correlations: what we uncover when we look at collective memory through the digital lens of our new scope.” Someone else is going to have to do the heavy lifting.”

Are Smart Cities Empty Hype?


Irving Wladawsky-Berger in the Wall Street Journal: “A couple of weeks ago I participated in an online debate sponsored by The Economist around the question: Are Smart Cities Empty Hype? Defending the motion was Anthony Townsend, research director at the Institute for the Future and adjunct faculty member at NYU’s Wagner School of Public Service. I took the opposite side, arguing the case against the motion.
The debate consisted of three phases spread out over roughly 10 days. We each first stated our respective positions in our opening statements, followed a few days later by our rebuttals, and then finally our closing statements.  It was moderated by Ludwig Siegele, online business and finance editor at The Economist. Throughout the process, people were invited to vote on the motion, as well as to post their own comments.
The debate was inspired, I believe, by The Multiplexed Metropolis, an article Mr. Siegele published in the September 7 issue of The Economist which explored the impact of Big Data on cities. He wrote that the vast amounts of data generated by the many social interactions taking place in cities might lead to a kind of second electrification, transforming 21st century cities much as electricity did in the past. “Enthusiasts think that data services can change cities in this century as much as electricity did in the last one,” he noted. “They are a long way from proving their case.”
In my opening statement, I said that I strongly believe that digital technologies and the many data services they are enabling will make cities smarter and help transform them over time. My position is not surprising, given my affiliations with NYU’s Center for Urban Science and Progress (CUSP) and Imperial College’s Digital City Exchange, as well as my past involvements with IBM’s Smarter Cities and with Citigroup’s Citi for Cities initiatives. But, I totally understand why so many– almost half of those voting and quite a few who left comments–feel that smart cities are mostly hype. The case for smart cities is indeed far from proven.
Cities are the most complex social organisms created by humans. Just about every aspect of human endeavor is part of the mix of cities, and they all interact with each other leading to a highly dynamic system of systems. Moreover, each city has its own unique style and character. As is generally the case with transformative changes to highly complex systems, the evolution toward smart cities will likely take quite a bit longer than we anticipate, but the eventual impact will probably be more transformative than we can currently envision.
Electrification, for example, started in the U.S., Britain and other advanced nations around the 1880s and took decades to deploy and truly transform cities. The hype around smart cities that I worry the most about is underestimating their complexity and the amount of research, experimentation, and plain hard work that it will take to realize the promise. Smart cities projects are still in their very early stages. Some will work and some will fail. We have much to learn. Highly complex systems need time to evolve.
Commenting on the opening statements, Mr. Siegele noted: “Despite the motion being Are smart cities empty hype?, both sides have focused on whether these should be implemented top-down or bottom-up. Most will probably agree that digital technology can make cities smarter–meaning more liveable, more efficient, more sustainable and perhaps even more democratic.  But the big question is how to get there and how smart cities will be governed.”…

Selected Readings on Data Visualization


The Living Library’s Selected Readings series seeks to build a knowledge base on innovative approaches for improving the effectiveness and legitimacy of governance. This curated and annotated collection of recommended works on the topic of data visualization was originally published in 2013.

Data visualization is a response to the ever-increasing amount of  information in the world. With big data, informatics and predictive analytics, we have an unprecedented opportunity to revolutionize policy-making. Yet data by itself can be overwhelming. New tools and techniques for visualizing information can help policymakers clearly articulate insights drawn from data. Moreover, the rise of open data is enabling those outside of government to create informative and visually arresting representations of public information that can be used to support decision-making by those inside or outside governing institutions.

Selected Reading List (in alphabetical order)

Annotated Selected Reading List (in alphabetical order)

Duke, D.J., K.W. Brodlie, D.A. Duce and I. Herman. “Do You See What I Mean? [Data Visualization].” IEEE Computer Graphics and Applications 25, no. 3 (2005): 6–9. http://bit.ly/1aeU6yA.

  • In this paper, the authors argue that a more systematic ontology for data visualization to ensure the successful communication of meaning. “Visualization begins when someone has data that they wish to explore and interpret; the data are encoded as input to a visualization system, which may in its turn interact with other systems to produce a representation. This is communicated back to the user(s), who have to assess this against their goals and knowledge, possibly leading to further cycles of activity. Each phase of this process involves communication between two parties. For this to succeed, those parties must share a common language with an agreed meaning.”
  • That authors “believe that now is the right time to consider an ontology for visualization,” and “as visualization move from just a private enterprise involving data and tools owned by a research team into a public activity using shared data repositories, computational grids, and distributed collaboration…[m]eaning becomes a shared responsibility and resource. Through the Semantic Web, there is both the means and motivation to develop a shared picture of what we see when we turn and look within our own field.”

Friendly, Michael. “A Brief History of Data Visualization.” In Handbook of Data Visualization, 15–56. Springer Handbooks Comp.Statistics. Springer Berlin Heidelberg, 2008. http://bit.ly/17fM1e9.

  • In this paper, Friendly explores the “deep roots” of modern data visualization. “These roots reach into the histories of the earliest map making and visual depiction, and later into thematic cartography, statistics and statistical graphics, medicine and other fields. Along the way, developments in technologies (printing, reproduction), mathematical theory and practice, and empirical observation and recording enabled the wider use of graphics and new advances in form and content.”
  • Just as the general the visualization of data is far from a new practice, Friendly shows that the graphical representation of government information has a similarly long history. “The collection, organization and dissemination of official government statistics on population, trade and commerce, social, moral and political issues became widespread in most of the countries of Europe from about 1825 to 1870. Reports containing data graphics were published with some regularity in France, Germany, Hungary and Finland, and with tabular displays in Sweden, Holland, Italy and elsewhere.”

Graves, Alvaro and James Hendler. “Visualization Tools for Open Government Data.” In Proceedings of the 14th Annual International Conference on Digital Government Research, 136–145. Dg.o ’13. New York, NY, USA: ACM, 2013. http://bit.ly/1eNSoXQ.

  • In this paper, the authors argue that, “there is a gap between current Open Data initiatives and an important part of the stakeholders of the Open Government Data Ecosystem.” As it stands, “there is an important portion of the population who could benefit from the use of OGD but who cannot do so because they cannot perform the essential operations needed to collect, process, merge, and make sense of the data. The reasons behind these problems are multiple, the most critical one being a fundamental lack of expertise and technical knowledge. We propose the use of visualizations to alleviate this situation. Visualizations provide a simple mechanism to understand and communicate large amounts of data.”
  • The authors also describe a prototype of a tool to create visualizations based on OGD with the following capabilities:
    • Facilitate visualization creation
    • Exploratory mechanisms
    • Viralization and sharing
    • Repurpose of visualizations

Hidalgo, César A. “Graphical Statistical Methods for the Representation of the Human Development Index and Its Components.” United Nations Development Programme Human Development Reports, September 2010. http://bit.ly/166TKur.

  • In this paper for the United Nations Human Development Programme, Hidalgo argues that “graphical statistical methods could be used to help communicate complex data and concepts through universal cognitive channels that are heretofore underused in the development literature.”
  • To support his argument, representations are provided that “show how graphical methods can be used to (i) compare changes in the level of development experienced by countries (ii) make it easier to understand how these changes are tied to each one of the components of the Human Development Index (iii) understand the evolution of the distribution of countries according to HDI and its components and (iv) teach and create awareness about human development by using iconographic representations that can be used to graphically narrate the story of countries and regions.”

Stowers, Genie. “The Use of Data Visualization in Government.” IBM Center for The Business of Government, Using Technology Series, 2013. http://bit.ly/1aame9K.

  • This report seeks “to help public sector managers understand one of the more important areas of data analysis today — data visualization. Data visualizations are more sophisticated, fuller graphic designs than the traditional spreadsheet charts, usually with more than two variables and, typically, incorporating interactive features.”
  • Stowers also offers numerous examples of “visualizations that include geographical and health data, or population and time data, or financial data represented in both absolute and relative terms — and each communicates more than simply the data that underpin it. In addition to these many examples of visualizations, the report discusses the history of this technique, and describes tools that can be used to create visualizations from many different kinds of data sets.”

Ten thoughts for the future


The Economist: “CASSANDRA has decided to revisit her fellow forecasters Thomas Malnight and Tracey Keys to find out what their predictions are for 2014. Once again they have produced a collection of trends for the year ahead, in their “Global Trends Report”.
The possibilities of mind control seem alarming ( point 6) as do the  implications of growing income inequality (point 10). Cassandra also hopes that “unemployability” and “unemployerability”, as discussed in point 9, are contested next year (on both linguistic and social fronts).
Nevertheless, the forecasts make for intriguing reading and highlights appear below.
 1. From social everything to being smart socially
Social technologies are everywhere, but these vast repositories of digital “stuff” bury the exceptional among the unimportant. It’s time to get socially smart. Users are moving to niche networks to bring back the community feel and intelligence to social interactions. Businesses need to get smarter about extracting and delivering value from big data including challenging business models. For social networks, mobile is the great leveller. Competition for attention with other apps will intensify the battle to own key assets from identity to news sharing, demanding radical reinvention.
2. Information security: The genie is out of the bottle
Thought your information was safe? Think again. The information security genie is out of the bottle as cyber-surveillance and data mining by public and private organizations increases – and don’t forget criminal networks and whistleblowers. It will be increasingly hard to tell friend from foe in cyberspace as networks build artificial intelligence to decipher your emotions and smart cities track your every move. Big brother is here: Protecting identity, information and societies will be a priority for all.
3. Who needs shops anyway?
Retailers are facing a digitally driven perfect storm. Connectivity, rising consumer influence, time scarcity, mobile payments, and the internet of things, are changing where, when and how we shop – if smart machines have not already done the job. Add the sharing economy, driven by younger generations where experience and sustainable consumption are more important than ownership, and traditional retail models break down. The future of shops will be increasingly defined by experiential spaces offering personalized service, integrated online and offline value propositions, and pop-up stores to satisfy demands for immediacy and surprise.
4. Redistributing the industrial revolution
Complex, global value chains are being redistributed by new technologies, labour market shifts and connectivity. Small-scale manufacturing, including 3D and soon 4D printing, and shifting production economics are moving production closer to markets and enabling mass customization – not just by companies but by the tech-enabled maker movement which is going mainstream. Rising labour costs in developing markets, high unemployment in developed markets, global access to online talent and knowledge, plus advances in robotics mean reshoring of production to developed markets will increase. Mobility, flexibility and networks will define the future industrial landscape.
5. Hubonomics: The new face of globalization
As production and consumption become more distributed, hubs will characterize the next wave of “globalization.” They will specialize to support the needs of growing regional trade, emerging city states, on-line communities of choice, and the next generation of flexible workers and entrepreneurs. Underpinning these hubs will be global knowledge networks and new business and governance models based on hubonomics™, that leverage global assets and hub strengths to deliver local value.
6. Sci-Fi is here: Making the impossible possible
Cross-disciplinary approaches and visionary entrepreneurs are driving scientific breakthroughs that could change not just our lives and work but our bodies and intelligence. Labs worldwide are opening up the vast possibilities of mind control and artificial intelligence, shape-shifting materials and self-organizing nanobots, cyborgs and enhanced humans, space exploration, and high-speed, intelligent transportation. Expect great debate around the ethics, financing, and distribution of public and private benefits of these advances – and the challenge of translating breakthroughs into replicable benefits.
7. Growing pains: Transforming markets and generations
The BRICS are succumbing to Newton’s law of gravitation: Brazil’s lost it, India’s losing it, China’s paying the price for growth, Russia’s failing to make a superpower come-back, and South Africa’s economy is in disarray. In other developing markets currencies have tumbled, Arab Spring governments are still in turmoil and social unrest is increasing along with the number of failing states. But the BRICS & Beyond growth engine is far from dead. Rather it is experiencing growing pains which demand significant shifts in governance, financial systems, education and economic policies to catch up. The likely transformers will be younger generations who aspire to greater freedom and quality of life than their parents.
8. Panic versus denial: The resource gap grows, the global risks rise – but who is listening?
The complex nexus of food, water, energy and climate change presents huge global economic, environmental and societal challenges – heating up the battle to access new resources from the Arctic to fracking. Risks are growing, even as multilateral action stalls. It’s a crisis of morals, governance, and above all marketing and media, pitting crisis deniers against those who recognize the threats but are communicating panic versus reasoned solutions. Expect more debate and calls for responsible capitalism – those that are listening will be taking action at multiple levels in society and business.
9. Fighting unemployability and unemployerability
Companies are desperate for talented workers – yet unemployment rates remain high. Polarization towards higher and lower skill levels is squeezing mid-level jobs, even as employers complain that education systems are not preparing students for the jobs of the future. Fighting unemployability is driving new government-business partnerships worldwide, and will remain a critical issue given massive youth unemployment. Employers must also focus on organizational unemployerability – not being able to attract and retain desired talent – as new generations demand exciting and meaningful work where they can make an impact. If they can’t find it, they will quickly move on or swell the growing ranks of young entrepreneurs.
10. Surviving in a bipolar world: From expecting consistency to embracing ambiguity
Life is not fair, nor is it predictable.  Income inequality is growing. Intolerance and nationalism are rising but interdependence is the currency of a connected world. Pressure on leaders to deliver results today is intense but so too is the need for fundamental change to succeed in the long term. The contradictions of leadership and life are increasing faster than our ability to reconcile the often polarized perspectives and values each embodies. Increasingly, they are driving irrational acts of leadership (think the US debt ceiling), geopolitical, social and religious tensions, and individual acts of violence. Surviving in this world will demand stronger, responsible leadership comfortable with and capable of embracing ambiguity and uncertainty, as opposed to expecting consistency and predictability.”

20 Innovations that Mattered in 2013


New Guide from GovLoop: “The end of the year means two things: setting unrealistic New Year’s resolutions and endless retrospectives.  While we can’t force you to put down the cake and pick up a carrot, we can help you to do your job better by highlighting some of the biggest and best innovations to come out of government in the last 365 days.
The past year brought us the Interior Department’s Instagram feed and Colorado’s redesigned website. It also brought us St. Louis’ optimized data analytics that make their city safer and North Carolina’s iCenter that adopted a “try before you buy” policy.
All of these new technologies and tactics saved time and resources, critical outcomes in the current government landscape where budget cuts are making each new purchase risky.
But these were not the only buzzworthy projects for government technology in 2013. In this end-of-year issue, GovLoop analyzed the 20 best innovations in government in four different categories:

  • Mobile Apps Movers and Shakers?
  • Big Data Dynamos
  • Social Media Mavericks
  •  Website Wonders

We also asked two of the most innovative Chief Information Officers in the country to don some Google Glass’ In a year where the government shutdown and sequestration brought progress to a screeching halt, many agencies were able to rise above the inauspicious environment and produce groundbreaking and innovative programs.
For instance, when the horrible bombings brought terror to the finish line of the Boston Marathon, the local police department sprang into action. They immediately mobilized their forces on the ground. But then they did something else, too. The Boston Police Department took to Twitter. The social media team was informative, timely and, accurate. The BPD flipped the script on emergency media management. They innovated in a time of crisis and got people the information they needed in a timely and appropriate manner.
We know that oftentimes it is hard to see through the budget cuts and government shutdowns, but government innovation is all around us. Our goal with this guide is to showcase programs that are not only making a difference but demonstrate risk and reward….”

When the wisdom of crowds meets the kindness of strangers


Tim Kelsey (NHS) on why patient and citizen participation is fundamental to high quality health and care services: “…But above all my priority is to improve the way in which health and care services listen to people  – and can therefore act and change. The work of entrepreneurs and apps developers like Patients Like Me, Patient Opinion and iwantgreatcare confirms the benefits of real time patient and citizen participation. The challenge is to do this at scale: open the doors, invite the whole community into the job of improving our national health service. Share decision making. Everybody needs the opportunity – and should be encouraged – to participate.
In April, the NHS did something unprecedented – it launched the Friends and Family Test (FFT), the first time a health service has reported a single measure of patient satisfaction for every hospital. It asked people to say whether they would recommend local inpatient and A&E services; the results are published every month on NHS Choices. By October more than 1m people had participated and hundreds of thousands had volunteered additional real time comments and feedback to local hospitals. ‘Great news’, said David Cameron – who has championed FFT from the start – in a tweet to mark the milestone, ‘giving patients a stronger voice in the NHS’.
This is the boldest move yet to promote patient voice at volume in the NHS and to concentrate our collective focus on improvement in care. At Hillingdon Hospitals NHS Trust, patients reported they could not sleep at night so staff have launched a ‘comfort at night’ campaign and developed a protocol for patient experience ‘never events’. In Lewisham, patients complained about poor communication and staff attitudes. They now plan daily visits for each patient. In Hull, bereaved families complained they had to pay car parking fees; the Trust has now given free passes to relatives in mourning. Routine feedback enables a different kind of conversation between the patient and the clinician. It is a catalyst for change. Commissioners will have to demonstrate how they are improving FFT for local communities to qualify for Quality Premium incentives.
This kind of customer insight is fundamental to the way we make choices as consumers. The NHS is not a hotel chain, nor a city authority: but there are vital lessons it can learn from Amazon and Trip Adviser about the power of transparency and feedback. In New York, more than 90,000 people every day share their views by phone, email and tweet on rubbish collections, potholes and dangerous buildings – and the city has become safer and cleaner.
Friends and family has its critics: people worry about the potential for gaming, for example. But the evidence, after six months, is of overwhelming human benefit and that’s why every maternity unit started to offer FFT to patients in October and why every NHS service will do so from 2015. It’s also why we are now requiring that every local organisation should offer people the chance to comment on, as well as rate, services from next year (most already do).
Some people ask me how we are ensuring the focus on transparency and participation is inclusive. We have launched Care Connect, a pilot project to test how giving people access by telephone and social media could improve feedback and complaints.  Recognising that digital exclusion is an issue in some of our communities, we have started a partnership with the Tinder Foundation to help 100,000 people learn how to go online for health benefit. None of these initiatives exist in isolation, nor do I see them as ‘silver bullets’.  My aim is to work with and build on existing good practice to make people’s voices heard and help the NHS act on them.
In a characteristically thoughtful talk last week, MT Rainey, social activist and former marketing guru, issued this challenge to the NHS: ‘How will we make the wisdom of the crowd meet the kindness of strangers?’ How do the tools of our age – big data, the internet, the mobile phone – meet the values of our species: compassion and honesty and doing our best for others? Friends and family is a good start. We are witnessing the birth of a new knowledge economy and a new social movement. The future is open.”

Data isn't a four-letter word


Speech by Neelie Kroes, Vice-President of the European Commission responsible for the Digital Agenda: “I want to talk about data too: the opportunity as well as the threat.
Making data the engine of the European economy: safeguarding fundamental rights capturing the data boost, and strengthening our defences.
Data is at a cross-roads. We have opportunities; open data, big data, datamining, cloud computing. Tim Berners Lee, creator of the world wide web, saw the massive potential of open data. As he put it, if you put that data online, it will be used by other people to do wonderful things, in ways that you could never imagine.
On the other hand, we have threats: to our privacy and our values, and to the openness that makes it possible to innovate, trade and exchange.
Get it right and we can safeguard a better economic future. Get it wrong, and we cut competitiveness without protecting privacy. So we remain dependent on the digital developments of others: and just as vulnerable to them.
How do we find that balance? Not with hysteria; nor by paralysis. Not by stopping the wonderful things, simply to prevent the not-so-wonderful. Not by seeing data as a dirty word.
We are seeing a whole economy develop around data and cloud computing. Businesses using them, whole industries depending on them, data volumes are increasing exponentially. Data is not just an economic sideshow, it is a whole new asset class; requiring new skills and creating new jobs.
And with a huge range of applications. From decoding human genes to predicting the traffic, and even the economy. Whatever you’re doing these days, chances are you’re using big data (like translation, search, apps, etc).
There is increasing recognition of the data boost on offer. For example, open data can make public administrations more transparent and stimulate a rich innovative market. That is what the G8 Leaders recognised in June, with their Open Data Charter. For scientists too, open data and open access offer new ways to research and progress.
That is a philosophy the Commission has shared for some time. And that is what our ‘Open Data’ package of December 2011 is all about. With new EU laws to open up public administrations, and a new EU Open Data Portal. And all EU-funded scientific publications available under open access.
Now not just the G8 and the Commission are seeing this data opportunity: but the European Council too. Last October, they recognised the potential of big data innovation, the need for a single market in cloud computing; and the urgency of Europe capitalising on both.
We will be acting on that. Next spring, I plan a strategic agenda for research on data. Working with private partners and national research funders to shape that agenda, and get the most bang for our research euro.
And, beyond research, there is much we can do to align our work and support secure big data. From training skilled workers, to modernising copyright for data and text mining, to different actors in the value chain working together: for example through a public-private partnership.
…Empowering people is not always easy in this complex online world. I want to see technical solutions emerge that can do that, give users control over their desired level of privacy, how their data will be used, and making it easier to verify online rights are respected.
How can we do that? How can we ensure systems that are empowering, transparent, and secure? There are a number of subtleties in play. Here’s my take.
First, companies engaged in big data will need to start thinking about privacy protection at every stage: and from system development, to procedures and practices.
This is the principle of “privacy by design”, set out clearly in the proposed Data Protection Regulation. In other words, from now on new business ideas have two purposes: delivering a service and protecting privacy at the right level.
Second, also under the regulation, big data applications that might put fundamental rights at risk would require the company to carry out a “Privacy Impact Assessment”. This is another good way to combine innovation and privacy: ensuring you think about any risks from the start.
Third, sometimes, particularly for personal data, a company might realise they need user consent. Consent is a cornerstone of data protection rules, and should stay that way.
But we need to get smart, and apply common sense to consent. Users can’t be expected to know everything. Nor asked to consent to what they cannot realistically understand. Nor presented with false dilemmas, a black-and-white choice between consenting or getting shut out of services.
Fourth, we can also get smart when it comes to anonymisation. Sometimes, full anonymisation means losing important information, so you can no longer make the links between data. That could make the difference between progress or paralysis. But using pseudonyms can let you to analyse large amounts of data: to spot, for example, that people with genetic pattern X also respond well to therapy Y.
So it is understandable why the European Parliament has proposed a more flexible data protection regime for this type of data. Companies would be able to process the data on grounds of legitimate interest, rather than consent. That could make all the positive difference to big data: without endangering privacy.
Of course, in those cases, companies still to minimise privacy risks. Their internal processes and risk assessments must show how they comply with the guiding principles of data protection law. And – if something does go wrong – the company remains accountable.
Indeed company accountability is another key element of our proposal. And here again we welcome the European Parliament’s efforts to reinforce that. Clearly, you might assure accountability in different ways for different companies. But standards for compliance and processes could make a real difference.
A single data protection law for Europe would be a big step forward. National fortresses and single market barriers just make it harder for Europe to lead in digital, harder for Europe to become the natural home of secure online services. Data protection cannot mean data protectionism. Rather, it means safeguarding privacy does not come at the expense of innovation: with laws both flexible and future proof, pragmatic and proportionate, for a changing world….
But data protection rules are really just the start. They are only part of our response to the Snowden revelations….”

Book Review: Three Harbingers of Change


Howard Rheingold reviews the following books in Strategy and Business:
Viktor Mayer-Schönberger and Kenneth Cukier
Big Data: A Revolution That Will Transform How We Live, Work, and Think
(Houghton Mifflin Harcourt, 2013)
Marina Gorbis
The Nature of the Future: Dispatches from the Socialstructed World
(Free Press, 2013)
Henry Jenkins, Sam Ford, and Joshua Green
Spreadable Media: Creating Value and Meaning in a Networked Culture
(New York University Press, 2013)
“Whether you invest, build, teach, research, regulate, investigate, heal, entertain, or sell, major changes in how you do what you do are looming. “Big data,” much in the media spotlight recently—particularly for the revelations of the National Security Agency’s (NSA’s) surveillance of “metadata”—is probably already changing how you do your work. But socialstructing and spreadable media, two new terms that signal similarly momentous shifts, may still be unfamiliar. This year’s best business books on digitization can equip you to better understand all three phenomena and the changes that they will enable and engender….”

DataViva: a Big Data Engine for the Brazilian Economy


Piece by André Victor dos Santos Barrence and Cesar A. Hidalgo: “The current Internet paradigm in which one can search about anything and retrieve information is absolutely empowering. We can browse files, websites and indexes and effortlessly reach good amount of information. Google, for instance, was explicitly built on a library analogy available to everyone. However, it is a world where information that should be easily accessible is still hidden in unfriendly databases, and that the best-case scenario is finding few snippets of information embedded within the paragraphs of a report. But is this the way it should be? Or is this just the world we are presently stuck with?
The last decade has been particularly marked by an increasing hype on big data and analytics, mainly fueled by those who are interested in writing narratives on the topic but not necessarily coding about it, even when data itself is not the problem.
Let’s take the case of governments. Governments have plenty of data and in many cases it is actually public (at least in principle). Governments “know” how many people work in every occupation, in every industry and in every location; they know their salaries, previous employers and education history. From a pure data perspective all that is embedded in tax, social security records or annual registrations. From a more pragmatic perspective, it is still inaccessible and hidden even when it is legally open the public. We live in a world where the data is there, but where the statistics and information are not.
The state government of Minas Gerais in Brazil (3rd economy the country, territory larger than France and 20 millions inhabitants) made an important step in that direction by releasing DataViva.info, a platform that opens data for exports and occupations for the entire formal sector of the Brazilian economy through more than 700 million interactive visualizations. Instead of poorly designed tables and interfaces, it guides users to answer questions or freely discover locations, industries and occupations in Brazil that are of interest to them. DataViva allows users to explore simple questions such as the evolution of exports in the last decade for each of the 5,567 municipalities in the country, or highly specific queries, for instance, the average salaries paid to computer scientists working in the software development industry in Belo Horizonte, the state capital of Minas.
DataViva’s visualizations are built on the idea that the industrial and economic activity development of locations is highly path dependent. This means that locations are more likely to be successful at developing industries and activities that are related to the ones already existing, since it indicates the existence of labor inputs, and other capabilities, that are specific and that can often be redeployed to a few related industries and activities. Thus, it informs the processes by which opportunities can be explored and prospective pathways for greater prosperity.
The idea that information is key for the functioning of economies is at least as old as Friedrich Hayek’s seminal paper The Use of Knowledge in Society from 1945. According to Hayek, prices help coordinate economic activities by providing information about the wants and needs of goods and services. Yet, the price information can only serve as a signal as long as people know those prices. Maybe the salaries for engineers in the municipality of Betim (Minas Gerais) are excellent and indicate a strong need for them? But who would have known how many engineers are there in Betim and what are their average salaries?
But the remaining question is: why is Minas Gerais making all of this public data easily available? More than resorting to the contemporary argument of open government Minas understands this is extremely valuable information for investors searching for business opportunities, entrepreneurs pursuing new ventures or workers looking for better career prospects. Lastly, the ultimate goal of DataViva is to provide a common ground for open discussions, moving away from the information deprived idea of central planning and into a future where collaborative planning might become the norm. It is a highly creative attempt to renew public governance for the 21st century.
Despite being a relatively unknown state outside of Brazil, by releasing a platform as DataViva, Minas is providing a strong signal about where in world governments are really pushing forward innovation rather than simply admiring and copying solutions that used to come from trendsetters in the developed world. It seems like real innovation isn’t necessarily taking place in Washington, Paris or London anymore.”
 

Making Europe's cities smarter


Press Release: “At a conference today hosted by the European Commission, city leaders, CEOs and civil society leaders discussed the actions outlined in the “Smart Cities Strategic Implementation Plan” and how to put them into practice. The Commission announced that it will launch an ‘Invitation for Smart City and Community Commitments’ in spring 2014 to mobilise work on the action plan’s priorities. The plan is part of Europe’s fifth “Innovation Partnership”.
Commission Vice-President Siim Kallas, in charge of transport, said: “I am very pleased to see transport operators, telecoms companies, vehicle manufacturers, city planners, energy companies and researchers all gathered in one room to discuss the future of our cities. The Smart Cities initiative is a great opportunity to make changes happen for less congestion and better business opportunities in our cities. We need to keep up the momentum and move from plan to action now.”
Commission Vice-President Neelie Kroes, responsible for the Digital Agenda, said: “The future of infrastructure and city planning will be based on integrating ICT systems and using big data to make our cities better places to live and work. We need to base those new systems on open standards for hardware, software, data and services which this European Innovation Partnership will develop.”
Günther H. Oettinger, EU Commissioner for energy, said: “The European Innovation Partnership for Smart Cities and Communities is about making investments in sustainable development in as many cities as possible. Creating equal partnerships between cities and companies based on synergies between ICT, energy and mobility will lead to projects that make a real difference in our everyday lives.”
The Commission intends to make available approximately EUR 200 million for Smart Cities and communities in the 2014-2015 budgets of the Horizon 2020 research and innovation programme, to accelerate progress and enlarge the scale of roll-out of smart cities solutions. There will also be possibilities to access the European Structural and Investment Funds.
For more information: http://ec.europa.eu/eip/smartcities/”