Open Data Impact: How Zillow Uses Open Data to Level the Playing Field for Consumers


Daniel Castro at US Dept of Commerce: “In the mid-2000s, several online data firms began to integrate real estate data with national maps to make the data more accessible for consumers. Of these firms, Zillow was the most effective at attracting users by rapidly growing its database, thanks in large part to open data. Zillow’s success is based, in part, on its ability to create tailored products that blend multiple data sources to answer customer’s questions about the housing market. Zillow’s platform lets customers easily compare neighborhoods and conduct thorough real estate searches through a single portal. This ensures a level playing field of information for home buyers, sellers and real estate professionals.

The system empowers consumers by providing them all the information needed to make well-informed decisions about buying or renting a home. For example, information from the Census Bureau’s American Community Survey helps answer people’s questions about what kind of housing they can afford in any U.S. market. Zillow also creates market analysis reports, which inform consumer about whether it is a good time to buy or sell, how an individual property’s value is likely to fluctuate over time, or whether it is better to rent or to own in certain markets. These reports can even show which neighborhoods are the top buyers’ or sellers’ markets in a given city. Zillow uses a wide range of government data, not just from the Census Bureau, to produce economic analyses and products it then freely provides to the public.

In addition to creating reports from synthesized data, Zillow has made a conscious effort to make raw data more usable. It has combined rental, mortgage, and other data into granular metrics on individual neighborhoods and zip codes. For example, the “Breakeven Horizon” is a metric that gives users a snapshot of how long they would need to own a home in a given area for the accrued cost of buying to be less than renting. Zillow creates this by comparing the up-front costs of buying a home versus the amount of interest that money could generate, and then analyzing how median rents and home values are likely to fluctuate, affecting both values. By creating metrics, rankings, and indices, Zillow makes raw or difficult-to-quantify data readily accessible to the public.

While real estate agents can be instrumental in the process of finding a new home or selling an old one, Zillow and other platforms add value by connecting consumers to a wealth of data, some of which may have been accessible before but was too cumbersome for the average user. Not only does this allow buyers and sellers to make more informed decisions about real estate, but it also helps to balance the share of knowledge. Buyers have more information than ever before on available properties, their valuations for specific neighborhoods, and how those valuations have changed in relation to larger markets. Sellers can use the same types of information to evaluate offers they receive, or decide whether to list their home in the first place. The success that Zillow and other companies like it have achieved in the real estate market is a testament to how effective they have been in harnessing data to address consumers’ needs and it is a marvelous example of the power of open data….(More)”

Good Governance by All Means


 at Huffington Post: “Citizens today have higher expectations and demand effective solutions to every day issues and challenges. From climate change to expedient postal services, governments are required to act with transparency and diligence. Public accountability demands us, public servants, to act with almost no margin of error and using the most open and transparent means available to achieve our goals. The name of the game is simple: government efforts should focus on building stronger, better and healthier relationships with civil society. Nobody should be left behind when tailoring public policy. For the Mexican Government, it is crystal clear, that such endeavor is no longer the State’s monopoly and thus, the pressing need for governments to use smarter and more efficient tool boxes, such as the one that the Open Government Partnership (OGP), provides. The buzzword is good governance by all means.

The High Level Segment of the 70th Session of the United Nations General Assembly was a milestone for the open government community. It allowed the 13 countries taking part of the OGP Steering Committee and several civil society organizations to endorse the Joint Declaration: Open Government for the Implementation of the 2030 Agenda for Sustainable Development. This declaration highlights the paramount importance of promoting the principles of open government (transparency, accountability, citizen participation and innovation) as key enablers of the Sustainable Development Goals. The Declaration particularly embraces Agenda 2030’s Goal 16 as a common target for all 66 OGP member countries. Our common goal is to continue building stronger institutions while weaving peaceful and inclusive societies. Our meeting in New York also allowed us to work with key players to develop the Open Data Charter that recognizes the value of having timely, comprehensive, accessible, and comparable data for the promotion of greater citizen engagement triggering development and innovation….(More)

Cleaning Up Lead Poisoning One Tweet at a Time


WorldPolicy Blog: “At first, no one knew why the children of Bagega in Zamfara state were dying. In the spring of 2010, hundreds of kids in and around the northern Nigerian village were falling ill, having seizures and going blind, many of them never to recover. A Médecins Sans Frontières‎ team soon discovered the causes: gold and lead.

With the global recession causing the price of precious metals to soar, impoverished villagers had turned to mining the area’s gold deposits. But the gold veins were mingled with lead, and as a result the villagers’ low-tech mining methods were sending clouds of lead-laced dust into the air. The miners, unknowingly carrying the powerful toxin on their clothes and skin, brought it into their homes where their children breathed it in.

The result was perhaps the worst outbreak of lead poisoning in history, killing over 400 children in Bagega and neighboring villages. In response, the Nigerian government pledged to cleanup the lead-contaminated topsoil and provide medical care to the stricken children. But by mid-2012, there was no sign of the promised funds. Digitally savvy activists with the organization Connected Development (CODE) stepped in to make sure that the money was disbursed.

A group of young Nigerians founded CODE in 2010 in the capital Abuja, with the mission of empowering local communities to hold the government to account by improving their access to information and helping their voices to be heard. “In 2010, we were working to connect communities with data for advocacy programs,” says CODE co-founder Oludotun Babayemi, a former country director of a World Wildlife Fund project in Nigeria. “When we heard about Bagega, we thought this was an opportunity for us.”

In 2012, CODE launched a campaign dubbed ‘Follow the Money Nigeria’ aimed at applying pressure on the government to release the promised funds. “Eighty percent of the less developed parts of Nigeria have zero access to Twitter, let alone Facebook, so it’s difficult for them to convey their stories,” says Babayemi. “We collect all the videos and testimonies and take it global.”

CODE members travelled to the lead-afflicted area to gather information. They then posted their findings online, and publicized them with a #SaveBagegahashtag, which they tweeted to members of the government, local and international organizations and the general public. CODE hosted a 48-hour ‘tweet-a-thon’, joined by a senator, to support the campaign….

By July 2014, CODE reported that the clean-up was complete and that over 1,000 children had been screened and enrolled in lead treatment programs. Bagega’s health center has also been refurbished and the village’s roads improved. “There are thousands of communities like Bagega,” says Babayemi. “They just need someone to amplify their voice.”….

Key lessons

  • Revealing information is not enough; change requires a real-world campaign driven by that information and civil society champions who can leverage their status and networks to draw international attention to the issues and maintain pressure.
  • Building relationships with sympathetic members of government is key.
  • Targeted online campaigns can help amplify the message of marginalized communities offline to achieve impact (More)”

Slowly but surely, government IT enters the 21st century


Jon Brodkin at Ars Technica: “Government IT departments have a mostly deserved reputation for being behind the times. While private companies keep giving customers new and better ways to buy products and learn about their services, government agencies have generally made it difficult for residents to interact with them via the Internet.

But this is slowly changing, with agencies from the local level to the federal level focusing on fixing broken websites and building new tools for Americans to get what they need from the government….

“Improve Detroit,” a smartphone app launched in April this year using technology from SeeClickFix, has helped Detroiters find out how to get things done. In its first six months of availability, 10,000 complaints were resolved in an average of nine days, “a vast improvement from when problems often languished for years,” the city said in an announcement this month.

Improve Detroit was used to get “more than 3,000 illegal dumping sites cleaned up; 2,092 potholes repaired; 991 complaints resolved related to running water in an abandoned structure; 565 abandoned vehicles removed; 506 water main breaks taken care of; [and] 277 traffic signal issues fixed,” Detroit said….

At the municipal level, Oakland is also planning to pass its hard-earned wisdom on to other cities. “Our goal is to create a roadmap for cities big and small,” Oakland Communications Director Karen Boyd told Ars.

Like Detroit, Oakland partnered with SeeClickFix and Code for America after experiencing tough economic times. “Oakland was particularly hard hit by the mortgage crisis [in 2008], a lot of predatory loans were made to our low-income folks,” Boyd said.

Property tax revenue plummeted and the city lost about a quarter of its government workforce, Boyd said.

“Governments were finding themselves way behind the curve on technology. We looked up and realized this was no longer sensible to try to do more with less. We have to do things differently, and technology is an opportunity,” she said.

Working with Code for America in 2013, Oakland made RecordTrac, a website for requesting public records and tracking records requests. Obtaining government documents is often a convoluted process, but Ars Technica’s own Freedom of Information Act enthusiast Cyrus Farivar told me that RecordTrac “is the best (albeit imperfect) public records process I’ve ever used.”…

One of the best examples of a government agency using the Internet to engage residents comes from NASA. The space agency has had an online presence since the early years of the Web, said Brian Dunbar, who has been the content manager for nasa.gov since 1995.

The website has allowed NASA to distribute huge amounts of photos and videos from missions and broadcast an online TV service. There’s even live video feed of the Earth from the International Space Station.

NASA is all over social media, with nearly 700,000 subscribers to its YouTube channel, 13 millionTwitter followers, 13 million Facebook likes, 5.4 million Instagram followers, and a big presence on several other social networks. That’s not even including individuals like astronaut Scott Kelly, who has been tweeting from the International Space Station.

NASA has nearly 100 people editing its website, with content generally capitalizing on current events such as the recent Pluto flyby. NASA gets a lot of feedback when there are video problems, “but we’ve been lucky in that the problems have been not been overwhelming in either number or size, and we get a lot of positive feedback from the public,” Dunbar said.

This is all a natural extension of NASA’s core mission because the legislation that created the agency in 1958 charged it “with disseminating information about its programs to the widest extent practicable,” Dunbar said….(More)”

 

Citizen-Generated Data and Governments: Towards a Collaborative Model


Civicus: “…we’re very happy today to launch “Citizen-Generated Data and Governments: Towards a Collaborative Model”.

This piece explores the idea that governments could host and publish citizen-generated data (CGD) themselves, and whether this could mean that data is applied more widely and in a more sustainable way. It was inspired by a recent meeting in Buenos Aires with Argentine civil society organizations and government representatives, hosted by the City of Buenos Aires Innovation and Open Government Lab (Laboratorio de innovación y Gobierno Abierto de la Ciudad de Buenos Aires).

Screen Shot 2015-10-26 at 20.58.06

The meeting was organized to explore how people within government think about citizen-generated data, and discuss what would be needed for them to consider it as a valid method of data generation. One of the most novel and exciting ideas that surfaced was the potential for government open data portals, such as that managed by the Buenos Aires Innovation Lab, to host and publish CGD.

We wrote this report to explore this issue further, looking at existing models of data collaboration and outlining our first thoughts on the benefits and obstacles this kind of model might face. We welcome feedback from those with deeper expertise into different aspects of citizen-generated data, and look forward to refining these thoughts in the future together with the broader community…(More)”

How open company data was used to uncover the powerful elite benefiting from Myanmar’s multi-billion dollar jade industry


OpenCorporates: “Today, we’re pleased to release a white paper on how OpenCorporates data was used to uncover the powerful elite benefiting from Myanmar’s multi-billion dollar jade industry, in a ground-breaking report from Global Witness. This investigation is an important case study on how open company data and identifiers are critical tool to uncover corruption and the links between companies and the real people benefitting from it.

This white paper shows how not only was it critical that OpenCorporates had this information (much of the information was removed from the official register during the investigation), but that the fact that it was machine-readable data, available via an API (data service), and programmatically combinable with other data was essential to discover the hidden connections between the key actors and the jade industry. Global Witness was able to analyse this data with the help of Open Knowledge.

In this white paper, we make recommendations about the collection and publishing of statutory company information as open data to facilitate the creation of a hostile environment for corruption by providing a rigorous framework for public scrutiny and due diligence.

You can find the white paper here or read it on Medium.”

How Big Data Could Open The Financial System For Millions Of People


But that’s changing as the poor start leaving data trails on the Internet and on their cell phones. Now that data can be mined for what it says about someone’s creditworthiness, likeliness to repay, and all that hardcore stuff lenders want to know.

“Every time these individuals make a phone call, send a text, browse the Internet, engage social media networks, or top up their prepaid cards, they deepen the digital footprints they are leaving behind,” says a new report from the Omidyar Network. “These digital footprints are helping to spark a new kind of revolution in lending.”

The report, called “Big Data, Small Credit,” looks at the potential to expand credit access by analyzing mobile and smartphone usage data, utility records, Internet browsing patters and social media behavior….

“In the last few years, a cluster of fast-emerging and innovative firms has begun to use highly predictive technologies and algorithms to interrogate and generate insights from these footprints,” the report says.

“Though these are early days, there is enough to suggest that hundreds of millions of mass-market consumers may not have to remain ‘invisible’ to formal, unsecured credit for much longer.”…(More)

Using data to improve the environment


Sir Philip Dilley at the UK Environment Agency: “We live in a data rich world. As an engineer I know the power of data in the design and implementation of new urban spaces, iconic buildings and the infrastructure on which we all depend.

Data also is a powerful force in helping us to protect the environment and it can be mined from a variety of sources.

Since the Victorian times naturalists have collected data on the natural world. At the Environment Agency we continue to use local enthusiasts to track rainfall, which we use to feed into and support local projections of flood risk. But the advent of computing power and the Government’s move to open data means we can now all use data in a new and exciting way. The result is a more informed approach to improving the environment and protecting people.

For the last 17 years the Environment Agency has used lasers in planes to map and scan the English landscape from above to help us carry out work such as flood modelling (data now available for everyone to use). The same information has been used to track changing coastal habitats and to help us use the power of nature to adapt to a changing climate.

We’ve used our LIDAR height data together with aerial photography to inform the location and design of major coastal realignment sites. The award-winning Medmerry project, which created 183 hectares of new coastal habitat and protects 348 properties from flooding, was based on this data-led approach.

Those who live near rivers or who use them for sport and recreation know the importance of getting up to date information on river flows. We already provide online services to the public so they can see current warnings and river levels information, but opening our data means everyone can get bespoke information through one postcode or location search.

We are not the only ones seeing the power of environmental data. Data entrepreneurs know how to get accurate and easily accessible information to the public. And that means that we can all make informed choices.FloodAlerts provides a graphical representation of flood warnings and gives localised updates every 15 minutes and Flood Risk Finder app provides flood risk profiles on any property in England, both using data made available for public use by the Environment Agency.

Our bathing waters data directs those who like to swim, surf or paddle with vital information on water quality. The Safer Seas Service app alerts water users when water quality is reduced at beaches and our bathing water data is also used by the Marine Conservation Society’s Good Beach Guide….(More)”

What is Citizensourcing?


Citizensourcing is the crowdsourcing practice applied by governments with the goal of tapping into the collective intelligence of the citizens. Through citizensourcing, governments can collect ideas, suggestions and opinions from their citizens — thereby creating a permanent feedback loop of communication.

Cities are a powerhouse of collective intelligence. Thanks to modern technologies, time has come to unlock the wisdom of the crowd. Tweet: Cities are powerhouses of collective intelligence - time to unlock them. via @citizenlabco http://ctt.ec/7e6Q2+

Yesterday

The current means of engaging citizens in public policy are in place since the 18th century: town hall meetings, in-person visits, phone calls or bureaucratic forms that allowed you to submit an idea. All of those ways of engagement are time-consuming, ineffective and expensive.

Great ideas and valuable feedback get lost, because those forms of engagement take too much effort for both citizens and cities. And next to that, communication happens in private between city government and citizens. Citizens cannot communicate with each other about how they want to improve their city.

Today

Advances in technology have restructured the way societies are organised; we’re living a digital age in which citizens are connected over networks. This creates unseen opportunities for cities to get closer to their citizens and serve them better. In the last years, we’ve seen several cities trying to build a strong online presence on social media channels.

Yet, they have discovered that communicating with their citizens over Twitter and Facebook is far from optimal. Messages get lost in the information overload that characterises those platforms, resulting in a lack of structured communication.

Tomorrow

Imagine that your town hall meetings could be held online… but then 24/7, accessible from every possible device. Citizensourcing on a dedicated platform is an inexpensive way for cities to get valuable input in the form of ideas, feedback and opinions from their citizens.

Whereas only a very small proportion of citizens engage in the time-consuming offline participation, an online platform allows you to multiply your reach by tenfolds. You reach an audience of citizens that you couldn’t reach before, which makes an online platform a well-needed complement for the already existing offline channels in every city.

When citizens can share their ideas in an easy and fun way and get rewarded for their valuable input, that’s when the wisdom of the crowd gets truly unlocked.

The most direct benefit for cities is clear: crowdsourcing new urban ideas drives superior innovations. At least as important as the fact that you offer a new channel for proposals, is that engagement leads to a better understanding of the different needs citizens have…..

There are several early success stories that show the gigantic potential though:

  • The Colombian city Medellín has its own crowdsourcing platform MiMedellín on which citizens share their urban solutions for problems the city faces. It turned out to be a big success: having collected more than 2,300 (!) posted ideas, the government is already developing policies with help from the creativity of citizens.
  • In the Icelandic capital, Reykjavik, the city council succeeded in having their citizensourcing website Better Reykjavik used by over 60% of the citizens. Since Reykjavik implemented their city platform, they have spent €1.9 million on developing more than 200 projectsbased on ideas from citizens..
  • Paris held a participatory budgeting process, called ‘Madame Mayor, I have an idea’, that brought forward wonderful proejcts. To name one, after having received well over 20,000 votes, the city government announced to invest €2 million in vertical garden projects. Other popular ideas included gardens in schools, neighbourhood recycling centers and co-working spaces for students and entrepreneurs….(More)”

Toward a manifesto for the ‘public understanding of big data’


Mike Michael and Deborah Lupton in Public Understanding of Science: “….we sketch a ‘manifesto’ for the ‘public understanding of big data’. On the one hand, this entails such public understanding of science and public engagement with science and technology–tinged questions as follows: How, when and where are people exposed to, or do they engage with, big data? Who are regarded as big data’s trustworthy sources, or credible commentators and critics? What are the mechanisms by which big data systems are opened to public scrutiny? On the other hand, big data generate many challenges for public understanding of science and public engagement with science and technology: How do we address publics that are simultaneously the informant, the informed and the information of big data? What counts as understanding of, or engagement with, big data, when big data themselves are multiplying, fluid and recursive? As part of our manifesto, we propose a range of empirical, conceptual and methodological exhortations. We also provide Appendix 1 that outlines three novel methods for addressing some of the issues raised in the article….(More)”