Smart OCR – Advancing the Use of Artificial Intelligence with Open Data

Curated on Posted on by Stefaan Verhulst

Article by Parth Jain, Abhinay Mannepalli, Raj Parikh, and Jim Samuel: “Optical character recognition (OCR) is growing at a projected compounded annual growth rate (CAGR) of 16%, and is expected to have a value of 39.7 billion USD by 2030, as estimated by Straits research. There has been a growing interest in OCR technologies over the past decade. Optical character recognition is the technological process for transforming images of typed, handwritten, scanned, or printed texts into machine-encoded and machine-readable texts (Tappert, et al., 1990). OCR can be used with a broad range of image or scan formats – for example, these could be in the form of a scanned document such as a .pdf file, a picture of a piece of paper in .png or .jpeg format, or images with embedded text, such as characters on a coffee cup, title on the cover page of a book, the license number on vehicular plates, and images of code on websites. OCR has proven to be a valuable technological process for tackling the important challenge of transforming non-machine-readable data into machine readable data. This enables the use of natural language processing and computational methods on information-rich data which were previously largely non-processable. Given the broad array of scanned and image documents in open government data and other open data sources, OCR holds tremendous promise for value generation with open data.

Open data has been defined as “being data that is made freely available for open consumption, at no direct cost to the public, which can be efficiently located, filtered, downloaded, processed, shared, and reused without any significant restrictions on associated derivatives, use, and reuse” (Chidipothu et al., 2022). Large segments of open data contain images, visuals, scans, and other non-machine-readable content. The size and complexity associated with the manual analysis of such content is prohibitive. The most efficient way would be to establish standardized processes for transforming documents into their OCR output versions. Such machine-readable text could then be analyzed using a range of NLP methods. Artificial Intelligence (AI) can be viewed as being a “set of technologies that mimic the functions and expressions of human intelligence, specifically cognition and logic” (Samuel, 2021). OCR was one of the earliest AI technologies implemented. The first ever optical reader to identify handwritten numerals was the advanced reading machine “IBM 1287,” presented at the World Fair in New York in 1965 (Mori, et al., 1990). The value of open data is well established – however, the extent of usefulness of open data is dependent on “accessibility, machine readability, quality” and the degree to which data can be processed by using analytical and NLP methods (data.gov, 2022; John, et al., 2022)…(More)”

The rise and fall of peer review

Curated on Posted on by Stefaan Verhulst

Blog by Adam Mastroianni: “For the last 60 years or so, science has been running an experiment on itself. The experimental design wasn’t great; there was no randomization and no control group. Nobody was in charge, exactly, and nobody was really taking consistent measurements. And yet it was the most massive experiment ever run, and it included every scientist on Earth.

Most of those folks didn’t even realize they were in an experiment. Many of them, including me, weren’t born when the experiment started. If we had noticed what was going on, maybe we would have demanded a basic level of scientific rigor. Maybe nobody objected because the hypothesis seemed so obviously true: science will be better off if we have someone check every paper and reject the ones that don’t pass muster. They called it “peer review.”

This was a massive change. From antiquity to modernity, scientists wrote letters and circulated monographs, and the main barriers stopping them from communicating their findings were the cost of paper, postage, or a printing press, or on rare occasions, the cost of a visit from the Catholic Church. Scientific journals appeared in the 1600s, but they operated more like magazines or newsletters, and their processes of picking articles ranged from “we print whatever we get” to “the editor asks his friend what he thinks” to “the whole society votes.” Sometimes journals couldn’t get enough papers to publish, so editors had to go around begging their friends to submit manuscripts, or fill the space themselves. Scientific publishing remained a hodgepodge for centuries.

(Only one of Einstein’s papers was ever peer-reviewed, by the way, and he was so surprised and upset that he published his paper in a different journal instead.)

That all changed after World War II. Governments poured funding into research, and they convened “peer reviewers” to ensure they weren’t wasting their money on foolish proposals. That funding turned into a deluge of papers, and journals that previously struggled to fill their pages now struggled to pick which articles to print. Reviewing papers before publication, which was “quite rare” until the 1960s, became much more common. Then it became universal.

Now pretty much every journal uses outside experts to vet papers, and papers that don’t please reviewers get rejected. You can still write to your friends about your findings, but hiring committees and grant agencies act as if the only science that exists is the stuff published in peer-reviewed journals. This is the grand experiment we’ve been running for six decades.

The results are in. It failed…(More)”.

Learnings on the Importance of Youth Engagement

Curated on Posted on by Stefaan Verhulst

Blog by  Anna Ibru and Dane Gambrell at The GovLab: “…In recent years, public institutions around the world are piloting new youth engagement initiatives like Creamos that tap the expertise and experiences of young people to develop projects, programs, and policies and address complex social challenges within communities. 

To learn from and scale best practices from international models of youth engagement, The GovLab has develop case studies about three path breaking initiatives: Nuortenbudjetti, Helsinki’s participatory budgeting initiative for youth; Forum Jove BCN, Barcelona’s youth led citizens’ assembly; and Creamos, an open innovation and coaching program for young social innovators in Chile. For government decision makers and institutions who are looking to engage and empower young people to get involved in their communities, develop real-world solutions, and strengthen democracy, these examples describe these initiatives and their outcomes along with guidance on how to design and replicate such projects in your community. Young people are still a widely untapped resource who are too-often left out in policy and program design. The United Nations affirms that it is impossible to meet the UN SDGs by 2030 without active participation of the 1.8 billion youth in the world. Government decision makers and institutions must capitalize on the opportunity to engage and empower young people. The successes of Nuortenbudjetti, Forum Jove BCN, and Creamos provide a roadmap for policymakers looking to engage in this space….(More)” See also:  Nuortenbudjetti: Helsinki’s Youth Budget; Creamos: Co-creating youth-led social innovation projects in Chile and Forum Jove BCN: Barcelona’s Youth Forum.

Screen Shot 2022 12 06 At 1.36.48 Pm

Can citizen deliberation address the climate crisis? Not if it is disconnected from politics and policymaking

Curated on Posted on by Stefaan Verhulst

Blog by John Boswell, Rikki Dean and Graham Smith: “..Modelled on the deliberative democratic ideal, much of the attention on climate assemblies focuses on their internal features. The emphasis is on their novelty in providing respite from the partisan bickering of politics-as-usual, instead creating space for the respectful free and fair exchange of reasons.

On these grounds, the Global Citizens’ Assembly in 2021 and experimental ‘wave’ of climate assemblies across European countries are promising. Participating citizens have demonstrated they can grapple with complex information, deliberate respectfully, and come to a well thought-through set of recommendations that are – every time – more progressive than current climate policies.

But, before we get carried away with this enthusiasm, it is important to focus on a fundamental point usually glossed over. Assemblies are too often talked about in magical terms, as if by their moral weight alone citizen recommendations will win the day through the forceless force of their arguments. But this expectation is naive.

Designing for impact requires much more attention to the nitty-gritty of how policy actually gets made. That means taking seriously the technical uncertainties and complexities associated with policy interventions, and confronting the political challenges and trade-offs required in balancing priorities in the shadow of powerful interests.

In a recent study, we have examined the first six national climate assemblies – in Ireland, France, the UK, Scotland, Germany and Denmark – to see how they tried to achieve impact. Our novel approach is to take the focus away from their (very similar) ‘internal design characteristics’ – such as random selection – and instead put it on their ‘integrative design characteristics’…(More)”.

Bridging Data Gaps Can Help Tackle the Climate Crisis

Curated on Posted on by Stefaan Verhulst

Article by Bo Li and Bert Kroese: “A famous physicist once said: “When you can measure what you are speaking about, and express it in numbers, you know something about it”.

Nearly 140 years later, this maxim remains true and is particularly poignant for policymakers tasked with addressing climate mitigation and adaptation.

That’s because they face major information gaps that impede their ability to understand the impact of policies—from measures to incentivize cuts in emissions, to regulations that reduce physical risks and boost resilience to climate shocks. And without comprehensive and internationally comparable data to monitor progress, it’s impossible to know what works, and where course corrections are needed.

This underscores the importance of the support of G20 leaders for a new Data Gaps Initiative to make official statistics more detailed, and timely. It calls for better data to understand climate change, together with indicators that cover income and wealth, financial innovation and inclusion, access to private and administrative data, and data sharing. In short, official statistics need to be broader, more detailed, and timely.

The sector where change is needed the most is energy, the largest contributor to greenhouse gas emissions, accounting for around three-quarters of the total.

Economies must expand their renewable energy sources and curb fossil fuel use, but while there’s been a gradual shift in that direction, the pace is still not sufficient. And not only is there a lack of policy ambition in many cases, there also is a lack of comprehensive and internationally comparable data to monitor progress.

To accelerate cuts to emissions, policymakers need detailed statistics to monitor the path of the energy transition and assist them in devising effective mitigation measures that can deliver the fastest and least disruptive pathway toward net zero emissions…(More)”.

Building Trust and Reinforcing Democracy

Curated on Posted on by Stefaan Verhulst

OECD Report: “Democracies are at a critical juncture, under growing internal and external pressures. This publication sheds light on the important public governance challenges countries face today in preserving and strengthening their democracies, including fighting mis- and disinformation; improving government openness, citizen participation and inclusiveness; and embracing global responsibilities and building resilience to foreign influence. It also looks at two cross-cutting themes that will be crucial for robust, effective democracies: transforming public governance for digital democracy and gearing up government to deliver on climate and other environmental challenges. These areas lay out the foundations of the new OECD Reinforcing Democracy Initiative, which has also involved the development of action plans to support governments in responding to these challenges..(More)”.

Behavioral Economics and the Energy Crisis in Europe

Curated on Posted on by Stefaan Verhulst

Blog by Carlos Scartascini: “European nations, stunned by Russia’s aggression, have mostly rallied in support of Ukraine, sending weapons and welcoming millions of refugees. But European citizens are paying dearly for it. Apart from the costs in direct assistance, the energy conflict with Russia had sent prices of gas soaring to eight times their 10-year average by the end of September and helped push inflation to around 10%. With a partial embargo of Russian oil going into effect in December and cold weather coming, many Europeans now fear an icy, bitter and poorer winter of 2023.

European governments hope to take the edge off by enacting price regulations, providing energy subsidies for households, and crucially curbing energy demand. Germany’s government, for example, imposed limits on heating in public offices and buildings to 19 degrees Celsius (66.2 Fahrenheit). France has introduced a raft of voluntary measures ranging from asking public officials to travel by train rather than car, suggesting that municipalities swap old lamps for LEDs and designing incentives to get people to car share…

As we know from years of experiments at the IDB in using behavioral economics to achieve policy goals, however, rules and recommendations are not enough. Trust in fellow citizens and in the government are also crucial when calling for a shared sacrifice. That means not appealing to fear, which can lead to deeper divisions in society, energy hoarding, resignation and indifference. Rather, it means appealing to social norms of morality and community.

In using behavioral economics to boost tax compliance in Argentina, for example, we found that sending messages that revealed how fellow citizens were paying their taxes significantly improved tax collection. Revealing how the government was using tax funds to improve people’s lives provided an additional boost to the effort. Posters and television ads in Europe showing people wearing sweaters, turning down their thermostats, insulating their homes and putting up solar panels might similarly instill a sense of common purpose. And signals that governments are trying to relieve hardship might help instill in citizens the need for sacrifice…(More)”.

Calls to “save democracy” won’t work if there is little agreement on what democracy is

Curated on Posted on by Stefaan Verhulst

Article by Nicholas T. Davis, Kirby Goidel and Keith Gaddie: “One of the most consistent findings in academic research is the existence of something called the principle-implementation gap. People can agree that an idea is perfectly reasonable but will largely reject any meaningful action designed to achieve it. It happens with government spending. People want government to create public goods such as law enforcement, healthcare, and national defense, but oppose new (or additional) taxes. It happens with climate change. The public largely accepts the idea that human-caused climate change is occurring but is unwilling to reduce their reliance on fossil fuels. And it happens with racial equality. People decry racism, but they reject policies that reduce inequality. It also happens, it turns out, with democracy. People claim to love democracy, but willingly sacrifice democratic norms in pursuit of partisan political ends.

A recent New York Times/Siena Poll illustrates this point. Most Americans (71 percent) said they believed American democracy was endangered, but there was little agreement on the nature of the threat or the appropriate corrective action. In response to an open-end question, the most frequently identified threat (mentioned by only 14 percent of respondents) was corruption, not the undermining of democratic norms or the rule of law by former President Donald Trump and the almost 300 Republican candidates running for public office in this year’s midterm elections who deny the legitimacy of the 2020 presidential election.…

Despite much weeping and gnashing of teeth about the “crisis of democracy,” a singular, widely shared understand of democracy is not on the ballot. Or, if it is on the ballot, it appears to be losing.

Why don’t right-wing populist threats against democracy inspire, mobilize, or persuade a public that professes to believe in democracy?

Our new book, Democracy’s Meanings: How the Public Thinks About Democracy and Why It Matters, suggests at least two reasons. First, according to open-ended responses, citizens mostly view democracy through the lens of “freedom” and “elections.” The United States is having an election this fall. It may be less free and less fair in some places than others, but, overall, the electoral apparatus in the United States hasn’t cracked apart – at least in the minds of ordinary voters who don’t pay much attention to the news or care much about the intricacies of electoral law….(More)”.

How citizen science can help realize the full potential of data

Curated on Posted on by Stefaan Verhulst

Blog by Haishan Fu, Craig Hammer, and Edward Anderson: “Citizen science, a critical pillar of Open Science, advocates for greater citizen involvement in knowledge generation, research goals, and outcomes. By engaging citizens directly in data collection, drone imaging, and crowdsourcing into project design, we provide policymakers and citizens with valuable data and information they need to make informed and effective decisions.   

Furthermore, abiding by the principles of citizen science, we can help communities establish a new social contract around data stewardship, grounded in the principles of value, trust, and equity, as proposed by the World Development Report 2021: Data for Better Lives. The report puts forward a vision of data governance that is multistakeholder and collaborative. It explicitly builds data production, protection, exchange, and use into planning and decision-making, and integrates participants from civil society, private sectors, and importantly, the public into the data life cycle and into the governance structures of the system. 

As the experience of the Resilience Academy shows, increasing our commitment to citizen science by inviting public engagement before, during, and after development projects can help engage a wider swath of the public with the Bank’s Open Data Initiative.   

The Tanzania-based project empowers students to adapt low-cost, low-complexity tools and open methods to collect and manage data from their changing environments. Resilience Academy students also participate in solving real-world challenges in their community, such as mapping flood- and rockfall-prone zones, surveying tourism and infrastructure needs, and other areas currently lacking critical data. 

This “learning by doing” approach equips young people with the long-term tools, knowledge, and skills they need to address the world’s most pressing urban challenges and ensure resilient urban development. This project is demonstrating the many co-benefits that come from hands-on learning, job creation, and data management-related skills. 

Incorporating citizen science into open data agendas and project design, however, will necessitate some changes to how the World Bank and other multilateral development agencies approach development projects….(More)”.

Tech-Fuelled Inequality Could Catalyze Populism 2.0

Curated on Posted on by Stefaan Verhulst

Article by Kyle Hiebert: “Geopolitical crises, looming climate chaos and the relentless expansion of surveillance capitalism are driving the development of the technologies of tomorrow — artificial intelligence (AI), semiconductors, green energy, big data, advanced robotics, virtual and augmented reality, nanotechnology, quantum computing, the Internet of Things and more.

Each of these tools holds tremendous potential to improve lives and help solve the world’s biggest problems. But technological change always produces winners and losers by giving rise to new concentrations of power and novel forms of inequality. For example, a study by the US National Bureau of Economic Research found that between 50 and 70 percent of lost wages in America from 1980 to 2016 stemmed from automation — far more than from aggressive offshoring or the withering of labour unions.

However, automation has brought about new occupations as well, evidenced by the absence of mass joblessness in the United States over the same period. Despite the lost wages, the US unemployment rate from 1993 to 2019 stayed around or below seven percent when excluding a four-year recovery following the exogenous shock of the 2008 financial crisis. Productivity has also increased by nearly 62 percent since 1979. But the wages of American workers have failed to keep pace, rising only 17.5 percent, signalling a deep disconnect in recent history between new technologies being adopted and the average worker being better off as a result.

Similar circumstances across the democratic world have provoked severe political consequences over the past decade. Disaffected populations caught on the wrong side of economic transformations and alienated by the accompanying social changes spurred by globalization have aligned themselves with populists pitching simplistic solutions to complex problems. Polarization has skyrocketed; international cooperation has frayed.

As the so-called Fourth Industrial Revolution accelerates in coming years, upending how economies and societies operate, a new form of populism rooted in tech-fuelled disparities may eventually consume democratic nations. To avoid this outcome, governments must get serious about harnessing new technologies to make the democratic process more agile and responsive to voters’ frustrations…(More)”