The Risks of Dangerous Dashboards in Basic Education


Lant Pritchett at the Center for Global Development: “On June 1, 2009 Air France flight 447 from Rio de Janeiro to Paris crashed into the Atlantic Ocean killing all 228 people on board. While the Airbus 330 was flying on auto-pilot, the different speed indicators received by the on-board navigation computers started to give conflicting speeds, almost certainly because the pitot tubes responsible for measuring air speed had iced over. Since the auto-pilot could not resolve conflicting signals and hence did not know how fast the plane was actually going, it turned control of the plane over to the two first officers (the captain was out of the cockpit). Subsequent flight simulator trials replicating the conditions of the flight conclude that had the pilots done nothing at all everyone would have lived—nothing was actually wrong; only the indicators were faulty, not the actual speed. But, tragically, the pilots didn’t do nothing….

What is the connection to education?

Many countries’ systems of basic education are in “stall” condition.

A recent paper of Beatty et al. (2018) uses information from the Indonesia Family Life Survey, a representative household survey that has been carried out in several waves with the same individuals since 2000 and contains information on whether individuals can answer simple arithmetic questions. Figure 1, showing the relationship between the level of schooling and the probability of answering a typical question correctly, has two shocking results.

First, the difference in the likelihood a person can answer a simple mathematics question correctly differs by only 20 percent between individuals who have completed less than primary school (<PS)—who can answer correctly (adjusted for guessing) about 20 percent of the time—and those who have completed senior secondary school or more (>=SSS), who answer correctly only about 40 percent of the time. These are simple multiple choice questions like whether 56/84 is the same fraction as (can be reduced to) 2/3, and whether 1/3-1/6 equals 1/6. This means that in an entire year of schooling, less than 2 additional children per 100 gain the ability to answer simple arithmetic questions.

Second, this incredibly poor performance in 2000 got worse by 2014. …

What has this got to do with education dashboards? The way large bureaucracies prefer to work is to specify process compliance and inputs and then measure those as a means of driving performance. This logistical mode of managing an organization works best when both process compliance and inputs are easily “observable” in the economist’s sense of easily verifiable, contractible, adjudicated. This leads to attention to processes and inputs that are “thin” in the Clifford Geertz sense (adopted by James Scott as his primary definition of how a “high modern” bureaucracy and hence the state “sees” the world). So in education one would specify easily-observable inputs like textbook availability, class size, school infrastructure. Even if one were talking about “quality” of schooling, a large bureaucracy would want this too reduced to “thin” indicators, like the fraction of teachers with a given type of formal degree, or process compliance measures, like whether teachers were hired based on some formal assessment.

Those involved in schooling can then become obsessed with their dashboards and the “thin” progress that is being tracked and easily ignore the loud warning signals saying: Stall!…(More)”.

Countries Can Learn from France’s Plan for Public Interest Data and AI


Nick Wallace at the Center for Data Innovation: “French President Emmanuel Macron recently endorsed a national AI strategy that includes plans for the French state to make public and private sector datasets available for reuse by others in applications of artificial intelligence (AI) that serve the public interest, such as for healthcare or environmental protection. Although this strategy fails to set out how the French government should promote widespread use of AI throughout the economy, it will nevertheless give a boost to AI in some areas, particularly public services. Furthermore, the plan for promoting the wider reuse of datasets, particularly in areas where the government already calls most of the shots, is a practical idea that other countries should consider as they develop their own comprehensive AI strategies.

The French strategy, drafted by mathematician and Member of Parliament Cédric Villani, calls for legislation to mandate repurposing both public and private sector data, including personal data, to enable public-interest uses of AI by government or others, depending on the sensitivity of the data. For example, public health services could use data generated by Internet of Things (IoT) devices to help doctors better treat and diagnose patients. Researchers could use data captured by motorway CCTV to train driverless cars. Energy distributors could manage peaks and troughs in demand using data from smart meters.

Repurposed data held by private companies could be made publicly available, shared with other companies, or processed securely by the public sector, depending on the extent to which sharing the data presents privacy risks or undermines competition. The report suggests that the government would not require companies to share data publicly when doing so would impact legitimate business interests, nor would it require that any personal data be made public. Instead, Dr. Villani argues that, if wider data sharing would do unreasonable damage to a company’s commercial interests, it may be appropriate to only give public authorities access to the data. But where the stakes are lower, companies could be required to share the data more widely, to maximize reuse. Villani rightly argues that it is virtually impossible to come up with generalizable rules for how data should be shared that would work across all sectors. Instead, he argues for a sector-specific approach to determining how and when data should be shared.

After making the case for state-mandated repurposing of data, the report goes on to highlight four key sectors as priorities: health, transport, the environment, and defense. Since these all have clear implications for the public interest, France can create national laws authorizing extensive repurposing of personal data without violating the General Data Protection Regulation (GDPR) which allows national laws that permit the repurposing of personal data where it serves the public interest. The French strategy is the first clear effort by an EU member state to proactively use this clause in aid of national efforts to bolster AI….(More)”.

Buzzwords and tortuous impact studies won’t fix a broken aid system


The Guardian: “Fifteen leading economists, including three Nobel winners, argue that the many billions of dollars spent on aid can do little to alleviate poverty while we fail to tackle its root causes….Donors increasingly want to see more impact for their money, practitioners are searching for ways to make their projects more effective, and politicians want more financial accountability behind aid budgets. One popular option has been to audit projects for results. The argument is that assessing “aid effectiveness” – a buzzword now ubiquitous in the UK’s Department for International Development – will help decide what to focus on.

Some go so far as to insist that development interventions should be subjected to the same kind of randomised control trials used in medicine, with “treatment” groups assessed against control groups. Such trials are being rolled out to evaluate the impact of a wide variety of projects – everything from water purification tablets to microcredit schemes, financial literacy classes to teachers’ performance bonuses.

Economist Esther Duflo at MIT’s Poverty Action Lab recently argued in Le Monde that France should adopt clinical trials as a guiding principle for its aid budget, which has grown significantly under the Macron administration.

But truly random sampling with blinded subjects is almost impossible in human communities without creating scenarios so abstract as to tell us little about the real world. And trials are expensive to carry out, and fraught with ethical challenges – especially when it comes to health-related interventions. (Who gets the treatment and who doesn’t?)

But the real problem with the “aid effectiveness” craze is that it narrows our focus down to micro-interventions at a local level that yield results that can be observed in the short term. At first glance this approach might seem reasonable and even beguiling. But it tends to ignore the broader macroeconomic, political and institutional drivers of impoverishment and underdevelopment. Aid projects might yield satisfying micro-results, but they generally do little to change the systems that produce the problems in the first place. What we need instead is to tackle the real root causes of poverty, inequality and climate change….(More)”.

Reduced‐Boundary Governance: The Advantages of Working Together


Introduction by Jeremy L. Hall and R. Paul Battaglio of Special Issue of the Public Administration Review: “Collaboration, cooperation, and coproduction are all approaches that reflect the realization that creative solutions look beyond traditional, organizational, and structural boundaries to overcome various capacity deficiencies while working toward shared goals….One of the factors complicating measurement and analysis in multistakeholder approaches to solving problems and delivering services is the inherently intergovernmental and intersectoral nature of the work. Performance now depends on accumulated capacity across organizations, including a special form of capacity—the ability to work together collaboratively. Such activity within a government has been referred to as “whole of government” approaches or “joined up government” (Christensen and Lægreid 2007). We have terms for work across levels of government (intergovernmental relations) and between government and the public and private sectors (intersectoral relations), but on the whole, the creative, collaborative, and interactive activities in which governments are involved today transcend even these neat categories and classifications. We might call this phenomenon reduced‐boundary governance. Moving between levels of government or between sectors often changes the variables that are available for analysis, or at least introduces validity issues associated with differences in measurement and estimation (see Brandsen and Honingh 2016; Nabatchi, Sancino, and Sicilia 2017). Sometimes data are not available at all. And, of course, collaboration or pooling of resources typically occurs in an ad hoc or one‐off basis that is limited to a single problem, a single program, or a single defined period of time, further complicating study and knowledge accumulation.

Increasingly, public service is accomplished together rather than alone. Boundaries between organizations are becoming blurred in new approaches to solving public problems (Christensen and Lægreid 2007). PAR is committed to better understanding the circumstances under which collaboration, cooperation, and coproduction occurs. What are the necessary antecedents? What are the deterrents? We are interested in the challenges that organizations face as they pursue collaborative action that transcends boundaries. And, of course, we are interested in the efficiency and performance gains that are achieved as a result of those efforts, as well as in their long‐term sustainability.

In this issue, we feature a series of articles that highlight research that focuses on working together, through collaboration, coproduction, or cooperation. The issue begins with a look at right‐sizing the use of volunteerism in public and nonprofit organizations given their limitations and possibilities (Nesbit, Christensen, and Brudney 2018). Uzochukwu and Thomas (2018) then explore coproduction using a case study of Atlanta to better understand who uses it and why. Klok et al. (2018) presents a fascinating look at intermunicipal cooperation through polycentric regional governance in the Netherlands, with an eye toward the costs and effectiveness of those arrangements. McGuire, Hoang, and Prakash (2018) look at the effectiveness of voluntary environmental programs in pollution reduction. Using different policy tools as lenses for analysis, Jung, Malatesta, and LaLonde (2018) ask whether work release programs are improved by working together or working alone. Finally, Yi et al. (2018) explore the role of regional governance and institutional collective action in promoting environmental sustainability. Each of these pieces explores unique dimensions of working together, or governing beyond traditional boundaries….(More)”.

City-as-a-Service


Circle Economy: Today during the WeMakeThe.City festival, Circle Economy launched the ‘City-as-a-Service’ publication, which offers a first glimpse into the ‘circular city of the future’. This publication is an initial and practical exploration of how service models will shape the way in which societal needs can be met in a future urban environment and how cities can take a leadership role in a transition towards a circular economy….

Housing, nutrition, mobility, and clothing are primary human needs and directly linked to material extraction. For each of these needs, Circle Economy has examined the potential impacts that service models can have.

By subscribing to a car-sharing service, for example, consumers are able to choose smaller, cheaper and more efficient cars when driving solo. In the Netherlands alone, this would save 2,200 kton of CO2 annually and will reduce annual spending on motoring by 10%. For textiles, a service model could potentially help us avoid “bad buys” that are never worn, which would result in a 15% cost saving for consumers and 23 kton of CO2 in the Netherlands. …

In an increasingly urban world, cities have to play a leading role to drive sustainable transitions and will lead the way on delivering the positive effects of a circular economy – and hence help to close the circularity gap. The circular economy offers a clear roadmap towards realizing the low-carbon, human-centered and prosperous circular city of the future. The ‘City-As-A-Service’ vision is a key next step into this promising future. Ultimately, service models could be a game changer for cities. In fact, city governments can influence this by providing the right boundary conditions and incentives in their policymaking…..(More)”.

Democracy doomsday prophets are missing this critical shift


Bruno Kaufmann and Joe Mathews in the Washington Post: “The new conventional wisdom seems to be that electoral democracy is in decline. But this ignores another widespread trend: direct democracy at the local and regional level is booming, even as disillusion with representative government at the national level grows.

Today, 113 of the world’s 117 democratic countries offer their citizens legally or constitutionally established rights to bring forward a citizens’ initiative, referendum or both. And since 1980, roughly 80 percent of countries worldwide have had at least one nationwide referendum or popular vote on a legislative or constitutional issue.

Of all the nationwide popular votes in the history of the world, more than half have taken place in the past 30 years. As of May 2018, almost 2,000 nationwide popular votes on substantive issues have taken place, with 1,059 in Europe, 191 in Africa, 189 in Asia, 181 in the Americas and 115 in Oceania, based on our research.

That is just at the national level. Other major democracies — Germany, the United States and India — do not permit popular votes on substantive issues nationally but support robust direct democracy at the local and regional levels. The number of local votes on issues has so far defied all attempts to count them — they run into the tens of thousands.

This robust democratization, at least when it comes to direct legislation, provides a context that’s generally missing when doomsday prophets suggest that democracy is dying by pointing to authoritarian-leaning leaders like Turkish President Recep Tayyip Erdogan, Russian President Vladimir Putin, Hungarian Prime Minister Viktor Orbán, Philippine President Rodrigo Duterte and U.S. President Donald Trump.

Indeed, the two trends — the rise of populist authoritarianism in some nations and the rise of local and direct democracy in some areas — are related. Frustration is growing with democratic systems at national levels, and yes, some people become more attracted to populism. But some of that frustration is channeled into positive energy — into making local democracy more democratic and direct.

Cities from Seoul to San Francisco are hungry for new and innovative tools that bring citizens into processes of deliberation that allow the people themselves to make decisions and feel invested in government actions. We’ve seen local governments embrace participatory budgeting, participatory planning, citizens’ juries and a host of experimental digital tools in service of that desired mix of greater public deliberation and more direct public action….(More).”

CrowdLaw Manifesto


At the Rockefeller Foundation Bellagio Center this spring, assembled participants  met to discuss CrowdLaw, namely how to use technology to improve the quality and effectiveness of law and policymaking through greater public engagement. We put together and signed 12 principles to promote the use of CrowdLaw by local legislatures and national parliaments, calling for legislatures, technologists and the public to participate in creating more open and participatory lawmaking practices. We invite you to sign the Manifesto using the form below.

Draft dated May 29, 2018

  1. To improve public trust in democratic institutions, we must improve how we govern in the 21st century.
  2. CrowdLaw is any law, policy-making or public decision-making that offers a meaningful opportunity for the public to participate in one or multiples stages of decision-making, including but not limited to the processes of problem identification, solution identification, proposal drafting, ratification, implementation or evaluation.
  3. CrowdLaw draws on innovative processes and technologies and encompasses diverse forms of engagement among elected representatives, public officials, and those they represent.
  4. When designed well, CrowdLaw may help governing institutions obtain more relevant facts and knowledge as well as more diverse perspectives, opinions and ideas to inform governing at each stage and may help the public exercise political will.
  5. When designed well, CrowdLaw may help democratic institutions build trust and the public to play a more active role in their communities and strengthen both active citizenship and democratic culture.
  6. When designed well, CrowdLaw may enable engagement that is thoughtful, inclusive, informed but also efficient, manageable and sustainable.
  7. Therefore, governing institutions at every level should experiment and iterate with CrowdLaw initiatives in order to create formal processes for diverse members of society to participate in order to improve the legitimacy of decision-making, strengthen public trust and produce better outcomes.
  8. Governing institutions at every level should encourage research and learning about CrowdLaw and its impact on individuals, on institutions and on society.
  9. The public also has a responsibility to improve our democracy by demanding and creating opportunities to engage and then actively contributing expertise, experience, data and opinions.
  10. Technologists should work collaboratively across disciplines to develop, evaluate and iterate varied, ethical and secure CrowdLaw platforms and tools, keeping in mind that different participation mechanisms will achieve different goals.
  11. Governing institutions at every level should encourage collaboration across organizations and sectors to test what works and share good practices.
  12. Governing institutions at every level should create the legal and regulatory frameworks necessary to promote CrowdLaw and better forms of public engagement and usher in a new era of more open, participatory and effective governing.

The CrowdLaw Manifesto has been signed by the following individuals and organizations:

Individuals

  • Victoria Alsina, Senior Fellow at The GovLab and Faculty Associate at Harvard Kennedy School, Harvard University
  • Marta Poblet Balcell , Associate Professor, RMIT University
  • Robert Bjarnason — President & Co-founder, Citizens Foundation; Better Reykjavik
  • Pablo Collada — Former Executive Director, Fundación Ciudadano Inteligente
  • Mukelani Dimba — Co-chair, Open Government Partnership
  • Hélène Landemore, Associate Professor of Political Science, Yale University
  • Shu-Yang Lin, re:architect & co-founder, PDIS.tw
  • José Luis Martí , Vice-Rector for Innovation and Professor of Legal Philosophy, Pompeu Fabra University
  • Jessica Musila — Executive Director, Mzalendo
  • Sabine Romon — Chief Smart City Officer — General Secretariat, Paris City Council
  • Cristiano Ferri Faría — Director, Hacker Lab, Brazilian House of Representatives
  • Nicola Forster — President and Founder, Swiss Forum on Foreign Policy
  • Raffaele Lillo — Chief Data Officer, Digital Transformation Team, Government of Italy
  • Tarik Nesh-Nash — CEO & Co-founder, GovRight; Ashoka Fellow
  • Beth Simone Noveck, Director, The GovLab and Professor at New York University Tandon School of Engineering
  • Ehud Shapiro , Professor of Computer Science and Biology, Weizmann Institute of Science

Organizations

  • Citizens Foundation, Iceland
  • Fundación Ciudadano Inteligente, Chile
  • International School for Transparency, South Africa
  • Mzalendo, Kenya
  • Smart Cities, Paris City Council, Paris, France
  • Hacker Lab, Brazilian House of Representatives, Brazil
  • Swiss Forum on Foreign Policy, Switzerland
  • Digital Transformation Team, Government of Italy, Italy
  • The Governance Lab, New York, United States
  • GovRight, Morocco
  • ICT4Dev, Morocco

Israeli, French Politicians Endorse Blockchain for Governance Transparency


Komfie Manolo at Cryptovest: “Blockchain is moving into the world’s political systems, with several influential political figures in Israel and France recently emerging as new believers in the technology. They are betting on blockchain for more transparent governance and have joined the decentralized platform developed by Coalichain.

Among the seven Israeli politicians to endorse the platform are former deputy minister and interior minister Eli Yishay, deputy defense minister Eli Ben-Dan, and HaBait HaYehudi leader Shulamit Mualem-Refaeli. The move for a more accountable democracy has also been supported by Frederic Lefebvre, the founder of French political party Agir.

Levi Samama, co-founder and CEO of Coalichain, said that support for the platform was “a positive indication that politicians are actively seeking ways to be transparent and direct in the way they communicate with the public. In order to impact existing governance mechanisms we need the support and engagement of politicians and citizens alike.”

Acceptance of blockchain is gaining traction in the world of politics.

During last month’s presidential election in Russia, blockchain was used by state-run public opinion research center VTSIOM to track exit polls.

In the US, budding political group Indie Party wants to redefine the country’s political environment by providing an alternative to the established two-party system with a political marketplace that uses blockchain and cryptocurrency….(More)”

If, When and How Blockchain Technologies Can Provide Civic Change


By Stefaan G. Verhulst and Andrew Young

The hype surrounding the potential of blockchain technologies– the distributed ledger technology (DLT) undergirding cryptocurrencies like Bitcoin – to transform the way industries and sectors operate and exchange records is reaching a fever pitch.

Gartner Hype Cycle

Source: Top Trends in the Gartner Hype Cycle for Emerging Technologies, 2017

Governments and civil society have now also joined the quest and are actively exploring the potential of DLTs to create transformative social change. Experiments are underway to leverage blockchain technologies to address major societal challenges – from homelessness in New York City to the Rohyingya crisis in Myanmar to government corruption around the world. At the same time, a growing backlash to the newest ‘shiny object’ in the technology for good space is gaining ground.   

At this year’s The Impacts of Civic Technology Conference (TICTeC), organized by mySociety in Lisbon, the GovLab’s Stefaan Verhulst and Andrew Young joined the Engine Room’s Nicole Anand, the Natural Resource Governance Institute’s Anders Pedersen, and ITS-Rio’s Marco Konopacki to consider whether or not Blockchain can truly deliver on its promise for creating civic change.

For the GovLab’s contribution to the panel, we shared early findings from our Blockchange: Blockchain for Social Change initiative. Blockchange, funded by the Rockefeller Foundation, seeks to develop a deeper understanding of the promise and practice of DLTs tin addressing public problems – with a particular focus on the lack, the role and the establishment of trusted identities – through a set of detailed case-studies. Such insights may help us develop operational guidelines on when blockchain technology may be appropriate and what design principles should guide the future use of DLTs for good.

Our presentation covered four key areas (Full presentation here):

  1. The evolving package of attributes present in Blockchain technologies: on-going experimentation, development and investment has lead to the realization that there is no one blockchain technology. Rather there are several variations of attributes that provide for different technological scenarios. Some of these attributes remain foundational -– such as immutability, (guaranteed) integrity, and distributed resilience – while others have evolved as optional including disintermediation, transparency, and accessibility. By focusing on the attributes we can transcend the noise that is emerging from having too many well funded start-ups that seek to pitch their package of attributes as the solution;Attributes of DLT
  2. The three varieties of Blockchain for social change use cases: Most of the pilots and use cases where DLTs are being used to improve society and people’s lives can be categorized along three varieties of applications:
    • Track and Trace applications. For instance: 
      1. Versiart creates verifiable, digital certificates for art and collectibles which helps buyers ensure each piece’s provenance.
      2. Grassroots Cooperative along with Heifer USA created a blockchain-powered app that allows every package of chicken marketed and sold by Grassroots to be traced on the Ethereum blockchain.
      3. Everledger works with stakeholders across the diamond supply chain to track diamonds from mine to store.
      4. Ripe is working with Sweetgreen to use blockchain and IoT sensors to track crop growth, yielding higher-quality produce and providing better information for farmers, food distributors, restaurants, and consumers.    
    • Smart Contracting applications. For instance:
      1. In Indonesia, Carbon Conservation and Dappbase have created smart contracts that will distribute rewards to villages that can prove the successful reduction of incidences of forest fires.
      2. Alice has built Ethereum-based smart contracts for a donation project that supports 15 homeless people in London. The smart contracts ensure donations are released only when pre-determined project goals are met.
      3. Bext360 utilizes smart contracts to pay coffee farmers fairly and immediately based on a price determined through weighing and analyzing beans by the Bext360 machine at the source.  
    • Identity applications. For instance:
      1. The State of Illinois is working with Evernym to digitize birth certificates, thus giving individuals a digital identity from birth.
      2. BanQu creates an economic passport for previously unbanked populations by using blockchain to record economic and financial transactions, purchase goods, and prove their existence in global supply chains.
      3. In 2015, AID:Tech piloted a project working with Syrian refugees in Lebanon to distribute over 500 donor aid cards that were tied to non-forgeable identities.
      4. uPort provides digital identities for residents of Zug, Switzerland to use for governmental services.

Three Blockchange applications

  1. The promise of trusted Identity: the potential to establish a trusted identity turns out to be foundational for using blockchain technologies for social change. At the same time identity emerges from a process (involving, for instance, provisioning, authentication, administration, authorization and auditing) and it is key to assess at what stage of the ID lifecycle DLTs provide an advantage vis-a-vis other ID technologies; and how the maturity of the blockchain technology toward addressing the ID challenge. 

ID Lifecycle and DLT

  1. Finally, we seek to translate current findings into
    • Operational conditions that can enable the public and civic sector at-large to determine when “to blockchain” including:
      • The need for a clear problem definition (as opposed to certain situations where DLT solutions are in search of a problem);
      • The presence of information asymmetries and high transaction costs incentivize change. (“The Market of Lemons” problem);
      • The availability of (high quality) digital records;
      • The lack of availability of credible and alternative disclosure technologies;
      • Deficiency (or efficiency) of (trusted) intermediaries in the space.
    • Design principles that can increase the likelihood of societal benefit when using Blockchain for identity projects (see picture) .

Design Principles

In the coming months, we will continue to share our findings from the Blockchange project in a number of forms – including a series of case studies, additional presentations and infographics, and an operational field guide for designing and implementing Blockchain projects to address challenges across the identity lifecycle.

The GovLab, in collaboration with the National Resource Governance Institute, is also delighted to announce a new initiative aimed at taking stock of the promise, practice and challenge of the use of Blockchain in the extractives sector. The project is focused in particular on DLTs as they relate to beneficial ownership, licensing and contracting transparency, and commodity trading transparency. This fall, we will share a collection of Blockchain for extractives case studies, as well as a report summarizing if, when, and how Blockchain can provide value across the extractives decision chain.

If you are interested in collaborating on our work to increase our understanding of Blockchain’s real potential for social change, or if you have any feedback on this presentation of early findings, please contact [email protected].

 

A Framework for Strengthening Data Ecosystems to Serve Humanitarian Purposes


Paper by Marc van den Homberg et al: “The incidence of natural disasters worldwide is increasing. As a result, a growing number of people is in need of humanitarian support, for which limited resources are available. This requires an effective and efficient prioritization of the most vulnerable people in the preparedness phase, and the most affected people in the response phase of humanitarian action. Data-driven models have the potential to support this prioritization process. However, the applications of these models in a country requires a certain level of data preparedness.
To achieve this level of data preparedness on a large scale we need to know how to facilitate, stimulate and coordinate data-sharing between humanitarian actors. We use a data ecosystem perspective to develop success criteria for establishing a “humanitarian data ecosystem”. We first present the development of a general framework with data ecosystem governance success criteria based on a systematic literature review. Subsequently, the applicability of this framework in the humanitarian sector is assessed through a case study on the “Community Risk Assessment and Prioritization toolbox” developed by the Netherlands Red Cross. The empirical evidence led to the adaption the framework to the specific criteria that need to be addressed when aiming to establish a successful humanitarian data ecosystem….(More)”.