Abstract

Data equity and official statistics in the age of private sector data proliferation
Introduction
Over the last few years, the private sector has become a primary generator of data due to widespread digitisation of the economy and society, the use of social media platforms, and advancements of technologies like the Internet of Things and AI. Unlike traditional sources, these new data streams often offer real-time information and unique insights into people's behaviour, social dynamics, and economic trends. However, the proprietary nature of most private sector data presents challenges for public access, transparency, and governance that have led to fragmented, often conflicting, data governance arrangements worldwide. This lack of coherence can exacerbate inequalities, limit data access, and restrict data's utility as a global asset.
Within this context, data equity has emerged as one of the key principles at the basis of any proposal of new data governance framework. The term “data equity” refers to the fair and inclusive access, use, and distribution of data so that it benefits all sections of society, regardless of socioeconomic status, race, or geographic location. It involves making sure that the collection, processing, and use of data does not disproportionately benefit or harm any particular group and seeks to address disparities in data access and quality that can perpetuate social and economic inequalities. This is important because data systems significantly influence access to resources and opportunities in society. In this sense, data equity aims to correct imbalances that have historically affected various groups and to ensure that decision-making based on data does not perpetuate these inequities.
The world economic forum insights on the multiple dimensions of data equity
The advent of data-driven technologies and the rise of big data have shifted the balance of data ownership significantly towards private companies. Corporations, especially those in technology and finance, possess vast quantities of data on individual behaviour, purchasing habits, and online activity, far surpassing the data traditionally gathered by governments. This shift has prompted discussions on data equity on a global scale, with the World Economic Forum among the key institutions emphasising the need for equitable data governance.
The WEF's recent reports and white papers on data equity and digital transformation 1 , such as the “Data for Common Purpose Initiative” (DCPI), have underscored how data ownership and access impact equitable outcomes. For instance, the DCPI promotes frameworks that would enable data sharing in ways that align with the public interest. The WEF argues that in order to bridge gaps in data access and ensure that marginalised groups are not excluded from data-driven decision-making, it is essential to establish clear rules on data ownership, portability, and sharing. This focus on equitable data governance highlights how private sector data, if accessible and responsibly shared, could contribute to social good by informing policy, supporting public health initiatives, and addressing inequalities.
The WEF's work has thus helped place data equity on the agenda by demonstrating the potential risks of data concentration and by advocating for mechanisms that allow data to be shared across sectors in ways that benefit all. According to the WEF, data is not simply an economic asset but a societal one, warranting policies and practices that prioritise equity, trust, and accountability. This emphasis on data as a societal asset frames data equity as a public good that must be regulated and managed to avoid exacerbating existing inequalities. The World Economic Forum's document “Advancing Data Equity: An Action-Oriented Framework” discusses how the principles of data equity can be embedded across various sectors, emphasising fair data practices that protect human rights and ensure inclusive outcomes. It provides a comprehensive approach for addressing imbalances in how data is used and shared, especially as technology and automated decision-making processes become more integral to everyday life. The document outlines key areas where equity can be implemented throughout the data lifecycle:
Statisticians’ and economists’ views on data equity
While both statisticians and economists agree on the importance of data equity, traditionally they tend to approach it from different angles due to their distinct disciplinary focuses.
Statisticians prioritise issues related to the quality, integrity and accessibility of data. For statisticians, data equity is mainly about ensuring that data is accurate, unbiased, and representative of the population. They emphasise the technical aspects of data collection and analysis, such as the need to avoid sampling biases that could lead to unequal representation of certain groups. This perspective is fully reflected in the Fundamental Principles of Official Statistics, which include guidelines on impartiality, quality, and transparency in data production. These principles underscore the need for national statistical offices to produce data that is objective, accessible, and reliable for all users.
Economists, on the other hand, approach data equity from the perspective of economic impact. They are concerned about how data ownership, data access, and data-driven decision-making affect economic power and resource allocation. For economists, data equity is closely linked to concepts of fair competition, market transparency, and equitable economic growth. They often advocate for policies that prevent data monopolies and ensure competitive markets, highlighting that unequal access to data can exacerbate income inequalities and reduce economic mobility. They also focus on the economic value of data, arguing that open data policies can unlock innovations, improve market efficiency, and create new opportunities for marginalised communities.
The distinction between these perspectives has significant implications for data equity policies. Statisticians’ focus on data quality and representativeness highlights the need for rigorous standards in data collection, processing, and dissemination. Economists’ emphasis on data accessibility and economic impact, meanwhile, underscores the importance of creating systems that make data widely available. Together, these perspectives contribute to a comprehensive approach to data equity that addresses both technical and social aspects.
Fundamental principles of official statistics and data equity
As we have seen, the statisticians’ perspective on data equity is fully reflected in the UN Fundamental Principles of Official Statistics (FPOS). Adopted by the UN Statistical Commission in 1994 and subsequently at the highest political level by the UN General Assembly in 2014, the FPOS have so far stood the test of time. Despite being reviewed by the Commission in two occasions, the Fundamental Principles were judged still relevant and in no need for a revision. The FPOS still serve as a strong foundation for official statistics production worldwide as they emphasise the need for impartiality, accountability, and quality, ensuring that statistical systems operate transparently and produce data that serves the public interest. In this regard, the Fundamental Principles have close connections with several of the key dimensions of data equity highlighted by the WEF documents, even if they are not concerned with data equity per sé. The WEF framework expands on the FPOS by focusing explicitly on equitable outcomes, inclusivity, and ethical governance.
It is thus possible to identify key gaps in the FPOS in terms of:
In summary, the data equity framework promoted by the WEF goes beyond the UN Fundamental Principles by emphasizing actions that promote fairness, representation, and inclusion in data collection, data use and data governance. A possibility would be to address these limitations of the UN FPOS by making them more responsive to the specific needs of underrepresented or marginalized communities and by embedding equity more explicitly into the structure of official statistics. An alternative approach could involve establishing a new set of international principles specifically designed to govern the broader data ecosystem. These principles would go beyond the scope of traditional official statistics to address the unique challenges presented by today's diverse and interconnected data landscape.
Recent UN initiatives combining the two perspectives
As we have seen, data equity is essential for creating a fair and inclusive society where data is used to benefit all individuals. The World Economic Forum's work has helped highlight data equity issues in a comprehensive way, advocating for data-sharing frameworks that promote public good. These documents broaden the UN Fundamental Principles of Official Statistics, which offer a set of values that can guide the professional production of equitable official statistics. While economists focus on preventing inequalities and monopolistic practices in data markets, statisticians stress the importance of producing data that are representative of all population groups and can guide policy decisions equitably. By combining these perspectives, a holistic approach to data equity can emerge, ensuring that data governance frameworks both uphold the integrity of public data and promote economic fairness.
Recently the UN has undertaken a couple of initiatives that can help combine the statisticians’ and economists’ perspectives on data equity. An important example in this direction is the paper titled “International Data Governance – Pathways to Progress” 2 , which was endorsed at the 45th session of the UN High-Level Committee on Programmes (HLCP) in 2023 and subsequently by the UN System Chief Executives Board for Coordination (CEB). This document articulates a vision and outlines steps for promoting and safeguarding data through a multistakeholder approach to international data governance, aimed at responsibly harnessing the full potential of data for the benefit of global public goods. More recently, this month, the CEB has also endorsed the document titled “Proposed Normative Foundations for International Data Governance: Goals and Principles" 3 , which suggests a set of common goals and principles that could form the normative basis for international data governance. Central to the document are three overarching goals: value, trust, and equity. In particular, data equity is promoted by empowering individuals and communities exercise control over their personal data and ensuring that the benefits of data access are distributed fairly, particularly to vulnerable and marginalized groups.
The other initiative was undertaken at the Summit of the Future last September, where the United Nations members adopted a Global Digital Compact 4 which aims to enable all countries to benefit from the digital transition. The Global Digital Compact sets out the objectives, principles, commitments, and actions to develop an open, free, and secure digital future for all, underlying the benefits that the digital technologies bring to humanity. In a landscape where private data sources are predominant, governments need to establish partnerships with private companies to obtain data that meets these standards and expands coverage, especially in areas where public sector data is limited. Among the initiatives related to AI, an independent International Scientific Panel on AI has been established, and a Global Dialogue on AI Governance has been initiated involving governments and all relevant stakeholders.
These initiatives provide a novel contribution to the body of recent discussions on data equity and international data governance, triggered by the rapid evolution of the digital ecosystem and the proliferation of private sector data.
The content of this issue
Understanding the informal economy and informal employment – the statistical challenge
In this Special Issue of the Statistics Journal of the IAOS, the focus is on the measurement of informal employment, that is, the methodological standards as well as the best practices used at international level for identifying the forms of employment where workers lack formal contractual and social protections. In their Guest Editorial, Kieran Walsh and Michael Frosch provide an introduction to this rich section, which comprises eleven articles covering different aspects of informality.
The section is opened by “
The second paper,
In “
The fourth paper of this section is
In “
The sixth paper of this section is
The seventh paper of this section is
In “
The ninth paper of this section is
The tenth paper of this section is
The last paper of this section is
The 2024 IAOS prize for young statisticians
The second section of the Journal publishes the winning papers of the Young Statistician Prize (YSP) of the International Association for Official Statistics (IAOS) for the year 2024. The YSP has been running since 2011, attracting submissions from across the world of statisticians who are less than 35 years old as of February of that year. With this prize, the IAOS seeks to actively encourage young statisticians to become members of the Association, promoting their involvement in the implementation of its activities. Today's young statisticians are tomorrow's leaders, and they inspire us, “older” statisticians, to think about the current and new frontiers in official statistics, promoting dynamic and innovative professional cooperation. In this section of the journal, the prize-winning manuscripts of the 2024 IAOS Young Statisticians Prize are celebrated by our colleague Gary Dunnet, who is the coordinator of this competition and has drafted this section of the editorial.
The Prize, along with the possibility to present the paper at an ISI/IIAOS conference, cash, and other associated opportunities, are very important not only for the prize winners but also for all participants. The judging of the prize is undertaken by a panel of eminent statisticians, and the SJIAOS articles are peer-reviewed, and the journal itself is well regarded and well-read across the Official Statistics community—all of this is good for one's resume or career progression opportunities. In addition, many National Statistical Offices of the submitted papers support young statisticians entering the Prize as a recognition of the remarkable methodological and analytical work performed by young statisticians in their organization. Even if you enter and are unsuccessful, you often reap some of the benefits highlighted above.
This year, 23 manuscripts from 21 countries were submitted, which is a signal of a healthy competition. The subject matter and statistical content of the submissions were generally of high quality; therefore, all authors should be proud of their work, whether they won or not. However, as they say, “there can only be one winner”, and this year the winning papers were the following:
The 1st place 2024 YSP winning paper is “
The 2nd place winning paper is “
The 3rd place winning paper is “
Lastly, a special commendation was awarded to “
All readers are encouraged to not only peruse the papers but also urge any young statisticians you know to consider entering the 2025 edition of the YSP competition; full details can be found at: https://iaos-isi.org/ysp.
Innovative statistical methods
This section of the Journal comprises five papers that show the richness and variety of the methodological research conducted in statistical and academic institutions. The focus of the papers ranges from testing survival models for analysing infant and child mortality, to introducing a dynamic microsimulation model for official population projections; from analysing the profile of immigrant groups using a symbolic data analysis approach, to using tourism satellite accounts to measure the direct and indirect evolution of tourism employment, to applying interregional input-output tables as an effective analytical tool to understand the regional interconnectivity of the food and beverage industry. These diverse papers offer valuable insights that can significantly contribute to the field of official statistics.
The first paper of this section is “
The second paper of this section is “
The third paper of this section is “
In “
The last paper of this section is “
