Abstract
The notion of Entrepreneurial Orientation (EO) is operationalized here to explore the influence of press freedom (PF) on the performance of news media firms. We find that growth in reader revenues (RR)—digital and print—is statistically significantly correlated to both EO and PF, suggesting that subscriptions to independently produced news are likely to be better in countries with high degrees of PF, and in instances where the firm’s leaders are entrepreneurial.
It is no secret that the sustainability of the independent press is of wide concern as firms worldwide face threats to their finances and their freedoms.
The double-sided business model on which the industry has long depended has not translated well into the digital realm (Nel, 2010). On the one side, many publishers have been able to grow audiences, but on the other, they have not necessarily been able to grow revenue—as competition for advertising income by local and global actors both within and beyond the news sector has intensified. This has spurred a pivot to reader revenues (RR) and a rise in what the latest World Press Trends report from WAN-IFRA, the World Association of Newspapers, describes at the “the subscription economy” (Nel & Milburn-Curtis, 2019, p. 7). At the same time, press freedom (PF) advocates, such as Freedom House and Reporters Without Borders, have sounded alarms about declines in PF worldwide from America to Zimbabwe. In parallel, the distinct but related phenomena of innovation and entrepreneurship have moved center-stage in the news media industry (Khajeheian, 2017). In academic circles too, it is argued that “journalism is enjoying its entrepreneurial moment” (Cohen, 2015, p. 515).
Perhaps it is not surprising that entrepreneurship has been of increased interest to media scholars and others concerned about the future of independent news and the sustainability of the organizations that produce it (Achtenhagen, 2008; Hoag, 2008; Khajeheian, 2017). After all, entrepreneurship is widely accepted as a critical part of economic development and growth and considered important for the continued dynamism of the modern economy (Oksana et al., 2015; World Bank, 2002). However, that has not always been top of mind in our sector. In fact, as Compaine and Hoag (2012) argued, “entrepreneurship of any sort is not a concept that has been closely identified with the media industry” (p. 30). Yet, scholars such as Hoag (2008) and Vos and Singer (2016) maintained that the industry has been more entrepreneurial in recent times than other manufacturing enterprises in the United States and other Western democracies. Even so, in the decade after Achtenhagen (2008) observed that “the area of media entrepreneurship is still a young and undeveloped field, this phenomenon is poorly understood” (p. 124), it had been noted that “no significant progress can be seen” (Khajeheian, 2017, p. 92). As a result, “the field is not clear enough yet, and there is no consensus among the experts of the field” (Khajeheian, 2017, p. 92). That summary is perhaps unduly harsh given contributions by, for example, Hang (2016) and Hass (2011; alongside those by Khajeheian himself), but it is clear that the lack of consensus on the character of media entrepreneurship can still impede research and has made it especially difficult to investigate the relationship between media entrepreneurship and performance.
Nonetheless, progress is being made. More recently, Hang (2020) reported on comprehensive bibliometric analysis of media and entrepreneurship and concluded that the period since 2017 has been a boon for studies in this area as scholars have embraced the challenge to fill in the gaps of both theory and empirical data. For example, Horst and Murschetz (2019) theorized the intersection of entrepreneurship and strategy to offer a foundation for studies into the process of the strategic media entrepreneurship pathway that aims at organizational success. Organizational success and entrepreneurialism in news media firms is further scrutinized by Nel et al. (2020) in their analysis of data drawn from 107 countries. Their findings show that, in times of significant volatility, entrepreneurial news media firms that prioritize the exploration of new opportunities are significantly more likely to reap financial rewards than their counterparts that focus most of their energies on exploiting existing markets; however, they worry about the limitations on such entrepreneurialism wrought by the political-economic contexts in which news media firms operate. The relevance of such concerns is underlined by scholars like Girija (2020), who identifies that digital news media entrepreneurship in India is constrained by government and corporate controls.
Thus, a number of questions remain, including “What are the linkages among entrepreneurialism, organizational performance and political-economic constraints?” This study addresses that issue by specifically considering two matters of wide concern inside and outside industry circles—the financial sustainability of independent news media firms and the declines in PF—in combination with a perspective that Achtenhagen (2020) recently noted is mostly absent from our field: the concept of Entrepreneurial Orientation (EO).
Review of Key Concepts
EO as Indicator of Organizational Innovativeness
Although widely explored in the general business literature more than two decades since it was conceptualized, the notion of EO has not often surfaced in media management scholarship (Achtenhagen, 2020). Pioneered by Lumpkin and Dess (1996), EO is characterized by a readiness to innovate and take risks, a bent to be aggressive toward competitors and a proactiveness relative to marketplace opportunities (p. 137). Such factors may be present when a firm engages opportunistically. However, organizations may also successfully exploit opportunities when only some of these aspects are at work. That is, the degree to which each of these elements is useful in predicting the nature and success of an entrepreneurial endeavor may be subject to external dynamics like the business environment (Lumpkin & Dess, 1996) and the nature of the industry, or by internal actors, such as the organizational culture (in the case of an existing firm) or the characteristics of the founders (in the case of startups). Thus, EO has the potential to lead to improved firm performance (Wiklund & Shepherd, 2005). Miller (2011) has argued that “the components of EO are more telling than the aggregate index” (p. 880). While encouraging more research to examine the effects of single EO dimensions on the overall EO, Miller (2011) observed that “in some research contexts, the best of both worlds may entail analyses that present results for the EO construct and for each of its components” (p. 880). The concern of this study is not whether either perspective is more correct than the other since, as Covin and Miller (2014) noted, both are legitimate.
Entrepreneurialism in the media has been investigated at many different levels, for example, individuals (Compaine & Hoag, 2012), teams (Page West, 2007), organizations (Usher, 2017), and even ecosystems (Powers & Vera-Zambrano, 2017). We here take it that the essential opportunistic act of entrepreneurship primarily occurs at the level of the organization or firm, which, Lumpkin and Dess (1996) pointed out, is considered as a “non-diversified economic unit” (p. 139). Thus, entrepreneurship may be initiated by an individual, a small firm or the strategic unit of a large conglomerate. As such, this study of EO will focus on the firm/business-unit level. This firm-level approach is consonant with classical economics that regards the individual entrepreneur as a firm, whether or not they have followed legal protocols (Lumpkin & Dess, 1996).
RR as an Indicator of Organizational Performance
We recognize that for media firms, among others, value is not only considered in economic terms (Picard, 2010). We are convinced by an argument of Rao and Weintraub (2013), who posit that the value of successful innovations can be captured at three levels: external, enterprise and personal. We are also alert to the case Bøe-Lillegraven (2014) made for the potential that Big Data offers to assess the performance of news organizations by offering insights into, among others, the productivity of individual staff members and specific pieces of content alongside traditional financial measures.
However, in this article, we focus our attention on an indicator of performance that is of particular contemporary interest: subscription revenues. That is because subscriptions indicate both editorial value and economic value as the offers meet readers’ quality expectations enough for them to take money out of their pockets to pay for it. Furthermore, it could be argued that subscription growth might also imply EO because to exploit marketplace opportunities by cultivating, in particular, digital subscriptions (or “paywalls”) publishers need to innovate and take risks.
These insights helped shape the Reader Revenues (RR) variable employed in this study, which is a combination of changes both in print subscriptions and in digital subscriptions.
PF as Indicator of Market Environment
Like all other organizations, news media firms exist in relation to other actors and within frameworks of institutions, and so on (Mintzberg, 1979). The conditions under which they operate are formed by the environment within which they exist, and their navigation of this environment determines how they engage in relation to other actors. It is important to remember that news media companies are “not just any other business” (McQuail, 2010, p. 190) because ideally they also serve social and democratic ends, rather than only commercial ones. Indeed, as pointed out in the World Press Trends report (Nel & Milburn-Curtis, 2019) and elsewhere (Milburn-Curtis & Nel, 2019), it is becoming increasingly clear that PF is inextricably linked with a range of political, economic and social factors that themselves underpin the sustainability of the media.
Important contexts for news media firms are the media systems and political structures in which they are embedded. Media systems are “typical patterns of how journalism culture, media policy, media markets, and media use are connected in a given society” (Brüggemann et al., 2014, p. 1038). Broadening this perspective, Cohen (2015) noted that,
the vision of the journalist as entrepreneur takes up contemporary society’s entrenched fixation on the entrepreneur as a remedy for broader political, economic, and social problems and signals a shift for an industry and practice that until recent decades had been dominated by large, somewhat stable media corporations with large, if volatile, ranks of employees. (p. 514)
To this end, one might add that the social and historic characteristics of the environment that the news media exist within play a role in forming how they operate. Scholars have, for example, traced the extensive Scandinavian frameworks for media subsidies back to the Social-Democratic welfare state that these societies epitomize (Kammer, 2016; Syvertsen et al., 2014), and studies of political communication illustrate how systemic differences reflect upon journalistic production (Humprecht & Esser, 2018). More recently, calls for increased state subsidies have grown stronger on the back of concerns about disruptive forces challenging the press worldwide (Murschetz, 2020; V. Picard, 2020). Their discussions also underline the importance of press ownership. In our study, we focus on independent press, by which we mean commercial and nonprofit news media firms that are neither directly nor indirectly owned and controlled government or politicians.
What else might be true, this much we do know: Without PF, there is little space for either the independent, critical journalism or the negotiation of public opinion that constitutes foundational pillars in liberal democracies (Schudson, 2008). Tellingly, a free press is widely considered a necessary condition not only for well-functioning democracies but also for well-functioning economies. Indeed, in the foreword to a seminal collection of studies by the Nobel Prize–winning economist Joseph Stiglitz and others published by the World Bank (2002), the head of the World Bank’s Poverty Reduction and Economic Management Unit Roumeen Islam notes, “a free press is not a luxury. It is a core of equitable development” (p. v).
It is suggested that a free press, protected by the rule of law, supports a robust, competitive and effective media (South China Morning Post [SCMP], 2019). While “economic freedom and press freedom are closely intertwined” (Kim & Tyrell, 2018, p. 1), debate continues regarding the direction of causality between the two, and the basic assumption has not been extensively tested empirically. We therefore focus our lens on an exploration of the relationship between PF, EO and the RR of media organizations.
In doing so, we recognize the complex relationship between media freedom and overall economic performance, as vividly illustrated by the cases of the United States and China, which are the world’s largest and second-largest economies, respectively (World Bank, 2019), while being ranked 45th and 176th of 180 on the 2019 Press Freedom Index (https://rsf.org/en/ranking). In addition, China has since 1946 been a member of United Nations Educational, Scientific and Cultural Organization (UNESCO), which sees cultivating media pluralism and independence as an extension of its core mandate “to foster ‘the unrestricted pursuit of objective truth,’ ‘the free exchange of ideas and knowledge’ and ‘the free flow of ideas by word and image,’ as prescribed by UNESCO’s Constitution” (Mendel, 2008, p. 1). A founding member, the United States, in its turn, withdrew from UNESCO on January 1, 2019.
Research Questions
On the basis of these theoretical positions and empirical findings, we explore whether the performance of independent news media firms—in particular with reference to their RR performance and indeed EO itself—is related to PF.
Specifically, we ask, “to what extent is PF related to the financial performance of news media firms and their EO?” by exploring the following subquestions:
Materials and Methods
The study used data collected from 246 respondents in 69 countries (for the methodology, see https://freedomhouse.org/report/freedom-press-2017-methodology). These comprised 64% from “developed” countries; 36% from “developing” countries; Europe: 50%; Americas: 21%; East & South Asia: 14%; Middle East & Africa: 15%. Data were collected via a 2016 survey, in association with the World Association of Newspapers and News Publishers (WAN-IFRA). Data were taken from 1 year of an ongoing annual global survey of senior news media executives. These were top managers (43%), editorial managers (30%), commercial and technology managers (23%), as well as academics and researchers (4%). Participating organizations were privately owned (32%), public service (46%), not-for-profit (4%) and cooperatives (6%). Government-owned organizations (12%) were excluded from this analysis, as our approach involved exploring only independent press organizations. Therefore, the final sample consisted of 214 participants from 62 countries (see the appendix).
The 22-question online survey collected data about country, language, world region, national income, area of work, size of organization, circulation, revenues and profitability, ownership, geographic focus, publishing and nonmedia activity, and 12-month and 5-year investment priorities. Organizational behavior was captured with Likert-type scale items that explored entrepreneurial and innovation orientation, attitudes to change, organizational values, behaviors, management climate, investment in people, processes and perceived success. Participants were asked to respond on a scale of 1 (total disagreement) to 7 (total agreement), to statements such as those detailed in Table 1.
Dimensions of Entrepreneurial Orientation and Survey Questions
Note. R&D = research & development.
These online questionnaires were offered in Arabic, Chinese, English, Finnish, French, German, Italian, Japanese, Persian, Portuguese, Russian, and Spanish, and participants could choose which language to use. Confidentiality was assured to participants in the consent document, and personal details, if they were supplied, were separated from the survey results before analysis. Email addresses, if supplied, were kept separately and used if participants requested information about study outcomes.
Using a purposive sampling strategy, our sampling frame included as much of the available population of managers of news media organizations, in national, regional and local media. This strategy is appropriate where the population has a particular set of characteristics that are not very common, and where the population is relatively small (Black Thomas, 2012). To address the limitations of this strategy, we aimed to make only analytical generalizations, rather than statistical ones. Thus, findings are related to the research questions derived through theory, and care has been taken not to generalize to a larger population.
It was not our intention to attribute causal conclusions. However, we were nevertheless able to address issues around our principal research problem, which was to explore the strength of relationships between indicators of PF, financial performance and EO.
Measures
We focused on two key variables from our annual survey data (EO and RR) and one constructed from other global indices (PF).
EO
EO, is a normally distributed continuous variable, created from an aggregate of six items. It measures attitudes to risk, proactiveness and competitive aggression (Lumpkin & Dess, 1996) and is measured by asking for responses on an agreement scale of 1 to 7, as detailed in Table 1. The scale was subject to confirmatory factor analysis, using maximum likelihood estimation. This confirmed the a priori structure of the scale, with a unidimensional factor that explained 63% of the variance. All factor loadings were significant and greater than .42. The Kaiser–Meyer–Olkin measure of sampling adequacy (Kaiser, 1974) indicated that, at 0.821, the sample size was appropriate for factor analysis, and the Cronbach’s alpha, a measure of reliability (Cronbach, 1951) was .82.
RR
RR is a normally distributed continuous variable, measuring change in subscriptions revenues over the 12 months preceding the study year. Participants were asked to report on the extent to which, over the previous year, their print and website revenues had increased or decreased. We combine print and digital RR since news publishers worldwide (e.g., New York Times, US, and The Times, UK) offer bundled subscriptions and because news publisher associations (e.g., Newsworks UK) have strongly argued for reporting a single RR metric across all formats, print and digital (DeGroose, 2019). The two manifest 7-point scales were thus aggregated into one variable, the descriptives for which can be found in Table 2.
Descriptives
PF
We considered two normally distributed continuous measures of PF: Freedom House (again see https://freedomhouse.org/report/freedom-press-2017-methodology) and Reporters Without Borders (2019; for methodology, see https://rsf.org/en/detailed-methodology). Freedom House publishes yearly reports on freedom of the press that give each of 199 countries and territories a score from 0 to 100. The level of PF is evaluated through 23 questions divided into categories covering the legal environment, the political environment, and the economic environment. Reporters Without Borders determines the degree of freedom available to journalists by using the responses of experts to a questionnaire. RSF Press Freedom Index is a publicly available data set, which presents PF scores for 180 countries. The index is made up of two elements. The first details the results of a survey which explores “pluralism, media independence, media environment and self-censorship, legislative framework, transparency, and the quality of the infrastructure that supports the production of news and information.” The second publishes quantitative data on abuses and acts of violence against journalists during the period evaluated.
As, at the time of this study, there was a high correlation between the two PF indices (>.9), we took the mean of the two as our PF variable. The resulting variable was normally distributed: Skewness = .913; Kurtosis = .086.
Results
We express correlations in terms of Pearson’s r correlation coefficient, with a significance cut-off of p < .05, that is, there is less than a 5% probability that our results could have been achieved by chance. All variables of interest conformed to the assumptions required for correlational analysis (continuous data; normal distribution; no significant outliers; linear relationships).
Correlational analysis revealed significant relationships across all three of our variables of interest (see Table 3).
Correlational Analysis of Variables of Interest
Note. EO: entrepreneurial orientation; PF: press freedom; RR: reader revenues.
Finding for
Finding for
Finding for
Summary of Findings
The study finds that financial performance of independent news media organizations (in terms of RR) is statistically and significantly correlated with two factors, namely, (a) PF and (b) the EO of the firm, with all reported results having at least a 95% probability of not having been achieved by chance. That suggests that, in our sample, news publishers exhibit better overall performances in countries with high degrees of PF and in instances where the firm’s culture is oriented toward being entrepreneurial.
Discussion
Worldwide, news operations have been redesigned, revamped, reorganized, converged (Siapera & Vergelis, 2012) and de-converged (Tameling & Broersma, 2013). Websites have been launched and relaunched. A wide array of mobile and tablet apps offer consumers news that might be variously aggregated, expanded, editioned, condensed, interactive, pushed, augmented or experienced in three dimension (3D). And although many companies have been able to grow audiences, they have often struggled to grow revenues. The once-Golden Rule of multisided markets that “money follows eyeballs” rarely materialized (Nel et al., 2017). As such, the future of quality journalism and the news media organizations that principally supply it continues to worry industry insiders, consumers, policy makers and academics worldwide (Wahl-Jorgensen et al., 2016). Thus it is not surprising that there has been heightened interest in the one thing that has widely been recognized to spur technological progress, business expansion and wealth creation for both start-up ventures and existing firms: entrepreneurship (Ahmad & Hoffman, 2007).
Of late, the focus of news media entrepreneurialism has increasingly shifted toward generating RR, principally through subscriptions to print and digital products. In doing so, news publishers worldwide have recognized that they have broadly lost their once-firm grip on the flow of advertising and, often reluctantly, have embraced the logic Rupert Murdoch first articulated in 2009 when he said, “There’s not enough ad revenue in the world to make all the websites profitable. We’d rather have fewer people coming to our websites but paying” (Speers, 2009). Labeled as “paywalls,” subscription models have not worked out for all who tried, but there have been successes in all markets, at a range of levels of PF. Zimbabwe, for example, with a population of around 14 million ranks among the world’s poorest nations with Gross National Income (GNI) of just US$1,790 per capita in 2018, while it was ranked 126th among the 180 nations and regions monitored by Reports Without Borders. Even so, that year Zimbabwe’s Daily News and Financial Gazette put up a hard paywall on all online news platforms, including mobile sites, and saw digital subscribers’ numbers climbing to nearly 80,000, according to publisher Jethro Goko (Nel & Milburn-Curtis, 2019). This is a remarkably strong performance when compared with the 27,000 digital subscribers of the New York Daily News and the 72,000 digital subscribers of The Dallas Morning News in the United States, whose population of 327 million in 2018 had a GNI per capita of US$63,200 while it ranked 45th on RWB’s Press Freedom Index (Nel & Milburn-Curtis, 2019).
This change in online revenue strategy has brought about a focus on user quality expectations, which should be welcomed by those who are worried about the rise of “click-bait as a strategy that seeks to lure users into clicking on a link to a page through tactics such as sensationalist stories and eye-catching headlines that work as bait” (Bazaco et al., 2019, p. 1). However, the shift toward quality expectations of users is not only evident in editorial activities as the emphasis turns from attention-seeking approaches, which drive the traffic volumes that are the key metric for advertising-based strategies, to engagement-seeking endeavors, which are essential for the retention of subscribers (Newman et al., 2020). The changes in activities and performance metrics necessitate a profound paradigm shift from a product-oriented mind-set, to a services mind-set (Nel & Milburn, 2017), that is, a shift from an emphasis on information products (stories), to an emphasis on information engagement and utility (service).
Whatever else, this turn has highlighted the need to reexamine some assumptions about a variety of interrelated issues to build our understanding about how news media firms’ successes or failures are related to external market forces—and to internal choices made by their leaders.
Here, we have underlined the relationship between EO and a measure of organizational performance. This study finds that growth in RR of independent news publishers in our sample has more to do with the EO of their organizations than with the general differences and dynamics found in both advanced and developing economies. This suggests that entrepreneurially oriented leaders have significant agency in the success of their firms and can make the choices that help their companies flourish whatever the typical market conditions. However, we also find that restrictions in PF are likely to negatively correlate with the RR performance of these news media firms. Thus, these findings are likely to bolster the cause of those working to ensure independent, pluralistic press systems that have enabling legislative framework and quality infrastructures, and environments where journalists are able to access and use information with high degrees of autonomy free from abuses, acts of violence and official constraints.
Summary, Limitations and Directions for Future Research
This study tests some basic assumptions about the extent to which the performance of news media firms are related to, on one hand, the firm’s EO and, on the other hand, to the wider media environment. In doing so, it has contributed analytically, theoretically, and empirically to the study of media management and economics, by
(a) determining that there was a statistically significant relationship between financial performance of firms in our study and its EO.
(b) identifying that country-level PF and organizational-level EO were significantly correlated.
(c) identifying that country-level PF and organizational-level RR were significantly correlated.
Limitations
While the results are based on a large sample, it should be noted that these findings are limited to a self-selected sample of media managers and their self-reported measures, and are not necessarily generalizable to a wider population. Research questions have been addressed through the objective analysis of quantitative data, and care has been taken not to generalize to a larger population (including those potential participants, who for one reason or another chose not to participate). As participants were self-selected, they therefore potentially possessed characteristics that we were not able to measure (for instance, the most stressed managers may not have had time to complete the survey). Furthermore, the contact method (email) may have resultant limitations for participation.
Implications for the Industry
These findings raise questions that further underline the concerns of those who see PFs under threat from the anti-press rhetoric of world leaders like President Donald Trump, during whose presidency the United States has dropped to 48th in the latest RWB Press Freedom Index (RSF, 2019). Trump’s antagonism to the press is argued to echo beyond the U.S. borders, giving rise to what is popularly referred to as the “Trump Effect” (Frank, 2018). Thus, the decline in PF in the world’s largest economy would necessarily concern all those who care that press are free to succeed editorially and economically. This study identifies that the greater an organization’s EO, in terms of their innovativeness, approaches to risk, proactiveness, competitive aggression and autonomy, the greater the RR. The significant relationship between PF in the country and the financial performance of the firm suggests that the freedom of the press should be of concern to editorial and commercial leaders alike.
Directions for Future Research
This study contributes to the theoretical understanding of how systems of governance (including PF) represent fertile or hostile environments for media performance and it broadens the scope of comparative research to a worldwide setting, beyond the Western-centric perspective that is usually prevalent (see, for example, Hallin & Mancini, 2012). Furthermore, the limitations stated above are guiding us toward potential new openings. For the research on hand, we limited ourselves to looking at the connections between PF, EO and company’s RR performance in the sample. However, there are questions that arise from the data, including those concerning different subgroups in the study. For example, are there other geographical differences, or differences between media manager generations?
Furthermore, we are mindful that, as Lumpkin and Dess (1996) pointed out “in investigating the EO–performance relationship, it is essential to recognize the multidimensional nature of the performance construct” (p. 153; see also Chakravarthy, 1986). As such, there is an opportunity to investigate the EO–performance relationship with reference not only to other aspects of financial performance, such as growth and market share, but also broader external dimensions, such as journalistic reputation and social impact, and internal dimensions, such as satisfaction and commitment of staff (cf. Nel et al., 2020).
Certainly, this is an issue that warrants further attention in future research that, like this study, responds to R. G. Picard and Lowe’s (2016) appeal for ambitious media management scholarship that does “not simply describe cases, highlight issues and challenges and documents perspectives and behaviors,” but tests, expands and develops theory directly pertinent to media management sciences—and which will potentially be relevant to other fields too (p. 63).
Footnotes
Appendix
Geographical distribution of participants: Afghanistan; Algeria; Argentina; Australia; Austria; Belgium; Bolivia; Brazil; Bulgaria; Canada; China; Colombia; Costa Rica; Czech Republic; Denmark; Ecuador; Egypt; El Salvador; Finland; France; Germany; Ghana; Greece; India; Indonesia; Iran; Ireland; Israel; Italy; Japan; Kenya; Latvia; Liberia; Luxembourg; Macau; Malaysia; Malta; Mexico; Namibia; Netherlands; Nigeria; North Macedonia; Norway; Pakistan; Philippines; Poland; Portugal; Romania; Russia; Singapore; South Africa; Spain; Sri Lanka; Sweden; Switzerland; Turkey; Uganda; Ukraine; United Arab Emirates; United Kingdom; United States and Zimbabwe.
Acknowledgements
This study draws on primary data from an annual study by François Nel and Coral Milburn-Curtis that underpins the World News Publishers Outlook report and for WAN-IFRA, the World Association of Newspapers and News Publishers, without whose support a global study of senior news media decision makers would be very difficult to do.
