Abstract
The present study uses a focused approach to compare self-reported versus administratively recorded measures of absences related to health or illness. To date, the few studies that focus on this topic produced mixed results. To help shed light on this issue, the present research has 2 related objectives: (1) examine how highly correlated self-reported and administratively recorded measures of absences related to health or illness might be, and (2) how each measure predicts various aspects of health. Using data from the 2012 StayWell® Health Management health risk appraisal (HRA) and 1 year (2011) of administratively recorded timekeeping data, bivariate analyses for continuous variables and generalized linear modeling for variables with greater than 2 response categories were used. For the multivariate analyses, linear regression models controlling for sex, age, race, income, job status, and campus location were calculated for the continuous outcomes (ie, self-rated health and chronic conditions). Results indicate that self-reported and administratively recorded absences related to health or illness were moderately correlated (correlation coefficient of 0.47). In addition, each measure functioned similarly (in direction and magnitude) to predict health outcomes. Both greater self-reported and recorded illness-related absenteeism was associated with poorer self-rated health and greater numbers of chronic conditions. These results suggest that self-rated illness-related absenteeism may be a reasonable way to assess various program outcomes meaningful to employers, particularly if administratively recorded measures are unavailable or too time consuming or expensive to analyze. (Population Health Management 2014;17:211–217)
Background
A
Because of the availability and relative ease of use compared to administratively recorded absenteeism data, self-reported data on illness-related absenteeism is commonly used to assess the association of absenteeism with health risks, health care costs, and health conditions. 7 Even though self-reported measures are of value to employers, little work has assessed the agreement between administratively recorded and self-reported absenteeism (with some exceptions 7,8,9 ). This is a problem in workplace settings where important programs are evaluated based on the assumption that the agreement between self-reported and administrative records of illness-related absenteeism is moderate to high.
The little work that has focused on the agreement between self-reported versus administratively recorded measures of illness-related absenteeism has produced mixed results. In a study that assessed 312 almost entirely male (99%) cargo employees from a Dutch airline, Poppel et al found that self-reported and administratively recorded measures of illness-related absenteeism have a low level of agreement. 8 Others found that employees tend to underestimate their self-reported illness-related absent days compared to those administratively recorded measures. 10 In contrast, some research finds that self-reported and administratively recorded measures of illness-related absenteeism have a strong level of agreement. 11,12 More work is needed to better understand the association between these 2 measures.
When assessing the association between measures, an important component is determining how similarly each measure functions with regard to predicting relevant outcomes. One recent study by Eriksson et al examines the association of self-reported illness-related absenteeism with self-rated health and symptomatology from over 43,000 residents in 5 counties in central Sweden. They found that self-reported illness-related absenteeism was associated with poorer self-rated health and a greater number of symptoms. 13 Other work found similar results. 14,15 One limitation of the Ericksson et al study was the use of a self-reported measure of illness-related absenteeism rather than a recorded assessment. The present study seeks to address this limitation by reviewing how each measure (both self-reported and administratively recorded measures of absences related to health or illness) predicts self-rated health and a count of chronic conditions. Assessing how each measure functions with regard to health outcomes is important to develop a better understanding of how accurate these 2 measures are in assessing the same construct (ie, illness-related absenteeism).
The present study uses a focused approach to compare the agreement between self-reported versus administratively recorded measures of absences related to health or illness. To date, there are few studies that focus on this topic. To help shed light on this issue, the present research has 2 related objectives: (1) examine how highly correlated self-reported and administratively recorded measures of absences related to health or illness might be, and (2) how each measure predicts various aspects of health. It is hypothesized that (1) self-reported and administratively recorded measures will be moderately to highly correlated, and (2) they will predict health outcomes similarly (in direction and magnitude), with more days absent being associated with poorer self-rated health and greater numbers of chronic conditions.
Methods
Data
Data were collected annually using the StayWell® Health Management health risk appraisal (HRA). Voluntary completion of the HRA was part of an employee incentive program used to promote health and well-being at a large midwestern university. Since 2009 the university had a $100 per year pretax incentive for its wellness program. The criteria for receiving the incentive changed somewhat throughout the years. Participants received a $100 per year pretax incentive for: completing an HRA and a wellness screening (2009), completing an HRA and 2 eligible wellness activities (2010), completing an HRA and 1 wellness activity (2011), completing an HRA and a wellness screening (2012), and completing an HRA and 1 wellness activity (2013).
The incentive program is administered by the university's employee health management program, a comprehensive population health strategy that provides high-quality services and fosters a culture of health at the university. This employee health management program has an integrated organizational structure, including wellness and risk-reduction services, employee assistance programs, occupational health services, and more and serves the university's approximately 40,000 employees. This incentive program began in 2009 and has continued each following year.
Employees' HRAs and their administratively measured absence data are individually linked and sent on separate files to a third-party vendor for de-identification. Thus, the user of these data cannot identify specific employees—only that they are unique individuals. It is important to note that the author was granted Institutional Review Board approval for this study.
Analytic sample
The HRA response rate was 48% for 2009, 42% for 2010, 55% for 2011, 54% for 2012, and 56% for 2013. In 2012 there were 20,506 benefits eligible (and who did not waive their health insurance coverage) HRA participants. There are 2 timekeeping processes at the university (ie, paid time off, sick and vacation time). Of those 20,506 benefits eligible participants, 11,766 HRA participants were excluded from these analyses because their timekeeping process did not allow one to distinguish between sick and vacation time (paid time off ). This study focused on respondents who had a continuous 12 months of administratively recorded nonzero hours of sick time in 2011, completed the HRA in 2012, and had complete data on the independent variables. This reduced analytic sample to 5746 participants. When comparing race, age, and sex, the demographic characteristics of this analytic sample compared to the overall university population 16 are quite similar. Across those 3 variables, the percentage point difference between the overall university and the analytic sample ranges from 0–4 percentage points.
The university also offers 2 robust long-term disability (LTD) plans. University employees who qualify for benefits under one of the LTD plans receive salary replacement and fringe benefits continuation. In order to qualify for benefits under either LTD plan, an employee must have an impairment that renders them completely unable to engage in any occupation or employment for which they are reasonably suited by education, training, or experience. The impairment must be expected to result in death or to have lasted, or be expected to last, for a continuous period of not less than 12 months from their last day of work. In 2013, approximately 2% of university employees were receiving LTD benefits. Given this, there were essentially 2 main reasons for excluding employees on LTD from these analyses: (1) there is a very small sample of employees who qualify for LTD, and (2) their nonwork status likely would skew absenteeism results.
Measures
Administratively recorded absence
The university offers employees a generous sick time benefit. Annually, on an employee's hire date, campus employees receive 15 days per year of sick time (exception time varies by union contract). Sick time days cannot be rolled over. As a result, length of employment should have little effect on these analyses.
One year (2011) of administratively recorded timekeeping data was used for these analyses. The codes that were used to create this measure were: (1) taking sick time without pay, (2) preventive sick appointment (eg, follow-up appointment or physical exam), (3) taking sick time from vacation time, and (4) sick time related to an illness or injury. Also, one particular group of employees has a different set of timekeeping processes that do not allow one to distinguish between vacation and sick time. For this reason, their timekeeping data also were excluded from these analyses.
Self-reported absence
Self-reported illness-related absenteeism was measured with a question contained on the 2012 StayWell® HRA: How many days did you miss from your job because of illness or injury in the last 12 months? If you don't work outside the home, how many days were you unable to do your usual activities in the last 12 months? Responses (coding in parentheses) were: None (=0), 1 day (=1), 2 days (=2), 3 days (=3), 4 days (=4), 5 days (=5), 6 days (=6), 7 days (=7), 8 days (=8), 9 days (=9), 10 days (=10), 11–15 days (=13), 16–20 days (=18), 21–30 days (=25.5), and 31 or more days (=31). This was treated as a continuous measure of self-reported absence.
Self-rated health
Self-rated health was assessed by asking participants to rate their health in the past 4 weeks on a 6-point scale (excellent=0 to very poor=5). Higher numbers represent poorer health. 17,18,19 Self-rated health also is associated with other objective measures of health status including mortality. 20
Self-reported chronic conditions
Chronic health conditions were measured from the HRA by obtaining a count of self-reported chronic conditions. Nineteen different conditions were listed: arthritis, osteoporosis, asthma, hay fever or other seasonal allergy, lung disease, cancer except skin, skin cancer, type 1 diabetes, type 2 diabetes, high blood pressure, high/unhealthy cholesterol, chronic heartburn, congestive heart failure, heart disease (coronary artery disease, angina, or heart attack), lower back pain, migraine or chronic severe headaches, depression, chronic insomnia, and other chronic conditions. Conditions that were checked were coded as 1 and conditions that were not checked were coded as 0. These measures were coded similarly as in other published analyses. 21
Covariates
Because health differs by age, sex, 22 income, 23 race, 24 and measures of occupational prestige, 26 age, sex, income, race, and job type were included in the models as covariates. Age was included as a continuous variable, measured in years. Sex was coded as female=1 and male=0. Race and ethnicity were combined into the following categories: white, African American, Asian, or Hispanic (reference=white). Regarding job status, participants were asked if they held: managerial, professional/nonmanagerial, or sales positions (each of these responses was collapsed into the category of manager); technical, clerical/office, or laborer/production positions (each of these responses was collapsed into the category of laborer); or were a homemaker/student or retiree (each of these responses was collapsed into the category of homemaker). Because of the small number of respondents in the homemaker category, these respondents were omitted from the analyses. Manager was entered in the models a separate dichotomous variable with laborer as the reference category. Faculty=1 and staff=0 status was also included. A continuous measure of respondents' annualized income also was included. The natural logarithm of income was used in the multivariate analyses to linearize the effect of the skewed distribution. For the bivariate analyses, income was coded as <$45,000 as the reference category. The other income categories were: $45,000–$75,000; $75,001–$95,000 and ≥$95,000. Because the social and demographic environment differs from the 4 various campuses of the university, campus location also was included as a covariate.
Analysis
The statistical package used for these analyses was SAS, release 9.1 (SAS Institute Inc., Cary, NC). The analytic sample included all respondents with complete data on the independent variables. Extreme values were excluded from these analyses. Bivariate analyses for continuous variables and generalized linear modeling for variables with more than 2 response categories were used (Table 1). For the multivariate analyses, linear regression models controlling for sex, age, race, income, job status, and campus location were calculated for the continuous outcomes (ie, self-rated health, and chronic conditions).
P<.05; ** P<.01; *** P<.001.
Results
Basic descriptive analyses were conducted to observe socioeconomic and demographic patterns between self-reported and administratively recorded illness-related absenteeism. Table 1 presents the findings of that information.
Of the 5746 respondents, for the administratively recorded measure, women tended to report higher absenteeism than men. Men had a lower discrepancy than women between recorded and self-reported absenteeism. Employees who classified themselves as a clerical, laborer, or technician had greater absences (both recorded and self-reported) and greater discrepancy between recorded and self-reported absenteeism compared to employees who classified themselves as professional or managerial. Employees who were 65 years of age and older had the highest discrepancy, while employees who were between the ages of 18–29 had the lowest discrepancy between the measures. Faculty had less discrepancy between recorded and self-reported absenteeism compared to staff. Interestingly, staff compared to faculty had higher administratively recorded days absent. There was a general linear pattern with income and absenteeism. Employees in higher income brackets had less absenteeism, regardless of the measure observed. Also, respondents in the higher income brackets had less discrepancy between recorded and self-reported absenteeism. When reviewing the patterns with campus location, one sees that campus 1 had the greatest disparity between self-reported and administratively recorded absenteeism compared to the other 3 campuses. Campus 4 had the highest number of self-reported and administratively recorded illness-related absenteeism compared to the other 3 campuses.
Table 2 reviews the results of self-reported and administratively recorded illness-related absenteeism on self-rated health. In general, both measures of illness-related absenteeism work similarly. Greater illness-related absenteeism is associated with poorer self-rated health (b=0.03 for administratively recorded illness-related absenteeism versus b=0.08 for self-reported illness-related absenteeism).
P<.05; ** P<.01; *** P<.001.
When reviewing race and ethnicity, income, and occupational group, the results also were very similar between the 2 measures. Black, Latino, and Asian reported poorer self-rated health compared to white employees. Lower income was associated with poorer self-rated health. Employees classifying themselves as clerical, laborer, or technician had poorer self-rated health compared to those employees who classified themselves as professional or managerial. Regarding age, in both models predicting self-rated health, those employees 65 years of age and older reported better self-rated health compared to those aged 18–29. This same pattern was observed for the 45–64 age group in the administratively recorded illness-related absenteeism model. In the self-reported illness-related absenteeism model, those classified as 30–44 years of age reported poorer self-rated health compared to those 18–29 years of age. Interestingly, in the administratively recorded sick days model, females reported better self-rated health compared to males.
Table 3 is structured similarly to Table 2. Table 3 reviews the results of self-reported and administratively recorded illness-related absenteeism for a count of self-reported chronic conditions. As with self-rated health, both measures of illness-related absenteeism function similarly. Greater illness-related absenteeism is associated with a greater number of chronic conditions (b=0.06 for administratively recorded illness-related absenteeism versus b=0.10 for self-reported illness-related absenteeism).
P<.05; ** P<.01; *** P<.001.
There were no statistically significant effects in either of the 2 models with regard to income, occupational group, faculty/staff status, or campus location. However, in both models, the associations with age, sex, and race/ethnicity were very similar between the 2 measures. Being female is associated with a higher number of self-reported chronic conditions compared to being male. Across all age categories, being older is associated with a greater number of chronic conditions, compared to being 18–29 years of age. Self-reporting an Asian race (compared to white) is associated with a fewer number of chronic conditions.
Discussion
Illness-related absenteeism is associated with various outcomes that are important to employers. 25 Evidence suggests that greater illness-related absenteeism is associated with poorer self-rated health, 14 a greater number of medical claims, 27 and lower productivity. 28 Such studies typically measure absenteeism via self-report from surveys. Yet, with the exception of a few studies, 29,30 little research has focused on the validity of administratively recorded illness-related absenteeism as compared to self-reported illness-related absenteeism. Given that illness-related absenteeism is meaningful for research and evaluation that influences key decisions among stakeholders, this study sought to address this important gap in the literature.
Results from this study provide some support for both of the hypotheses. First, self-reported and administratively recorded measures of absences related to health or illness were moderately correlated. The correlation between the 2 measures was statistically significant and had a correlation coefficient of 0.47. In addition, holding constant a number of important social and demographic factors, each measure functioned similarly (in direction and magnitude) to predict health outcomes. Both greater self-reported and measured illness-related absenteeism was associated with poorer self-rated health and greater numbers of chronic conditions.
More specifically, this study showed that employees tend to underestimate their self-reported illness-related absent days compared to those administratively recorded measures. This is consistent with previous research. 10 This underestimation may be attributable in part to the 12-month recall period, which has been suggested to provide less accurate responses compared to shorter recall periods. 7 Employers might consider selecting a survey that utilizes a self-reported measure of illness-related absenteeism that has a shorter recall period.
In addition, this study finds strong similarities in the functionality of self-reported and administratively recorded measures of illness-related absenteeism with self-rated health and number of self-reported chronic conditions. Other studies that have explored related outcomes such as all-cause mortality 31 and health risks 32 have found similar associations. This, in turn, stresses the importance of reviewing the agreement between these 2 measures to ensure that programming and business decisions based on evidence resulting from self-reported absenteeism data are accurate.
These results suggest that self-reported absenteeism was only moderately correlated with administratively recorded absenteeism. However, that factor, along with the similar predictive nature of the 2 measures, may suggest that self-rated illness-related absenteeism is a reasonable proxy for administratively recorded measures of illness-related absenteeism. This may be so particularly when administratively recorded measures are not available or are too time consuming to analyze. To strengthen this argument, future work may want to consider other health outcomes, different recall periods of self-reported absenteeism, and longitudinal measures of absenteeism when exploring this association.
These results should be interpreted in the context of several potential limitations of the study. First, the measure of self-reported illness-related absenteeism is based on a 12-month recall. Studies suggest that shorter (eg, 1 month) versus longer (eg, 1 year) recall periods are less prone to recall biases and in turn produce more accurate responses. Employers might place a preference on surveys with shorter recall periods for the self-reported measures. Second, the timing of both the self-reported and administratively recorded measures of illness-related absenteeism may contribute in part to the moderate correlation between the 2 measures. The self-reported measure asks respondents to report their illness days within the prior 12 months. Respondents could have taken the survey anytime from January–April 2012. The administratively recorded measure utilized data collected from calendar year 2011. The slight difference in time frame may have contributed to the underreporting of the self-reported measure. Third, given the university's generous sick time benefit, it is possible that some employees may take advantage of this generous benefit and use more sick time than is strictly necessary. This could have at least 1 possible effect on these results; some employees' self-reported sick time may be a more precise measure of actual illness (ie, lower average number of days) rather than simply time off work. In turn, this could contribute to the moderate, rather than high, correlation between the self-reported versus administratively measured illness-related absenteeism. Fourth, the data collection process of administrative timekeeping data varies from university unit to university unit. Web clocks, time clocks, and employee self-service time sheets are the typical collection methods employed. Generally, employees enter their own timekeeping data using these tools and their manager provides approval status of the employee's entry. The non-salaried employees (referred to by the university as nonexempt employees) report their time to the nearest 10th of an hour. Salaried employees (referred to by the university as exempt employees) report their exception time in half-day increments. Thus, it is plausible that nonexempt employees have more precise administratively recorded illness-related absenteeism than exempt employees.
The interpretation and resultant implications of these findings are important for employers, researchers, and program evaluators. These results suggest that self-rated illness-related absenteeism may be a reasonable way to assess various program outcomes that are meaningful to employers. Assessing the agreement between other self-reported and administratively recorded measures such as health care utilization, particularly over time, also may be important in making business analytics more efficient.
Footnotes
Author Disclosure Statement
Dr. Jenkins declared no conflicts of interest with respect to the research, authorship, and/or publication of this article. The author received no financial support this article.
Acknowledgments
The author would like to thank Nour Fakhoury, MA for her editorial assistance.
