Abstract
The Short Acculturation Scale for Hispanics (SASH) is a popular acculturation measure. Although SASH has been validated, conflicting information has been published about the youth version (SASH-Y). We examined the psychometric properties (i.e., validity and reliability) of SASH-Y in low-income, Mexican-heritage youth (aged 8-18; n = 100) and SASH with their parents (n = 100; total N = 200). Confirmatory factor analyses comparing the three published structural variations of the SASH-Y revealed the three-factor structure originally proposed for SASH-Y fit the data best, and the frequently used unidimensional structure did not fit. The adult SASH fit parent data well. For researchers interested in comparing parent and child scores (e.g., acculturation gap research), we examined the 10 identical parent and child items for invariance. Invariance was established for parent and child data with the traditional SASH structure. However, internal consistency was inadequate for the child data regardless of variable structure. Implications are discussed.
The Hispanic/Latino(a) population (henceforth, Hispanic) is the largest ethnic/racial minority in the United States (U.S. Census Bureau, 2015), with Hispanic children representing the largest ethnic/racial minority group of children (National Kids Count, 2017). Hispanic families’ adaptation to United States’ mainstream culture associates with parents’ and children’s mental health, social and emotional adjustment and development, and family functioning, especially for immigrant families (Kuo, 2014; Zambrana & Carter-Pokras, 2010). Acculturation describes the cultural adaptation process, referring to the change in people’s practices, values, and cultural identifications that stem from their contact with a dissimilar culture (Berry, 1997; Schwartz, Unger, Zamboanga, & Szapocznik, 2010). How adult and child immigrants cope with acculturation processes influences their psychological health and well-being (for reviews, see Kuo, 2014; Lara, Gamboa, Kahramanian, Morales, & Bautista, 2005; Thomson & Hoffman-Goetz, 2009), self-reported health, and psychological health outcomes (Todorova et al., 2013).
A major limitation in connecting acculturation research to the Hispanic population’s health outcomes is the lack of well-validated measures, especially for children (for reviews see Thomson & Hoffman-Goetz, 2009; Wallace, Pomery, Latimer, Martinez, & Salovey, 2010). Using acculturation measurements that have not been psychometrically examined poses a severe threat to the validity of findings and methodological rigor of acculturation and health research (Chaffee, 1991). To partially address these issues, the present study seeks to confirm the factor structure of a widely used measurement of acculturation—the Short Acculturation Scale for Hispanics (SASH; Marín, Sabogal, Marín, Otero-Sabogal, & Perez-Stable, 1987)—and more importantly to validate its modified version for Hispanic youth (SASH-Y; Barona & Miller, 1994).
The adult SASH has 12 items that factor into three sub-domains of acculturation and has demonstrated validity in multiple Hispanic subgroups (Marín et al., 1987; Yamada, Valle, Barrio, & Jeste, 2006). The first factor (i.e., language use) includes items that measure English and Spanish language use when reading, thinking, and speaking with family and friends. The second factor (i.e., media language use) taps preference of language when watching television or listening to the radio, and the third factor (i.e., ethnic social relations) assesses preference of ethnicity of one’s social contacts (Marín et al., 1987). When the SASH was modified for youth (Barona & Miller, 1994), two of the items were replaced with items that were more appropriate for adolescents (see Table 1 for items of SASH-Y and Table 2 for items of SASH).
Child SASH-Y CFA Standardized Item Loadings.
Note. Standardized loadings reported. Model 1 = unidimensional model. Model 2 = Barona and Miller (1994) 3-factor model. Model 3 = Serrano and Anderson (2003) 3-factor model. Extra = Extrafamilial language use. Fam = Familial language use. Social = Ethnic social relations. Pers = Personal language use. External = External language use. ns = nonstatistically significant item loading.
p < .05. ***p < .001.
SASH CFA Item Loadings for Parent Only and Dyadic Scale.
Note. Parent items were assessed in Spanish, although the English translation is given. Standardized loadings reported for the parent data, unstandardized loadings reported for the invariant scale. Invariant loadings are with scalar invariance.
p < .001.
Although the scale factor structure for the adult version (i.e., SASH) has been psychometrically examined, the factor structure and reliability of the youth version (i.e., SASH-Y) remains unclear despite its wide use. In the original proposal of the youth version, Barona and Miller (1994) conducted an exploratory factor analysis (EFA) on the 12-item SASH-Y scale and identified three factors. The authors called for a confirmatory factor analysis (CFA) on the proposed structure, which they later conducted in an unpublished manuscript (Miller & Barona, 2001). Serrano and Anderson (2003) also performed an EFA on the 12 SASH-Y items but found a different three-factor structure. The factor structures reported in Barona and Miller (1994) and Serrano and Anderson (2003) both included an ethnic social relations factor, composed of items 10 to 12, but the two models differed on how the nine language items were divided (see Table 1 for item wording and factors). Although the EFAs produced multidimensional results, both Barona and Miller (1994) and Serrano and Anderson (2003) suggested the scale should be used as a composite measure (i.e., a unidimensional scale). Most published studies using SASH-Y have summed all 12 items (e.g., Olvera, Dempsey, Gonzalez, & Abrahamson, 2013; Schofield, Parke, Kim, & Coltrane, 2008; Weisskirch, 2005). Psychometric analysis of the SASH-Y is warranted given the popularity of the scale and the unresolved issues concerning its factor structure.
The current investigation aimed to psychometrically examine the SASH and SASH-Y with a sample of low-income, Mexican-heritage parent-child dyads (N = 100 dyads, 200 participants). The SASH was administered to the parents and the SASH-Y was given to the children. For the children, we compared three SASH-Y measurement models using CFA: (a) the unidimensional model (henceforth “Model 1”), (b) the three-factor model identified in Barona and Miller (1994; henceforth “Model 2”), and (c) the three-factor model identified in Serrano and Anderson (2003; henceforth “Model 3”). For the parents, we examined the previously published three-factor model of SASH. Finally, CFA allows researchers to assess whether measures function similarly in both members of a dyad (e.g., parents and children) or are invariant between dyad members (Claxton, Deluca, & Van Dulmen, 2015). Research comparing parent and child acculturation scores (see Birman, 2006) assume that parent and child measures are invariant and comparable. Thus, we also examined the measure for invariance between parents and children. Our findings seek to provide evidence for appropriate acculturation measures for low-income Hispanic families, how researchers should form scales from the acculturation items, and therefore conduct research on acculturation and health with more rigorous measures.
Method
Participants and Procedure
We recruited 100 low-income parent-children dyads in the United States (N = 200). Children ranged in age from 9 to 18 years (M = 13.22, SD = 2.07), with corresponding grade levels (M = 7.72, SD = 2.31, range =3 to 12). Children of both genders filled out the survey (females = 55, males = 45). Children were born in the United States (n = 70), Mexico (n = 23), and El Salvador, Honduras, and Venezuela (n = 3 each). Four did not report birthplace. Most children were of Mexican descent (n = 86). Parents were predominantly mothers (n = 87) and were born outside of the United States (n = 90, seven declined to answer). Parents were between 25 and 56 years old (M = 37.96, SD = 5.66). On average, parents lived in the United States for 15.41 years (SD = 6.66, range = 3 to 40) and had an eighth grade education (range = no education to 2 years in college).
Two bilingual employees of a university extension program recruited participants from the Gary, Indiana, and East Chicago area. Families with primarily Spanish-speaking parents and children bilingual in Spanish and English were recruited. The two employees were familiar with the targeted population, as their job was to recruit low-income families for family programs run through extension (e.g., nutrition programs for low-income families). Study recruitment procedures followed extension and state guidelines for defining low-income (i.e., at or below 100% of the poverty line); thus, families who were participating in or eligible for extension programs were also eligible for the current study. For families not associated with extension, the employees assessed current study eligibility in the same way they assessed extension program eligibility (e.g., asking questions that indicated a certain level of poverty, such as “Are you currently using SNAP?” [Supplemental Nutrition Assistance Program, formerly known as food stamps, which requires a 165% federal poverty level for eligibility]). Each dyad was compensated US$50. A bilingual assistant was present to answer any questions. Given the low education level of some parents, the bilingual assistant gave parents the choice of having the survey read to them. Although these data were not officially recorded, between 20 and 30 parents opted to take the survey in this manner. No surveys were read to the child participants. A university institutional review board approved the study protocol.
Measures
Children answered the 12-item Short Acculturation Scale for Hispanic Youth in English (SASH-Y; Barona & Miller, 1994; see Table 1 for item wording and descriptive statistics). Items 1 through 9 had a 5-point response: 1 (only Spanish), 2 (Spanish better than English), 3 (both equally), 4 (English better than Spanish), 5 (only English). Items 10 through 12 were assessed on a similar 5-point scale from 1 (all Hispanic) to 5 (all White).
Parents answered the 12-item Short Acculturation Scale for Hispanics in Spanish (SASH; Marín et al., 1987; see Table 2). Parents responded to the four questions on language use and four questions on media preferences on a 5-point scale from 1 (only Spanish) to 5 (only English). The four questions about ethnic social relations were assessed on a different 5-point scale from 1 (only Latinos) to 5 (only Americans).
Children and parents reported on their English and Spanish ability (speaking and listening) by responding to Tse’s (1996) language proficiency scale (1 = not at all or a little, 4 = very well). They also reported demographic questions (e.g., sex, age, and time living in the United States).
Results
Confirmatory factor analyses (CFAs) were performed with full information likelihood (less than 1% of data were missing) and robust maximum likelihood (MLR), given data nonnormality. We conducted CFAs in Mplus 7.3 (Muthén & Muthén, 2012). We evaluated model fit by considering whether χ2 p > .05, comparative fit index (CFI) > .90, Tucker–Lewis index (TLI) > .90, root mean square error of approximation (RMSEA) ≤ .08, (Brown, 2015; Hu & Bentler, 1999). Internal consistency was assessed with Cronbach’s alpha and a CFA-based reliability coefficient (Brown, 2015). CFA-based reliability “represents the proportion of true-score variance to total observed variance in the measure” and addresses known issues with Cronbach’s alpha (see Brown, 2015, p. 309).
Child CFA Models: SASH-Y
Table 1 includes item loadings for all three CFA models. Model 1, the unidimensional model, did not fit the data well, χ2 = 95.98, p < .001, χ2/df = 1.78, CFI = .67, TLI = .59, RMSEA = .088, 90% confidence interval (CI) = .059 to .117. Items’ internal consistency was low (Cronbach’s alpha = .68; CFA-based reliability = .68).
Model 2 produced adequate fit, χ2 = 60.14, p = .18, χ2/df = 1.18, CFI = .93, TLI = .91, RMSEA = .042 (90% CI = .00 to .080). However, Item 1 loaded poorly at .24 (see Table 1). Barona and Miller originally proposed Item 1 loaded on both extrafamilial and familial factors; we reran the model with this variation, but the item did not statistically load on either factor (external = .15, family = .25), χ2 = 58.26, p = .20, χ2/df =1.17, CFI = .93, TLI = .91, RMSEA = .041 (90% CI = .00 to .079). Thus, Item 1 was dropped (Brown, 2015) and the CFA rerun, χ2 = 41.63, p = .44, χ2/df = 1.02, CFI = .99, TLI = .99, RMSEA = .012 (90% CI = .00 to .070). The revised Model 2 fit the data well. However, internal consistency statistics were low (Cronbach’s alpha for extrafamilial = .72, familial = .41, and social = .61; CFA-based reliability extrafamilial = .73, familial = .50, and social = .62).
Model 3 did not fit the data well, χ2 = 71.99, p = .03, χ2/df = 1.41, CFI = .83, TLI = .78, RMSEA = .064 (90% CI = .022 to .097). Internal consistency statistics were low (Cronbach’s alpha for personal language = .52, external language = .62, and social = .61; CFA-based reliability personal language = .51, external language = .67, and social = .62).
Parent Model: SASH
All 100 parents scored Item 2 as a one (i.e., all spoke only Spanish as a child, see Table 2): Thus, the item had no variation and was excluded from all CFAs with parent data. The three-factor CFA adequately fit the parent data (see Table 2), χ2 = 54.98, p = .07, χ2/df = 1.34, CFI = .93, TLI = .91, RMSEA = .059 (90% CI = .00 to .097). Items’ internal consistency statistics were adequate, although low for the social factor (Cronbach’s alpha for personal language use = .74, media = .73, and social = .66; CFA-based reliability personal language use = .74, media = .76, and social = .67).
Measure Invariance Between Parents and Children
To examine measurement invariance between parents and children, we assessed the 10 items with identical wording (i.e., removed Item 12 from the parent scale and Item 9 from the child scale; we also removed Item 2 because all parents gave the same answer; see Tables 1 and 2). Following the recommendations of Claxton and colleagues (2015), we examined the model for configural χ2(64)= 76.14, p = .14, CFI = .96, TLI = .94, RMSEA = .044 (90% CI = .000 to .078); metric χ2(71)= 83.23, p = .15, CFI = .96, TLI = .95, RMSEA = .042 (90% CI = .000 to .075); and scalar invariance χ2(78)= 88.71, p = .19, CFI = .96, TLI = .96, RMSEA = .037 (90% CI = .000 to .070). With the first item loading of each factor constrained to one, model fit did not worsen when constrained at different levels: configural against metric: χ2(7)= 7.07, p = .42, metric against scalar: χ2(7)= 6.11, p = .53. Scalar invariance remained when the second item loading of each factor was constrained to one instead of the first item loading. Because scalar invariance was achieved, we compared latent means between parents and children. Not surprisingly, latent means significantly varied, with lower parent unstandardized latent means on language (–1.79 lower than children, p < .001), media (–2.01 lower than children, p < .001), and social factors (–0.78 lower than children, p < .001). Residuals and latent variable covariances were not invariant between parents and children (i.e., structural invariance was not present as the two populations demonstrated heterogeneity; Muthén & Muthén, 2012). Thus, parent and child scores can be compared on the modified 10-item SASH because the measures meet invariance requirements. Internal consistency for the invariant model data ranged (Language use, media, and social variable Cronbach’s alpha were .53, .67, and .61 for children, and .74, .76, and .70 for parents; and CFA-based reliability were .51, .67, and .62 for children and .74, .76, and .72 for parents).
Correlations With Other Indicators of Acculturation
To examine convergent validity of the SASH-Y and SASH scales, we assessed the correlations between these scales and other indicators of acculturation. As shown in Table 3, the composite score of SASH-Y was negatively associated with adolescents’ Spanish proficiency and positively correlated with their time spent in the United States. More nuanced patterns of associations were revealed when decomposing the SASH-Y scale into different factors (see Table 3). For example, whereas familial language use was positively associated with English ability, extrafamilial language use and ethnic social relational tended to be inversely related to Spanish ability. Similarly, we assessed the correlations between parents’ reports on SASH and other indicators of acculturation (see Table 4). As would be expected, the three factors of acculturation were positively associated with English ability, with language use demonstrating the strongest association. Two of the factors in SASH were also positively related to parents’ time living in the United States.
Descriptive Statistics.
Note. Scales with the same superscript letter are identical. Age and Time living in the United States are in years. Spanish and English ability are speaking and understanding only, measured on a 4-point scale.
Correlations Between SASH and SASH-Y and Demographic Characteristics.
Note. Lang = language use; Media = media language use; Social = ethnic social relations.
p < .10. * p < .05. **p < .01. ***p < .001.
Discussion
The current study examined SASH and SASH-Y factor structures in 100 low-income, parent-child Mexican-heritage dyads (N = 200). The adult SASH measure, with the three factors of language use, media language use, and ethnic social relations, fit the data well although the internal consistency of the social factor was low. Three competing factor structures for the youth measure (i.e., SASH-Y) have been proposed in the literature: a unidimensional scale (Model 1) and two three-factor multi-dimensional scales (Models 2 and 3). When examining the child data only, the originally proposed 3-factor structure best fit the data (Model 2). However, researchers who want to use dyadic data (e.g., for acculturation gap research) and compare parent and child data need a measure that is invariant between parents and children. Examination of the dyadic data showed that a modified 10-item measure had strong factorial invariance (i.e., scalar invariance) between parents and children. However, the child data did not have strong internal consistency statistics for any factor structure, although the invariant scale variables had the highest internal consistency for both children and parents.
SASH-Y Factor Structure
When examining the child data only, and comparing the three models, the current findings did not support a unidimensional model. Although researchers initially proposed the SASH-Y should be used as a composite scale until the factor structure was confirmed, the current CFAs, the lack of statistically significant correlations between the factors, and the previously published EFAs indicate that the scale is multi-dimensional in nature.
Model 2 (Barona & Miller, 1994) best fit the child data in the current study. However, issues emerged in terms of item loadings and internal consistency. In the original EFA that proposed the factors in Model 2, Barona and Miller noted that Item 1 double loaded on the two language factors of familial and extrafamilial language use; additionally, they confirmed this double loading in an unpublished CFA (Miller & Barona, 2001). Item 1 is a double-barreled item (DeVellis, 2003), as the question has two parts with potentially different answers: What languages do you read (Part 1) and speak (Part 2)? Immigrant children in the United States often continue speaking their native language at home but are enrolled in the English education system and discontinue their native language formal education. Children may differ on what language they read well (based on education; i.e., extrafamilial language use), and what languages they speak well (based on familial language use), explaining why the item previously loaded on both factors. However, the item did not statistically load on either factor in the current analyses, and was ultimately dropped. Reporting spoken language use and reading and writing is a common way to assess acculturation (Wallace et al., 2010), so the removal of this item may be problematic.
Comparing Parent and Child Acculturation Scores
Research that compares scores between two individuals or two populations on a measure first needs to ensure that the measure structure is invariant, or comparable, between the populations (Claxton et al., 2015). A modified version of the SASH (10 items; see Table 2) demonstrated strong factor invariance between parents and children, indicating that parent and child means can be compared. As would be expected given the recruited sample, parents scored significantly lower than children on all three acculturation variables (language use, media use, and social ethnic relations). Although the factor structure that best mirrored the parent SASH was not the best-fitting factor structure when examining the child data only, the modified SASH did fit the parent and child data adequately and thus could be used when examining parents and children simultaneously. Although internal consistency was still an issue for the child variable data (e.g., Cronbach’s alpha ranged from .53 to .67), the internal consistency scores were highest for the parent and child data with the 10-item invariant variables compared to item groupings suggested by other factor structures.
Implications of Low Internal Consistency
In the current manuscript, we presented two types of internal consistency: Cronbach’s alpha and a CFA-based reliability coefficient (Brown, 2015). Internal consistency refers to the homogeneity of item responses, or “the degree to which the items on a test jointly measure the same construct” (Henson, 2001, p. 177). Rules of thumb state that internal consistency statistics equal or higher than .70 are acceptable (e.g., Kline, 2011; Streiner, 2003), indicating the range of internal consistency scores for the child scales were problematic. The SASH and SASH-Y items (particularly for language) are heterogenous, in that they assess different aspects of the concept of acculturation and therefore likely will not be highly consistent for a sample of bilingual children who use both languages. For example, children reported predominantly speaking Spanish at home (Item 3) because although children speak English with their siblings, parents find it disrespectful (De Ment, Buriel, & Villanueva, 2005). However, children reported thinking in both Spanish and English (skewed more toward English; Item 4) and predominantly spoke to their friends in English (Item 5). Likely, children make and socialize with friends at school, where English is the dominant and preferred language. Thus, when examining bilingual children who move between two linguistic contexts (e.g., English at school and Spanish at home), the scores for these items are expected to be heterogeneous. Populations such as first-generation native Spanish-speakers in the United States (Yamada et al., 2006) and individuals who have not yet acquired complete fluency in one language (such as the parents in this sample) may demonstrate greater internal consistency in their scores because their lives are more predominantly centered in one linguistic context. Internal consistency scores are specific to a sample, not a measurement, and, therefore, researchers should conduct internal consistency tests for their data. For example, Serrano and Anderson (2003) reported acceptable internal consistency Cronbach’s alpha from their sample for the Model 2 factor in a predominantly Euro-American sample of fourth and fifth graders (extrafamilial = .86, familial = .86, and social = .74). The low internal reliability in the current study children scores may be replicated in samples with similar characteristics to ours, but the scale may demonstrate higher reliability in other samples.
Given the lack of high item homogeneity in the current SASH-Y variables (regardless of which factor structure is used), clinicians should recognize that the composite scores are not an accurate reflection of all of the test’s items (Henson, 2001, p. 178) and therefore will likely lead to inappropriate decisions if used as such (e.g., using a certain scale “cut-off” point to determine child eligibility for a program). For researchers, the invariance parent and child SASH measures provide one advantage in research, as parent and child scores can be compared using invariant measures. However, because effect size magnitude and statistical significance are intrinsically tied to reliability of scores (Henson, 2001), when internal reliability test scores are low, power for statistical tests is attenuated and likelihood of Type II error increases (i.e., failing to reject a null hypothesis; Kline, 2011).
However, scholars also caution against overprioritizing item homogeneity: Even a set of indicators of “poor” psychometric quality (e.g., low reliabilities, little common variance) can produce accurate estimates of the relationships among constructs provided that they (a) are spread out across the construct domain sufficiently to capture the centroid, (b) yield sufficient variability on the construct, and, again, (c) are analyzed by confirmatory analysis. (Little, Lindenberger, & Nesselroade, 1999, p. 207)
These authors note that the “true construct centroid” or “construct domain centroid” is the underlying, conceptual abstraction of the construct attempting to be assessed. When assessing acculturation, particularly in samples that have heterogeneity on the items, only using items that are highly correlated (and have high internal consistency) may lead to a measure well-defined by psychometric indicators, but that strays from the underlying concept (Little et al., 1999, p. 207). Thus, prioritizing high internal consistency may lead to a measurement assessing too narrow a construct that misses the true construct centroid. In sum, researchers using the current measures should (a) determine the internal reliability statistics for their sample, (b) verify that parent and child scores are invariant for their sample if using family data (and conduct CFAs), and (c) understand the implications of internal consistency scores and confirmatory factor analyses for research findings.
Implications and Future Directions
The current participants may have characteristics that are not generalizable to all populations and thus the SASH-Y findings and internal consistency issues may be unique. Our sample were all low-income families, at or below 100% of the poverty line. Per our recruitment procedures, all parents predominantly spoke Spanish and children were bilingual in Spanish and English. Thus, our recruitment procedures focused on families who likely have acculturation gaps between children and parents. Because the scale relies on some generational markers of acculturation (i.e., what language do your parents speak to you in, what language did your grandparents speak to your parents in), the scale may not function well in families in which generational acculturation is not consistent. Children whose parents speak to them in Spanish and who grew up speaking Spanish may still be highly acculturated, thus causing a lack of consistency between these items. Furthermore, the sample size of the current investigation (i.e., 100 parent-child dyads) was relatively small. Replication with larger samples will help validate our findings.
Researchers examining acculturation-related issues should utilize acculturation measures that are structurally valid and reliable in their target child demographic sample. Findings of the current study indicate that the 12 SASH-Y items should not be used as a unidimensional scale. These findings underscore the need for additional psychometric validation of child acculturation measures, particularly across levels of socioeconomic status and ethnic/cultural heritage (Guo, Suarez-Morales, Schwartz, & Szapocznik, 2009). Moreover, parent and child scales need to be compared for measurement invariance when examining acculturation gaps (Claxton et al., 2015).
Footnotes
Declaration of Conflicting Interests
The author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.
Funding
The author(s) received no financial support for the research, authorship, and/or publication of this article.
