Variability Across Caregiver and Performance-Based Measures of Executive Functioning in an Acute Pediatric Neurocritical Care Population

Abstract

Youth admitted to the pediatric intensive care unit (PICU) for traumatic brain injury (TBI) commonly struggle with long-term residual effects in the domains of physical, cognitive, emotional, and psychosocial/family functioning. In the cognitive domain, executive functioning (EF) deficits are often observed. The Behavior Rating Inventory of Executive Functioning, Second Edition (BRIEF-2) is a parent/caregiver-completed measure that is regularly utilized to assess caregivers' perspectives of daily EF abilities. Using parent/caregiver-completed measures like the BRIEF-2 in isolation as outcome measures for capturing symptom presence and severity might be problematic given that caregiver ratings are vulnerable to influence from external factors. As such, this study aimed to investigate the association between the BRIEF-2 and performance-based measures of EF in youth during the acute recovery period post-PICU admission for TBI. A secondary aim was to explore associations among potential confounding factors, including family-level distress, injury severity, and the impact of pre-existing neurodevelopmental conditions. Participants included 65 youths, 8–19 years of age, admitted to the PICU for TBI, who survived hospital discharge and were referred for follow-up care. Non-significant correlations were found between BRIEF-2 outcomes and performance-based measures of EF. Measures of injury severity were strongly correlated with scores from performance-based EF measures, but not BRIEF-2. Parent/caregiver-reported measures of their own health-related quality of life were related to caregiver responses on the BRIEF-2. Results demonstrate the differences captured by performance-based versus caregiver-report measures of EF, and also highlight the importance of considering other morbidities related to PICU admission.

Introduction

Traumatic brain injury (TBI) continues to be the leading cause of morbidity and mortality in children and adolescents, with neurological injury accounting for >20% of youth admitted to the pediatric intensive care unit (PICU).^1–4 Though the efficacy of PICU-specific intervention has increased survival rates, many children and families face worsening functional outcomes after discharge.⁵ PICU survivors often experience long-term sequelae or post-intensive care syndrome, which includes physical, cognitive, emotional, and psychosocial impairments.^1,6,7

Of the cognitive domains affected by TBI, executive functioning (EF) is often the most severely impacted.^8,9 EF encompasses the skills necessary to achieve a given goal by means of regulating thoughts, behaviors, and emotions and includes skills such as problem solving, self-monitoring, task initiation/completion, cognitive flexibility, and behavioral/emotional modulation.¹⁰ Pronounced weaknesses in this population are observed given that pediatric TBI often affects the neural circuitry underlying EF abilities, including frontal regulatory areas of the brain or diffuse axonal injury.^11–15

A multi-modal approach is recommended to assess functioning and track TBI recovery post-PICU admission; however, neuropsychological evaluations indexing EF are seldom completed during the acute recovery phase.^1,16,17 More often, in structured PICU follow-up programs and research protocols, EF is measured using tools such as the Behavior Rating Inventory of Executive Functioning, Second Edition (BRIEF-2), an informant-reported measure designed to assess daily EF.^18–22 In fact, the BRIEF-2 is recommended by the National Institutes of Health as a common data element for TBI research and is often utilized as a sole measure of EF.^21,23,24 Clinically, the BRIEF/BRIEF-2 has been widely utilized as an accepted way to assess and track EF deficits and recovery across ages.^25–30 However, some have proposed that parent/caregiver-reported measures are not ideal as the sole outcome measures for capturing symptom presence and severity. Caregiver ratings tend to be influenced by factors including stress level, skewed recollections of pre-morbid functioning, and response bias.^30–33

Further, the literature highlights notable discrepancies between informant-reported and performance-based measures of EF. For instance, the BRIEF/BRIEF-2 has been shown to poorly correlate with performance-based measures of EF across numerous pediatric samples unless TBIs were in the moderate to severe range.^34–40 These findings indicate that parent-reported and performance-based EF measures may capture a different set of constructs (e.g., stress related to PICU admission), particularly when EF challenges are in the more normative or mildly impaired range.^33,34 More research directly evaluating the connection between family distress and parent-reported EF post-TBI is needed to ensure that EF outcome measures (BRIEF/BRIEF-2) are utilized effectively in TBI populations given both the prominence and longevity of executive dysfunction typically present after the acute recovery phase >10 years post-injury.^28,29,40,41

Further, earlier studies have been agnostic to time post-injury when studying EF in pediatric TBI. This oversight is, in part, attributable to the rarity of neuropsychological evaluations and rehabilitation programs services available.^29,42 As such, the research is lacking temporal specificity when it comes to multi-component performance-based assessment of EF, while also accounting for pre-morbid functioning, injury severity, and parent stress. Additionally, pre-existing neurodevelopmental diagnoses are often not reported or addressed, although they are a known risk factor for executive dysfunction beyond injury severity.^26,43–46

The primary aim of this study was to determine the concordance between parent-reported measures and performance-based measures of EF after neurocritical care during the acute recovery period. A secondary aim was to explore possible confounding factors on EF outcomes, including family-level distress, injury severity, and pre-existing neurodevelopmental conditions. We hypothesized that caregiver-reported measures of EF would not be significantly associated with performance-based measures. Conversely, we hypothesized that parent-reported measures would be associated with caregiver-reported measures of family impact and distress. Additionally, we hypothesized that performance-based measures of EF would relate to injury severity. Finally, we hypothesized that there would be group differences across those with and without pre-existing neurodevelopmental diagnoses.

Methods

Participants and procedures

We performed a retrospective analysis of data collected on children 8–19 years of age admitted to the PICU for TBI, who had survived hospital discharge and were referred for follow-up care in the Pediatric Critical Care Neurotrauma Recovery Program (PCCNRP) at Doernbecher Children's Hospital ∼1–3 months (mean [M ] = 51.72 days, [SD] = 16.27; range = 26–85) after date of injury (Table 1). The sample included 65 patients who completed a follow-up visit between September 2018 and January 2022. Demographic information and clinical data were extracted from the electronic medical record and included age, sex assigned at birth, race/ethnicity, date of birth, date of hospitalization, Glasgow Coma Scale (GCS) at admission, insurance (public or commercial/private), time elapsed post-injury, neuroimaging findings, mechanism of injury, previous diagnoses of neurodevelopmental conditions, Injury Severity Score (ISS) values, and date of hospital discharge. Patients presenting to the PCCNRP clinic were included in the study if they had been seen within 3 months post-discharge and had complete caregiver-reported and performance-based measures. Participants were excluded if they met criteria for a reading disability preceding injury. Further information regarding PCCNRP policies and procedures have been previously described.^47,48 The institutional review board at Oregon Health & Science University approved the study procedures with a waiver of consent.

Table 1.

Demographic Characteristic of Study Participants

Variables	N = 65 (%)
Sex
Male	38 (58.5)
Female	27 (41.5)
Age at admission, years
M (SD)	13.35 (2.65)
Min–Max	8–19
Race
American Indian/Alaska Native	1 (1.5)
Asian	1 (1.5)
Hawaiian Native/Pacific Islander	2 (3.1)
White	48 (73.8)
More than one race	2 (3.1)
Unknown or not reported	11 (16.9)
Ethnicity
Hispanic or Latinx	5 (7.7)
Not Hispanic or Latinx	46 (70.8)
Unknown or not reported	14 (21.5)
Insurance
Private	39 (60)
Public	26 (40)
Distance from home to clinic
Within 50 miles	27 (41.5)
Further than 50 miles	38 (58.5)
GCS at admission
M (SD)	13.66 (2.88)
Min–Max	3–15
ISS
M (SD)	13.24 (9.38)
Min–Max	1–38
Abbreviated Injury Scale, by region, M (SD)
Head/neck	2.69 (1.36)
Face	1.79 (0.43)
Chest	2.86 (1.03)
Abdomen/pelvis	2.89 (0.93)
Extremities	2.38 (0.72)
External	1.04 (0.19)
Length of hospitalization, days
M (SD)	3.65 (4.61)
Min–Max	1–33
Mechanism of injury
Motor vehicle accident	18 (27.7)
ATV accident	8 (12.3)
Bike/skateboard/scooter	13 (20)
Pedestrian accidents	9 (13.8)
Fall	10 (15.4)
Other blunt trauma	7 (10.8)
Injury types
Subdural	12 (28.6)
Epidural	9 (21.4)
Subarachnoid	14 (33.3)
Contusion	15 (35.7)
Mixed or multiple	10 (23.8)
Indeterminate	3 (7.1)
No. of injury types
M (SD)	0.68 (0.87)
Min–Max	0–3
0	34 (52.3)
1	17 (26.2)
2	12 (18.5)
3	2 (3.1)
Injury location
Frontal	14 (21.5)
Parietal	10 (15.4)
Temporal	11 (16.9)
Occipital	6 (9.2)
Cerebellum	2 (3.0)
Axonal injury	3 (4.6)
None/concussion only	34 (52.3)
No. of injury locations
M (SD)	0.72 (0.88)
Min–Max	0–3
0	36 (55.4)
1	16 (24.6)
2	11 (16.9)
3	2 (3.1)

GCS, Glasgow Coma Scale; ISS, Injury Severity Score; SD, standard deviation; M, mean; ATV, all-terrain vehicle.

Measures

TBI severity was measured and defined by the GCS (pediatric version) recorded at the time of injury (mild 13–15, moderate 9–12, and severe 3–8) and ISS.^49–51 ISS scores were assigned by trained trauma program staff in accordance with National Trauma Data Bank standards.^52,53 ISS and GCS scores were utilized in principal analyses. Notably, GCS scores given at admission are known to have multiple confounders, limiting its utility in predicting trajectory and outcomes in pediatric TBI, although research has also highlighted that GCS produced the strongest associations with more severe injuries.^1,54–57 Additional patient pre-morbid medical or neurodevelopmental disorders were documented and collected from inpatient and clinic notes.

The PCCNRP clinic was utilized to determine the presence of cognitive impairment through implementation of a fixed neuropsychological screening battery consisting of multiple performance-based measures (Table 2).⁴¹ The Wide-Range Achievement Test (WRAT), 4th Edition (WRAT-4) was given until April 2021, then replaced with the 5th Edition (WRAT-5) to assess Word Reading and provide a proxy, age-adjusted estimate of pre-morbid cognitive functioning.^58–61 Youth completed either the Children's Memory Scale (CMS) Numbers subtest or the Wechsler Adult Intelligence Scale, Fourth Edition (WAIS-IV) Digit Span subtests to capture attention and working memory performance.^62,63 The Child and Adolescent Memory Profile (ChAMP) Lists subtest was given to gauge verbal learning and general memory ability.⁶⁴

Table 2.

Measures Administered by Age at Initial Follow-up Visit

	Age range (years:months)
	8:0–12:11	13:0–6:11	17:0–19:11
Estimate of pre-morbid functioning
WRAT-4 or WRAT-5 Word Reading	X	X	X
Attention/working memory
CMS Digits (forward, backward, and total)	X	X
WAIS-IV Digit Span			X
Memory & Learning
ChAMP Lists (immediate and delayed)	X	X	X
Language
D-KEFS Verbal Fluency (letter and category)	X	X	X
Processing speed
D-KEFS Trails 2/Number Sequencing	X	X	X
WISC-V Coding and Symbol Search	X	X
WAIS-IV Coding and Symbol Search			X
Cognitive flexibility
D-KEFS Trails 4/Number-Letter Switching	X	X	X
Parent/caregiver
PedsQL (Health Quality of Life Total Score)	X	X	X
BRIEF-2 (Executive Functioning)	X	X	X

WRAT, Wide-Range Achievement Test; CMS, Children's Memory Scale; WAIS, Wechsler Adult Intelligence Scale; ChAMP, Child and Adolescent Memory Profile; D-KEFS, Delis-Kaplan Executive Function System; WISC, Wechsler Intelligence Scale for Children; PedsQL, Pediatric Quality of Life Inventory; BRIEF-2, Behavior Rating Inventory of Executive Functioning, Second Edition.

All patients completed parts of the Delis-Kaplan Executive Function System (D-KEFS) producing scaled scores for Verbal Fluency and Trail Making tasks.⁶⁵ The Verbal Fluency task consisted of a patient's ability to use language and abide by inhibition rules to generate a word based on a single letter or semantic category. For Trail Making, examinees were tasked with connecting and sequencing numbers in order (Condition 2; Number Sequencing) capturing processing speed, whereas the numbers and letters switching task assessed cognitive flexibility (Condition 4; Letter-Number Sequencing).⁶⁵ The Wechsler Intelligence Scale for Children, Fifth Edition (WISC-V) or the WAIS-IV Coding and Symbol Search subtests were administered to assess processing speed.^63,66

Information regarding daily executive skills was collected by the BRIEF-2 as the parent-report measure.²¹ The BRIEF-2 also provides three additional index scores to evaluate specific areas related to EF: Emotion Regulation Index (ERI), Cognitive Regulation Index (CRI), and Behavior Regulation Index (BRI). The Pediatric Quality of Life Inventory (PedsQL) Parent Related Health Quality of Life (HRQL) was used to collect information regarding caregiver functioning after hospital discharge.^67,68

Statistical analysis

All data analyses were completed using SPSS software (Version 27.0; SPSS, Inc., Chicago, IL).⁶⁹ First, to compare differences between patients with and without pre-injury neurodevelopmental conditions, independent samples t-tests were used.

Given the high correlations across performance-based EF measures (Supplementary Table S2), principal components analysis (PCA) was conducted to create a single, cumulative neurocognitive index (NCI), thereby reducing the likelihood of type 1 error (Table 3).^{43,44,46,47,70} The maximum number of convergences was set to 25. All eight neurocognitive measures were retained. The WRAT Word Reading subtest was given to provide a proxy, age-adjusted estimate for pre-morbid cognitive functioning.

Table 3.

Details of Principal Components Analysis

Measures	PCA loading	Inclusion
Combined WISC-V/WAIS-IV Coding	0.75	Retained
Combined WISC-V/WAIS-IV Symbol Search	0.72	Retained
Combined WAIS-IV Digit Span/CMS numbers	0.59	Retained
D-KEFS Trails 4 Switching	0.82	Retained
D-KEFS Phonemic Verbal Fluency	0.70	Retained
D-KEFS Category Fluency	0.76	Retained
ChAMP Lists Immediate	0.64	Retained
ChAMP Lists Delayed	0.72	Retained

Principal components analysis performed on N = 65 patients with complete data in all variables. Combining all participant data yielded a single component solution accounting for 51.7% of the total explained variance. Reasons for missing data in cognitive assessments included complications such as orthopedic injury, vision impairment, and behavioral cooperation precluding the completion of some tasks; also, the need for virtual-only visits for some patients assessed during the COVID-19 pandemic.

CMS, Children's Memory Scale; WAIS, Wechsler Adult Intelligence Scale; ChAMP, Child and Adolescent Memory Profile; D-KEFS, Delis-Kaplan Executive Function System; WISC, Wechsler Intelligence Scale for Children; PedsQL, Pediatric Quality of Life Inventory.

Higher NCI scores are reflective of stronger neurocognitive ability. Combining all participant data yielded a single component solution accounting for 51.27% of the total explained variance (Table 3). The NCI included data from the 65 patients who had all eight neurocognitive measures included within the composite, and NCI Z-scores ranged from −2.27 to 2.16. In order to control for estimated pre-morbid cognitive functioning on the NCI, we constructed residualized change scores using a simple linear regression model in which the WRAT Word Reading score predicted NCI.^71,72 Using this method, more negative residuals represent worse cognitive functioning at follow-up than expected based on estimated pre-morbid functioning, whereas more positive residuals represent better functioning.

In order to explore the relationship between caregiver-reported and performance-based measures of EF, bivariate correlations were then conducted assessing the relationships between the residual of Word Reading and NCI and the BRIEF-2 Global Executive Composite (GEC) score (see Supplementary Table S3 for correlations between performance-based measures of EF and the BRIEF-2 index scores). We also evaluated the relationship between parental impact through caregiver responses on the PedsQL compared to BRIEF-2. Hospital-appointed measures, including the GCS and ISS, were compared to NCI and BRIEF-2. Non-parametric tests were used for variables that did not demonstrate normality with the Kolmogorov-Smirnov goodness-of-fit test.

Results

Among the 65 patients who completed the follow-up visit, we evaluated 38 males and 27 females 8–19 years of age assessed ∼1–3 months after critical care hospitalization for TBI (Table 1). Most patients were injured by motor vehicle accidents (27.7%), with the remaining categorized by all-terrain vehicle (ATV; 12.3%), biker/skateboard/scooter (20%), pedestrian accident (13.8%), fall (15.4%), and other blunt trauma (10.8%). TBI severity ranged from mild TBI/concussion to severe TBI. GCS at admission was 3–15 (M = 13.66, SD = 2.88) with ISS scores being 1–38 (M = 13.24, SD = 9.38) and length of stay 1–33 days (M = 3.65, SD = 4.61).

Correlations Behavior Rating Inventory of Executive Functioning, Second Edition, neurocognitive index, and indicators

The following results referring to performance-based neurocognitive outcomes account for the NCI score and estimated pre-morbid functioning with residualized change scores, as described above. Results are similar when original NCI scores are used (see Supplementary Table S1).

Bivariate correlations showed non-significant relationships between NCI and BRIEF-2 GEC and index scores (Table 4). Similarly, the BRIEF-2 GEC score did not significantly correlate with NCI (r₍₆₄₎ = −0.02, p = 0.10) or injury severity. However, a strong negative correlation was observed between BRIEF-2 GEC and HRQL total score.

Table 4.

Bivariate Correlation of BRIEF-2 and Neurocognitive Index (Controlling for Word Reading Score)

	GEC	BRI	ERI	CRI
NCI	–0.21	–0.10	–0.21	–0.17

NCI, Neurocognitive Index; GEC, Global Executive Composite; BRI, Behavior Regulation Index; ERI, Emotion Regulation Index; CRI, Cognitive Regulation Index; BRIEF-2, Behavioral Rating Inventory of Executive Functioning, Second Edition.

On the other hand, NCI was strongly, negatively correlated with ISS (Table 5), such that higher severity correlated with worse EF on performance-based measures. Interestingly, NCI did not correlate with GCS at admission or caregiver-rated EF or parent functioning (PedsQL-HRQL). Parent HRQL Summary Score negatively correlated with both injury-severity indicators ISS and GCS at admission (Table 5).

Table 5.

Bivariate Correlation of Indicators (Controlling for Word Reading Score)

	1	2	3	4	5
1. Neurocognitive Index	1
2. BRIEF-2 GEC	–0.21	1
3. Injury Severity Score	–0.35^**	0.13	1
4. GCS AdmissionMild (13–15)Moderate (9–12)Severe (3–8)	–0.21	0.23	0.25^*	1
5. PedsQL Parent Report Total Score	0.08	–0.45^**	–0.35^**	–0.32^**	1

Correlation is significant at the 0.05 level (two-tailed).

Correlation is significant at the 0.01 level (two-tailed).

BRIEF-2, Behavior Rating Inventory of Executive Function, Second Edition; GEC, Global Executive Composite; GCS, Glasgow Coma Scale; PedsQL, Pediatric Quality of Life Inventory.

Pre-injury neurodevelopmental condition

Significant group differences were observed for BRIEF-2 GEC, NCI, Word Reading Score, and the residual of NCI and Word Reading between patients with and without a pre-injury neurodevelopmental condition before admittance to the PICU (Table 6). Those with pre-existing conditions had scores that reflected lower abilities. Because of the small sample size of those with pre-existing conditions (n = 14), exploratory correlations were not conducted.

Table 6.

Independent-Sample t-Tests Comparing Participants With and Without History of Developmental Disability

	No pre-injury neurodevelopmental conditions (N = 51)		Pre-injury neurodevelopmental conditions (N = 14)
Variable	Mean	SD	Mean	SD	t value	p value
ISS	12.81	9.81	14.71	7.89	–0.66	0.51
BRIEF-2 GEC	51.96	10.79	62.86	12.91	–3.21	0.002
NCI	0.21	0.93	–0.78	0.88	3.59	<0.001
Word Reading Score	101.08	12.22	92.29	10.42	2.45	0.017
Residual of NCI and Word Reading	0.12	0.69	–0.44	0.99	2.43	0.009
PedsQL Parent Score	77.02	18.91	66.41	19.19	1.84	0.07

ISS, Injury Severity Score; BRIEF-2, Behavior Rating Inventory of Executive Function, Second Edition; GEC, Global Executive Composite; NCI, Neurocognitive Index; PedsQL, Pediatric Quality of Life Inventory.

Discussion

TBI-related EF impairment, coupled with the effects of family distress post-PICU admission, is an important area of consideration when working with youth in the acute phase of TBI recovery. The present study contributes to the pediatric critical care and TBI literature by providing novel information regarding the relationship between caregiver-reported outcomes, performance-based measures, and hospital-based measures of injury severity in a cohort of pediatric TBI survivors. In support of the study hypotheses, parent-reported outcomes on the BRIEF-2 were not associated with performance-based neuropsychological measures. Results indicate that performance-based assessment and the BRIEF-2 capture different constructs associated with EF, which is consistent with previous research suggesting that the two methods capture different components of EF.^32,33

The authors of the BRIEF-2 sought to create a measure that describes the day-to-day components and presentations of EF through parent proxy report evaluating a child's ability to modulate behavior, emotions, and metacognitive skills.²¹ Some researchers have suggested that the behaviors rated by parents on this measure may be more related to emotional and behavioral skills (i.e., hot EF), rather than standardized cognition-based neuropsychological assessments administered in a quiet, calm, and distraction-free setting (i.e., cool EF).^{37,38,73–76} As such, caregiver ratings likely reflect hot EF challenges, such as emotional and behavioral dysregulation, which are observed in daily life. By this metric, greater child-reported EF disturbance may reflect higher family burden.^77,78 In the current study, we found that caregiver-rated EF was strongly correlated with parent-reported distress.

It is also possible that elevated family distress hinders child recovery, though this cannot be determined by this study given that parent ratings of their own distress and their child's EF were given at the same time. Still, this study's findings are consistent with previous research identifying family distress to impact recovery trajectories.^74,79,80 For instance, clinically elevated levels of family distress have been shown to be a barrier to adherence to clinical recommendations.^81,82 In addition, parent distress may interact with recovery by reducing parental resources to alleviate and manage children's emotional, cognitive, and physical symptoms.^80–85

It is also important to consider that some families may under-report symptoms on rating forms both about their own level of distress and about functioning in their children. Research demonstrates that ratings of a child's behavior are likely to be biased because of respondents' perceptions, which are often influenced by contextual factors such as demographic background, societal expectations, and skewed recollections of pre-morbid functioning.^37–39,81 In these cases, had performance-based measures of EF not been administered, these children's needs would have gone unidentified and untreated. Therefore, a multi-system approach is warranted to effectively identify the culmination of sequalae and family stress observed in this population.^79,84–88

As expected, there was a significant relationship between expert-rated injury severity and performance-based measures of EF. This relationship remained significant even when accounting for pre-morbid individual differences in cognition indexed by word reading scores, a proxy measure known to remain intact after neurological insult.^{61,62,89–92} Past work shows that EF is vulnerable post-TBI, with these impairments being present early in the acute recovery phase and persisting long term in youth who presented with complicated mild, moderate, or severe TBI and also experienced hospitalization, critical care, and comorbid orthopedic injury.^{9,25,28,30,39,41,43,74,86,87} EF deficits can hinder academic achievement and adaptive functioning in daily life.^90,92 The current work emphasizes the importance of evaluating for impairment in EF post-TBI, especially in those with greater overall injury severity. Ideally, these children will benefit from neuropsychological evaluations that include both performance-based measures and informant-reported measures to quantify EF. This approach identifies both the impact of TBI on cognitive skills and how these impairments affect daily functioning.

In addition to performance-based and informant-reported measures of EF when considering TBI outcomes, it is also necessary to consider pre-injury abilities. Though the design of our study did not allow for direct measurement of baseline EF pre-injury, we examined the impact of previously identified neurodevelopmental conditions. The past TBI literature has identified lower pre-injury abilities to be a significant risk factor for recovery.^92–95 Secondary exploratory analyses in the present study revealed differences in EF based on pre-morbid developmental diagnoses, suggesting that pre-morbid conditions may exacerbate or result in diminished EF capacities on both parent report and performance-based measures after TBI. Given our small sample size and inability to directly measure pre-morbid functioning, future research is warranted to further elucidate the connection between pre-injury abilities and EF recovery.

Together, the results demonstrate the differences captured by performance-based and parent reported measures of EF, and also highlight the importance of considering other morbidities, particularly family distress related to PICU admission. We assert that both types of EF measures have merit and add useful information to research and clinical care; however, consistent with previous research, performance-based and informant-report measures appear to capture different constructs related to EF, and utilization of either of these measures in isolation may inaccurately capture EF outcomes, particularly if not accounting for the impact of family distress in an acute pediatric TBI population.^38,39,96 Overall, the results underscore the need for researchers and professionals to carefully consider the type of information that can be gleaned from various measurement tools, especially when interpreting outcomes to inform treatment and guide intervention.

Limitations

The present study has several limitations. First, this study is a single-institution, retrospective cohort study with a relatively small sample size largely attributable to the unique population of interest. Additionally, patient TBI severity ranged from mild without intracranial injury to severe with multiple intracranial injuries. Yet, heterogeneity is the rule in community samples drawn from patients admitted and treated in the PICU. Further, there are known geographical and institutional differences regarding acute treatment and critical care approaches, which may limit the generalizability of our findings. Relatedly, broad inferences beyond the scope of this pediatric TBI population are limited. This study was a cross-sectional analysis, thus limiting determination of causation. Further, longitudinal studies are needed too given that all outcome measures were collected 1–3 months after hospital discharge. Future research with greater statistical power is needed to explore the contribution of injury characteristics on outcomes.

Conclusion

The present study revealed a non-significant association between caregiver-reported measures and performance-based measures of EF in the acute-recovery period after pediatric TBI. The findings demonstrate the importance of multi-method assessment to detect potential acquired deficits to inform rehabilitation. Further, these findings are consistent with previous literature attesting that performance-based measures may underestimate behavioral and emotional impairments associated with EF.^47,76,81 Overall, these findings evince that the BRIEF-2 and neuropsychological assessment measure different constructs, with the BRIEF-2 capturing subtle behavioral problems, parental psychological distress, and emotional constructs associated with pediatric TBI recovery. Conversely, performance measures of EF may capture specific functional neurocognitive deficits directly related to injury severity. Moreover, our study demonstrates that BRIEF-2 scores are related to measures of caregiver distress, and therefore using this measure as a primary clinical outcome for cognition requires the caveat that it also reflects other morbidities related to PICU admission.

Footnotes

Acknowledgments

We thank the children and families who have sought clinical care through the Pediatric Critical Care & Neurotrauma Recovery Program. It is a privilege to be part of your journey toward recovery.

Authors' Contributions

Kera R. Larson: conceptualization, methodology, formal analysis, data curation writing–original draft. Lauren A. Demers: conceptualization, methodology, data curation, formal analysis, writing– writing–original draft, review & editing. Emily Z. Holding: conceptualization, methodology, data curation, writing–review & editing. Cydni N. Williams: conceptualization, methodology, data curation, writing–review & editing, supervision. Trevor A. Hall: conceptualization, methodology, data curation, writing–review & editing, supervision.

Funding Information

Dr. Williams received support from the National Heart, Lung, and Blood Institute (NHLBI; K23HL150229). The content is solely the responsibility of the authors and does not necessarily represent the official views of the NHLBI.

Author Disclosure Statement

No competing financial interests exist.

Supplementary Material

Abbreviations Used

References

Williams

, Hartman

, Guilliams

, et al. Postintensive care syndrome in pediatric critical care survivors: therapeutic options to improve outcomes after acquired brain injury. Curr Treat Options Neurol, 2019; 21(10):49; doi: 10.1007/s11940-019-0586-x

Williams

, Eriksson

, Piantino

, et al. Long-term sequelae of pediatric neurocritical care: the parent perspective. J Pediatr Intensive Care, 2018; 7(4):173–181; doi: 10.1055/s-0038-1637005

Cheng

, Li

, Schwebel

, et al. Traumatic brain injury mortality among US children and adolescents ages 0–19 years, 1999–2017. J Saf Res, 2020;(72):93–100; doi: 10.1016/j.jsr.2019.12.013

Yue

, Upadhyayula

, Avalos

, et al. Pediatric traumatic brain injury in the United States: rural-urban disparities and considerations. Brain Sci, 2020; 10(3):135; doi: 10.3390/brainsci10030135

Pinto

, Rhinesmith

, Kim

, et al. Long-term function after pediatric critical illness: results from the survivor outcomes study. Pediatr Crit Care Med, 2017; 18(3):e122–e130; doi: 10.1097/PCC.0000000000001070

Dodd

, Hall

, Guilliams

, et al. Optimizing neurocritical care follow-up through the integration of neuropsychology. Pediatr Neurol, 2018;(89):58–62; doi: 10.1016/j.pediatrneurol.2018.09.007

Hall

, Leonard

, Bradbury

, et al. Post-intensive care syndrome in a cohort of infants & young children receiving integrated care via a pediatric critical care & neurotrauma recovery program: a pilot investigation. Clin Neuropsychol, 2022; 36(3):639–663; doi: 10.1080/13854046.2020.1797176

Babikian

, Merkley

, Savage

, et al. Chronic aspects of pediatric traumatic brain injury: review of the literature. J Neurotrauma, 2015; 32(23):1849–1860; doi: 10.1089/neu.2015.3971

Goh

MSL

, Looi

DSH

, Goh

, et al. The impact of traumatic brain injury on neurocognitive outcomes in children: a systematic review and meta-analysis. J Neurol Neurosurg Psychiatry, 2021; 92(8):847–853; doi: 10.1136/jnnp-2020-325066

10.

Finnanger

, Olsen

, Skandsen

, et al. Life after adolescent and adult moderate and severe traumatic brain injury: self-reported executive, emotional, and behavioural function 2–5 years after injury. Behav Neurol, 2015; 2015:329241; doi: 10.1155/2015/329241

11.

McDonald

, Flashman

, Saykin

. Executive dysfunction following traumatic brain injury: neural substrates and treatment strategies. NeuroRehabilitation, 2002; 17(4):333–344.

12.

Krasny-Pacini

, Chevignard

, Lancien

, et al. Executive function after severe childhood traumatic brain injury–age-at-injury vulnerability periods: the TGE prospective longitudinal study. Ann Phys Rehabil Med, 2017; 60(2):74–82; doi: 10.1016/j.rehab.2016.06.001

13.

Gioia

, Kenworthy

, Isquith

. Executive function in the real world: BRIEF lessons from Mark Ylvisaker. J Head Trauma Rehabil, 2010; 25(6):433–439; doi: 10.1097/HTR.0b013e3181fbc272

14.

Ryan

, van Bijnen

, Catroppa

, et al. Longitudinal outcome and recovery of social problems after pediatric traumatic brain injury (TBI): contribution of brain insult and family environment. Int J Dev Neurosci, 2016; 49:23–30; doi: 10.1016/j.ijdevneu.2015.12.004

15.

Vander Linden

, Verhelst

, Genbrugge

, et al. Is diffuse axonal injury on susceptibility weighted imaging a biomarker for executive functioning in adolescents with traumatic brain injury?. Eur J Paediatr Neurol, 2019; 23(3):525–536; doi: 10.1016/j.ejpn.2019.04.003

16.

Bennett

TL.

Neuropsychological evaluation in rehabilitation planning and evaluation of functional skills. Arch Clin Neuropsychol, 2001; 16(3):237–253; doi: 10.1016/S0887-6177(00)00082-2

17.

Gaines

, Soper

. Neuropsychological assessment of executive functions following pediatric traumatic brain injury. Appl Neuropsychol Child, 2018; 7(1):31–43; doi: 10.1080/21622965.2016.1229406

18.

Isquith

, Roth

, Gioia

. Contribution of rating scales to the assessment of executive functions. Appl Neuropsychol Child, 2013; 2(2):125–132; doi: 10.1080/21622965.2013.748389

19.

Lace

, Merz

, Grant

, et al. Relationships between the BRIEF/BRIEF-SR and performance-based neuropsychological tests in adolescents with mild traumatic brain injury. J Pediatr Neuropsychol, 2019; 5(4):163–176.

20.

Peterson

, Welsh

. The Development of Hot and Cool Executive Functions in Childhood and adolescence: Are We Getting Warmer? In: Handbook of Executive Functioning. (Goldstein S, Naglieri JA. Eds.) Springer Science + Business Media: New York, NY; 2014; pp. 45–65.

21.

Gioia

, Isquith

, Guy

, et al. BRIEF-2: Behavior Rating Inventory of Executive Function. Psychological Assessment Resources: Lutz, FL; 2015.

22.

Joyner

, Silver

, Stavinoha

. Relationship between parenting stress and ratings of executive functioning in children with ADHD. J Psychoeduc Assess, 2009; 27(6):452–464; doi: 10.1177/0734282909333945

23.

Gioia

, Isquith

. Ecological assessment of executive function in traumatic brain injury. Dev Neuropsychol, 2004; 25(1–2):135–158; doi: 10.1080/87565641.2004.9651925

24.

National Institute of Neurological Disorders and Stroke (NINDS). Common Data Elements for Pediatric TBI research. Available from: https://www.commondataelements.ninds.nih.gov/Traumatic%20Brain%20Injury [Last accessed: July 9, 2022].

25.

Chevignard

, Kerrouche

, Krasny-Pacini

, et al. Ecological assessment of everyday executive functioning at home and at school following childhood traumatic brain injury using the BRIEF questionnaire. J Head Trauma Rehabil, 2017; 32(6):E1–E12; doi: 10.1097/HTR.0000000000000295

26.

Sesma

, Slomine

, Ding

, et al. Executive functioning in the first year after pediatric traumatic brain injury. Pediatrics, 2008; 121(6):e1686–e1695; doi: 10.1542/peds.2007-246

27.

Donders

, DenBraber

, Vos

. Construct and criterion validity of the Behaviour Rating Inventory of Executive Function (BRIEF) in children referred for neuropsychological assessment after paediatric traumatic brain injury. J Neuropsychol, 2010; 4(2):197–209; doi: 10.1348/174866409X47897

28.

Nyongesa

, Ssewanyana

, Mutua

, et al. Assessing executive function in adolescence: a scoping review of existing measures and their psychometric robustness. Front Psychol, 2019; 10:311; doi: 10.3389/fpsyg.2019.00311

29.

Keenan

, Clark

, Holubkov

, et al. Psychosocial and executive function recovery trajectories one year after pediatric traumatic brain injury: the influence of age and injury severity. J Neurotrauma, 2018; 35(2):286–296; doi: 10.1089/neu.2017.5265

30.

McCauley

, Wilde

, Anderson

, et al. Recommendations for the use of common outcome measures in pediatric traumatic brain injury research. J Neurotrauma, 2012; 29(4):678–705; doi: 10.1089/neu.2011.1838

31.

Brooks

, Kadoura

, Turley

, et al. Perception of recovery after pediatric mild traumatic brain injury is influenced by the “good old days” bias: tangible implications for clinical practice and outcomes research. Arch Clin Neuropsychol, 2014; 29(2):186–193; doi: 10.1093/arclin/act083

32.

Toplak

, West

, Stanovich

. Practitioner review: do performance-based measures and ratings of executive function assess the same construct?. J Child Psychol Psychiatry, 2013; 54(2):131–143; doi: 10.1111/jcpp.12001

33.

Ten Eycke

, Dewey

. Parent-report and performance-based measures of executive function assess different constructs. Child Neuropsychol, 2016; 22(8):889–906; doi: 10.1080/09297049.2015.1065961

34.

Semrud-Clikeman

, Romero

RAA

, Prado

, et al. Selecting measures for the neurodevelopmental assessment of children in low- and middle-income countries. Child Neuropsychol, 2017; 23(7):761–802; doi: 10.1080/09297049.2016.1216536

35.

Pino Muñoz

, Arán Filippetti

. Confirmatory factor analysis of the BRIEF-2 parent and teacher form: relationship to performance-based measures of executive functions and academic achievement. Appl Neuropsychol Child, 2021; 10(3):219–233; doi: 10.1080/21622965.2019.1660984

36.

Anderson

, Anderson

, Northam

, et al. Relationships between cognitive and behavioral measures of executive function in children with brain disease. Child Neuropsychol, 2002; 8(4):231–240; doi: 10.1076/chin.8.4.231.13509

37.

Anderson

Assessment and development of executive function (EF) during childhood. Child Neuropsychol, 2002; 8(2):71–82; doi: 10.1076/chin.8.2.71.8724

38.

Mangeot

, Armstrong

, Colvin

, et al. Long-term executive function deficits in children with traumatic brain injuries: assessment using the Behavior Rating Inventory of Executive Function (BRIEF). Child Neuropsychol, 2002; 8(4):271–284; doi: 10.1076/chin.8.4.271.13503

39.

Vriezen

, Pigott

. The relationship between parental report on the BRIEF and performance-based measures of executive function in children with moderate to severe traumatic brain injury. Child Neuropsychol, 2002; 8(4):296–303; doi: 10.1076/chin.8.4.296.13505

40.

Treble-Barna

, Zang

, Zhang

, et al. Long-term neuropsychological profiles and their role as mediators of adaptive functioning after traumatic brain injury in early childhood. J Neurotrauma, 2017; 34(2):353–362; doi: 10.1089/neu.2016.4476

41.

Beauchamp

, Catroppa

, Godfrey

, et al. Selective changes in executive functioning ten years after severe childhood traumatic brain injury. Dev Neuropsychol, 2011; 36(5):578–595; doi: 10.1080/87565641.2011.555572

42.

Gorman

, Barnes

, Swank

, et al. The effects of pediatric traumatic brain injury on verbal and visual-spatial working memory. J Int Neuropsychol Soc, 2012; 18(1):29–38; doi: 10.1017/S1355617711001251

43.

Hartman

, Williams

, Hall

, et al. Post-intensive-care syndrome for the pediatric neurologist. Pediatr Neurol, 2020;(108):47–53; doi: 10.1016/j.pediatrneurol.2020.02.003

44.

Lambregts

, Smetsers

, Verhoeven

, et al. Cognitive function and participation in children and youth with mild traumatic brain injury two years after injury. Brain Inj, 2018; 32(2):230–241; doi: 10.1080/02699052.2017.1406990

45.

Narad

, Treble-Barna

, Peugh

, et al. Recovery trajectories of executive functioning after pediatric TBI: a latent class growth modeling analysis. J Head Trauma Rehabil, 217; 32(2):98–106; doi: 10.1097/HTR.0000000000000247

46.

Kurowski

, Taylor

, Yeates

, et al. Caregiver ratings of long-term executive dysfunction and attention problems after early childhood traumatic brain injury: family functioning is important. PM R, 2011; 3(9):836–845; doi: 10.1016/j.pmrj.2011.05.016

47.

Hall

, Greene

, Lee

, et al. Post-intensive care syndrome in a cohort of school-aged children and adolescent ICU survivors: the importance of follow-up in the acute recovery phase. J Pediatr Intensive Care, 2022; doi: 10.1055/s-0042-1747935

48.

Hall

, Leonard

, Bradbury

, et al. Post-intensive care syndrome in a cohort of infants and young children receiving integrated care via a pediatric critical care and neurotrauma recovery program: a pilot investigation. Clin Neuropsychol, 2022; 36(3):639–663; doi: 10.1080/13854046.2020.1797176

49.

Reilly

, Simpson

, Sprod

, et al. Assessing the conscious level in infants and young children: a paediatric version of the Glasgow Coma Scale. Childs Nerv Syst, 1988; 4(1):30–33; doi: 10.1007/BF00274080

50.

Baker

, O'Neill

, Haddon

, et al. The Injury Severity Score: development and potential usefulness. J Trauma, 1974;(18):58–74; doi: 10.1097/00005373-197403000-00001

51.

Committee on Medical Aspects of Automotive Safety. Rating the severity of tissue damage. The Abbreviated Scale. JAMA, 1971:215(2):277–280; doi: 10.1001/jama.1971.03180150059012

52.

Hashmi

, Kaji

, Nathens

. Practical guide to surgical data sets: National Trauma Data Bank (NTDB). JAMA Surg, 2018; 153(9):852–853; doi: 10.1001/jamasurg.2018.0483

53.

Williams

, McEvoy

, Lim

, et al. Sleep and executive functioning in pediatric traumatic brain injury survivors after critical care. Children (Basel), 2022; 9(5):748; doi: 10.3390/children9050748

54.

Brown

, Gestring

, Leeper

, et al. The value of the injury severity score in pediatric trauma: time for a new definition of severe injury?. J Trauma Acute Care Surg, 2017; 82(6):995–1001; doi: 10.1097/TA.0000000000001440

55.

Lieh-Lai

, Theodorou

, Sarnaik

, et al. Limitations of the Glasgow Coma Scale in predicting outcome in children with traumatic brain injury. J Pediatr, 1992; 120(2):195–199; doi: 10.1016/s0022-3476(05)80426-3

56.

King

Jr , Carlier

, Marion

. Early Glasgow Outcome Scale scores predict long-term functional outcome in patients with severe traumatic brain injury. J Neurotrauma, 2005; 22(9):947–954; doi: 10.1089/neu.2005.22.947

57.

Bradbury

, Williams

, Leonard

, et al. Emotional aspects of pediatric post-intensive care syndrome following traumatic brain injury. J Child Adolesc Trauma, 2021; 14(2):177–187; doi: 10.1007/s40653-020-00332-y

58.

Wilkinson

, Robertson

Wide Range Achievement Test—Fourth Edition (WRAT-4). Psychological Corporation: San Antonio, TX; 2006.

59.

Wilkinson

, Robertson

Wide Range Achievement Test—Fifth Edition (WRAT-5). Psychological Corporation: San Antonio, TX; 2017.

60.

Franzen

, Burgess

, Smith-Seemiller

Methods of estimating premorbid functioning. Arch Clin Neuropsychol, 1997; 12(8):711–738.

61.

Gladsjo

, Heaton

, Palmer

, et al. Use of oral reading to estimate premorbid intellectual and neuropsychological functioning. J Int Neuropsychol Soc, 1999; 5(3):247–254; doi: 10.1017/s1355617799533079

62.

Cohen

Children's Memory Scale (CMS). Psychological Corporation: San Antonio, TX; 1999.

63.

Wechsler

Wechsler Adult Intelligence Scale—Fourth Edition (WAIS–IV). NCS Pearson: San Antonio, TX; 2008.

64.

Sherman

, Brooks

Child and Adolescent Memory Profile (ChAMP). Psychological Assessment Resources (PAR), Inc.: Lutz, FL; 2015.

65.

Delis

, Kaplan

, Kramer

. Delis-Kaplan Executive Function System: Technical Manual. Harcourt Assessment Company: San Antonio, TX; 2001.

66.

Wechsler

Wechsler Intelligence Scale for Children—Fifth Edition (WISC-V). Pearson: Bloomington, MN; 2014.

67.

Varni

, Seid

, Kurtin

. PedsQL™ 4.0: reliability and validity of the Pediatric Quality of Life Inventory™ Version 4.0 Generic Core Scales in healthy and patient populations. Med Care, 2001; 39(8):800–812; doi: 10.1097/00005650-200108000-00006

68.

Sherman

, Eisen

, Burwinkle

, et al. The PedsQL™ present functioning visual analogue scales: preliminary reliability and validity. Health Qual Life Outcomes, 2006; 4(1):75; doi: 10.1186/1477-7525-4-75

69.

IBM Corp. IBM SPSS Statistics for Windows, Version 27.0. IBM Corp: Armonk, NY; 2020.

70.

McCabe

, Roediger HL

III

, McDaniel

, et al. The relationship between working memory capacity and executive functioning: evidence for a common executive attention construct. Neuropsychology, 2010; 24(2):222–243; doi: 10.1037/a0017619

71.

Vanderlind

, Stanton

, Weinbrecht

, et al. Remembering the good ole days: fear of positive emotion relates to affect repair using positive memories. Cogn Ther Res, 2017; 41(3):362–368; doi: 10.1007/s10608-016-9775-z

72.

Segal

, Kennedy

, Gemar

, et al. Cognitive reactivity to sad mood provocation and the prediction of depressive relapse. Arch Gen Psychiatry, 2006; 63(7):749–755; doi: 10.1001/archpsyc.63.7.74

73.

Anderson

, Catroppa

, Haritou

, et al. Identifying factors contributing to child and family outcome 30 months after traumatic brain injury in children. J Neurol Neurosurg Psychiatry, 2005; 76(3):401–408; doi: 10.1136/jnnp.2003.019174

74.

Zelazo

, Carlson

. Hot and cool executive function in childhood and adolescence: development and plasticity. Child Dev Perspect, 2012; 6(4):354–360; doi: 10.1111/j.1750-8606.2012.00246.x

75.

Babikian

, Asarnow

. Neurocognitive outcomes and recovery after pediatric TBI: meta-analytic review of the literature. Neuropsychology, 2009; 23(3):283–296; doi: 10.1037/a001526

76.

Olsson

, Lloyd

, LeBrocque

, et al. Predictors of child post-concussion symptoms at 6 and 18 months following mild traumatic brain injury. Brain Inj, 2013; 27(2):145–157; doi: 10.3109/02699052.2012.729286

77.

Lundine

, Ciccia

, Koterba

, et al. Factors that influence follow-up care for families of children with acquired brain injury: a scoping review. Brain Inj, 2022; 36(4):469–478; doi: 10.1080/02699052.2022.2051741

78.

Chavez-Arana

, Catroppa

, Yáñez-Téllez

, et al. Parenting and the dysregulation profile predict executive functioning in children with acquired brain injury. Child Neuropsychol, 2019; 25(8):1125–1143; doi: 10.1080/09297049.2019.1589442

79.

Hawley

, Ward

, Magnay

, et al. Parental stress and burden following traumatic brain injury amongst children and adolescents. Brain Inj, 2003; 17(1):1–23; doi: 10.1080/0269905021000010096

80.

Fischer

, Bickart

, Giza

, et al. A review of family environment and neurobehavioral outcomes following pediatric traumatic brain injury: implications of early adverse experiences, family stress, and limbic development. Biol Psychiatry, 2022; 91(5):488–497; doi: 10.1016/j.biopsych.2021.08.012

81.

Keith Owen

, Taylor

. Neurobehavioural outcomes of mild head injury in children and adolescents. Pediatr Rehabil, 2005; 8(1):5–16; doi: 10.1080/13638490400011199

82.

Bennetts

, Mensah

, Westrupp

, et al. The agreement between parent-reported and directly measured child language and parenting behaviors. Front Psychol, 2016;(7):1710; doi: 10.3389/fpsyg.2016.01710

83.

Zapolski

, Smith

. Comparison of parent versus child-report of child impulsivity traits and prediction of outcome variables. J Psychopathol Behav Assess, 2013; 35(3):301–313; doi: 10.1007/s10862-013-9349-2

84.

Andrews

, Atkinson

, Harris

, et al. Examining the effects of household chaos on child executive functions: a meta-analysis. Psychol Bull, 2021; 147(1):16–32; doi: 10.1037/bul0000311

85.

Petranovich

, Smith-Paine

, Wade

, et al. From early childhood to adolescence: Lessons about traumatic brain injury (TBI) from the Ohio Head Injury Outcomes Study. J Head Trauma Rehabil, 2020; 35(3):226–239; doi: 10.1097/HTR.0000000000000555

86.

Williams

, Eriksson

, Kirby

, et al. Hospital mortality and functional outcomes in pediatric neurocritical care. Hosp Pediatr, 2019; 9(12):958–966; doi: 10.1542/hpeds.2019-0173

87.

Aitken

, McCarthy

, Slomine

, et al. Family burden after traumatic brain injury in children. Pediatrics, 2009; 123(1):199–206; doi: 10.1542/peds.2008-0607

88.

Barnes

, Dennis

, Wilkinson

. Reading after closed head injury in childhood: effects on accuracy, fluency, and comprehension. Dev Neuropsychol, 1999; 15(1):1–24; doi: 10.1080/87565649909540737

89.

Berger-Gross

, Shackelford

. Closed-head injury in children: neuropsychological and scholastic outcomes. Percept Motor Skills, 1985; 61(1):254–254E; doi: 10.2466/pms.1985.61.1.254

90.

Allen

, Leany

, Thaler

, et al. Memory and attention profiles in pediatric traumatic brain injury. Arch Clin Neuropsychol, 2010; 25(7):618–633; doi: 10.1093/arclin/acq051

91.

Arnett

, Peterson

, Kirkwood

, et al. Behavioral and cognitive predictors of educational outcomes in pediatric traumatic brain injury. J Int Neuropsychol Soc, 2013; 19(8):881–889; doi: 10.1017/S1355617713000635

92.

Anderson

, Catroppa

, Dudgeon

, et al. Understanding predictors of functional recovery and outcome 30 months following early childhood head injury. Neuropsychology, 2006; 20(1):42–57; doi: 10.1037/0894-4105.20.1.42

93.

Catroppa

, Godfrey

, Rosenfeld

, et al. Functional recovery ten years after pediatric traumatic brain injury: outcomes and predictors. J Neurotrauma, 2012; 29(16):2539–2547; doi: 10.1089/neu.2012.2403

94.

Doud

, Weaver

, Talton

, et al. Mortality risk in pediatric motor vehicle crash occupants: accounting for developmental stage and challenging Abbreviated Injury Scale metrics. Traffic Inj Prev, 2015; 16(Suppl 2):S201–S208; doi: 10.1080/15389588.2015.1048337

95.

Ganesalingam

, Sanson

, Anderson

, et al. Self-regulation as a mediator of the effects of childhood traumatic brain injury on social and behavioral functioning. J Int Neuropsychol Soc, 2007; 13(2):298–311; doi: 10.1017/S1355617707070324

96.

De Vries

, De Ruiter

, Oostrom

, et al. The association between the behavior rating inventory of executive functioning and cognitive testing in children diagnosed with a brain tumor. Child Neuropsychol, 2018; 24(6):844–858; doi: 10.1080/09297049.2017.1350262

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

0.00 MB

0.01 MB

0.02 MB