It is common for individuals with a neurological impairment, such as a stroke, to present with cognitive-perceptual impairments. The early identification of such problems can assist with rehabilitation efforts. Standardised cognitive and perception tests are often used by practitioners to make such identifications; therefore, it is important to examine the measurement properties of these tests.
Objective:
This study investigated the convergent validity of the Occupational Therapy Adult Perceptual Screening Test (OT-APST) with two other cognitive-perceptual tests: the Neurobehavioural Cognitive Status Examination (Cognistat) and the Developmental Test of Visual Perception — Adolescent and Adult (DTVP-A). The Cognistat is primarily a test of cognition but has some subscales that evaluate perceptual skills. The convergent validity between the Cognistat and the DTVP-A was also investigated. It is imperative that tests used by therapists have documented validity to ensure that the results obtained actually measure the skills and abilities that the tests claim they measure.
Method:
Thirty-two adult patients, ranging in age between 46 and 91 years (mean = 73, SD = 4.6) with a primary diagnosis of stroke, completed the OT-APST, the Cognistat and the DTVP-A. Spearman's rho was used to analyse the correlations between the tests' subscales.
Results:
Three of the Cognistat subscales were significantly correlated with OT-APST subscales: Cognistat Constructional Ability and OT-APST Body Scheme; Cognistat Memory and OT-APST Functional Skills; and Cognistat Calculations and OT-APST Body Scheme. Only one of the OT-APST subscales, Body Scheme, had statistically significant correlations with the DTVP-A's Figure-Ground, Visual-Motor Search and Visual Closure subscales. There were significant correlations between the Cognistat's Constructional Ability and Judgment subscales and five of the six DTVP-A's subscales.
Conclusion:
Given that only a few of the subscales from the Cognistat and DTVP-A were significantly correlated with those of the OT-APST, this indicates that many of the constructs assessed by the three tests are not associated; hence, limited convergent validity evidence for the OT-APST was present. Further inquiry is required because it is important that such instruments are assessing what they purport to test, particularly when they are used to determine clients' strengths and weaknesses in clinical practice.
AdamsonJBeswickAEbrahimS (2004) Is stroke the most common cause of disability?Journal of Stroke and Cerebrovascular Diseases, 13(4), 171–77.
2.
American Educational Research Association, American Psychological Association, and National Council on Measurement in Education (1999) Standards for educational and psychological testing. Washington, DC: American Psychological Association.
BjørnebyERReinvangIR (1985) Acquiring and maintaining self-care skills after stroke. Scandinavian Journal of Rehabilitation Medicine, 17(2), 75–80.
5.
BlakeHMcKinneyMTreeceKLeeELincolnNB (2002) An evaluation of screening measures for cognitive impairment after stroke. Age and Ageing, 31(6), 451–56.
6.
British Heart Foundation and the Stroke Association (2009) Stroke Statistics 2009. London: British Heart Foundation and the Stroke Association.
7.
BrownT (2010) Construct validity: A unitary concept for occupational therapy assessment, evaluation, and measurement. Hong Kong Journal of Occupational Therapy, 20(1), 30–42.
8.
BrownT (2011) Construct validity of the three motor-reduced subscales of the Developmental Test of Visual Perception — Adolescent and Adult (DTVP-A): A Rasch analysis model evaluation. British Journal of Occupational Therapy, 74(2), 66–77.
9.
BrownTMullinsEStagnittiK (2008) The reliability of performance of healthy adults on three visual perception tests. British Journal of Occupational Therapy, 71(10), 438–47.
10.
CiceroneKDahlbergCMalecJLangenbahnDFelicettiTKneippSEllmoWKalmarKGiacinoJTHarleyJPLaatschLMorsePACataneseJ (2005) Evidence-based cognitive rehabilitation: Updated review of the literature from 1998 through 2002. Archives of Physical Medicine and Rehabilitation, 86(8), 1681–92.
11.
CookeDM (2005) Occupational Therapy Adult Perceptual Screening Test (OT-APST) administration manual. Brisbane: Function for Life Pty Ltd.
12.
CookeDMMcKennaKFlemingJ (2005a) Development of a standardized occupational therapy screening tool for visual perception in adults. Scandinavian Journal of Occupational Therapy, 12(2), 59–71.
13.
CookeDMMcKennaKFlemingJDarnellR (2005b) The reliability of the Occupational Therapy Adult Perceptual Screening Test (OT-APST). British Journal of Occupational Therapy, 68(11), 509–17.
14.
CookeDMMcKennaKFlemingJDarnellR (2006a) Criterion validity of the Occupational Therapy Adult Perceptual Screening Test. Scandinavian Journal of Occupational Therapy, 13(1), 38–44.
15.
CookeDMMcKennaKFlemingJDarnellR (2006b) Construct validity and ecological validity of the Occupational Therapy Adult Perceptual Screening Test (OT-APST). Scandinavian Journal of Occupational Therapy, 13(1),49–61.
16.
DelisDCKramerJHKaplanEOberBA (2000) California Verbal Learning Test: Second edition. San Antonio, TX: Psychological Corporation.
17.
DesmondDWMoroneyJTSanoMSternY (1996) Recovery of cognitive function after stroke. Stroke, 27(10), 1798–803.
18.
DouglasALiuLWarrenSHopperT (2007) Cognitive assessments for older adults: Which ones are being used by Canadian therapists and why?Canadian Journal of Occupational Therapy, 74(5), 370–80.
19.
EdwardsDFHahnMGBaumCMPerlmutterMSSheedyCDromerickAW (2006) Screening patients with stroke for rehabilitation needs: Validation of the post-stroke rehabilitation guidelines. Neurorehabilitation and Neural Repair, 20(1), 42–48.
20.
EkstamLUppgardBvon KochLThamK (2007) Functioning in everyday life after stroke: A longitudinal study of elderly people receiving rehabilitation at home. Scandinavian Journal of Caring Sciences, 21(4), 434–46.
21.
FolsteinMFFolsteinSEMcHughPR (1975) ‘Mini-Mental State’: A practical method for grading the cognitive state of patients for the clinician. Journal of Psychiatric Research, 12(3), 189–98.
22.
FongKNKChanCCHAuDKS (2001) Relationship of motor and cognitive abilities to functional performance in stroke rehabilitation. Brain Injury, 15(5), 443–53.
23.
GrieveJGnanasekaranL (2008) Neuropsychology for occupational therapists: Cognition in occupational performance. 3rd ed. Oxford: Blackwell Publishing.
24.
HinkleJ (2002) A descriptive study of cognitive status in acute motor stroke. Journal of Neuroscience Nursing, 34(4), 191–97.
IshiharaKIshiharaSNagamachiMOsakiHHiramatsuS (2004) Independence of older adults in performing instrumental activities of daily living (IADLs) and the relation of this performance to visual abilities. Theoretical Issues in Ergonomics Science, 5(3), 198–213.
JefferyDRGoodDC (1995) Rehabilitation of the stroke patient. Current Opinion in Neurology, 8(1), 62–68.
29.
KatzNHartman-MaeirARingHSorokerN (2000) Relationships of cognitive performance and daily function of clients following right hemisphere stroke: Predictive and ecological validity of the LOTCA battery. Occupational Therapy Journal of Research, 20(1), 3–17.
30.
KerteszA (1982) The Western Aphasia Battery. New York: Grune and Stratton.
31.
KielhofnerG (2006) Research in occupational therapy: Methods of inquiry for enhancing practice. Philadelphia: FA Davis.
32.
KiernanRJMuellerJLangstonJW (1987) Neurobehavioral Cognitive Status Exam (Cognistat). Fairfax, CA: NCNG Inc.
33.
LincolnNBDrummondABermanP (1997) Perceptual impairment and its impact on rehabilitation outcome. Disability and Rehabilitation, 19(6), 213–34.
34.
ManDWTamSFHui-ChanC (2006) Prediction of functional rehabilitation outcomes in clients with stroke. Brain Injury, 20(2), 205–11.
35.
MarcotteTDvan GorpWHinkinCOsatoS (1997) Concurrent validity of the Neurobehavioral Cognitive Status Exam subtests. Journal of Clinical and Experimental Neuropsychology, 19(3), 386–95.
36.
MercierLATAudetTHebertRRochetteADuboisM (2001) Impact of motor, cognitive, and perceptual disorders on abilities to performance activities daily after stroke. Stroke, 32(11), 2602–08.
37.
MessickS (1989) Validity. In: LinnR, ed. Educational measurement. New York: American CouncilonEducation and Macmillan Publishing Company, 13–104.
38.
MessickS (1995) Validity of psychological assessment: Validation of inferences from persons' responses and performances as scientific inquiry into score meaning. American Psychologist, 50(9), 741–49.
39.
MeyersJEMeyersKR (1995) Rey Complex Figure Test and Recognition Trial. Odessa, FL: Psychological Assessment Resources.
40.
MitrushinaMAbaraJBlumenfeldA (1994) Aspects of validity and reliability of the Neurobehavioral Cognitive Status Examination (NCSE) inassessment of psychiatric patients. Journal of Psychiatric Research, 28(1), 85–95.
41.
MuellerJKiernanRLangstonW (2001) Manual for Cognistat (The Neurobehavioral Cognitive Status Examination). Fairfax, CA: Northern California Neurobehavioral Group.
42.
MysiwWJBeeganJGGatensPF (1999) Prospective cognitive assessment of stroke patients before inpatient rehabilitation. The relationship of the Neurocognitive Status Examination to Functional Improvement. American Journal of the Physical Medicine Rehabilitation, 68(4), 168–71.
43.
NøklebyKBolandEBergersenHSchankeA-KFarnerLWagleJWylleTB (2008) Screening for cognitive deficits after stroke: A comparison of three screening tools. Clinical Rehabilitation, 22(12), 1095–104.
44.
NysGMSvan ZandvoortJEdeKortPLMvan der WorpHBJansenBPWAlgraAde HaanHFKappelleLJ (2005) The prognostic value of domain-specific cognitive abilities in acute first-ever stroke. Neurology, 64(5), 821–27.
45.
PaolucciSAntonucciGGialloretiIETraballesiMLubichSPratesiIPalmobiI (1996) Predicting stroke inpatient rehabilitation outcome: The prominent role of neuropsychological disorders. European Neurology, 36(6), 385–90.
46.
PedersenPJorgensenHNakayamaHRaaschouHOlsenT (1996) Orientation in the acute and chronic stroke patient: Impact on ADL and social activities. The Copenhagen stroke study. Archives of Physical Medicine Rehabilitation, 77(4), 336–39.
47.
PortneyLGWatkinsMP (2009) Foundations of clinical research: Applications to practice. 3rd ed. Upper Saddle River, NJ: Pearson Education.
48.
RoperBLBieliauskasLAPetersonMR (1996) Validity of the Mini-Mental State Examination and the Neurobehavioral Cognitive Status Examination in cognitive screening. Neuropsychiatry, Neuropsychology, and Behavioral Neurology, 9(1), 54–57.
ReynoldsCRHickmanJ (2004) Draw a Person: IQ. Austin, TX: PRO-ED.
51.
ReynoldsCRPearsonNAVoressJK (2002) Developmental Test of Visual Perception: Adolescent and Adult. Austin, TX: PRO-ED.
52.
SchwammLHVan DykeCKiernanRMerrinEMuellerJ (1987) The Neurobehavioral Cognitive Status Examination: Comparison with the Cognitive Capacity Screening Examination and the Mini-Mental State Examination in a neurosurgical population. Annals of Internal Medicine, 107(4), 486–91.
53.
ShulmanKIGoldDPCohenCAZuccheroCA (1993) Clock drawing and dementia in the community: A longitudinal study. International Journal of Geriatric Psychiatry, 8(6), 487–96.
54.
SødringKMLaakeKSveenUWyllerTBBautz-HolterE (1998) Validation of the screening instrument for neuropsychological impairment in stroke. Physiotherapy Research International, 3(1), 15–26.
55.
SrikanthVKAndersonJFIDonnanGASalingMMDidusEAlpitsisRDeweyHMMacDonellRAThriftAG (2004) Progressive dementia after first-ever stroke: A community-based follow up study. Neurology, 63(5), 785–92.
56.
SteinMSMaskillDMarstonL (2009) Impact of visual-spatial neglect on stroke functional outcomes, discharge destination and maintenance of improvement post-discharge. British Journal of Occupational Therapy, 72(5), 219–25.
57.
StreinerDLNormanGR (1989) Health measurement scales: A practical guide to their development and use. 2nd ed. Oxford: Oxford University Press.
58.
TatemichiTKDesmondDWSternYPaikMSanoMBagiellaE (1994) Cognitive impairment after stroke: Frequency, patterns, and relationship to functional abilities. Journal of Neurology, Neurosurgery and Psychiatry, 57(2), 202–07.
59.
TitusMNGallMGYerxaEJRobersonTAMackW (1991) Correlation of perceptual performance and activities of daily living in stroke patients. American Journal of Occupational Therapy, 45(5), 410–18.
60.
TromblyCMaH (2002) A synthesis of the effects of occupational therapy for persons with stroke, part 1: Restoration of roles, tasks and activities. American Journal of Occupational Therapy, 56(3), 250–59.
61.
WadeDParkerVHewerLangton R (1986) Memory disturbance after stroke: Frequency and associated losses. International Rehabilitation Medicine, 8(2), 60–64.
