Characterizing Score Reliability for the South Oaks Gambling Screen

Abstract

Accurate measurement of problem gambling and subsequent interpretation of results require that assessment devices yield strong psychometric properties. In terms of consistent measurement, reliability estimates must be calculated with each administration, as changes in sample characteristics may alter the scale's ability to generate reliable scores. The purpose in the present study was to explore reliability reporting practices and variability in reliability estimates on a frequently used problem gambling detection measure, the South Oaks Gambling Screen. All empirical research employing the South Oaks Gambling Screen was retained for analysis. Of the 121 studies used in the present study, only 13 (10.7%) reported reliability for the data at hand. The remaining studies either induced reliability (42%) or did not cite reliability at all (46%). The median internal consistency estimate across 15 samples was .86, ranging from .69 to .97. Predictor variables did not demonstrate significant relationships with score reliability. Results from this study indicate wide variability in reliability coefficients across studies. Therefore, it is suggested that further psychometric analysis be conducted on the SOGS in order to yield more consistent and accurate measurement of problem gambling.

Keywords

coefficient alpha gambling screen internal consistency reliability SOGS South Oaks Gambling Screen

References

Barnes

L. L. B.

Harp

Jung

W. S.

(2002). Reliability generalization of scores on the Spielberger State-Trait Anxiety Inventory. Educational and Psychological Measurement, 62, 603–618.

Battersby

M. W.

(2002). The South Oaks Gambling Screen: A review with reference to Australian use. Journal of Gambling Studies, 18, 257–271.

Beretvas

S. N.

Meyers

J. L.

Leite

W. L.

(2002). A reliability generalization study of the Marlowe-Crown Social Desirability Scale. Educational & Psychological Measurement, 62, 570–589.

Biddle

Hawthrone

Forbes

Coman

(2005). Problem gambling in Australian PTSD treatment-seeking veterans. Journal of Traumatic Stress, 18, 759–767.

Capraro

R. M.

Capraro

M. M.

(2000). Myers-Briggs Type Indicator score reliability across studies: A meta-analytic reliability generalization study. Educational and Psychological Measurement, 62, 590–602.

Caruso

J. C.

Witkiewitz

Belcourt-Ditloff

Gottlieb

(2001). Reliability of scores from the Eysenck[MSOffice17] Personality Questionnaire: A reliability generalization study. Educational and Psychological Measurement, 61, 675–689.

Clarke

(2004). Impulsiveness, locus of control, motivation and problem gambling. Journal of Gambling Studies, 20, 319–345.

Crocker

Algina

(1986). Introduction to classical and modern test theory. Toronto: Holt, Rinehart & Winston.

Duvarci

Varan

Coskunol

Ersoy

M. A.

(1997). DSM-TV and the South Oaks Gambling Screen: Diagnosing and assessing pathological gambling in Turkey. Journal of Gambling Studies, 13, 193–207.

10.

Ellery

(2005). Alcohol's effects on video lottery terminal (VLT) play among probably pathological and non-pathological gamblers. Journal of Gambling Studies, 21, 299–324.

11.

Erickson

Molina

C. A.

Ladd

G. T.

Pietrzak

R. H.

Perry

N. M.

(2005). Problem and pathological gambling are associated with poorer mental and physical health in older adults. International Journal of Geriatric Psychiatry, 20, 754–759.

12.

Henderson

M. J.

(2004). Psychological correlates of co-morbid gambling in psychiatric outpatients: A pilot study. Substance Use & Misuse, 39, 1341–1352.

13.

Henson

R. K.

(2001). Understanding internal consistency reliability estimates: A conceptual primer for coefficient alpha. Measurement and Evaluation in Counseling and Development, 34, 177–189.

14.

Henson

R. K.

Thompson

(2002). Characterizing measurement error in scores across studies: Some recommendations for conducting “reliability generalization” studies. Measurement and Evaluation in Counseling and Development, 35, 113–127.

15.

Hodgins

D. C.

(2004). Using the NORC DSM Screen for gambling problems as an outcome measure for pathological gambling: Psychometric evaluation. Addictive Behaviors, 29, 1685–1690.

16.

Jarvis

C. B.

MacDenzie

S. B.

Podsakoff

P. M.

(2003). A critical review of construct indicators and measurement model misspecification in marketing and consumer research. Journal of Consumer Research, 30, 199–218.

17.

Kweitel

(1998). Cognitive progress associated with gambling behaviour. Psychological Reports, 82, 147–153.

18.

Lesieur

H. R.

Blume

S. B.

(1987). The South Oaks Gambling Screen (SOGS): A new instrument for the identification of pathological gamblers. American Journal of Psychiatry, 144, 1184–1188.

19.

Meier

S. T.

Davis

S. R.

(1990). Trends in reporting psychometric properties of scales used in counseling psychology research. Journal of Counseling Psychology, 37, 113–115.

20.

Morasco

B. J.

von Eigen

K. A.

Perry

N. M.

(2006). Severity of gambling is associated with physical and emotional health in urban primary care patients. General Hospital Psychiatry, 28, 94–100.

21.

Oliveira

M. P. M. T.

Silva

M. T. A.

de Silveira

D. X.

(2002). Validity study of the South Oaks Gambling Screen (SOGS) among distinct groups of Brazilian gamblers. Revista Brasileira de Psiquiatria, 24, 170–176.

22.

Parker

J. D.

(2005). Alexithymia in young adulthood: A risk factor for pathological gambling. Psychotherapy and Psychosomatics, 74, 51–55.

23.

Pedhazur

E. J.

Schmelkin

L. P.

(1991). Measurement, design, and analysis: An integrated approach. Hillsdale, NJ: Lawrence Erlbaum.

24.

Petry

N. M.

Armentano

Kuoch

Norinth

Smith

(2003). Gambling participation and problems among South East Asian refugees to the United States. Psychiatric Services, 54, 1142–1148.

25.

Platz

Millar

(2001). Gambling in the context of other recreation activity: A quantitative comparison of casual and pathological student gamblers. Journal of Leisure Research, 33, 383–395.

26.

Rockey

D. L.

Jr. Beason

K. R.

Howington

E. B.

(2005). Gambling by Greek-affiliated college students: An association between affiliation and gambling. Journal of College Student Development, 46, 75–87.

27.

Rodda

Brown

S. L.

Phillips

J. G.

(2004). The relationship between anxiety, smoking, and gambling in electronic gaming machine players. Journal of Gambling Studies, 20, 71–81.

28.

Ross

M. E.

Blackburn

Forbes

(2005). Reliability generalization of the Patterns of Adaptive Learning Survey Goal Orientation Scales. Educational and Psychological Measurement, 65, 451–464.

29.

Schmidt

F. L.

Hunter

J. E.

(1977). Development of a general solution to the problem of validity generalization. Journal of Applied Psychology, 62, 529–540.

30.

Sellman

J. D.

Adamson

Robertson

Sullivan

Coverdale

(2002). Gambling in mild-moderate alcohol-dependent outpatients. Substance Use & Misuse, 37, 199–213.

31.

Shaffer

H. J.

Hall

M. N.

(2002). The natural history of gambling and drinking problems among casino employees. Journal of Social Psychology, 142, 405–424.

32.

Shields

A. L.

Caruso

J. C.

(2004). A reliability induction and reliability generalization study of the CAGE Questionnaire. Educational and Psychological Measurement, 64, 254–270.

33.

Skitch

S. A.

Hodgins

D. C.

(2005). A passion for the game: Problem gambling and passion among university students. Canadian Journal of Psychiatry, 37, 193–197.

34.

Stinchfield

(2002). Reliability, validity, and classification accuracy of the South Oaks Gambling Screen (SOGS). Addictive Behaviors, 27, 1–19.

35.

Strong

D. R.

Lesieur

H. R.

Breen

R. B.

Stinchfield

Lejuez

C. W.

(2004). Using a Rasch model to examine the utility of the South Oaks Gambling Screen across clinical and community samples. Addictive Behaviors, 29, 465–481.

36.

Symes

B. A.

(1997). A preliminary consideration of cue-exposure, response-prevention treatment for pathological gambling behaviour: Two case studies. Journal of Gambling Studies, 13, 145–157.

37.

Thompson

(1994). Guidelines for authors. Educational and Psychological Measurement, 54, 837–847.

38.

Thompson

Vacha-Haase

(2000). Psychometrics is datametrics: The test is not reliable. Educational and Psychological Measurement, 60, 174–195.

39.

Vacha-Haase

(1998). Reliability Generalization: Exploring variance in measurement error affecting score reliability across studies. Educational & Psychological Measurement, 58, 6–20.

40.

Vacha-Haase

Henson

R. K.

Caruso

J. C.

(2002). Reliability generalization: Moving toward improved understanding and use of score reliability. Educational & Psychological Measurement, 62, 562–569.

41.

Vacha-Haase

Kogan

Thompson

(2000). Sample compositions and variabilities in published studies versus those in test manuals: Validity of score reliability inductions. Educational and Psychological Measurement, 61, 45–59.

42.

Willson

V. L.

(1980). Research techniques in AERJ articles: 1969 to 1978. Educational Research, 9, 5–10.

43.

Wulfert

Hartley

Lee

Wang

Franco

Sodano

(2005). Gambling screens: Does shortening the time frame affect their psychometric properties? Journal of Gambling Studies, 21, 521–536.

44.

Yin

Fan

(2000). Assessing the reliability of Beck Depression Inventory scores: Reliability generalization across studies. Educational & Psychological Measurement, 60, 201–223.