This study aims to identify and review tools used to evaluate consumer-oriented written medicine (WMI) and health (WHI) information from a document and user perspective. Articles that met the following inclusion criteria were reviewed: studies evaluating readability, presentation, suitability, quality of WMI/WHI. A total of 152 articles were identified, of which 64 satisfied the inclusion criteria. Fifty-nine original studies used evaluation tools and 5 reviewed a specific group of tools. Sixteen detailed the development or validation of an instrument. Fifteen studies evaluated WMI and 28 evaluated WHI. Twenty-three evaluation instruments were identified. Of the seven readability tests, SMOG was predominantly used (12 of 43 studies). Eight tools measured health literacy, with REALM being the most popular instrument (7 of 43). SAM was the most commonly used presentation tool (12 of 43 studies). Many tools are available to evaluate WMI and WHI. However, the majority are researcher focused. Most evaluate readability and presentation, revealing a gap in valid and reliable tools for assessing quality of information, and those that can be used by consumers.
ArnoldC. L.DavisT. C.FrempongJ. O.HumistonS. G.BocchiniA.KennenE. M.Lloyd-PuryearM. (2006). Assessment of newborn screening parent education materials. Pediatrics, 117(5 Pt. 2), S320-S325.
4.
ArozullahA. M.YarnoldP. R.BennettC. L.SoltysikR. C.WolfM. S.FerreiraR. M.. . . DavisT. (2007). Development and validation of a short-form, rapid estimate of adult literacy in medicine. Medical Care, 45, 1026-1033.
5.
AslaniP.BenrimojS. I.KrassI. (2007). Development and evaluation of a training program to foster the use of written drug information in community pharmacies. Part 2: Evaluation. Pharmacy Education, 7, 141-149.
6.
BakerD. W. (1999). Reading between the lines: Deciphering the connections between literacy and health [Comment]. Journal of General Internal Medicine, 14, 315-317.
7.
BakerD. W.WilliamsM. V.ParkerR. M.GazmararianJ. A.NurssJ. (1999). Development of a brief test to measure functional health literacy. Patient Education and Counseling, 38, 33-42.
8.
BakerS. J. (1997). Who can read consumer product information?Australian Journal of Hospital Pharmacy, 27, 126-131.
9.
BassP. F.3rdWilsonJ. F.GriffithC. H. (2003). A shortened instrument for literacy screening. Journal of General Internal Medicine, 18, 1036-1038.
10.
BentonM.SnowK.ParrV. (2004). Evaluation of the medicines information for consumers (MIC) program. Pyrmont, New South Wales, Australia: TNS.
11.
BowskillR.ClatworthyJ.ParhamR.RankT.HorneR. (2007). Patients’ perceptions of information received about medication prescribed for bipolar disorder: Implications for informed choice. Journal of Affective Disorders, 100(1-3), 253-257.
12.
BuchbinderR.HallS.GrantG.MylvaganamA.PatrickM. R. (2001). Readability and content of supplementary written drug information for patients used by Australian rheumatologists [see comment]. Medical Journal of Australia, 174(11), 575-578.
13.
BuckM. L. (1998). Providing patients with written medication information. Annals of Pharmacotherapy, 32, 962-969.
14.
CharnockD.ShepperdS.NeedhamG.GannR. (1999). DISCERN: An instrument for judging the quality of written consumer health information on treatment choices. Journal of Epidemiology and Community Health, 53, 105-111.
15.
Charvet-BerardA. I.ChopardP.PernegerT. V. (2008). Measuring quality of patient information documents with an expanded EQIP scale. Patient Education and Counseling, 70, 407-411.
16.
ChessonA. L.Jr.MurphyP. W.ArnoldC. L.DavisT. C. (1998). Presentation and reading level of sleep brochures: Are they appropriate for sleep disorders patients?Sleep, 21, 406-412.
17.
ChisolmD. J.BuchananL. (2007). Measuring adolescent functional health literacy: A pilot validation of the Test of Functional Health Literacy in Adults. Journal of Adolescent Health, 41, 312-314.
18.
ClementW. A.WalesY. (2004). Readability and content of postoperative tonsillectomy instructions given to patients in scotland. Clinical Otolaryngology, 29, 149-152.
19.
Communicating with patients who have limited literacy skills: Report of the national work group on literacy and health. Journal of Family Practice, 46, 168-176.
20.
DavisT. C.MichielutteR.AskovE. N.WilliamsM. V.WeissB. D. (1998). Practical assessment of adult literacy in health care. Health Education & Behavior, 25, 613-624.
21.
DavisT. C.WolfM. S.ArnoldC. L.ByrdR. S.LongS. W.SpringerT.. . . BocchiniJ. A. (2006). Development and validation of the rapid estimate of adolescent literacy in medicine (REALM-TEEN): A tool to screen adolescents for below-grade reading in health care settings. Pediatrics, 118, e1707-e1714.
22.
DavisT. C.MayeauxE. J.FredricksonD.BocchiniJ. A.Jr.JacksonR. H.MurphyP. W. (1994). Reading ability of parents compared with reading level of pediatric patient education materials. Pediatrics, 93, 460-468.
23.
DavisT. C.WolfM. S.BassP. F.3rdThompsonJ. A.TilsonH. H.NeubergerM.ParkerR. M. (2006). Literacy and misunderstanding prescription drug labels. Annals of Internal Medicine, 145, 887-894.
24.
DemirF.OzsakerE.IlceA. O. (2008). The quality and suitability of written educational materials for patients. Journal of Clinical Nursing, 17, 259-265.
25.
DickinsonD.RaynorD. K.DumanM. (2001). Patient information leaflets for medicines: Using consumer testing to determine the most effective design. Patient Education and Counseling, 43, 147-159.
26.
DoakC. C.DoakL. G.RootJ. (1996). Assessing suitability of materials. In BelcherM. (Ed.), Teaching patients with low literacy skills (2nd ed., pp. 41-60). Philadelphia, PA: JB Lippincott.
27.
DollahiteJ.ThompsonC.McNewR. (1996). Readability of printed sources of diet and health information. Patient Education and Counseling, 27, 123-134.
28.
DuBayW. H. (2004). The principles of readability, in Cloze Test. Costa Mesa, CA: Impact Information.
29.
EamesS.MckennaK.WorrallL.ReadS. (2003). The suitability of written education materials for stroke survivors and their carers. Topics in Stroke Rehabilitation, 10, 70-83.
30.
EsteyA.MusseauA.KeehnL. (1991). Comprehension levels of patients reading health information. Patient Education and Counseling, 18, 165-169.
31.
EstradaC. A.HryniewiczM. M.HiggsV. B.CollinsC.ByrdJ. C. (2000). Anticoagulant patient information material is written at high readability levels. Stroke, 31, 2966-2970.
32.
Food and Drugs Administration. (2006). Guidance useful written consumer medication information (CMI). Washington, DC: U.S. Department of Health and Human Services.
33.
FosterD. R.RhoneyD. H. (2002). Readability of printed patient information for epileptic patients. Annals of Pharmacotherapy, 36, 1856-1861.
34.
FredaM. C. (2005). The readability of American Academy of Pediatrics patient education brochures. Journal of Pediatric Health Care, 19, 151-156.
35.
FriedmanD. B.Hoffman-GoetzL. (2007). An exploratory study of older adults’ comprehension of printed cancer information: Is readability a key factor?. Journal of Health Communication, 12, 423-437. [Erratum appears in Journal of Health Communication, 12(7), 703 (2007).]
36.
FuchsJ.HippiusM. (2007). Inappropriate dosage instructions in package inserts. Patient Education and Counseling, 67, 157-168.
37.
GallowayG.MurphyP.ChessonA. L.MartinezK. (2003). MDA and AAEM informational brochures: Can patients read them?Journal of Neuroscience Nursing, 35, 171-174.
38.
GlanzK.RuddJ. (1990). Readability and content analysis of print cholesterol education materials. Patient Education and Counseling, 16, 109-118.
39.
GoodfellowG. W.TrachimowiczR.SteeleG. (2008). Patient literacy levels within an inner-city optometry clinic. Optometry, 79, 98-103.
40.
GrahamJ. D.KwokY. S. (1995). What consumers want to know about medicines. Australian Prescriber, 18, 10-11.
41.
HendricksonR. L.HuebnerC. E.RiedyC. A. (2006). Readability of pediatric health materials for preventive dental care. BMC Oral Health, 6(14), 1-9.
42.
HoffmannT.MckennaK. (2006). Analysis of stroke patients’ and carers’ reading ability and the content and design of written materials: Recommendations for improving written stroke information. Patient Education and Counseling, 60, 286-293.
43.
HorneR.HankinsM.JenkinsR. (2001). The satisfaction with information about medicines scale (SIMS): A new measurement tool for audit and research [see comment]. Quality in Health Care, 10, 135-140.
44.
KalichmanS.RamachandranB.CatzS. (1999). Adherence to combination antiretroviral therapies in HIV patients of low literacy. Journal of General Internal Medicine, 14, 267-273.
45.
KirkpatrickM. F.MohlerB. S. (1999). Using the readability assessment instrument to evaluate patient medication leaflets. Drug Information Journal, 33, 557-563.
46.
KondilisB.SoteriadesE. S.FalagasM. E. (2007). Readability levels of health pamphlets distributed during the Athens 2004 Olympic Games. Public Health, 121, 189-192.
47.
KooM. M. (2005). The use of written medicine information by consumers. Phd thesis, Faculty of Pharmacy, University of Sydney, New South Wales, Australia.
48.
KooM. M.KrassI.AslaniP. (2003). Factors influencing consumer use of written drug information. Annals of Pharmacotherapy, 37, 259-267.
49.
KooM. M.KrassI.AslaniP. (2005a). Consumer use of consumer medicine information. Journal of Pharmacy Practice and Research, 35, 94-98.
50.
KooM. M.KrassI.AslaniP. (2005b). Patient characteristics influencing evaluation of written medicine information: Lessons for patient education. Annals of Pharmacotherapy, 39, 1434-1440.
51.
KooM. M.KrassI.AslaniP. (2007). Evaluation of written medicine information: Validation of the consumer information rating form. Annals of Pharmacotherapy, 41, 951-956.
52.
KrassI.SvarstadB. L.BultmanD. (2002). Using alternative methodologies for evaluating patient medication leaflets. Patient Education and Counseling, 47, 29-35.
53.
LeeD. Y.ArmourC.KrassI. (2007). The development and evaluation of written medicines information for type 2 diabetes. Health Education Research, 23, 918-930.
54.
MccrayA. T.MccrayA. T. (2005). Promoting health literacy. Journal of the American Medical Informatics Association, 12, 152-163.
55.
MeadeC. D.SmithC. F. (1991). Readability formulas: Cautions and criteria. Patient Education and Counseling, 17, 153-158.
56.
MetlayJ.HennessyS.LocalioA. R.HanX.YangW.CohenA.. . . StromB. L. (2008). Patient reported receipt of medication instructions for warfarin is associated with reduced risk of serious bleeding events. Journal of General Internal Medicine, 23, 1589-1594.
57.
MonsivaisD.ReynoldsA. (2003). Developing and evaluating patient education materials. Journal of Continuing Education in Nursing, 34, 172-176.
58.
MoultB.FranckL. S.BradyH. (2004). Ensuring quality information for patients: Development and preliminary validation of a new instrument to improve the quality of written health care information. Health Expectations, 7, 165-175.
59.
MullanJ. R.CrookesP. A.YeatmanH. R. (2003). RAIN, SMOG, FOG and printed educational materials. Journal of Pharmacy Practice and Research, 33, 284-286.
60.
MurphyP. W.DavisT. C.DeckerB.ArnoldC.JacksonR. H. (1993). Rapid Estimate of Adult Literacy in Medicine (REALM): A quick reading test for patients. Journal of Reading, 37, 124-130.
61.
NathanJ. P.ZerilliT.CiceroL. A.RosenbergJ. M. (2007). Patients’ use and perception of medication information leaflets. Annals of Pharmacotherapy, 41, 777-782.
62.
NicolsonD. J.KnappP.RaynorD. K.GrimeJ.PollockK. (2006). Do themes in consumer medicines information literature reviews reflect those important to stakeholders?Patient Education and Counseling, 64, 112-118.
63.
OsbornC. Y.WeissB. D.DavisT. C.SkripkauskasS.RodrigueC.BassP. F.WolfM. S. (2007). Measuring adult literacy in health care: Performance of the newest vital sign. American Journal of Health Behavior, 31(Suppl. 1), s36-s46.
64.
Paasche-orlowM.ChengD.PalepuA.MeliS.FaberV.SametJ. H. (2006). Health literacy, antiretroviral adherence, and HIV-RNA supression: A longitudinal perspective. Journal of General Internal Medicine, 21, 835-840.
65.
ParkerR. M.BakerD. W.WilliamsM. V.NurssJ. R. (1995). The test of functional health literacy in adults: A new instrument for measuring patients’ literacy skills. Journal of General Internal Medicine, 10, 537-541.
66.
PettersonT. (1994). How readable are the hospital information leaflets available to elderly patients?Age and Ageing, 23, 14-16.
67.
PignoneM.DewaltD. (2006). Literacy and health outcomes. Is adherence the missing link?Journal of General Internal Medicine, 21, 896-897.
68.
RaynorD. K.BlenkinsoppA.KnappP.GrimeJ.NicolsonD. J.PollockK.. . . SpoorP. (2007). A systematic review of quantitative and qualitative research on the role and effectiveness of written information available to patients about individual medicines. Health Technology Assessment, 11(5), iii, 1-160.
69.
RaynorD. K.SavageI.KnappP. (2004). We are experts: People with asthma talk about their medicine information needs. Patient Education and Counseling, 53, 167-174.
70.
ReesC. E.FordJ.SheardC. E. (2002). Evaluating the reliability of DISCERN: A tool for assessig the quality of written patient information on treatment choices. Patient Education and Counseling, 47, 273-275.
71.
RobertsL. (2006). First impressions: An information leaflet for patients attending a musculoskeletal outpatient department. Physiotherapy, 92, 179-186.
72.
RollandP. D. (2000). Reading level of drug information printouts: A barrier to effective communication of patient medication information. Drug Information Journal, 34, 1329-1338.
73.
RoskosS. E.WallaceL. S.WeissB. D. (2008). Readability of consumer medication information for intranasal corticosteroid inhalers. American Journal of Health-System Pharmacists, 65, 65-68.
74.
SheaJ. A.GuerraC. E.RavenellK. L.McDonaldV. J.HenryC. A.AschD. A. (2007). Health literacy weakly but consistently predicts primary care patient dissatisfaction. International Journal for Quality in Health Care, 19, 45-49.
75.
ShiehC.HoseiB. (2008). Printed health information materials: Evaluation of readability and suitability. Journal of Community Health Nursing, 25, 73-90.
76.
SlessD.WisemanR. (1997). Writing about medicines for people—Usability guidelines for consumer medicine information. Canberra, Australia: Australian Government Publishing Service.
77.
SmithJ.ForsterA.HouseA.KnappP.WrightJ.YoungJ. (2008). Information provision for stroke patients and their caregivers. Cochrane Database of Systematic Reviews (2), CD001919.
78.
SmithP. T.CasonC. L. (1998). Suitability of patient education materials for cardiac catheterization. Clinical Nurse Specialist, 12, 140-144.
79.
SvarstadB. L.BultmanD. C.MountJ. K.TabakE. R. (2003). Evaluation of written prescription information provided in community pharmacies: A study in eight states. Journal of the American Pharmacists Association, 43, 383-393.
80.
SvarstadB. L.MountJ. K. (2001). Evaluation of written prescription information provided in community pharmacies. Madison: University of Wisconsin.
81.
The European Parliament and the Council of the European Union. (2004). Directive 2004/27/EC of the European Parliament and of the Council of 31 March 2004 Amending Directive 2001/83/EC on the community code relating to medicinal products for human use, Official Journal of the European Union: l136/ 134 - 157.
82.
TrifilettiL. B.ShieldsW. C.McDonaldE. M.WalkerA. R.GielenA. C. (2006). Development of injury prevention materials for people with low literacy skills. Patient Education and Counseling, 64, 119-127.
83.
VallanceJ. K.TaylorL. M.LavalleeC. (2008). Suitability and readability assessment of educational print resources related to physical activity: Implications and recommendations for practice. Patient Education and Counseling, 72, 342-349.
84.
WallaceL. S.KeenumA. J.RoskosS. E.BlakeG. H.ColwellS. T.WeissB. D. (2008). Suitability and readability of consumer medical information accompanying prescription medication samples. Patient Education and Counseling, 70, 420-425.
85.
WallaceL. S.RoskosS. E.WeissB. D. (2006). Readability characteristics of consumer medication information for asthma inhalation devices. Journal of Asthma, 43, 375-378.
86.
WeintraubD.MaliskiS. L.FinkA.ChoeS.LitwinM. S. (2004). Suitability of prostate cancer education materials: Applying a standardized assessment tool to currently available materials. Patient Education and Counseling, 55, 275-280.
87.
WeissB. D.MaysM. Z.MartzW.CastroK. M.DeWaltD. A.PignoneM. P.. . . HaleF. A. (2005). Quick assessment of literacy in primary care: The newest vital sign. Annals of Family Medicine, 3, 514-522.
88.
WilliamsD. M.CounselmanF. L.CaggianoC. D. (1996). Emergency department discharge instructions and patient literacy: A problem of disparity. American Journal of Emergency Medicine, 14, 19-22.
89.
WilsonF. L. (1999). The suitability of United States Pharmacopoeia Dispensory Information psychotropic drug leaflets for urban patients with limited reading skills. Archives of Psychiatric Nursing, 13, 204-211.
90.
WolfM. S.DavisT. C.ShrankW. H.NeubergerM.ParkerR. M. (2006). A critical review of FDA-approved Medication Guides. Patient Education and Counseling, 62, 316-322.
91.
WongI. C. (1999). Readability of patient information leaflets on antiepileptic drugs in the UK. Seizure, 8, 35-37.
92.
ZwaenepoelL.LaekemanG. (2003). Drug information in psychiatric hospitals in Flanders: A study of patient-oriented leaflets. Pharmaceutical World of Science, 25, 247-250.
