Cross-cultural Adaptation and Psychometric Testing of the Malay Version of Patient Education Materials Assessment Tool

Main Article Content

Wan Nor Arifin
Norkhafizah Saddki
Siong Ting Wong

Abstract

Introduction: The Patient Education Materials Assessment Tool (PEMAT) evaluates the understandability and actionability of patient education materials. There are PEMAT-P and PEMAT-A/V for printable and audio-visual materials respectively. This study cross-culturally adapted these versions of PEMAT into Malay and determine their psychometric properties. Materials and methods: The study proceeded in four stages: 1) translation and cross-cultural adaptation of PEMAT-P(M) and PEMAT-A/V(M) (four translators, five healthcare workers [HCWs]), followed by cross-sectional studies to 2) determine the internal consistency, inter-rater and test-retest reliabilities (nine HCWs), 3) determine the validity by correlation with the Suitability Assessment of Materials (SAM) (20 HCWs) and 4) determine the validity by correlation with the Consumer Testing Questionnaire (16 adult patients). These stages involved HCWs from different healthcare disciplines. Results: Cross-culturally adapted PEMAT-P(M) and PEMAT-A/V(M) were produced. The median Cronbach’s alpha for understandability and actionability domains ranged between 0.78 and 0.90. The domain-level inter-rater reliability showed ICCs ranging from 0.72 to 0.81, and test-retest reliability showed ICCs ranging from 0.82 to 0.90. The item-level inter-rater and test-retest reliability showed Gwet’s AC1 values above 0.60 for most items. Significant positive correlations were found between all PEMAT-P(M) and PEMAT-A/V(M) scores with the SAM score. Most domain scores were significantly correlated with the consumer testing comprehension score, while only one domain score was significantly correlated with consumer testing numerical score. Conclusion: The cross-culturally adapted PEMAT-P(M) and PEMAT-A/V(M) were found to be valid and reliable. PEMAT(M) can be used by raters from diverse backgrounds to evaluate printable and audiovisual patient education materials.

Downloads

Download data is not yet available.

Article Details

How to Cite
Wan Nor Arifin, Norkhafizah Saddki, & Siong Ting Wong. (2026). Cross-cultural Adaptation and Psychometric Testing of the Malay Version of Patient Education Materials Assessment Tool. Malaysian Journal of Medicine and Health Sciences, 22(3), 1592. https://doi.org/10.47836/mjmhs.v22i3.1592
Section
Original Articles

References

Giguère A, Zomahoun HTV, Carmichael PH, Uwizeye CB, Légaré F, Grimshaw JM, et al. Printed educational materials: effects on professional practice and healthcare outcomes. Cochrane Database Syst Rev. 2020;8(8):CD004398. doi: 004310.001002/14651858.CD14004398.pub14651854.

Nutbeam D. Health literacy as a public health goal: a challenge for contemporary health education and communication strategies into the 21st century. Health Promot Int. 2000;15(3):259-267.

Pothier L, Day R, Harris C, Pothier DD. Readability statistics of patient information leaflets in a Speech and Language Therapy Department. Int J Lang Commun Disord. 2008;43(6):712-22.

Doak CC, Doak LG, Root JH. Teaching patients with low literacy skills. 2nd ed. Philadelphia: J.B. Lippincott; 1996.

Charnock D, Shepperd S, Needham G, Gann R. DISCERN: an instrument for judging the quality of written consumer health information on treatment choices. J Epidemiol Community Health. 1999;53(2):105-11.

Moody C, Rose M. Literacy and Health: Defining Links and Developing Partnerships. A Final Report to Population Health. Literacy Partners of Manitoba; 2004.

Northwest Territories Literacy Council. A Plain Language Audit Tool [Internet]. 2008. Available from: [https://www.ece.gov.nt.ca/files/T4.05.01_Plain%20Language%20Audit%20Tool.pdf](https://www.ece.gov.nt.ca/files/T4.05.01_Plain%20Language%20Audit%20Tool.pdf)

Clayton LH. TEMPtEd: development and psychometric properties of a tool to evaluate material used in patient education. J Adv Nurs. 2009;65(10):2229-38.

Kaphingst KA, Kreuter MW, Casey C, Leme L, Thompson T, Cheng MR, et al. Health Literacy INDEX: development, reliability, and validity of a new tool for evaluating the health literacy demands of health information materials. J Health Commun. 2012;17(sup3):203-21.

Shoemaker S, Wolf M, Brach C. The Patient Education Materials Assessment Tool (PEMAT) and User's Guide. Rockville, MD: Agency for Healthcare Research and Quality; 2013.

Shoemaker SJ, Wolf MS, Brach C. Development of the Patient Education Materials Assessment Tool (PEMAT): a new measure of understandability and actionability for print and audiovisual patient information. Patient Educ Couns. 2014;96(3):395-403. doi: 310.1016/j.pec.2014.1005.1027.

Kang SJ, Lee MS. Assessing of the audiovisual patient educational materials on diabetes care with PEMAT. Public Health Nurs. 2019;36(3):379-387. doi: 310.1111/phn.12577.

Furukawa E, Okuhara T, Okada H, Shirabe R, Yokota R, Iye R, Kiuchi T. Translation, cross-cultural adaptation, and validation of the Japanese version of the patient education materials assessment tool (PEMAT). Int J Environ Res Public Health. 2022;19(23):15763. doi: 10.3390/ijerph192315763.

Akkoç CP, Orgun F. Psychometric testing of the Turkish version of the patient education materials assessment tool. Florence Nightingale J Nurs. 2023;31(3):180. doi: 10.5152/FNJN.2023.22196.

Shan Y, Ji M, Dong Z, Xing Z, Wang D, Cao X. The Chinese version of the patient education materials assessment tool for printable materials: Translation, adaptation, and validation study. J Med Internet Res. 2023;25:e39808.

AERA, APA, NCME. The standards for educational and psychological testing. Washington DC: American Educational Research Association; 2014.

Cook DA, Beckman TJ. Current concepts in validity and reliability for psychometric instruments: theory and application. Am J Med 2006;119:166e7–166e16.

Beaton DE, Bombardier C, Guillemin F, Ferraz MB. Guidelines for the Process of Cross-Cultural Adaptation of Self-Report Measures. Spine. 2000;25(24):3186-3191.

Arifin WN. Sample Size Calculator (Version 2) [Spreadsheet file]. Available from: http://wnarifin.github.io [Accessed 20th January 2017] 2017.

Nunnally JC. Psychometric Theory. New York: McGraw-Hill 1967.

Bland JM, Altman DG. Statistics Notes: Cronbach's alpha. BMJ. 1997;314(7080):572.

Walter S, Eliasziw M, Donner A. Sample Size and Optimal Designs for Reliability Studies. Stat Med. 1998;17(1):101-110.

Cicchetti DV. Guidelines, criteria, and rules of thumb for evaluating normed and standardized assessment instruments in psychology. Psychol Assess. 1994;6(4):284-289.

Arifin WN. Calculating the Cronbach’s alpha coefficients for measurement scales with “not applicable” option. Preprint. 2018. doi: 10.13140/RG.2.2.16955.87843.

Anselmi P, Colledani D, Robusto E. A Comparison of Classical and Modern Measures of Internal Consistency. Front Psychol. 2019;10. doi: 10.3389/fpsyg.2019.02714.

Koo TK, Li MY. A guideline of selecting and reporting intraclass correlation coefficients for reliability research. J Chiropr Med. 2016;15(2):155-163. doi: 110.1016/j.jcm.2016.1002.1012.

Cicchetti DV. Guidelines, criteria, and rules of thumb for evaluating normed and standardized assessment instruments in psychology. Psychol Assess. 1994;6(4):284-290. doi: 210.1037/1040-3590.1036.1034.1284.

Gwet KL. Computing inter-rater reliability and its variance in the presence of high agreement. Br J Math Stat Psychol. 2008;61(1), 29-48.

Gwet KL. R functions for calculating agreement coefficients [Online]. Available from: http://agreestat.com/r_functions.html [Accessed 25th March 2018] 2010.

Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977;33(1):159-174.

Morony S, McCaffery KJ, Kirkendall S, Jansen J, Webster AC. Health Literacy Demand of Printed Lifestyle Patient Information Materials Aimed at People With Chronic Kidney Disease: Are Materials Easy to Understand and Act On and Do They Use Meaningful Visual Aids? J Health Commun. 2017;22(2):163-170.

Munro BH. Statistical Methods for Health Care Research. 5th ed. Philadelphia: Lippincott Williams & Wilkins; 2005.

Vishnevetsky J, Walters CB, Tan KS. Interrater reliability of the Patient Education Materials Assessment Tool (PEMAT). Patient Educ Couns. 2018;101(3):490-496. doi: 410.1016/j.pec.2017.1009.1003.

DeVellis RF. Scale Development: Theory and Applications. 3rd ed. Thousand Oaks: CA: Sage Publications; 2012.

Avis JL, Komarnicki A, Farmer AP, Holt NL, Perez A, Spence N, et al. Tools and resources for preventing childhood obesity in primary care: A method of evaluation and preliminary assessment. Patient Educ Couns. 2016;99(5):769-775. doi: 710.1016/j.pec.2015.1012.1006.