A Validation Study: Evaluating the Impact of Gameful Experience on Sexual and Reproductive Health Education amongst Adolescent Boys
Main Article Content
Abstract
Introduction: Gamification-based learning (GBL) approach has the potential to enhance teaching and learning about reproductive and sexual health education (ReReki). There were six games (Let’s X-plore, The Red Zone, Message Card for You, Box & Portal, This & That, and MonoReReki) created in ReReki module with the element of gamification (e.g.: milestones, rules, guides, points, competition). This study aimed to assess the gameful experience (G-EXP) of ReReki among adolescent boys in Sarawak’s Southern region, specifically Kota Samarahan and Serian. Materials and methods: The questionnaire was subjected to a validation process that included content and face validity (n = 5), exploratory factor analysis (EFA, n = 175), confirmatory factor analysis (CFA, n = 165), and internal reliability. Boys between the ages of 13 and 17 who attend schools in Kota Samarahan and Serian participated in this study. This study used the original 65-items by Hogberg GAMEFULQUEST, which is divided into seven domains (accomplishment, challenge, competition, guided, immersion, playfulness, and social experience). Results: The panel experts rated all 35 items and chose six domains in G-EXP questionnaire as “essential” with a minimum 0.99 content validity ratio (CVR). However, the EFA procedure supported only five-factor domains (accomplishment, competition, guidance, playfulness, and social experience) with 32 items. The immersion domain was eliminated. The CFA procedure confirmed only 16 items and five domains, with a model fit of χ2 = 198.00, df = 94, p < 0.001, χ2/df = 2.11, SRMR=0.04, CFI = 0.94 and TLI = 0.93 and RMSEA = 0.08. The Cronbach’s alpha for five constructs varied between 0.72 and 0.91. Conclusion: This study proposed five domains and 16 items to assess the gameful experience of the ReReki module in adolescent boys. To enhance GBL in sexual and reproductive health education, the element of games must include competition, accomplishment, guidance, playfulness, and social experience domains.
Downloads
Article Details
References
Smiderle R, Rigo SJ, Marques LB, Peçanha De Miranda Coelho JA, Jaques PA. The impact of gamification on students’ learning, engagement and behavior based on their personality traits. Smart Learning Environments [Internet]. 2020 Jan 9 [cited 2023 Oct 11];7(1);3. Available from: https://doi.org/10.1186/s40561-019-0098-x
Parker R, Thomsen B, Berry A. Learning through play at school – A framework for policy and practice. Frontiers in Education [Internet]. 2022 Feb 17 [cited 2023 Apr 1]; 7(1). DOI:10.3389/feduc.2022.751801
Kilic I, Ozkan G. The effect of educational game activities applied on the academic achievement of secondary students in science education. African Educational Research Journal [Internet]. 2022 Jul 14 [cited 2023 Jan 26];10(3):242–9. DOI:10.30918/AERJ.103.22.038
Kijpoonphol W, Phumchanin W. A Comparison between traditional and gamified teaching methods for phrasal verb: A case of grade 10 students. TESOL International Journal [Internet]. 2018 [cited 2023 Jan 2];13(3):56–65. Available from: https://files.eric.ed.gov/fulltext/EJ1247192.pdf
McGonial J. Games for Innovation: A Five Year Forecast [Internet]. SlideShare. 2011 [cited 2024 Feb 6]. Available from: https://www.slideshare.net/avantgame/games-for-innovation-a-five-year-forecast
Whipp J. Using existing educational tools to support and enhance environmental education: Utilizing ecoliterary texts, gamifying education, and integrating Technology. [Internet] [Thesis].[Lakehead University]; 2021 [cited 2024 Feb 6]. p. 1-74. Available from: ttps://knowledgecommons.lakeheadu.ca/bitstream/handle/2453/4874/WhippJ2021mp-1a.pdf?sequence=1&isAllowed=y
Hong GY, Masood M.. Effects of gamification on lower secondary school students’ motivation and engagement. International Journal of Education and Pedagogical Sciences. [Internet]. 2014 [cited 2023 Dec 1];8(12):3765–72. Available from: doi.org/10.5281/zenodo.1096962
Ali A, Abbas LN, Mohmad Sabiri A. Effectiveness of gamification learning in student’s achievement for complex number topic. Online journal for TVET practitioners. [Internet]. 2021 Sept 30 [cited 2023 Apr 23];6(2):108–22. Available from: https://doi.org/10.30880/jtet.2021.06.02.012
Cascella M, Cascella A, Monaco F, Shariff MN. Envisioning gamification in anesthesia, pain management, and critical care: basic principles, integration of artificial intelligence, and simulation strategies. Journal of Anesthesia, Analgesia and Critical Care. [Internet]. 2023 Sep 11 [cited 2023 Apr 13];3(1):33. Available from: https://doi.org/10.1186/s44158-023-00118-2
Farber M. Gamify your classroom: Afield guide to game-based learning. 3rd ed. Vol. 3. USA: Peter Lang INC., International Academic Publishers; New edition; 2014
Siripipatthanakul S, Muthmainnah M, Siripipattanakul S, Sriboonruang P, Kaewpuang P, Sitthipon T, et al. Gamification and edutainment in 21st century learning. Multidisciplinary Approaches to Research [Internet] 2023 Mar 10 [cited 2023 Dec 10];2;210-9. Available from: https://papers.ssrn.com/sol3/papers.cfm?abstract_id=4367648
Tan MZ. In Malaysia, talking about safe sex online sparks criticism as cultural taboos persist. [Internet]. Malay Mail. 2020 [cited 2023 Apr 2]. Available from: ttps://www.malaymail.com/news/life/2020/03/09/in-malaysia-talking-about-safe-sex-online-sparks-criticism-as-cultural-tabo/1844668
Abutto A. Game-based learning and 21st century skills. Available [Internet]. Medium. 2020 [cited 2024 Feb 6]. Available from: https://adaniabutto.medium.com/game-based-learning-and-21st-century-skills-c8763569d44e
Institute for Public Health. National Health & Morbidity Survey 2022. Adolescent Health Survey [Internet]. Institut Kesiahtan Umum. Putrajaya: Kementerian Kesihatan Malaysia; 2022 [cited 2023 Feb 4] p. 1-151. Available from: https://iku.gov.my/images/nhms-2022/Report_Malaysia_nhms_ahs_2022.pdf
Högberg J, Hamari J, Wästlund E. Gameful experience questionnaire (GAMEFULQUEST): An instrument for measuring the perceived gamefulness of system use. User Modelling User-Adaption Interaction [Internet]. 2019 Feb 28 [cited 2023 Apr 15];29(2):619–60. Available from: https:doi.org/10.007/s11257-019-09223-w
Finstad K. Response interpolation and scale Sensitivity: Evidence against 5-point scales. Journal of User Experience [Internet]. 2019 Feb 28 [cited 2023 Apr 15];5:104–10. Availabe from: https://uxpajournal.org/response-interpolation-and-scale-sensitivity-evidence-against-5-point-scales/
Polit DF, Beck CT. The content validity index: Are you sure you know what’s being reported? critique and recommendations. Research in Nursing & Health [Internet]. 2006 [cited 2023 Apr 4];29(5):489–97. DOI:10.1002/nur.20147
Tristan-Lopez A. Modificación al modelo de Lawshe para el dictamen cuantitativo de la validez de contenido de un instrumento objetivo. Avances en Medición. [Intrnet]. 2008 Jan 1 [cited 2024 Feb 5];;6(1):37–48. Available from: https://dialnet.unirioja.es/servlet/revista?codigo=9396
Lawshe CH. A quantitative approach to content validity. [Internet]. st ed. Vol. 1. Lafayette, Indiana: Personal Psychology;1975 [cited 2023 May 2]. Available from: https://onlinelibrary.wiley.com/doi/10.1111/j.1744-6570.1975.tb01393.x
Setia MS. Methodology series module 9: Designing questionnaires and clinical record forms – Part II. Indian Journal of Dermatology [Internet]. 2017 May [cited 2023 Mar 4];62(3):258. DOI: 10.4103/ijd.IJD_200_17
Hair J, Anderson R, Black B, Babin B. Multivariate data analysis. 8th ed. United Kingdom: Cengage Learning EMEA; 2018.
MacCallum RC, Widaman KF, Zhang S, Hong S. Sample size in factor analysis. Psychological Methods [Internet]. 1999 [cited 2023 Apr 4];4(1):84–99. DOI:10.1037/1082-989X.4.1.84
Awang Z. Structural equation modelling using AMOS graphic. 2nd ed. Shah Alam: Universiti Teknologi MARA Press; 2012.
Hair JF, Black WC, Babin BJ. Multivariate data analysis. 3rd edition. Vol. 5. USA: Prentice Hall, Upper River; 1998.
Hair JF, Black WC, Babin BJ, Anderson RE. Multivariate data analysis 7th ed. Upper Saddle River, N. J.;Pearson Pretince Hall; 2010.
Shumacker RE, Lomax RG. A Beginner’s Guide to Structural Equation Modeling. Vol. 1. New York: Psychology Press; 2004.
Streiner DL. Figuring Out Factors: The Use and Misuse of Factor Analysis. The Canadian Journal of Psychiatry [Internet] 1994 [cited 2023 May 2];39(3):135–40. DOI: 10.1177/070674379403900303
Henseler J, Ringle CM, Sarstedt M. A new criterion for assessing discriminant validity in variance-based structural equation modelling. Journal of the Academy of Marketing Science [Internet]. 2015 Aug 22. [cited 2023 May 2];43(1):115–35. DOI 10.1007/s11747-014-0403-8
Miller LA, Lovler RL. Foundations of psychological testing: A practical approach. 6th ed. New York, USA: SAGE Publications; 2019
Rubio DM, Berg-Weger M, Tebb SS, Lee ES, Rauch S. Objectifying content validity: Conducting a content validity study in social work research. Social Work Research [Internet]. 2003 Jun 1 [cited 2023 Dec 5];27(2):94–104. DOI:10.1093/swr/27.2.94
Cohen J. Set correlation and contingency tables. Applied Psychological Measurement [Internet]. 1988 Dec 13 [cited 2023 Feb 13];12(4):425–34. Available from: https://conservancy.umn.edu/handle/11299/104317
Fornell C, Larcker DF. Evaluating structural equation models with unobservable variables and measurement error. Journal of Marketing Research [Internet]. 1981 Feb 28 [cited 2023 Mar 19];18(1):39–50. Available from: https://doi.org/10.2307/3151312
Montes H, Hijon-Neira R, Perez-Marin D, Montes S. Using an online serious game to teach basic programming concepts and facilitate gameful experiences for high school students. IEEE Access. [Internet]. 2021 [cited 2023 Mar 22];9:12567–78. DOI: 10.1109/ACCESS.2021.3049690
Booysen N, Adams S. An examination of the psychometric properties of the gameful experience questionnaire (GAMEFULQUEST) in an online training environment [Internet] [Thesis]. [University of Stellenbosch]; 2022 [cited 2023 Mar 22]. p.1-90 Available from: https://scholar.sun.ac.za/server/api/core/bitstreams/81197ff6-1380-4d75-a553dbbf945 bcd94 /content
Antonaci A, Klemke R, Specht M. The effects of gamification in online learning environments: A systematic literature review. Informatics Journal [Internet]. 2019 Aug 12 [cited 2023 Apr 4];6(3):32. Available from: https://www.mdpi.com/2227-9709/6/3/32
Lin Q. The impact of dynamic game difficulty balancing on player user experience in puzzle games [Internet] [Thesis]. [University of Skovde]; 2023 [cited 2023 Nov 12]. p. 1-41. Available from: https://www.mdpi.com/2227-9709/6/3/32
Lum HC, Greatbatch R, Waldfogle G, Benedict J. How immersion, presence, emotion, & workload differ in virtual reality and traditional game mediums. Proceedings of the Human Factors and Ergonomics Society Annual Meeting [Internet]. 2018 Sep [cited 2023 May 2]; 62(1);1474-8. Available from: https://journals.sagepub.com/doi/10.1177/154193121862 1334
Kaimara P, Oikonomou A, Deliyannis I. Could virtual reality applications pose real risks to children and adolescents? A systematic review of ethical issues and concerns. Virtual Reality [Internet]. 2021 Aug 3 [cited 2023 May 4] ;26(2):697–735. Available from: https://doi.org/10.1007/s10055-021-00563-w
Cheng MT, She HC, Annetta LA. Game immersion experience: Its hierarchical structure and impact on game-based science learning. Journal of Computer Assisted Learning [Internet] 2014 Apr 14 [cited 2023 Mar 13];31(3):232–53. DOI:10.111/jcal.12066
Peng LH, Bai MH. How gameful experience affects public knowledge, attitudes, and practices regarding COVID-19 among the Taiwanese public: Cross-sectional study. JMIR Serious Games [Internet]. 2020 Dec 2 [cited 2023 Feb 6];9(2):e26216. DOI: 10.2196/26216
Paasovaara S, Väänänen K, Malapaschas A, Olshannikova E, Olsson T, Jarusriboonchai P, et al. Playfulness and progression in technology-enhanced social experiences between nearby strangers. In: NordiCHI ’18: Proceedings of the 10th Conference on Human-computer Interaction [Internet]. New York: Association for Computing Machinery; 2018 [cited 2023 Feb 6] p. 537–48. DOI:10.1145/3240167.3240212
William Jacques. How can educators use gamification to promote critical thinking and problem-solving skills? [Internet]. www.linkedin.com. 2023 [cited 2023 Dec 29]. Available from: https://www.linkedin.com/advice/3/how-can-educators-use-gamification-promote-critical
Haruna H, Hu X, Chu S, Mellecker R, Gabriel G, Ndekao P. Improving Sexual Health Education Programs for Adolescent Students through Game-Based Learning and Gamification. International Journal of Environment Research and Public Health [Internet]. 2018 Sep 17 [cited 2023 May 10];15(9):2027. DOI:10.3390/ijerph15092027
Ratinho E, Martins C. The role of gamified learning strategies in student’s motivation in high school and higher education: A systematic review. Heliyon Journal [Internet]. 2023 [cited 2023 Mar 3];1(9):1–16. Available from: https://doi.org/10.1016/j.heliyon.2023.e19033
Herzig P, Ameling M, Schill A. A generic platform for enterprise gamification. In: IEEE Computer Society [Internet]. Finand: Institute of Electrical and Electronics Engineers; 2012 [cited 2023 Mar 5]. p. 1-335. DOI 10.1109/WICSA-ECSA.212.33
Rau PLP, Peng SY, Yang CC. Time distortion for expert and novice online game players. Cyberpsychology and Behaviour [Internet]. 2006 Aug [cited 2023 Mar 13];9(4):396–403. DOI:10.1089/cpb.2006.9.396
Tavakol M, Dennick R. Making sense of Cronbach’s alpha. International Journal of Medical Education [Internet]. 2011 Jun 27 [cited 2023 Apr 4];2:53–5. DOI: 10.5116/ijme.4dfb.8dfd
Betit AL, Kennedy C. The need for earlier implementation of comprehensive sexual education within a formal classroom setting and beyond based on the influences of technology. Cureus Journal [Internet]. 2022 Aug 29 [cited 2022 sep 30];14(8):1–7. DOI:10.7759/cureus.28552
Lewis Ellison T, Solomon M. Digital play as purposeful productive literacies in African American boys. Roswell J, editor. The Reading Teacher [Internet]. 2017 Dec 28 [cited 2023 May 8]; 71(4):495–500. Available from: https://ila.onlinelibrary.wiley.com/doi/abs/ 10.1002/trtr.1657