Usability Testing of a Database Management System for Nutritional Care Delivery
Main Article Content
Abstract
Introduction: Effective healthcare systems must integrate smoothly with clinical workflow by minimizing unnecessary steps and ensuring quick access to patient data. Poor integration can create difficulties for healthcare professionals, affecting their long-term use. Therefore, a well-designed system must prioritize usability and workflow integration to support high-quality care. As such, this paper evaluates the usability of a database management system for nutritional care in a diet clinic. Methodology: The evaluation involved four steps: (1) filling out a demographic form, (2) performing task-oriented scenarios using the think-aloud method to assess effectiveness and efficiency, (3) completing a survey using the System Usability Scale (SUS) to measure satisfaction, and (4) participating in an interview to provide suggestions for improvement. Results: The DietCARE system demonstrated an efficiency rate of 80.48%, with 100% effectiveness. Although all assigned tasks were completed, some had minor challenges, with Task 3 being the most difficult, as 80% of respondents struggled with scheduling appointments. The SUS score had a median (IQR) of 77.50 (76.25–91.25), indicating good user satisfaction. Four themes related to suggestions for improvement were identified: improving data interpretation, enhancing flexibility in data entry, tracking and monitoring patient progress, and expanding data scope for comprehensive patient profiling. Conclusion: Overall, the DietCARE system demonstrated good efficiency, effectiveness, and user satisfaction. While some improvements are needed based on user feedback, incorporating their suggestions could enhance the system’s usability, efficiency, and overall user experience. Addressing these usability issues will help create a more user-friendly system that meets the needs of its users.
Downloads
Article Details
References
Zayas-Cabán T, Okubo TH, Posnack S. Priorities to accelerate workflow automation in health care. J Am Med Inform Assoc. 2022;30(1):195–201. doi:10.1093/jamia/ocac197.
Bowens FM, Frye PA, Jones WA. Health information technology: integration of clinical workflow into meaningful use of electronic health records. Perspect Heal Inf Manag. 2010;7:1d. Available from: https://pmc.ncbi.nlm.nih.gov/articles/PMC2966355/
Derecho KC, Cafino R, Aquino-Cafino SL, Isla AJ, Esencia JA, Lactuan NJ, et al. Technology adoption of electronic medical records in developing economies: A systematic review on physicians’ perspective. Digit Heal. 2024;10:1–21. doi: 10.1177/20552076231224605
Said AH, Mohd FN, Baharom MZ, Md Aris MA, Mohamad Shahrin MA. Barriers Towards Healthcare Access and Services among People with Disabilities: A Scoping Review of Qualitative Studies. IIUM Med J Malaysia. 2024;23(4):20-28. doi: 10.31436/imjm.v23i04.2460
Moran K. Usability Testing 101. Nielsen Norman Group; 2019 [cited 2022 Jan 15]. Available from: https://www.nngroup.com/articles/usability-testing-101/
Khajouei R, Farahani F. A combination of two methods for evaluating the usability of a hospital information system. BMC Med Inform Decis Mak. 2020;20(1):84. doi: 10.1186/s12911-020-1083-6
Maguire M, Isherwood P. A Comparison of User Testing and Heuristic Evaluation Methods for Identifying Website Usability Problems. In: Design, User Experience, and Usability: Theory and Practice. Proceedings of the 7th International Conference, DUXU 2018; Berlin, Heidelberg: Springer-Verlag; 2018. p. 429–438. Available from: https://doi.org/10.1007/978-3-319-91797-9_31
Windle JR, Windle TA, Shamavu KY, Nelson QM, Clarke MA, Fruhling AL, et al. Roadmap to a more useful and usable electronic health record. Cardiovasc Digit Heal J. 2021;2(6):301–11. doi: 10.1016/j.cvdhj.2021.09.007
Borges do Nascimento IJ, Abdulazeem H, Vasanthan LT, Martinez EZ, Zucoloto ML, Østengaard L, et al. Barriers and facilitators to utilizing digital health technologies by healthcare professionals. NPJ Digit Med. 2023;6(1):161. doi: 10.1038/s41746-023-00899-4
Ahmed MI, Spooner B, Isherwood J, Lane M, Orrock E, Dennison A. A Systematic Review of the Barriers to the Implementation of Artificial Intelligence in Healthcare. Cureus. 2023;15(10):e46454. doi: 10.7759/cureus.46454
Hellstrand Tang U, Smith F, Karilampi UL, Gremyr A. Exploring the Role of Complexity in Health Care Technology Bottom-Up Innovations: Multiple-Case Study Using the Nonadoption, Abandonment, Scale-Up, Spread, and Sustainability Complexity Assessment Tool. JMIR Hum factors. 2024;11:e50889. doi: 10.2196/50889
Muhiyaddin R, Elfadl A, Mohamed E, Shah Z, Alam T, Abd-Alrazaq A, et al. Electronic Health Records and Physician Burnout: A Scoping Review. Stud Health Technol Inform. 2022;289:481–4. doi: 10.3233/SHTI210962
Alobayli F, O’Connor S, Holloway A, Cresswell K. Electronic Health Record Stress and Burnout Among Clinicians in Hospital Settings: A Systematic Review. Digit Heal. 2023;9:1-17. doi: 10.1177/20552076231220241
Kim MO, Coiera E, Magrabi F. Problems with health information technology and their effects on care delivery and patient outcomes: a systematic review. J Am Med Inform Assoc. 2017;24(2):246–50. doi: 10.1093/jamia/ocw154
Holmgren AJ, McBride S, Gale B, Mossburg S. Technology as a Tool for Improving Patient Safety. PSNet; 2023 [cited 2024 Jane 10]. Available from: https://psnet.ahrq.gov/perspective/technology-tool-improving-patient-safety
Aziz NN, Yusof HM, Amalina I, Sabri A, Ali A, Shazmin K. Nurturing Health with DietCARE: A Needs Analysis for the Development of A Nutritional Care Database Management System at University Health Centre. Malaysian J Med Heal Sci. 2024;20(3):258–65. doi: 10.47836/mjmhs.20.3.35
Brooke J. SUS: A quick and dirty usability scale [Internet]; 1995 [cited 2022 May 10]. Available from: https://www.researchgate.net/publication/228593520_SUS_A_quick_and_dirty_usability_scale
Hajesmaeel-Gohari S, Khordastan F, Fatehi F, Samzadeh H, Bahaadinbeigy K. The most used questionnaires for evaluating satisfaction, usability, acceptance, and quality outcomes of mobile health. BMC Med Inform Decis Mak. 2022;22(1):22. doi: 10.1186/s12911-022-01764-2
Maramba I, Chatterjee A, Newman C. Methods of usability testing in the development of eHealth applications: A scoping review. Int J Med Inform. 2019;126:95–104. doi: 10.1016/j.ijmedinf.2019.03.018
Brooke J. SUS: a retrospective. J Usability Stud. 2013;8(2):29–40. doi: 10.5555/2817912.2817913
Bangor A, Kortum PT, Miller JT. An Empirical Evaluation of the System Usability Scale. Int J Human–Computer Interact. 2008;24(6):574–94. doi: 10.1080/10447310802205776.
Walsh CM, Jones NL, McCreath GA, Connan V, Pires L, Chen AQH, et al. Co-development and Usability Testing of Research 101: A Patient-Oriented Research Curriculum in Child Health (PORCCH) E-Learning Module for Patients and Families. Front Pediatr. 2022;10:849959. doi: 10.3389/fped.2022.849959
ISO. Ergonomics of human-system interaction. Part 11: Usability: Definitions and Concepts [Internet]. 2nd Edition. Geneva: International Organization for Standardization; 2018. Available from: https://www.iso.org/obp/ui/#iso:std:iso:9241:-11:ed-2:v1:en
Farrahi R, Rangraz Jeddi F, Nabovati E, Sadeqi Jabali M, Khajouei R. The relationship between user interface problems of an admission, discharge and transfer module and usability features: a usability testing method. BMC Med Inform Decis Mak. 2019;19(1):172. doi: 10.1186/s12911-019-0893-x
Rochat J, Ehrler F, Siebert JN, Ricci A, Garretas Ruiz V, Lovis C. Usability Testing of a Patient-Centered Mobile Health App for Supporting and Guiding the Pediatric Emergency Department Patient Journey: Mixed Methods Study. JMIR Pediatr Parent. 2022;5(1):e25540. doi: 10.2196/25540
Georgsson M, Staggers N. Quantifying usability: an evaluation of a diabetes mHealth system on effectiveness, efficiency, and satisfaction metrics with associated user characteristics. J Am Med Inform Assoc. 2016;23(1):5–11. doi: 10.1093/jamia/ocv099
Pierce RP, Eskridge BR, Rehard L, Ross B, Day MA, Belden JL. The Effect of Electronic Health Record Usability Redesign on Annual Screening Rates in an Ambulatory Setting. Appl Clin Inform. 2020;11(4):580–8. doi: 10.1055/s-0040-1715828
Inoue T, Iida Y, Takahashi K, Shirado K, Nagano F, Miyazaki S, et al. Nutrition and Physical Therapy: A Position Paper by the Physical Therapist Section of the Japanese Association of Rehabilitation Nutrition (Secondary Publication). JMA J. 2022;5(2):243–51. doi: 10.31662/jmaj.2021-0201
Netzer R, Elboim-Gabyzon M. Implementation of Nutritional Assessment and Counseling in Physical Therapy Treatment: An Anonymous Cross-Sectional Survey. Nutrients. 2023;15(19). doi: 10.3390/nu15194204
Nielsen J. 10 Usability Heuristic for User Interface Design [Internet]. Nielsen Norman Group; 1994 [cited 2023 Jan 23]. Available from: https://www.nngroup.com/articles/ten-usability-heuristics/
Street RLJ, Liu L, Farber NJ, Chen Y, Calvitti A, Weibel N, et al. Keystrokes, Mouse Clicks, and Gazing at the Computer: How Physician Interaction with the EHR Affects Patient Participation. J Gen Intern Med. 2018;33(4):423–8. doi: 10.1007/s11606-017-4228-2
McLellan S, Muddimer A, Peres SC. The effect of experience on System Usability Scale ratings. J Usability Stud. 2012;7(2):56–67. Available from: https://uxpajournal.org/the-effect-of-experience-on-system-usability-scale-ratings/
North JC, Jordan KC, Metos J, Hurdle JF. Nutrition Informatics Applications in Clinical Practice: a Systematic Review. AMIA Annu Symp Proc. 2015;2015:963–72. Available from: https://pmc.ncbi.nlm.nih.gov/articles/PMC4765562/
Bernardi FA, Alves D, Crepaldi N, Yamada DB, Lima VC, Rijo R. Data Quality in Health Research: Integrative Literature Review. J Med Internet Res. 2023;25:e41446. doi: 10.2196/41446
Aakre C, Dziadzko M, Keegan MT, Herasevich V. Automating Clinical Score Calculation within the Electronic Health Record. A Feasibility Assessment. Appl Clin Inform. 2017;8(2):369–80. doi: 10.4338/ACI-2016-09-RA-0149
Sandhu N, Krusina A, Quan H, Walker R, Martin EA, Eastwood CA, et al. Automated extraction of weight, height, and obesity in electronic medical records are highly valid. Obes Sci Pract. 2024;10(1):e705. doi: 10.1002/osp4.705
Pannunzio V, Kleinsmann M, Snelders D, Raijmakers J. From digital health to learning health systems: four approaches to using data for digital health design. Heal Syst. 2023;12(4):481–94. doi: 10.1080/20476965.2023.2284712
Ferreira JC, Elvas LB, Correia R, Mascarenhas M. Empowering Health Professionals with Digital Skills to Improve Patient Care and Daily Workflows. Healthcare. 2025;13(3):329. doi: 10.3390/healthcare13030329
Beutter CNL, Zeller K, Martens UM, Pfleiderer B, Fegeler C. User-Centered Development of a Mobile App to Assess the Quality of Life of Patients With Cancer: Iterative Investigation and Usability Testing. JMIR cancer. 2023;9:e44985. doi: 10.2196/44985