Usability Evaluation of SATUSEHAT Mobile Using the System Usability Scale: A Demographic Comparison Among Users in Yogyakarta

Nita Budiyanti; Arif Nugroho

Authors

Nita Budiyanti Poltekkes Kemenkes Yogyakarta
Arif Nugroho Poltekkes Kemenkes Yogyakarta

Keywords:

SATUSEHAT mobile, system usability scale, usability, digital health, user experience

Abstract

SATUSEHAT Mobile provides access to digital health services and personal health information. Usability may affect users’ ability to access these services effectively. To evaluate SATUSEHAT Mobile usability and compare System Usability Scale (SUS) scores across demographic groups in Yogyakarta. This descriptive-comparative cross-sectional study involved 99 purposively selected active users. Data were collected using a demographic questionnaire and the 10-item SUS. Descriptive statistics, Mann–Whitney U tests, and Kruskal–Wallis tests were performed using IBM SPSS Statistics version 25. Bonferroni adjustment was applied to pairwise age-group comparisons. The mean SUS score was 68.0 (median = 70.0; SD = 12.1). Item 10 had the lowest mean score (1.73/4), suggesting potential difficulties with initial learning. SUS scores differed significantly across age groups (H = 8.663, p = 0.034). Bonferroni-adjusted comparisons showed a significant difference between participants aged ≤20 years (median = 72.5) and those aged 41–50 years (median = 58.7; adjusted p = 0.025). No significant differences were found by gender, employment status, or educational level. SATUSEHAT Mobile usability was around the commonly cited acceptability threshold. Age-related differences and the low Item 10 score highlight the need to evaluate age-inclusive interface design and clearer onboarding guidance.

References

Alshammari, H. M., & Ia, R. (2025). Evaluating user satisfaction and engagement in mHealth : Insights from the Integrated Digital Health Engagement Model (IDHEM). Digital Health, 11, 1–14. https://doi.org/10.1177/20552076251346698.

Amouzadeh, E., Dianat, I., Faradmal, J., & Babamiri, M. (2025). Optimizing mobile app design for older adults : systematic review of age ‑ friendly design. Aging Clinical and Experimental Research. https://doi.org/10.1007/s40520-025-03157-7 (2025).

Bangor, A., Kortum, P., & Miller, J. (2009). Determining what individual SUS scores mean; adding an adjective rating. Journal of usability studies, 4(3), 114–123.

Denecke, K., Cvijic, L., & Petersen, C. (2025). Toward Inclusive Design Heuristics for Digital Health Interventions for the Aging Population : Scoping Review Corresponding Author : Journal Of Medical Internet Research, 27. https://doi.org/10.2196/79449.

Deniz-garcia, A., Fabelo, H., Rodriguez-almeida, A. J., Palmas, L., & Canaria, D. G. (2023). Quality , Usability , and Effectiveness of mHealth Apps and the Role of Artificial Intelligence : Current Scenario and Challenges Corresponding Author : Journal Of Medical Internet Research, 25. https://doi.org/10.2196/44030.

Durmus, A. (2024). The in fl uence of digital literacy on mHealth app usability : The mediating role of patient expertise. Digital Health, 10, 1–13. https://doi.org/10.1177/20552076241299061.

Dyayu, A. L., Beny, & Yani, H. (2023). Evaluasi Usability Aplikasi PeduliLindungi Menggunakan Metode Usability Testing dan System Usability Scale (SUS) Jurnal Manajemen Teknologi dan Sistem Informasi ( JMS ). Jurnal Manajemen Teknologi dan Sistem Informasi (JMS), 3, 395–404.

Gomez-Hernandez, M., Ferre, X., Moral, C., & Villalba-Mora, E. (2023). Design Guidelines of Mobile Apps for Older Adults: Systematic Review and Thematic Analysis. JMIR mHealth and uHealth, 11. https://doi.org/10.2196/43186.

Hyzy, M., Bond, R., Mulvenna, M., & Bai, L. (2022). System Usability Scale Benchmarking for Digital Health Apps : Corresponding Author : JMIR Mhealth and Uhealth, 10, 1–11. https://doi.org/10.2196/37290.

Irawan, Y., Suryani, F. B., Wanabuliandari, S., & Muzid, S. (2025). System Usability Scale ( SUS ) Model in Evaluating Internal Quality Audit Systems for Accreditation Process Optimization. Journal of Applied Informatics and Computing (JAIC), 9(2), 511–516.

ISO 9241. (2018). Ergonomics of human-system interaction — Part 11: Usability: Definitions and concepts (Vol. 2018). www.iso.org.

Joshi, I., Shahid, S., Venneti, S., & Vasu, M. (2025). CoPrompter: User-Centric Evaluation of LLM Instruction Alignment for Improved Prompt Engineering. CoPrompter: User-Centric Evaluation of LLM Instruction Alignment for Improved Prompt Engineering.

Judijanto, L., Triutomo, A. N., Urbanantika, R., & Anisa, D. (2026). Analisis dan Perancangan Sistem Informasi Kesehatan (Efitra (ed.)). Penerbit Buku Sonpedia.

Kadek, N., Tara, P., Tri, I. N., & Putra, A. (2025). Analisis Usability Aplikasi Kesehatan Digital System Usability Scale ( SUS ). JITET (Jurnal Informatika dan Teknik Elektro Terapan), 13(3).

Kumaladewi, N., & Saputra, F. R. (2023). Usability evaluation of satusehat application using usability testing method. Jurnal Perangkat Lunak, 5, 240–250.

Lewis, J. R. (2018). The System Usability Scale : Past , Present , and Future The System Usability Scale : Past , Present , and Future. International Journal of Human–Computer Interaction, 34(7), 577–590. https://doi.org/10.1080/10447318.2018.1455307.

Orfanou, K., Tselios, N., & Katsanos, C. (2015). Perceived Usability Evaluation of Learning Management Systems : Empirical Evaluation of the System Usability Scale. International Review of Research in Open and Distributed Learning, 16(2), 227–246.

Peres, S. C., Pham, T., & Phillips, R. (2013). Validation Of The System Usability Scale ( SUS ): Human Factors and Ergonomics Society 57th Annual Meeting, 1, 192–196.

Vlachogianni, P., & Tselios, N. (2022). Perceived usability evaluation of educational technology using the System Usability Scale (SUS): A systematic review. Journal of Research on Technology in Education, 54(3), 392–409. https://doi.org/https://doi.org/10.1080/15391523.2020.1867938.

Yani, R., Nazhifah, I., & Pradika, M. I. (2025). System Usability Scale in Information System Application Development Using Systematic Mapping Study. IJATIS: Indonesian Journal of Applied Technology and Innovation Science, 2(August), 130–140.