Usability testing for therapist module on virtual environment for poststroke motor rehabilitation of upper limb

Authors

  • Guadalupe Toledo Toledo Universidad del Istmo
  • Aguilar Acevedo Francisco Departamento de Ingeniería en Computación; Universidad del Istmo
  • Nieva García Omar Santiago Departamento de Ingeniería en Computación; Universidad del Istmo
  • Daniel Pacheco Bautista Departamento de Ingeniería en Computación; Universidad del Istmo
  • Bezares Molina Francisco Gabriel Departamento de Ingeniería en Computación; Universidad del Istmo
  • Marleydy Acevedo Gómez Departamento de Ingeniería en Computación; Universidad del Istmo

DOI:

https://doi.org/10.32870/recibe.v12i1.252

Keywords:

Stroke, Thinking aloud, Usability testing, Virtual reality.

Abstract

This article describes the implementation of Thinking Aloud protocol in its Active Intervention modality as an evaluation phase of a virtual reality environment. It supports the therapist during rehabilitation sessions with patients who have lost mobility in the upper limb due to a stroke. This strategy is low cost, and the qualitative results allow us to understand the quality of the software in the first instance. The test was aimed at therapists specializing in physical therapy, who serve as the main users of the virtual environment and who will configure the therapies that their future patients will carry out. As a result of the test, it was possible to collect 19 usability problems classified by gravity and correction priority, considered two of High Priority, five of Medium Priority and twelve of Low Priority, the latter oriented to small modifications at the interface level. In this way, a first approach to the end user's expectations regarding the evaluated virtual environment was achieved, in order to obtain a new iteration of software development that allows reducing or canceling problems, which suggests, on the one hand, the mechanisms for immediate refinement of the software, and on the other, a background that allows the evaluation procedure to be adapted to other software intended for rehabilitation.

References

Acevedo, M. (2018). Ambiente virtual para la rehabilitación pos-ictus de los movimientos del codo en adultos. Universidad del Istmo, Santo Domingo Tehuantepec, México.

Aguilar Acevedo, F., Pacheco Bautista, D., Acevedo Gómez, M., Toledo Toledo, G., & Nieva García, O. S. (2022). User-Centered Virtual Environment for Post-Stroke Motor Rehabilitation. Journal of Medical Devices. https://doi.org/10.1115/1.4053605

Ávila García, M. S., Bianchetti, M., & González Gaviña, A. (2017). Uso del método “Thinking Aloud” en la investigación cualitativa. Pistas Educativas, 39(127), 26–38.

Bangor, A., Kortum, P. T., & Miller, J. T. (2008). An Empirical Evaluation of the System Usability Scale. International Journal of Human–Computer Interaction, 24(6), 574–594. https://doi.org/10.1080/10447310802205776

Bermudez i Badia, S., Fluet, G., Llorens, R., & Deutsch, J. (2016). Virtual reality for sensorimotor rehabilitation post stroke: Design principles and evidence. In D. Reinkensmeyer & V. Dietz (Eds.), Neurorehabilitation Technology (Second, pp. 573–603). Springer International Publishing. https://doi.org/https://doi.org/10.1007/978-3-319-28603-7_28

Boren, T., & Ramey, J. (2000). Thinking aloud: Reconciling theory and practice. IEEE Transactions on Professional Communication, 43(3), 261–278. https://doi.org/10.1109/47.867942

Dumas, J. S., & Redish, J. C. (1999). A Practical Guide to Usability Testing (1st ed.). Intellect Press.

Hung, Y.-X., Huang, P.-C., Chen, K.-T., & Chu, W.-C. (2016). What Do Stroke Patients Look for in Game-Based Rehabilitation: A Survey Study. Medicine, 95(11), e3032. https://doi.org/10.1097/MD.0000000000003032

Jääskeläinen, R. (2010). Think-aloud protocol. In Y. Gambier & L. Van Doorslaer (Eds.), Handbook of Translation Studies (pp. 371–373). John Benjamins Publishing Company.

Korn, O., & Tietz, S. (2017). Strategies for Playful Design when Gamifying Rehabilitation: A Study on User Experience. Proceedings of the 10th International Conference on Pervasive Technologies Related to Assistive Environments, 209–214. https://doi.org/10.1145/3056540.3056550

Krahmer, E., & Ummelen, N. (2004). Thinking About Thinking Aloud: A Comparison of TwoVerbal Protocols for Usability Testing. IEEE Transactions on Professional Communication, 47(2), 105–117. https://doi.org/10.1109/TPC.2004.828205

Lauesen, S. (2005). User interface design: a software engineering perspective. Pearson Education.

Nielsen, J. (1993). Usability Engineering. Morgan Kaufmann Publishers Inc.

Nielsen, J. (2012). Thinking Aloud: The #1 Usability Tool. Nielsen Norman Group. https://www.nngroup.com/articles/thinking-aloud-the-1-usability-tool/

Nørgaard, M., & Hornbæk, K. (2006). What Do Usability Evaluators Do in Practice?: An Explorative Study of Think-aloud Testing. Proceedings of the 6th Conference on Designing Interactive Systems, 209–218. https://doi.org/10.1145/1142405.1142439

Olmsted-Hawala, E. L., Murphy, E. D., Hawala, S., & Ashenfelter, K. T. (2010). Think-aloud Protocols: A Comparison of Three Think-aloud Protocols for Use in Testing Data-dissemination Web Sites for Usability. Proceedings of the 28th International Conference on Human Factors in Computing Systems, 2381–2390. https://doi.org/10.1145/1753326.1753685

Sáenz-de-Urturi, Z., García Zapirain, B., & Méndez Zorrilla, A. (2015). Elderly user experience to improve a Kinect-based game playability. Behaviour & Information Technology, 34(11), 1040–1051. https://doi.org/10.1080/0144929X.2015.1077889

Shiratuddin, M. F., Rai, S., Krishnan, G. M., Newton, M., Wang, X., Sohel, F., Blacker, D., & Byrnes, M. (2017). A usability evaluation of Neuromender’s upper limb game-based rehabilitation system for stroke survivors. In N. Dias (Ed.), 2017 IEEE 5th International Conference on Serious Games and Applications for Health (SeGAH) (pp. 1–8). IEEE. https://doi.org/10.1109/SeGAH.2017.7939258

Someren, M. van, Barnard, Y., & Sandberg, J. (1994). The Think Aloud Method - A Practical Guide to Modelling CognitiveProcesses. Academic Press.

Toledo, T. G., Rosales, L. R., Hernandez, M. A., & Arellano, J. P. J. (2015). Usability test of a SCADA system for monitoring and operating an experimental wind rotor. 2015 International Conference on Computing Systems and Telematics, ICCSAT 2015. https://doi.org/10.1109/ICCSAT.2015.7362932

Van Someren, M. W., Barnard, Y. F., y Sandberg, J. A. C. (1994). The Think Aloud Method: A Practical Guide to Modelling Cognitive Processes. London: Academic Press.

Yoshida, K., Asakawa, K., Yamauchi, T., Sakuraba, S., Sawamura, D., Murakami, Y., y Sakai, S. (2013). The Flow State Scale for Occupational Tasks: Development, Reliability, and Validity. Hong Kong Journal of Occupational Therapy, 23(2), 54–61. https://doi.org/https://doi.org/10.1016/j.hkjot.2013.09.002

Published

2023-06-11

How to Cite

Toledo Toledo, G., Francisco, A. A. ., Omar Santiago, N. G., Pacheco Bautista, D., Francisco Gabriel, B. M., & Acevedo Gómez, M. (2023). Usability testing for therapist module on virtual environment for poststroke motor rehabilitation of upper limb. ReCIBE, Electronic Journal of Computing, Informatics, Biomedical and Electronics, 12(1), C3–18. https://doi.org/10.32870/recibe.v12i1.252

Issue

Section

Computer Science & IT