Usability testing for therapist module on virtual environment for poststroke motor rehabilitation of upper limb
DOI:
https://doi.org/10.32870/recibe.v12i1.252Keywords:
Stroke, Thinking aloud, Usability testing, Virtual reality.Abstract
This article describes the implementation of Thinking Aloud protocol in its Active Intervention modality as an evaluation phase of a virtual reality environment. It supports the therapist during rehabilitation sessions with patients who have lost mobility in the upper limb due to a stroke. This strategy is low cost, and the qualitative results allow us to understand the quality of the software in the first instance. The test was aimed at therapists specializing in physical therapy, who serve as the main users of the virtual environment and who will configure the therapies that their future patients will carry out. As a result of the test, it was possible to collect 19 usability problems classified by gravity and correction priority, considered two of High Priority, five of Medium Priority and twelve of Low Priority, the latter oriented to small modifications at the interface level. In this way, a first approach to the end user's expectations regarding the evaluated virtual environment was achieved, in order to obtain a new iteration of software development that allows reducing or canceling problems, which suggests, on the one hand, the mechanisms for immediate refinement of the software, and on the other, a background that allows the evaluation procedure to be adapted to other software intended for rehabilitation.References
Acevedo, M. (2018). Ambiente virtual para la rehabilitación pos-ictus de los movimientos del codo en adultos. Universidad del Istmo, Santo Domingo Tehuantepec, México.
Aguilar Acevedo, F., Pacheco Bautista, D., Acevedo Gómez, M., Toledo Toledo, G., & Nieva García, O. S. (2022). User-Centered Virtual Environment for Post-Stroke Motor Rehabilitation. Journal of Medical Devices. https://doi.org/10.1115/1.4053605
Ávila García, M. S., Bianchetti, M., & González Gaviña, A. (2017). Uso del método “Thinking Aloud” en la investigación cualitativa. Pistas Educativas, 39(127), 26–38.
Bangor, A., Kortum, P. T., & Miller, J. T. (2008). An Empirical Evaluation of the System Usability Scale. International Journal of Human–Computer Interaction, 24(6), 574–594. https://doi.org/10.1080/10447310802205776
Bermudez i Badia, S., Fluet, G., Llorens, R., & Deutsch, J. (2016). Virtual reality for sensorimotor rehabilitation post stroke: Design principles and evidence. In D. Reinkensmeyer & V. Dietz (Eds.), Neurorehabilitation Technology (Second, pp. 573–603). Springer International Publishing. https://doi.org/https://doi.org/10.1007/978-3-319-28603-7_28
Boren, T., & Ramey, J. (2000). Thinking aloud: Reconciling theory and practice. IEEE Transactions on Professional Communication, 43(3), 261–278. https://doi.org/10.1109/47.867942
Dumas, J. S., & Redish, J. C. (1999). A Practical Guide to Usability Testing (1st ed.). Intellect Press.
Hung, Y.-X., Huang, P.-C., Chen, K.-T., & Chu, W.-C. (2016). What Do Stroke Patients Look for in Game-Based Rehabilitation: A Survey Study. Medicine, 95(11), e3032. https://doi.org/10.1097/MD.0000000000003032
Jääskeläinen, R. (2010). Think-aloud protocol. In Y. Gambier & L. Van Doorslaer (Eds.), Handbook of Translation Studies (pp. 371–373). John Benjamins Publishing Company.
Korn, O., & Tietz, S. (2017). Strategies for Playful Design when Gamifying Rehabilitation: A Study on User Experience. Proceedings of the 10th International Conference on Pervasive Technologies Related to Assistive Environments, 209–214. https://doi.org/10.1145/3056540.3056550
Krahmer, E., & Ummelen, N. (2004). Thinking About Thinking Aloud: A Comparison of TwoVerbal Protocols for Usability Testing. IEEE Transactions on Professional Communication, 47(2), 105–117. https://doi.org/10.1109/TPC.2004.828205
Lauesen, S. (2005). User interface design: a software engineering perspective. Pearson Education.
Nielsen, J. (1993). Usability Engineering. Morgan Kaufmann Publishers Inc.
Nielsen, J. (2012). Thinking Aloud: The #1 Usability Tool. Nielsen Norman Group. https://www.nngroup.com/articles/thinking-aloud-the-1-usability-tool/
Nørgaard, M., & Hornbæk, K. (2006). What Do Usability Evaluators Do in Practice?: An Explorative Study of Think-aloud Testing. Proceedings of the 6th Conference on Designing Interactive Systems, 209–218. https://doi.org/10.1145/1142405.1142439
Olmsted-Hawala, E. L., Murphy, E. D., Hawala, S., & Ashenfelter, K. T. (2010). Think-aloud Protocols: A Comparison of Three Think-aloud Protocols for Use in Testing Data-dissemination Web Sites for Usability. Proceedings of the 28th International Conference on Human Factors in Computing Systems, 2381–2390. https://doi.org/10.1145/1753326.1753685
Sáenz-de-Urturi, Z., García Zapirain, B., & Méndez Zorrilla, A. (2015). Elderly user experience to improve a Kinect-based game playability. Behaviour & Information Technology, 34(11), 1040–1051. https://doi.org/10.1080/0144929X.2015.1077889
Shiratuddin, M. F., Rai, S., Krishnan, G. M., Newton, M., Wang, X., Sohel, F., Blacker, D., & Byrnes, M. (2017). A usability evaluation of Neuromender’s upper limb game-based rehabilitation system for stroke survivors. In N. Dias (Ed.), 2017 IEEE 5th International Conference on Serious Games and Applications for Health (SeGAH) (pp. 1–8). IEEE. https://doi.org/10.1109/SeGAH.2017.7939258
Someren, M. van, Barnard, Y., & Sandberg, J. (1994). The Think Aloud Method - A Practical Guide to Modelling CognitiveProcesses. Academic Press.
Toledo, T. G., Rosales, L. R., Hernandez, M. A., & Arellano, J. P. J. (2015). Usability test of a SCADA system for monitoring and operating an experimental wind rotor. 2015 International Conference on Computing Systems and Telematics, ICCSAT 2015. https://doi.org/10.1109/ICCSAT.2015.7362932
Van Someren, M. W., Barnard, Y. F., y Sandberg, J. A. C. (1994). The Think Aloud Method: A Practical Guide to Modelling Cognitive Processes. London: Academic Press.
Yoshida, K., Asakawa, K., Yamauchi, T., Sakuraba, S., Sawamura, D., Murakami, Y., y Sakai, S. (2013). The Flow State Scale for Occupational Tasks: Development, Reliability, and Validity. Hong Kong Journal of Occupational Therapy, 23(2), 54–61. https://doi.org/https://doi.org/10.1016/j.hkjot.2013.09.002