Combination of Augmented Reality with Control Hand Gestures to Support Letter Learning in Preschool Children
Keywords:
learning letters, Human-Machine Interaction, Augmented Reality, Hand Gesture ControlAbstract
Knowledge of letters is the first step to achieving the ability to read and write properly, so it is of utmost importance in the teaching-learning process to develop activities that capture the child's attention and interest in learning. Currently, the use of information technologies (ICTs) offers the possibility of expanding the teaching strategies that can be used to improve educational work. The use of Augmented Reality is one of the most widely applied technologies in the educational area, so this work presents the development of a tool that combines the use of Augmented Reality with interface control through the movement of the hands to introduce children to the knowledge of letters. This application displays three-dimensional models of the letters and objects that use them and allows users to interact with them through hand movements. Its application with preschool children proved to be an entertaining tool that positively helped learning letters.References
A. Karambakhsh, A. Kamel, B. Sheng, P. Li, P. Yang, and D. D. Feng, “Deep gesture interaction for augmented anatomy learning,” Int J Inf Manage, vol. 45, pp. 328–336, 2019, doi: 10.1016/j.ijinfomgt.2018.03.004.
D. Salinas, C. De moraes, and M. Schwabe, “Programa Para La Evaluación Internacional De Alumnos (Pisa) Pisa 2018 - Resultados - Nota País México,” Ocde, vol. I–III, pp. 1–12, 2018, [Online]. Available: https://www.oecd.org/pisa/publications/PISA2018_CN_MEX_Spanish.pdf
H. ; Shamsee, N.; Klebenov, D.; Fayed, CCNA Data Center DCICT 640-916: Official Cert Guide. Cisco. 2015.
H. Q. Le and J. I. Kim, “An augmented reality application with hand gestures for learning 3D geometry,” 2017 IEEE International Conference on Big Data and Smart Computing, BigComp 2017, pp. 34–41, 2017, doi: 10.1109/BIGCOMP.2017.7881712.
I. Nugraha, A. R. Suminar, D. W. Octaviana, M. T. Hidayat, and A. Ismail, “The application of augmented reality in learning English phonetics,” J Phys Conf Ser, vol. 1402, no. 7, 2019, doi: 10.1088/1742-6596/1402/7/077024.
J. Atherton and G. Wang, “Chunity: Integrated Audiovisual Programming in Unity,” New Interfaces for Musical Expression, p. Virginia, US, 2018, [Online]. Available: http://www.nime.org/proceedings/2018/nime2018_paper0024.pdf
J. Haas, “A History of the Unity Game Engine An Interactive Qualifying Project Submitted to the Faculty of WORCESTER POLYTECHNIC INSTITUTE in partial fulfillment of the requirements for graduation,” p. 44, 2014, [Online]. Available: https://web.wpi.edu/Pubs/E-project/Available/E-project-030614-143124/unrestricted/Haas_IQP_Final.pdf
Microsoft, “Visual Studio Code.” https://visualstudio.microsoft.com/es/ (accessed Feb. 27, 2022).
N. SyafiqahSafiee and A. Wanis Ismail, “AR Home Deco: Virtual Object Manipulation Technique Using Hand Gesture in Augmented Reality,” pp. 1–6, 2018.
P. Bifulco, F. Narducci, R. Vertucci, P. Ambruosi, M. Cesarelli, and M. Romano, “Telemedicine supported by Augmented Reality: An interactive guide for untrained people in performing an ECG test,” Biomed Eng Online, vol. 13, no. 1, pp. 1–16, 2014, doi: 10.1186/1475-925X-13-153.
S. Schutera et al., “On the potential of augmented reality for mathematics teaching with the application cleARmaths,” Educ Sci (Basel), vol. 11, no. 8, 2021, doi: 10.3390/educsci11080368.
UltraLeap, “Leap Motion Controller.” https://www.ultraleap.com/product/leap-motion-controller/#overview
V. Lin, G. Z. Liu, and N. S. Chen, “The effects of an augmented-reality ubiquitous writing application: a comparative pilot project for enhancing EFL writing instruction,” Comput Assist Lang Learn, vol. 0, no. 0, pp. 1–42, 2020, doi: 10.1080/09588221.2020.1770291.
Y. et al. Sun, “Manipulating IoT Devices in Augmented Reality Environment MagicHand : A Deep Learning Approach towards Manipulating IoT Devices in Augmented Reality Environment,” pp. 0–9, 2019.
