Interactive Prototype Design Using AR and Drag-and-Drop Games to Support Computational Thinking in Children with Mild Autism

Dwi Fitria Al Husaeni, Dwi Novia Al Husaeni, M. Munir, R. Rasim, Patah Herwanto, Kaisha Zahra Zain, Sherina Oktavia Martana

Abstract


This research aims to develop AR applications and drag-and-drop games that can improve computational thinking (CT) abilities in children with mild autism. The method used in this research is Analyze, Design, Development, Implement, Evaluate (ADDIE). In this study, an application was designed that is suitable for children aged 10-12 years who are diagnosed with mild ASD to learn basic programming concepts. Based on the research results, the initial prototype for an application that applies augmented reality technology and drag-and-drop games can be used to help improve the CT abilities of children with ASD. Based on validation results from experts, the average percentage score was 97.64% (category: very good) and many teachers accompanying children with ASD rated this application as very good with an average percentage of 94.80%. It is hoped that the implementation of this application can improve the quality of education and provide better support for children with mild autism in developing their computational thinking skills.

Keywords


Augmented reality, Autism, Computational thinking, Puzzle games, Special needs.

References


Arikunto, S. (2018). Evaluasi program pendidikan edisi 2. Jakarta: Bumi Aksara.

Chen, H., Zhang, X., Chen, Z., Ren, Y., & Liu, R. (2025). Auxiliary diagnostic method for children with autism spectrum disorder based on virtual reality and eye-tracking technology. Scientific Reports, 15(1), 40552. https://doi.org/10.1038/s41598-025-24243-w

Cunha, P., Brandão, J., Vasconcelos, J., Soares, F., & Carvalho, V. (2016). Augmented reality for cognitive and social skills improvement in children with ASD. Proceedings of the 2016 13th International Conference on Remote Engineering and Virtual Instrumentation (REV) (pp. 334-335). IEEE. https://doi.org/10.1109/rev.2016.7444495

de Souza, F. A., Pires, S. V. L., Leal, S. R. A., Arias, C. C. M., do Aguiar, E. H., de Araújo, R. P., ... & da Silva, C. M. R. (2025). Towards serious games through a playful approach for children with autism spectrum disorder. International Journal of Child-Computer Interaction, 45, 100750. https://doi.org/10.1016/j.ijcci.2025.100750

Eden, S., & Oren, A. (2021). Computer‐mediated intervention to foster prosocial ability among children with autism. Journal of Computer Assisted Learning, 37(1), 275-286. https://doi.org/10.1111/jcal.12490

Elshahawy, M., Bakhaty, M., & Sharaf, N. (2020, September). Developing computational thinking for children with autism using a serious game. Proceedings of the 2020 24th international conference information visualisation (IV) (pp. 761-766). IEEE. https://doi.org/10.1109/iv51561.2020.00135

Fallea, A., Costanza, C., L’Episcopo, S., Bartolone, M., Rundo, F., Smirni, D., Roccella, M., Elia, M., Ferri, R., & Vetri, L. (2025). Virtual reality-based versus traditional teaching approaches in the oral hygiene education of children with autism spectrum disorder. Journal of Clinical Medicine, 14(16), 5795. https://doi.org/10.3390/jcm14165795

Fernell, E., & Gillberg, C. (2023). Autism under the umbrella of ESSENCE. Frontiers in Psychiatry, 14, 1002228. https://doi.org/10.3389/fpsyt.2023.1002228

Fridhi, A., Benzarti, F., Frihida, A., & Amiri, H. (2018). Application of virtual reality and augmented reality in psychiatry and neuropsychology, in particular in the case of autistic spectrum disorder (ASD). Neurophysiology, 50(3), 222-228. https://doi.org/10.1007/s11062-018-9741-3

Grossard, C., Grynspan, O., Serret, S., Jouen, A. L., Bailly, K., & Cohen, D. (2017). Serious games to teach social interactions and emotions to individuals with autism spectrum disorders (ASD). Computers and Education, 113, 195-211. https://doi.org/10.1016/j.compedu.2017.05.002

Kemuda, N. M. G. A. A., & Wulandari, I. G. A. A. (2023). Button space sebagai media berdiferensiasi pada kurikulum merdeka di sekolah dasar [Button space as a differentiated learning medium in the independent curriculum for elementary schools]. Innovative: Journal of Social Science Research, 3(6), 7439-7452. https://j-innovative.org/index.php/Innovative/article/view/6925

Khowaja, K., & Salim, S. S. (2019). A framework to design vocabulary-based serious games for children with autism spectrum disorder (ASD). Universal Access in the Information Society, 19(4), 739-781. https://doi.org/10.1007/s10209-019-00689-4

Lodi, M., & Martini, S. (2021). Computational thinking, between Papert and Wing. Science and Education, 30(4), 883-908. https://doi.org/10.1007/s11191-021-00202-5

Lorenzo, G., Gómez-Puerta, M., Arráez-Vera, G., & Lorenzo-Lledó, A. (2019). Preliminary study of augmented reality as an instrument for improvement of social skills in children with autism spectrum disorder. Education and Information Technologies, 24(1), 181-204. https://doi.org/10.1007/s10639-018-9768-5

Lu, S. J., & Liu, Y. C. (2015). Integrating augmented reality technology to enhance children’s learning in marine education. Environmental Education Research, 21(4), 525-541. https://doi.org/10.1080/13504622.2014.911247

Nisrina, N., Rahmawati, I., & Hikmah, F. N. (2022). Pengembangan instrumen validasi produk multimedia pembelajaran fisika [Development of a validation instrument for physics learning multimedia products]. Lensa: Jurnal Kependidikan Fisika, 10(1), 32-38. https://doi.org/10.33394/j-lkf.v10i1.5278

Rezayi, S., Shahmoradi, L., & Tehrani-Doost, M. (2025). Systematic review and thematic analysis of digital games for cognitive enhancement in children with autism spectrum disorder: toward a conceptual framework. Cognitive Computation, 17(1), 60. https://doi.org/10.1007/s12559-024-10395-w

Shute, V. J., Sun, C., & Asbell-Clarke, J. (2017). Demystifying computational thinking. Educational research review, 22, 142-158. https://doi.org/10.1016/j.edurev.2017.09.003

Skoufou, A. (2019). Social interaction of preschool children with autism spectrum disorders (ASD)-characteristics and educational approaches. Online Submission, 6(6), 28-36. https://doi.org/10.14445/23939125/ijems-v6i6p105

Solórzano Alcívar, N. I., Paillacho Chiluiza, D. F., Arce Sierra, M. X., Pincay Lino, A. J., & Eras Zamora, E. A. (2025). Facial expression analysis in children with autism spectrum disorder using a refined Human-Robot-Game platform for active learning. Behaviour and Information Technology, 44(13), 3152-3164. https://doi.org/10.1080/0144929x.2024.2434896

Supriyono, S. (2020). Software testing with the approach of blackbox testing on the academic information system. IJISTECH (International Journal of Information System and Technology), 3(2), 227-233. https://doi.org/10.30645/ijistech.v3i2.54

Topu, F. B., Yılmaz, R. M., & Takkaç Tulgar, A. (2023). An examination of pre-school children's interaction levels and motivation in learning English with AR-supported educational toys. International Journal of Human–Computer Interaction, 39(20), 4024-4041. https://doi.org/10.1080/10447318.2022.2108960

Zhang, M., Ding, H., Naumceska, M., & Zhang, Y. (2022). Virtual reality technology as an educational and intervention tool for children with autism spectrum disorder: current perspectives and future directions. Behavioral Sciences, 12(5), 138. https://doi.org/10.3390/bs12050138




DOI: https://doi.org/10.17509/ijotis.v5i2.96517

Refbacks

  • There are currently no refbacks.


Copyright (c) 2026 Universitas Pendidikan Indonesia

Creative Commons License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.