Evaluasi pengalaman penggunaan Artificial Intelligence pada ChatGPT dan Gemini dalam proses pembelajaran di Samarinda dengan metode User Experience Questionnaire

Ulya Chamidah, Hario Jati Setyadi, Muhammad Rivani Ibrahim

Abstract


Artificial Intelligence (AI) plays a crucial role and provides substantial benefits across various fields, particularly in education. Among AI-based applications, ChatGPT has demonstrated exceptionally high usage, with 14.6 billion visits recorded in 2024, while Gemini registered 241.6 million visits during the same period. This study emphasizes the need to evaluate user experience in order to measure, analyze, and assess how users interact with a product, system, or service. One effective method for evaluating user experience is the User Experience Questionnaire (UEQ), which offers comprehensive measurement scales covering hedonic quality, attractiveness, and pragmatic quality, thereby enabling comparative evaluation through standardized questionnaires.The population of this study consists of ChatGPT and Gemini users involved in the learning process in Samarinda, with samples selected using a simple random sampling technique. Data evaluation was conducted using the UEQ Data Analysis Tool. The results indicate that, for both ChatGPT and Gemini, the Efficiency scale achieved the highest scores, with mean values of 2.013 for ChatGPT and 1.723 for Gemini. Conversely, the lowest scores for both applications were observed on the Novelty scale, with mean values of 1.185 for ChatGPT and 1.241 for Gemini.


Keywords


UEQ Data Analysis Tool; ChatGPT; Gemini; Artificial Intelligence; UEQ

Full Text:

PDF

References


Akgun, S., & Greenhow, C. (2022). Artificial intelligence in education: Addressing ethical challenges in K-12 settings. AI and Ethics, 2(3), 431–440. https://doi.org/10.1007/s43681-021-00096-7

Ameniar, N., Prastawa, H., & Rosyada, Z. F. (2022). Evaluasi User Experience Menggunakan Metode User Experience Questionnaire (UEQ) Dan Penerapan Kansei Engineering Pada Aplikasi Cinepolis Cinemas Indonesia. Industrial Engineering Online Journal, 11(4), 1–8. https://ejournal3.undip.ac.id/index.php/ieoj/article/view/35951

Annisa, F. D. N., Jaya, J. N. U., & Surmiati, S. (2022). Evaluasi Pengalaman Pengguna Pada Aplikasi E-Wallet OVO dan GOPAY Dengan Metode User Experience Questionnaire. Journal of Information System Research (JOSH), 3(3), 242–251. https://doi.org/10.47065/josh.v3i3.1527

Chen, L., Chen, P., & Lin, Z. (2020). Artificial intelligence in education: A review. IEEE access, 8, 75264–75278. https://doi.org/10.1109/ACCESS.2020.2988510

Handoko, R. M. H., Wahyuni Putra, Ryan Delon Pratama, Nova Noor Kamalasari, & Viktor Handrianus Pranatawijaya. (2024). Implementasi Gemini Ai Dalam Pengembangan Aplikasi E-Commerce Mobile Generate Deskripsi Produk. ProTekInfo (Pengembangan Riset Dan Observasi Teknik Informatika), 11(1), 21–25. https://doi.org/10.30656/protekinfo.v11i1.8595

Hinderks, A., Schrepp, M., Mayo, F. J. D., Escalona, M. J., & Thomaschewski, J. (2019). Developing a UX KPI based on the user experience questionnaire. Computer Standards & Interfaces, 65, 38–44. https://doi.org/10.1016/j.csi.2019.01.007

Ibrahim, M. R., Soepriyadi, A., Bambang Basuki, N., & Pamilih Widagdo, P. (2024). Implementasi Metode User Experience Questionnaire Pada Website Kepegawaian Universitas Mulawarman. Jurnal Rekayasa Teknologi Informasi (JURTI), 8(1), 41–48. https://doi.org/10.30872/jurti.v8i1.15772

Imran, M., & Almusharraf, N. (2024). Google Gemini as a next generation AI educational tool: a review of emerging educational technology. Smart Learning Environments, 11(1), 22. https://doi.org/10.1186/s40561-024-00310-z

Indahsari, R. D., Andini, T. D., Irsyada, A. E., & Indahsari, R. D. (2024). Pembelajaran Secara Optimal di SMK Al-Basthomi Loceret Nganjuk. 3(2), 81–88. https://doi.org/10.26798/jpm.v3i2.1450

Jiang, Y., Li, X., Luo, H., Yin, S., & Kaynak, O. (2022). Quo vadis artificial intelligence?. Discover Artificial Intelligence, 2(1), 1–19. https://doi.org/10.1007/s44163-022-00022-8

Khuntari, D. (2022). Analisis pengalaman pengguna aplikasi Gojek dan Grab dengan pendekatan User Experience Questionnaire. Jurnal Teknik Informatika dan Sistem Informasi, 8(1), 275–286. https://doi.org/10.28932/jutisi.v8i1.4499

Masruroh, A. A., Juita, R., & Pangaribuan, B. (2023). Analisis Kepuasan Penggguna Pada Layanan Aplikasi Mobile Jaminan Kesehatan Nasional (JKN) Menggunakan Metode User Experience Questionnaire (UEQ). INFORMAL: Informatics Journal, 8(2), 143. https://doi.org/10.19184/isj.v8i2.38011

Maulani, T. J., Suprapto, S., & Perdanakusuma, A. R. (2021). Evaluasi user experience menggunakan metode usability testing dan user experience questionnaire (ueq)(studi kasus: Website superprof. co. id dan zonaprivat. com). Jurnal Pengembangan Teknologi Informasi dan Ilmu Komputer, 5(6), 2639–2645. https://j-ptiik.ub.ac.id/index.php/j-ptiik/article/view/9384

Rasio, H. S., & Perdana, S. R. (2020). Evaluasi User Experience Sistem Informasi Akademik Mahasiswa pada Perguruan Tinggi Menggunakan User Experience Questionnaire. Jurnal Komputer Terapan, 6(1), 69–78. https://doi.org/10.35143/jkt.v6i1.3582

Sahabudin, A. (2023). ChatGPT: Sebuah transformasi cara belajar mahasiswa studi kasus: mahasiswa itbm polman di kabupaten polewali mandar. Jurnal E-Bussiness Institut Teknologi Dan Bisnis Muhammadiyah Polewali Mandar, 3(1), 65–73. https://doi.org/10.59903/ebussiness.v3i1.63

Sari, R. P. (2024). Top 10 Aplikasi AI Paling Sering Dipakai, ChatGPT Paling Populer. Cloud Computing Indonesia. https://www.cloudcomputing.id/berita/top-10-aplikasi-ai

Serdianus, S., & Saputra, T. (2023). Peran artificial intelligence ChatGPT dalam perencanaan pembelajaran di era revolusi industri 4.0. Masokan: Jurnal Ilmu Sosial Dan Pendidikan, 3(1), 1–18. https://orcid.org/0000-0003-4504-1781

Suganda, A. (2023). Memilih AI Yang Tepat Untuk Guru: Perbandingan Fitur Gemini, ChatGPT, dan Claude AI. Jurnal Inovasi Teknologi Dan Edukasi Teknik, 3(11), 2. https://doi.org/10.17977/um068.v3.i11.2023.2

Xu, Y., Liu, X., Cao, X., Huang, C., Liu, E., Qian, S., ... & Zhang, J. (2021). Artificial intelligence: A powerful paradigm for scientific research. The innovation, 2(4), 1–20. https://doi.org/10.1016/j.xinn.2021.100179

Zawacki-Richter, O., Marín, V. I., Bond, M., & Gouverneur, F. (2019). Systematic review of research on artificial intelligence applications in higher education–where are the educators?. International journal of educational technology in higher education, 16(1), 39. https://doi.org/10.1186/s41239-019-0171-0




DOI: https://doi.org/10.17509/manajerial.v24i2.87250

Refbacks

  • There are currently no refbacks.


Copyright (c) 2026 Universitas Pendidikan Indonesia (UPI)

Creative Commons License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.

Creative Commons License

Jurnal Manajerial is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.

View My Stats