Evaluasi pengalaman penggunaan Artificial Intelligence pada ChatGPT dan Gemini dalam proses pembelajaran di Samarinda dengan metode User Experience Questionnaire

Ulya Chamidah, Hario Jati Setyadi, Muhammad Rivani Ibrahim

Abstract


Artificial Intelligence (AI) plays a crucial role and provides substantial benefits across various fields, particularly in education. Among AI-based applications, ChatGPT has demonstrated exceptionally high usage, with 14.6 billion visits recorded in 2024, while Gemini registered 241.6 million visits during the same period. This study emphasizes the need to evaluate user experience in order to measure, analyze, and assess how users interact with a product, system, or service. One effective method for evaluating user experience is the User Experience Questionnaire (UEQ), which offers comprehensive measurement scales covering hedonic quality, attractiveness, and pragmatic quality, thereby enabling comparative evaluation through standardized questionnaires.The population of this study consists of ChatGPT and Gemini users involved in the learning process in Samarinda, with samples selected using a simple random sampling technique. Data evaluation was conducted using the UEQ Data Analysis Tool. The results indicate that, for both ChatGPT and Gemini, the Efficiency scale achieved the highest scores, with mean values of 2.013 for ChatGPT and 1.723 for Gemini. Conversely, the lowest scores for both applications were observed on the Novelty scale, with mean values of 1.185 for ChatGPT and 1.241 for Gemini.

Keywords


UEQ data analysis tool; ChatGPT; Gemini; artificial intelligence; UEQ

Full Text:

PDF

References


Ameniar, N., Prastawa, H., & Rosyada, Z. F. (2022). Evaluasi User Experience Menggunakan Metode User Experience Questionnaire (UEQ) Dan Penerapan Kansei Engineering Pada Aplikasi Cinepolis Cinemas Indonesia. Industrial Engineering Online Journal, 11(4), 1–8. https://ejournal3.undip.ac.id/index.php/ieoj/article/view/35951

Annisa, F. D. N., Jaya, J. N. U., & Surmiati, S. (2022). Evaluasi Pengalaman Pengguna Pada Aplikasi E-Wallet OVO dan GOPAY Dengan Metode User Experience Questionnaire. Journal of Information System Research (JOSH), 3(3), 242–251. https://doi.org/10.47065/josh.v3i3.1527

Handoko, R. M. H., Wahyuni Putra, Ryan Delon Pratama, Nova Noor Kamalasari, & Viktor Handrianus Pranatawijaya. (2024). Implementasi Gemini Ai Dalam Pengembangan Aplikasi E-Commerce Mobile Generate Deskripsi Produk. ProTekInfo(Pengembangan Riset Dan Observasi Teknik Informatika), 11(1), 21–25. https://doi.org/10.30656/protekinfo.v11i1.8595

Ibrahim, M. R., Soepriyadi, A., Bambang Basuki, N., & Pamilih Widagdo, P. (2024). Implementasi Metode User Experience Questionnaire Pada Website Kepegawaian Universitas Mulawarman. Jurnal Rekayasa Teknologi Informasi (JURTI), 8(1), 41–48. https://doi.org/10.30872/jurti.v8i1.15772

Indahsari, R. D., Andini, T. D., Irsyada, A. E., & Indahsari, R. D. (2024). Pembelajaran Secara Optimal di SMK Al-Basthomi Loceret Nganjuk. 3(2), 81–88. https://doi.org/10.26798/jpm.v3i2.1450

Masruroh, A. A., Juita, R., & Pangaribuan, B. (2023). Analisis Kepuasan Penggguna Pada Layanan Aplikasi Mobile Jaminan Kesehatan Nasional (JKN) Menggunakan Metode User Experience Questionnaire (UEQ). INFORMAL: Informatics Journal, 8(2), 143. https://doi.org/10.19184/isj.v8i2.38011

Rasio, H. S., & Perdana, S. R. (2020). Evaluasi User Experience Sistem Informasi Akademik Mahasiswa pada Perguruan Tinggi Menggunakan User Experience Questionnaire. Jurnal Komputer Terapan, 6(1), 69–78. https://doi.org/10.35143/jkt.v6i1.3582

Sari, R. P. (2024). Top 10 Aplikasi AI Paling Sering Dipakai, ChatGPT Paling Populer. Cloud Computing Indonesia. https://www.cloudcomputing.id/berita/top-10-aplikasi-ai

Suganda, A. (2023). Memilih AI Yang Tepat Untuk Guru: Perbandingan Fitur Gemini, ChatGPT, dan Claude AI. Jurnal Inovasi Teknologi Dan Edukasi Teknik, 3(11), 2. https://doi.org/10.17977/um068.v3.i11.2023.2




DOI: https://doi.org/10.17509/manajerial.v24i2.87250

Refbacks

  • There are currently no refbacks.


Copyright (c) 2026 Universitas Pendidikan Indonesia (UPI)

Creative Commons License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.

Creative Commons License

Jurnal Manajerial is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.

View My Stats