DEVELOPMENT OF FUEL CELL ELECTRIC VEHICLE TEST INSTRUMENT FOR STUDENTS WITH GEMINI AI MULTI-ROUND

Andika Naufal Puku, Sriyono Sriyono, Wahid Munawar, Deliana Amanda

Abstract


This Research and Development study, adopting the 4D model, aims to develop and test the feasibility of a valid and reliable knowledge test instrument for Fuel Cell Electric Vehicle (FCEV) material for students of Automotive Engineering Education, while integrating the methodological innovation of the Gemini AI Multi-Round large language model. The development process included the Define stage (analyzing the need for a standard instrument) and the Design stage (developing the test blueprint from cognitive levels C1 to C6). In the Develop stage, test items were created using the iterative Gemini AI Multi-Round procedure; the blueprint was validated by three experts, yielding a Content Validity Index of 1 (Valid). The Disseminate stage involved testing the instrument on 30 students. Quantitative analysis using Anates V4.0 showed the instrument is reliable, with an Alpha coefficient of 0.890. The majority of items were rated "Good" (70%), with difficulty levels predominantly "Moderate" (66.6%) and a discriminating power rated "Satisfactory" (48.3%). However, a significant weakness was found in distractor effectiveness, where 50 items (83.3%) were deemed "Not Functioning Well". In conclusion, this research successfully presents an efficient and innovative procedure using AI to produce a valid and reliable FCEV test instrument.

 

Penelitian Research and Development model 4D ini bertujuan mengembangkan dan menguji kelayakan instrumen tes pengetahuan Fuel Cell Electric Vehicle (FCEV) yang valid dan reliabel bagi mahasiswa Pendidikan Teknik Otomotif, dengan mengintegrasikan inovasi metodologis Gemini AI Multi-Round. Proses pengembangan melibatkan tahapan Define (analisis kebutuhan akan instrumen baku) dan Design (penyusunan kisi-kisi C1 hingga C6). Dalam tahap Develop, butir soal dikembangkan melalui prosedur iteratif Gemini AI Multi-Round, di mana kisi-kisi divalidasi oleh tiga ahli dengan menghasilkan nilai Content Validity Index  sebesar 1 (Valid). Uji coba pada 30 mahasiswa menunjukkan instrumen reliabel, dengan koefisien Alpha mencapai 0,890. Kualitas butir tes mayoritas "Baik" (70%) dengan tingkat kesukaran "Sedang" (66,6%) dan daya beda "Cukup Memuaskan" (48,3%). Meskipun demikian, terdapat kelemahan signifikan pada efektivitas distraktor, di mana 50 butir soal (83,3%) dinyatakan "Belum Berfungsi Baik". Secara keseluruhan, penelitian ini menyajikan prosedur inovatif yang efisien untuk menghasilkan instrumen FCEV yang valid dan reliabel.


Full Text:

PDF

References


Arikunto, S. (2018). Dasar-dasar evaluasi pendidikan (Edisi revisi). Bumi Aksara.

Gronlund, N. E., & Linn, R. L. (1990). Measurement and evaluation in teaching (6th ed.). Macmillan.

Haladyna, T. M., Downing, S. M., & Rodriguez, M. C. (2002). A review of multiple-choice item-writing guidelines for classroom assessment. Applied Measurement in Education, 15(3), 309–334. https://doi.org/10.1207/S15324818AME1503_5

Institute for Essential Services Reform. (2021). Indonesia Electric Vehicle Outlook 2021. IESR.

International Energy Agency. (2022). Global EV Outlook 2022. International Energy Agency.

Kementerian Perindustrian Republik Indonesia. (2023). Perkembangan industri kendaraan listrik di Indonesia.

Kompas.com. (2024). Populasi kendaraan listrik di Indonesia terus meningkat.

Mo, T., Li, Y., & Luo, Y. (2023). Advantages and technological progress of hydrogen fuel cell vehicles. World Electric Vehicle Journal, 14(6), 162. https://doi.org/10.3390/wevj14060162

Nitko, A. J., & Brookhart, S. M. (2011). Educational assessment of students (6th ed.). Pearson Education.

Owan, V. J., Abang, K. B., Idika, D. O., Etta, E. O., & Bassey, B. A. (2023). Exploring the potential of artificial intelligence tools in educational measurement and assessment. Eurasia Journal of Mathematics, Science and Technology Education, 19(8), em2307. https://doi.org/10.29333/ejmste/13428

Rizky, A., Pratama, D., & Wibowo, A. (2023). Kesiapan pembelajaran kendaraan listrik di pendidikan vokasi otomotif. Jurnal Pendidikan Teknologi dan Kejuruan, 29(2), 145–154.

Sari, D., & Puspitasari, R. (2023). Tantangan implementasi pembelajaran kendaraan listrik di pendidikan tinggi vokasi. Jurnal Pendidikan Vokasi, 13(1), 45–55.

Suratno. (2017). Metodologi penelitian pengembangan. UNNES Press.

Tamtomo, D., Dwilaksono, & Subiyanto. (2022). Kesesuaian kurikulum otomotif dengan kebutuhan industri kendaraan listrik. Jurnal Pendidikan Vokasi, 12(3), 321–330.

Thiagarajan, S., Semmel, D. S., & Semmel, M. I. (1974). Instructional development for training teachers of exceptional children. Indiana University.

Yadnyawati, I. A., & Dachliyani, L. (2019). Perencanaan dan pengembangan tes hasil belajar. Graha Ilmu.




DOI: https://doi.org/10.17509/atikanoto.v3i1.95505

Refbacks

  • There are currently no refbacks.


© 2024 ATIKANOTO: Journal of Automotive Engineering Education