Development of a fuel cell electric vehicle test instrument using Gemini AI multi-round for students

Andika Naufal Puku, Sriyono Sriyono, Wahid Munawar, Deliana Amanda

Abstract


This Research and Development study, adopting the 4D model, aims to develop and test the feasibility of a valid and reliable knowledge test instrument for Fuel Cell Electric Vehicle (FCEV) material for students of Automotive Engineering Education, while integrating the methodological innovation of the Gemini AI Multi-Round large language model. The development process included the Define stage (analyzing the need for a standard instrument) and the Design stage (developing the test blueprint from cognitive levels C1 to C6). In the Develop stage, test items were created using the iterative Gemini AI Multi-Round procedure; the blueprint was validated by three experts, yielding a Content Validity Index of 1 (Valid). The Disseminate stage involved testing the instrument on 30 students. Quantitative analysis using Anates V4.0 showed the instrument is reliable, with an Alpha coefficient of 0.890. The majority of items were rated "Good" (70%), with difficulty levels predominantly "Moderate" (66.6%) and a discriminating power rated "Satisfactory" (48.3%). However, a significant weakness was found in distractor effectiveness, where 50 items (83.3%) were deemed "Not Functioning Well". In conclusion, this research successfully presents an efficient and innovative procedure using AI to produce a valid and reliable FCEV test instrument.


Keywords


fuel cell Eeectric vehicle (FCEV); gemini AI; multi-round; reliability; test instrument; validity

Full Text:

PDF

References


Arikunto, S. (2018). Dasar-dasar evaluasi pendidikan (Edisi revisi). Bumi Aksara.

Gronlund, N. E., & Linn, R. L. (1990). Measurement and evaluation in teaching (6th ed.). Macmillan.

Haladyna, T. M., Downing, S. M., & Rodriguez, M. C. (2002). A review of multiple-choice item-writing guidelines for classroom assessment. Applied Measurement in Education, 15(3), 309–334. https://doi.org/10.1207/S15324818AME1503_5

Institute for Essential Services Reform. (2021). Indonesia Electric Vehicle Outlook 2021. IESR.

International Energy Agency. (2022). Global EV Outlook 2022. International Energy Agency.

Kementerian Perindustrian Republik Indonesia. (2023). Perkembangan industri kendaraan listrik di Indonesia.

Kompas.com. (2024). Populasi kendaraan listrik di Indonesia terus meningkat.

Mo, T., Li, Y., & Luo, Y. (2023). Advantages and technological progress of hydrogen fuel cell vehicles. World Electric Vehicle Journal, 14(6), 162. https://doi.org/10.3390/wevj14060162

Nitko, A. J., & Brookhart, S. M. (2011). Educational assessment of students (6th ed.). Pearson Education.

Owan, V. J., Abang, K. B., Idika, D. O., Etta, E. O., & Bassey, B. A. (2023). Exploring the potential of artificial intelligence tools in educational measurement and assessment. Eurasia Journal of Mathematics, Science and Technology Education, 19(8), em2307. https://doi.org/10.29333/ejmste/13428

Rizky, A., Pratama, D., & Wibowo, A. (2023). Kesiapan pembelajaran kendaraan listrik di pendidikan vokasi otomotif. Jurnal Pendidikan Teknologi dan Kejuruan, 29(2), 145–154.

Sari, D., & Puspitasari, R. (2023). Tantangan implementasi pembelajaran kendaraan listrik di pendidikan tinggi vokasi. Jurnal Pendidikan Vokasi, 13(1), 45–55.

Suratno. (2017). Metodologi penelitian pengembangan. UNNES Press.

Tamtomo, D., Dwilaksono, & Subiyanto. (2022). Kesesuaian kurikulum otomotif dengan kebutuhan industri kendaraan listrik. Jurnal Pendidikan Vokasi, 12(3), 321–330.

Thiagarajan, S., Semmel, D. S., & Semmel, M. I. (1974). Instructional development for training teachers of exceptional children. Indiana University.

Yadnyawati, I. A., & Dachliyani, L. (2019). Perencanaan dan pengembangan tes hasil belajar. Graha Ilmu.




DOI: https://doi.org/10.17509/atikanoto.v3i1.95505

Refbacks

  • There are currently no refbacks.


© 2024 ATIKANOTO: Journal of Automotive Engineering Education