CONTENT VALIDITY RATIO AND CONFIRMATORY FACTOR ANALYSIS OF THREE TIER TEST INSTRUMENT ON SOLUTION BALANCE CONCEPTS

Erni Tuherni, Euis Nursa'adah, Isriyanti Affifah

Abstract


 

Three tier test is one of the instruments which can be used to detect conception level of the students. This developed-three tier test instrument consists of three levels of question. The first tier is multiple choice, the second tier is reason to choose the answer, and the third tier is affirmative question about the belief of the answers chosen on the first and second tier. An instrument can be used as it well-qualified; that can be seen from its validity and reliability value.  One of the methods that used to measure the instrument’s validity is Content Validity Ratio (CVR) and Confirmatory Factor Analysis (CFA) while a method that used to measure the instrument’s reliability is cronbach test.  The quality of tree tier instrument test, based on CVR result in an average 0.64, indicates that the instrument had owned conformity content with the measured-domain, and CFA in a MSA-average 0.805, indicates that the instrument had been valid and can develop the construct that measured in accordance with the developed-indicators as well as the three tier instrument’s reliability in Cronbach’s Alpha value 0.927 insists that the three tier instrument that developed has a quite good reliability value. Among 27 instruments that had been analyzed, 12 instruments of them considered valid based on CVR and CFA examination result. 

 

ABSTRAK

Three tier adalah salah satu instrumen yang dapat digunakan dalam mendeteksi tingkat konsepsi yang terjadi pada peserta didik. Instrument Three Tier yang dikembangkan ini meliputi 3 tingkatan soal. Pada tingkat pertama (First-tier) berupa pilihan ganda, tingkat kedua (Second-tier) berupa alasan dalam pemilihan jawaban, dan tingkat ketiga (Third-tier) berupa pertanyaan penegasan tentang keyakinan dari jawaban yang telah dipilih pada tingkat satu dan dua. Suatu instrumen dapat digunakan apabila memiliki kualitas yang baik dilihat dari nilai validitas dan reliabilitas. Salah satu metode yang digunakan untuk mengukur validitas instrumen yaitu dengan menggunakan content validity ratio (CVR) dan confirmatory factor analysis (CFA). Kualitas instrument three tier berdasarkan hasil CVR (Content Validity Ratio) dengan rata-rata nilai 0,64 menunjukkan instrumen telah memiliki kesesuaian isi dengan domain yang diukur, dan CFA (Confirmatory Factor Analysis) dengan nilai MSA rata-rata sebesar 0,805 menunjukkan bahwa instrumen telah valid dan dapat membangun konstruk yang diukur sesuai dengan indikator yang dikembangkan serta realiabilitas instrument three tier dengan nilai Cronbach’s Alpha sebesar 0,927 mengungkapkan bahwa instrument three tier yang dikembangkan memiliki nilai reliabilitas yang cukup baik. Dari 27 instrumen yang dianalisis, terdapat 12 instrument three tier yang valid berdasarkan hasil uji CVR dan CFA.


Keywords


Three tier test, content validity ratio (CVR), confirmatory factor analysis (CFA)

References


Arikunto, S. (2012). Dasar-dasar Evaluasi Pendidikan . Jakarta: PT. Bumi Akasara.

Brady, J. E. (2010). Kimia Universitas Asas & Struktur Jilid 2. Jakarta: Binarupa Aksara.

Caleon, I. (2009). Development and Applications od a Three tier Diagnostic test to Assess Secondary Students' Understanding of Waves. International Journal of Science Education.

Cetiadindar, A. (2014). Development of a Three Tier Test to Assess High School Students' Understanding of Acids and Bases. Procedia Social and Behavioral Sciences.

Chang, R. (2003). Kimia dasar jilid 2. Jakarta: Erlangga.

Chittleborough, D. F. (2007). The Modeling Ability of non Major Chemistry Student and Their Understanding of The Submicroscopic Level. Chemistry Education Research and Practice Journal.

Cullinane, A. L. (2011). Two Tier Multiple Choice Question (MCQs)-How Effective are they: A Pre-Servis Teacher's Perspective. UK:IOSTE-NW Europe.

David F. Treagust, M. M. (2007). The Development of a Two Tier Multiple Choice Diagnostic Instrument for Evaluating Secondary School Students Ability to Describe and Explain Chemical Reaction Using Multiple Levels of Representation. Chemistry Education Research and Practice Journal.

Froncek, C. (2014). Characteristic pf Effevtive Exam-Development and Validation of an Instrumet for Evaluating Writtem Exam. Studies in Educational Evaluation

Ghazali, N. H. (2016). A Reliability and Validity of an Instrument to Evaluate the School based Assessment System: A Pilot Study. International Journal of Evaluation & Research in Education.

H.D Barke, H. A. (2009). Miskonception in Chemistry. Adresing Perception in Chemical Education . Germany: Spinger.

Hakan, K. (2011). CIPP Evaluation Model Scale : Development, Reliability and Validity. Procedia Social and Behavioral Science.

Kaltakci, D. (2012). Development and Application of a Four Tier Test to Assess Pre-service Physics Teachers Missconception About Geometrical Optics. a thesis submitted to the graduate school of natural and applied sciences of middle east technical university.

Kaltakci, D. (2012). Identifying Pre-service Physics Teachers Misconceptions with Three tier test. Eurasia Journal of Mathematics, Science and Technology Education.

Kaltakci, D. (2015). A Review and Comparison of Diagnostic Instruments to Identify Students' Misconceptions in Science. Eurasia Journal of Mathematics, Science and Technology Education.

Kirbulut, Z. D. (2014). Using Three Tier Diagnostic Test to Assess Students Misconceptions of States of Matter. Eurasia Journal of Mathematics, Science & Technology Education.

Kirbulut, Z. D. (2014). Using Three tier Diagnostic test to Assess Students' Misconceptions of States of Matter . Eurasia Journal of Mathematics, Science and Technology Education.

Kowsalya. (2012). Development and Validation of a Scale to Assess Self-Concept inMild Intellectually Disabled Children . International Journal Soc. Sci & Education.

Nursalam. (2018). Developing test Instrument for Measurement of Students' High Order Thinking Skill on Mathematics in Junior High School in Makasar. International Conference on Statistic, Mathematics, Teaching and Research.

R Justi, G. J. (2009). The Application of a "Model of Modeling to Illistrate the Importance Of Metavisualisation in Respect of the Three Types of Representation.

Romine, W. L. (2015). Development and Application Of A Novel Rasch Based Methodology For Evaluating Multi-Tiered Assesment Instrument : Validation and Utilization Of An Undergraduate Diagnostic Test Of The Water Cycle. International Journal on Science Education .

Saxena, A. C. (2014). A Confirmatory Factor Analysis of Knowledge Management Assessment Instrument in Indian Higher Educational Institution . International Journal of Quality & Reliability Management.

Taherdoost, H. (2016). Validity and Reliability of the Research Instrument : How to test the Validation of a Questionnaire/Survey in a Research. International Journal of Academic Research in Management .

Tuysuz. (2009). Development of Two Tier Diagnostic Instrument and Assess Students' Understanding in Chemistry. Academic Journal .

Yin, K. A. (2010). Misconceptions in The Singapore and Malaysia. Proceedings of The Sunway Academic Conference Swan Convention Center.




DOI: https://doi.org/10.18269/jpmipa.v24i1.17271

Refbacks

  • There are currently no refbacks.


Copyright (c) 2019 Jurnal Pengajaran MIPA

JPMIPA http://ejournal.upi.edu/index.php/jpmipa/index is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License

Jurnal Pengajaran Matematika dan Ilmu Pengetahuan Alam (JPMIPA) or Journal of Mathematics and Science Teaching 

All rights reserverd. pISSN 1412-0917 eISSN 2443-3616

Copyright © Faculty of Mathematics and Science Education (FPMIPA) Universitas Pendidikan Indonesia (UPI)

 

View JPMIPA Stats