Assessing the validity and reliability of science multiple choice test using rasch dichotomous measurement model

Najah Hazirah Mohd Dzin and Lay, Yoon Fah (2021) Assessing the validity and reliability of science multiple choice test using rasch dichotomous measurement model. Journal of Baltic Science Education, 20. pp. 924-941. ISSN 1648-3898 (P-ISSN) , 2538-7138 (E-ISSN)

	Text Assessing the validity and reliability of science multiple choice test using rasch dichotomous measurement model.pdf Download (43kB)
	Text Assessing the validity and reliability of science multiple choice test using rasch dichotomous measurement model1.pdf Restricted to Registered users only Download (650kB)

URL: http://oaji.net/articles/2021/987-1639222215.pdf

Abstract

Multiple choice tests are widely applied to assess students’ knowledge in science education. This study aimed at assessing the validity and reliability of Science Multiple-choice Test in Malaysia. The items for this test were formulated by the researcher together with a panel of science teachers and the head of the science department with close reference to Secondary School Standard Curriculum (KSSM) syllabus. The test consists of 50 multiple-choice items with four options. Rasch measurement model was adopted to evaluate the quality of the Science Multiple-choice Test in terms of reliability analysis, item polarity analysis (PTMEA-CORR), item fit analysis and Principal Component Analysis of Residuals (PCAR). The reliability analysis was performed using Cronbach’s Alpha, and the results of reliability and separation index respectively indicated good reliability level of the test items. In order to improve the validity of the test, two negatively worded items (Q39 and Q40) were removed. Lastly, the PCAR analysis showed the unexplained variance in the 1st contrast (5.4%) was found to be well controlled and was below the ceiling value of one-third of the variance explained by the item (18.7%). However, the positive value of the disattenuated correlations indicate no evidence of the presence of secondary dimension.

Item Type:	Article
Keyword:	Multiple-choice test , Rasch measurement model , Reliability and validity, Science subject , Secondary school standard curriculum
Subjects:	L Education > LB Theory and practice of education > LB5-3640 Theory and practice of education > LB1603-1696.6 Secondary education. High schools
Department:	FACULTY > Faculty of Psychology and Education
Depositing User:	SITI AZIZAH BINTI IDRIS -
Date Deposited:	16 Mar 2022 15:34
Last Modified:	16 Mar 2022 15:34
URI:	https://eprints.ums.edu.my/id/eprint/31861

Actions (login required)

View Item