Multidimensional Computerized Adaptive Testing for Indonesia Junior High School Biology

Bor-Chen Kuo; Muslem Daud; Chih-Wei Yang

doi:10.12973/eurasia.2015.1384a

Full Text (PDF)

Bor-Chen Kuo ¹ ^* , Muslem Daud ¹, Chih-Wei Yang ¹

More Detail

¹ National Taichung University of Education^* Corresponding Author

Abstract

Background:
This paper describes a curriculum-based multidimensional computerized adaptive test that was developed for Indonesia junior high school Biology.

Materials and methods:
In adherence to the Indonesian curriculum of different Biology dimensions, 300 items was constructed, and then tested to 2238 students. A multidimensional random coefficients multinomial logit model was used to develop multidimensional scales.

Results:
A simulation study based on the item and ability parameters estimated from real data is conducted to evaluate the performance of the proposed Biology-MCAT system. The results show that the bias and standard error of Biology-MCAT system are acceptable.

Conclusions:
It suggests that, this online assessment system can be a model for Indonesian National Examination in future.

Keywords

science education
computerized adaptive testing
Indonesia assessment
multidimensional random coefficients multinomial logit model

License

This is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Article Type: Research Article

EURASIA J Math Sci Tech Ed, Volume 11, Issue 5, 2015, 1105-1118

https://doi.org/10.12973/eurasia.2015.1384a

Publication date: 25 Aug 2015

Article Views: 2156

Article Downloads: 1149

Open Access References How to cite this article

References

Adams, R. J., Wilson, M. R., & Wang, W.C. (1997). The multidimensional random coefficients multinomial logit model. Applied Psychological Measurement, 21, 1–23.
Babcock, B., & Weiss, D. J. (2012). Termination criteria in computerized adaptive tests: Do variable-length CATs provide efficient and effective measurement? Journal of Computerized Adaptive Testing, 1(1), 1–17.doi: 10.7333/1212-0101001
Chae, S., Kang, U., Jeon, E., & Linacre, J.M. (2000). Development of computerized middle school achievement test. Seoul: Komesa Press.
Chen, P. H. (2006). The influences of the ability estimation methods on the measurement accuracy in multidimensional computerized adaptive testing. Bulletin of Educational Psychology, 38(2), 195–211.
Clark, L.A., & Watson, D. (1995). Constructing validity: Basic issues in objective scale development. Psychological Assessment, 7(3), 309–319.
DeVellis, R. F. (2003).Scale development: Theory and applications, 2nd ed., London: SAGE Publications.
Firman, H., & Tola, B. (2008). The future of schooling in Indonesia. Journal of International Cooperation in Education, 11(1), 71–84.
Hinkin, T. R. (1995).A review of scale development practices in the study of organizations. Journal of Management, 21(5), 967–988.
Kuo, B. C., & Daud, M. (2014a), Biology Scale Development for junior secondary school students, Aceh Indonesia. In The fifth Pacific Rim Conference on education: Educational innovation (pp.109–110). Taipei: University of Taipei.
Kuo, B. C., & Daud, M. (2014b). Computerized adaptive testing as an innovation for Indonesian national examination. In International Multidisciplinary Conference (pp.223- 231). Jakarta: Jakarta Muhammadiyah University.
Kuo, B. C., & Daud, M. (2015). CAT untuk UN jujur [CAT for an honest national examination]. Retrieved April 14, 2015, http://aceh.tribunnews.com/2015/04/14/cat-untuk-unjujur
Kustiyahningsih, Y., & Cahyani, A. D. (2013). Computerized adaptive test based on item response theory in e-learning system. International Journal of Computer Applications, 81(6), 6-11.doi: 10.5120/14014-2022
Maryono, M., & Purnama, B.E. (2012). Education policy development with development strategy application of national test exercises for vocational high school: Case study vocational high school Bina Taruna Masaran Sragen. International Journal of Computer Science Issues, 9(5), 136–145.
Meijer, R. R., & Nering, M.L. (1999). Computerized adaptive testing: Overview and introduction. Applied Psychological Measurement, 23(187).doi:10.1177/01466219922031310
Nguyen, P.C. (2010). Author guidelines for reporting scale development and validation results in the Journal of the Society for Social Work and Research. Journal of the Society for Social Work and Research, (1)2, 99–103.
OECD. (2012). PISA 2009 technical report PISA. OECD Publishing. doi: http://dx.doi.org/10.1787/9789264167872-en
Osman, K., & Kaur, S. J. (2014). Evaluating biology achievement scores in an ICT integrated PBL environment. Eurasia Journal of Mathematics, Science & Technology Education, 10(3), 185–194.
Ozyurt, O., & Ozyurt, H. (2013). An examination of computer engineering students’ perceptions about asynchronous discussion forums. Eurasia Journal of Mathematics, Science & Technology Education, 9(4), 371–378.
Pietzner, V. (2014). Computer-based learning in chemistry classes. Eurasia Journal of Mathematics, Science & Technology Education, 10(4), 297–311.
Rahmi, U. (2011). An evaluation of the Indonesian National Examination. Retrieved November 02, 2014,fromhttps://zh.scribd.com/doc/48858766/An-Evaluation-of-IndonesianNational-Examination
Reckase, M. D. (2009). Multidimensional item response theory, Statistics for social and behavioral sciences. Springer Science &Business Media.doi 10.1007/978-0-387-89976-31
Segall, O.D. (1996). Multidimensional adaptive testing, PSYCHOMETRIKA, 61(2), 331–354.
Solopos. (2014, April 22).Jual beli kunci UN sindikat penjual kunci UN beroperasi lintas daerah [National examination syndicate key answer seller operated nationally]. Retrieved November 11, 2014, from http://www.solopos.com/2014/04/22/jual-beli-kunci-unsindikat-penjual-kunci-un-beroperasi-lintas-daerah-503932?mobile_switch=mobile
Sulistyo, G.H. (2009). English as a measurement standard in the national examination: Some grassroots voice. TEFLIN Journal, 20(1), 1–24.
The Ministry of National Education (2006). Peraturan menteri pendidikan nasional nomor 23 tanggal 23 mei 2006 about standar kompetensi lulusan (SKL) [Regulation of national education ministry number 23 date 23 may 2006 about graduate standard competencies]. Jakarta: MONE.
Thomson, N.A., & Weiss, D.J. (2012). A framework for the development of computerized adaptive tests. Practical Assessment, Research and Evaluation, 16(1), 1–9.
van der Linden, W.J., & Glas, G.A. (2002). Computerized adaptive testing: Theory and practice. New York: Kluwer Academic Publishers.
Wainer, H. (2000). Computerized adaptive testing: A Primer. 2nd ed., New Jersey: Lawrence Erlbaum Associates.
Wang, C., Chang, H.H., & Boughton, K.A. (2012). Deriving stopping rules for multidimensional computerized adaptive testing. Applied Psychological Measurement, 37(2), 99–122. doi: 10.1177/0146621612463422
Wang, H.P., Kuo, B.C., & Chao, R.C. (2011). A multidimensional computerized adaptive testing system for enhancing the Chinese as Second Language proficiency test. Selected Topics in Education and Educational Technology, 5, 245–252
Wang, H.P., Kuo, B.C., Tsai, Y.H., & Liao, C.H. (2012). A CEFR-based computerized adaptive testing system for Chinese proficiency. The Turkish Online Journal of Educational Technology, 11(4), 1–12.
Wang, T., Hanson, B. A., & Lau, C. M. (1999). Reducing bias in CAT trait estimation: A comparison of approaches. Applied Psychological Measurement, 23, 263–278. doi: 10.1177/01466219922031383
Weiss, D.J. (2011). Item banking, test development, and test delivery. Minnesota: University of Minnesota Press.
Wilson, M., & Adams, R. J. (1995). Rasch models for item bundles. PSYCHOMETRIKA, 60,181– 198.
Wu, M. (2012). ConQuest Software. Australia: Australian Software Ltd.
Yao, L. (2012). Comparing the performance of five multidimensional CAT selection procedures with different stopping rules. Applied Psychological Measurement, 37(1), 3– 23.doi: 10.1177/0146621612455687

How to cite this article

APA

Kuo, B.-C., Daud, M., & Yang, C.-W. (2015). Multidimensional Computerized Adaptive Testing for Indonesia Junior High School Biology. Eurasia Journal of Mathematics, Science and Technology Education, 11(5), 1105-1118. https://doi.org/10.12973/eurasia.2015.1384a

Vancouver

Kuo BC, Daud M, Yang CW. Multidimensional Computerized Adaptive Testing for Indonesia Junior High School Biology. EURASIA J Math Sci Tech Ed. 2015;11(5):1105-18. https://doi.org/10.12973/eurasia.2015.1384a

AMA

Kuo BC, Daud M, Yang CW. Multidimensional Computerized Adaptive Testing for Indonesia Junior High School Biology. EURASIA J Math Sci Tech Ed. 2015;11(5), 1105-1118. https://doi.org/10.12973/eurasia.2015.1384a

Chicago

Kuo, Bor-Chen, Muslem Daud, and Chih-Wei Yang. "Multidimensional Computerized Adaptive Testing for Indonesia Junior High School Biology". Eurasia Journal of Mathematics, Science and Technology Education 2015 11 no. 5 (2015): 1105-1118. https://doi.org/10.12973/eurasia.2015.1384a

Harvard

Kuo, B.-C., Daud, M., and Yang, C.-W. (2015). Multidimensional Computerized Adaptive Testing for Indonesia Junior High School Biology. Eurasia Journal of Mathematics, Science and Technology Education, 11(5), pp. 1105-1118. https://doi.org/10.12973/eurasia.2015.1384a

MLA

Kuo, Bor-Chen et al. "Multidimensional Computerized Adaptive Testing for Indonesia Junior High School Biology". Eurasia Journal of Mathematics, Science and Technology Education, vol. 11, no. 5, 2015, pp. 1105-1118. https://doi.org/10.12973/eurasia.2015.1384a