Development and Validation of the Middle Grades Computer Science Concept Inventory (MG-CSCI) Assessment
Arif Rachmatullah 1 , Bita Akram 1, Danielle Boulden 1, Bradford Mott 1, Kristy Boyer 2, James Lester 1, Eric Wiebe 1 *
More Detail
1 North Carolina State University, USA2 University of Florida, USA* Corresponding Author

Abstract

The increasing interest in computer science (CS) and CS-integrated STEM teaching and learning has created a need for assessment instruments that can be used to evaluate the efficacy of innovative instructional approaches to K-12 CS education. However, there is a lack of validated assessment tools aligned to core CS concepts for younger students. This paper reports on the development and validation of a CS concept assessment for middle grades (ages 11-13) students. A total of 27 multiple-choice items were developed, guided by focal knowledge, skills and abilities associated with the concepts of variables, loops, conditionals, and algorithms. These items were administered to 457 middle grades students. The items were presented in form of block-based programming code and administered in a week-long computational modeling intervention. A combination of classical test theory and item response theory approaches were used to validate the assessment. Based on results, it was found that only 24 items are considered valid and reliable items to measure CS conceptual understanding. The results also suggested that the assessment can be used as a pre and post-test to investigate students’ learning gains. This work fills an important gap by providing a key resource for researchers and practitioners interested in assessing middle grades student CS conceptual understanding.

License

This is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Article Type: Research Article

EURASIA J Math Sci Tech Ed, Volume 16, Issue 5, May 2020, Article No: em1841

https://doi.org/10.29333/ejmste/116600

Publication date: 14 Feb 2020

Article Views: 4397

Article Downloads: 2575

Open Access References How to cite this article