Development and validation of an artificial intelligence literacy scale for students

In today’s technological age, artificial intelligence literacy (AIL) has become a critical issue in the field of education. The ability to understand, use, and critically evaluate artificial intelligence (AI) technologies is recognized as a fundamental competency enabling students to actively participate in the digital age. In this context, the aim of this study is to develop a valid and reliable scale to obtain accurate data on artificial intelligence literacy by examining the concept of artificial intelligence literacy. The study sample consists of 870 students (424 boys, 346 girls) in grades 4, 5, 6, 7 and 8 attending elementary and middle schools. A pool of 50 items was created to measure students’ levels of artificial intelligence literacy. Exploratory Factor Analysis (EFA) resulted in 22 items and 6 subscales. The measurement model obtained from Confirmatory Factor Analysis (CFA) demonstrated good fit. The Cronbach’s Alpha internal consistency coefficient for the scale was found to be 0.857, while the internal consistency coefficients for the subscales ranged between 0.81 and 0.82. The CR, AVE, MSV, and ASV values indicate that the scale possesses both discriminant and convergent validity. In conclusion, the developed scale possesses sufficient characteristics to determine students’ levels of AIL. This study will assist in the development, teaching, and learning of AIL, as well as in the evaluation of AI education.