Understanding generative artificial intelligence literacy in higher education: Development and validation of an instrument

Generative artificial intelligence (GenAI) is rapidly entering higher education, creating a need to assess students’ GenAI literacy (GenAIL). Drawing on existing GenAIL frameworks and related assessment instruments, this study developed and validated the Generative Artificial Intelligence Literacy Scale for College Students (GenAILS-CS) as an instrument for assessing GenAIL in higher education. Survey data from 658 undergraduates were split for exploratory (n = 329) and confirmatory (n = 329) factor analyses. Results supported a five-dimensional, 21-item structure covering cognitive understanding, skill application, critical reflection, ethical responsibility, and collaborative innovation. Evidence indicated acceptable-to-good fit, internal consistency, convergent and discriminant validity, positive associations with GenAI use frequency, and measurement invariance across gender and grade level. The instrument could inform diagnostic assessment and targeted GenAIL support in higher education.