Assessing the Cognitive and Content Validity of the Driver Licensing Knowledge Test: An LLM-Based Approach

View Full Paper

Ask AI

Bookmark

Share

Key Points

The study aims to evaluate the cognitive and content validity of the driver licensing knowledge test, highlighting structural issues in current assessments.
Combined LLM-based automatic classification with expert verification for analyzing 989 test items.
Used the SOLO classification system and driving competency content areas for categorizing items.
Analyzed response rates to assess performance differences based on cognitive levels and content areas.
More than half of the items focused on lower cognitive levels, while higher-order thinking items were rare.
Performance was highest on relational items, indicating potential reliance on intuitive responses rather than analytical thinking.
Significant differences in performance based on cognitive levels and content areas were found, particularly affecting older age groups.

Assesses cognitive and content validity of driver tests, suggesting structural limitations.

No abstract yet. The journal hasn't published one we can show.

No takes yet. Share an insight, caveat, or question.

MIN et al. (2026) studied this question.

View Full Paper

Ask AI

Bookmark

Share