Answers are grounded in this paper and cite their sources.
Evaluation assessments improved using AI chatbots in road design, suggesting the need for more human oversight.
In the realm of educational assessment, the integration of artificial intelligence (AI) offers a promising pathway for the development of robust evaluations. This study explores the application of AI chatbots in crafting and validating examinations tailored to road geometric design, while adhering to the principles of Bloom’s Taxonomy. Utilizing Gemini AI Studio, three distinct exam versions were generated, covering eight crucial topics within road geometric design. A panel of expert chatbots, including Chat GPT 3.5, Claude 3, Sonet, Copilot, Perplexity, and You, assessed the validity of the exam content. These chatbots achieved scores of 9.17 or higher, establishing their proficiency as experts. Subsequent evaluations focused on relevance and wording, revealing high scores for both metrics, indicating the adequacy of the assessment tools. The two remaining versions were administered to student groups enrolled in the Road Construction II course at the Universidad Técnica Particular de Loja. Only 1.2% of students reached Bloom’s Taxonomy level 3, with many questions deemed easy, leading to varying trends in cognitive levels. Comparative analysis of student scores revealed significant discrepancies between a previous “classic” exam. While AI shows potential in crafting valid assessments aligned with Bloom’s Taxonomy, greater human involvement is necessary to ensure high-quality instrument generation.
No takes yet. Share an insight, caveat, or question.
Yasmany García-Ramírez (2025) studied this question.
Synapse has enriched 10 related papers. Consider them for comparative context: