A Pilot Study of the Use and Attitudes Toward Large Language Models Across Academic Disciplines

Abstract This study investigates college students' use of and attitude toward large language models (LLMs). The primary research questions are, "What are students' perceptions of the ethical use of large language models in college coursework and other settings?" and "How does teaching about large-language models impact student understanding of the applications of machine-learning, plagiarism, and ethics in specific content areas?" Our mixed-methods study involves pre- and post-module surveys with questions assessing students' attitudes and perceptions about the ethics of large language model use in college and professional settings. The learning module includes an introductory video, interactive slide presentation, and discussion questions. We collected additional data through a related assignment. Participants were students from introductory engineering courses, along with those in computer science, science, and humanities courses, in the fall 2023 semester. Our study considers the impact of LLMs in engineering education, addressing opportunities for enhancing students' understanding of machine learning and ethical considerations in college and the workplace. The results will offer insights to educators, allowing for more effective integration of LLMs in engineering curricula.