What type of study is this?

August 26, 2025Open Access

Susceptibility of Assessment Types to AI-Generated Content: a Quasi-Experimental Pilot Study in Digital Health and Health Information Management Education (Preprint)

View Full Paper

Ask AI

Bookmark

Authors

TWTafheem Ahmad WaniLa Trobe University MLMichael LiemLa Trobe University NPNatasha PrasadLa Trobe University

Discussion

Member takes

Overview

Quasi-experimental pilot study assesses ChatGPT's output across diverse assessment types in DIGHIM, indicating limitations in technical accuracy and contextual reasoning.

Key Points

ChatGPT performed best on objective tasks, achieving a mean accuracy of 87.5% in health classification quizzes, but faced challenges in technical assessments.
Reflective assessments had a mean score of 69.4% from ChatGPT, yet responses often lacked industry-specific context and personal touch.
Pilot study utilized a quasi-experimental design, comparing AI-generated responses with student submissions across five varied assessment types.
Study highlights the need for critical thinking and ethical reasoning in assessments to prepare graduates for real-world digital health environments.

Cite This Study

Wani et al. (2025) studied this question.

synapsesocial.com/papers/68af6216ad7bf08b1eae36cc https://doi.org/10.2196/preprints.82988

View Full Paper

Ask AI

Bookmark

August 26, 2025Open Access

Susceptibility of Assessment Types to AI-Generated Content: a Quasi-Experimental Pilot Study in Digital Health and Health Information Management Education (Preprint)

View Full Paper

Ask AI

Bookmark

Authors

TWTafheem Ahmad WaniLa Trobe University MLMichael LiemLa Trobe University NPNatasha PrasadLa Trobe University

Discussion

Member takes

Overview

Quasi-experimental pilot study assesses ChatGPT's output across diverse assessment types in DIGHIM, indicating limitations in technical accuracy and contextual reasoning.

Key Points

ChatGPT performed best on objective tasks, achieving a mean accuracy of 87.5% in health classification quizzes, but faced challenges in technical assessments.
Reflective assessments had a mean score of 69.4% from ChatGPT, yet responses often lacked industry-specific context and personal touch.
Pilot study utilized a quasi-experimental design, comparing AI-generated responses with student submissions across five varied assessment types.
Study highlights the need for critical thinking and ethical reasoning in assessments to prepare graduates for real-world digital health environments.

Cite This Study

Wani et al. (2025) studied this question.

synapsesocial.com/papers/68af6216ad7bf08b1eae36cc https://doi.org/10.2196/preprints.82988

Also Consider

Synapse has enriched 5 closely related papers on similar clinical questions. Consider them for comparative context:

View Full Paper

Ask AI

Bookmark