We ran a controlled laboratory experiment to examine whether ChatGPT's aid can increase the participants' performance in three different – reading and writing, mathematical problem-solving, and computational thinking – tasks. We find that the maths score significantly decreases with ChatGPT's assistance. This result is mainly because the low-ability subjects couldn't discern the hallucinated answers with the correct ones, and it contests the general idea that ChatGPT can complement the workers with less expertise.
No takes yet. Share an insight, caveat, or question.
Kim et al. (2024) studied this question.
Synapse has enriched 4 closely related papers on similar clinical questions. Consider them for comparative context: