Should I hide my mum's slippers? a design-based pilot study of children's critical engagement with AI sycophancy using a custom AI chatbot

This article reflects on the process, challenges and outcomes of a pilot project that explored the use of a participatory, game-based approach to developing children's critical capabilities with respect to AI literacy. The pilot focussed on AI sycophancy: the tendency of large language models (LLMs) to flatter and agree with users, prioritising likeability and ongoing engagement over accuracy. Our multi-disciplinary team combined expertise in communication and media studies, technology regulation, machine learning, and early childhood education, and actively involved children at various points in the process. We designed a bespoke ‘explainer’ animation and an interactive ‘game’ based on custom-built voice chatbots, which we delivered in a workshop at an Australian school with children aged 6 to 10. The article discusses the process of developing and delivering the pilot, navigating disciplinary boundaries, children's responses to the experience, and the trade-offs involved in a participatory approach to AI ethics for children.