Hidden processes of workflow in cognitive developmental psychology

In the study of children's thinking, the research process includes not just the visible steps of study design, data collection, data analyses and write-up but also hidden yet crucial steps that have consequences throughout the workflow process. These steps include informal observations, pilot testing, decisions about inclusion and exclusion criteria and decisions about how to communicate the results. In this article, we critically evaluate the benefits and challenges of these often invisible steps, provide suggestions for determining how best to avoid potential pitfalls and encourage researchers to more transparently communicate decisions that often fall outside traditional method sections. Although we situate this discussion within the context of our specific field of inquiry, we believe that the lessons apply across a range of research endeavours. We end by suggesting that a critical look at this aspect of workflow may provide insights into some of the resistance to methodological reforms in the social sciences. This article is part of the theme issue 'Statistical workflow'.