Evaluating the contribution of inter- and transdisciplinary networks to collaborative research

Abstract New forms of research spanning and engaging different sectors and disciplines promise to provide holistic approaches to complex socio-ecological problems. The increasing complexity in terms of determining the composition of research teams, diversity of disciplines and protocols for the communication and translation of science is problematic, and many questions remain open regarding the evaluation of these novel endeavours between interdisciplinary research (IDR) and transdisciplinary research (TDR). This paper conceptualises and tests a participatory and reflexive evaluative approach tailored to TDR projects. The focus is on the development and testing of psychometric scales for the evaluation of TDR. A case study of a transdisciplinary (TD) collaborative science network is presented as an example of this type of research assessment and evaluation. The results of a longitudinal survey series capturing the TD scales are reported: two psychometric scales are tested; IDR values (IV) and TDR evaluation (TDE). One- and three-factor solutions were identified using confirmatory factor analysis. The authors suggest making these scales part of a holistic evaluative approach that accompanies TDR in progress as it allows evaluators to simultaneously monitor the evolution of values and attitudes towards TD alongside a project self-evaluation. The evaluation scales presented in this paper underline the importance of taking a multi-dimensional approach to research evaluation assessing the diverse dimensions of TDR, such as relevance, additionality, learning, and exchange between disciplines. This paper argues in favour of evaluative approaches that harness the learning potential stemming from constant reflection and self-evaluation in research projects.