Network evaluation of an innovation platform in continuous quality improvement in Australian Indigenous primary health care

Background From 2014–2019, the Centre of Research Excellence in Integrated Quality Improvement (CRE-IQI) was evaluated as an innovation platform focusing on continuous quality improvement in Indigenous Australian primary health care. Although social network analysis (SNA) is a recognised method for evaluating the functioning, collaboration and effectiveness of innovation platforms, applied research is limited. This study applies SNA to evaluate the CRE-IQI’s functioning as an innovation platform. Methods Two surveys (2017, 2019) were conducted using social survey and network methods. Survey items covered respondent characteristics, their perceptions of the CRE-IQI’s performance, its impact and sociometric relationships. Members’ relationship information was captured for the CRE-IQI at three timepoints: start (retrospectively), mid-term, and final year on three network types (knew, shared information, collaborated). SNA software was used to compute standard network metrics such as diameter, density and centrality, and develop visualisations. Survey and network results were workshopped by members to develop improvement strategies. Results The response rate was 80% in 2017 and 65% in 2019, n = 49 and 47 respectively. Between 2017 and 2019 respondents’ mean ratings of the CRE-IQI’s functioning and achievements in meeting its goals increased. They perceived the CRE-IQI as multi-disciplinary, having effective management and governance, and incorporating Indigenous research leadership, representation and ways of working. Respondents recognised high levels of trust amongst members, rated ‘good communication and coordination with participants’ highly, and ‘facilitating collaboration’ as the CRE’s most strongly recognised achievement. In collaboration and information sharing networks, average path length remained low in 2017 and 2019, indicating good small-world network properties for relaying information. On average, respondents shared information, and collaborated, with more CRE members in 2017 than 2019. However, in both 2017 and 2019 there were new collaborations and information sharing outside of direct collaborations. CRE-IQI outcomes included: evidence generation; knowledge transfer and skills development in quality improvement; research capacity building, career development; mentoring; grant support; development of new projects; health service support; and policy impact. Conclusion This study shows the utility of network analysis in evaluating the functioning, and collaboration, at individual, organisational and health system levels, of an innovation platform, and adds to our understanding of factors enabling successful innovation platforms.