Key points are not available for this paper at this time.
Evaluations of teacher professional development programmes are often constrained by reliance on single-source self-report data and partial evaluation designs, limiting the validity of conclusions on training effectiveness. This study evaluates a Reflective Thinking-Based Training programme in Indonesia using Kirkpatrick’s model, strengthened through multi-source triangulation involving teachers, school principals, peer teachers, and students. A convergent mixed-methods design was employed, integrating quantitative and qualitative data across all four levels. The sample comprised 30 lower secondary school teachers. External evaluations were provided by three principals and four peer teachers at Level 3 (Behaviour), and by 266 students at Level 4 (Results). Findings indicate positive outcomes at early levels, with lower scores observed at higher levels. Mean scores ranged from 4.08 (student-reported outcomes) to 4.77 (teacher reactions). The gradual decline across levels suggests that transfer of training into classroom practice and student learning experiences is not automatic. Cross-level analysis indicates that relationships among evaluation levels are conditional rather than deterministic. These findings provide preliminary support for the feasibility of combining a comprehensive four-level evaluation with multi-source triangulation in resource-constrained contexts. For policymakers and practitioners, results underscore the importance of institutional support mechanisms for sustaining the transfer of professional learning into practice.
Wulandari et al. (Wed,) studied this question.