Level 5 – Structural Complexity (SC) Reliability Protocol (v1.0-S-R)

Key Points

• The aim is to establish a reliable protocol for measuring structural complexity using inter-rater agreement.
• Defines a rating scale from 0 to 2 for structural complexity.
• Utilizes linearly weighted Cohen's κ for assessing agreement.
• Includes operational criteria and a two-rater procedure.
• Provides a 15-slot rating form for evaluations.
• Achieves a threshold of κw_SC ≥ 0.75 for robust inter-rater reliability.
• Demonstrates clear operational criteria for evaluators.
• Illustrates the procedure with an example for clarity.