Evaluation of emergency preparedness exercises: the design of a questionnaire to measure staff perceptions

Evaluation is an essential part of health emergency preparedness exercises (HEPE) that allows identification of limitations in performance. Addressing limitations enhances preparedness. However, there is a lack of reliable and validated tools to assist with exercise evaluation. This study reports the design and validation of a questionnaire to collect data from participants to study their experiences with HEPE and perceptions of their own and their organisation's emergency preparedness. Questionnaire test-retest reliability using ICC was checked (N = 27). Internal reliability using Cronbach's alpha is reported separately for discussion-based (N = 97) and operation-based exercises (N = 238). Analysis checked for discriminant validity and sensitivity to change. The questionnaire consists of four scales (parts): pre-exercise assessment, participant's perceptions, exercise feedback, and satisfaction with the exercise. All scales demonstrated good internal consistency for both exercise types (Cronbach's alpha: 0.672-0.940), but mixed test-retest agreement for the pre-exercise and exercise feedback scales. The questionnaire offers a valid and reliable tool for assessing healthcare staff perceptions of emergency preparedness and exercise satisfaction.