Performance evaluation in visual surveillance using the F-measure

Majority of visual surveillance algorithms rely on effective and accurate motion detection.However,most evaluation techniques described in literature do not address the complexity and range of the issues which underpin the design of good evaluation methodology.In this paper we explore the problems associated with optimising the operating point of motion detection algorithms and objective performance evaluation. We emphasise advantages of object-based approach, examine problems associated with ROC optimisation and propose a solution based on F-measure optimisation.Finally, we describe a motivated and comprehensive methodology for evaluation of motion detection within the wider context of a surveillance system.