Efficient Pre-Trained Semantics Refinement for Video Temporal Grounding

This is the authors' abstract. We don't add key points for this paper.

Video Temporal Grounding (VTG) is a fine-grained video understanding task that aims to ground the relevant video moments corresponding to given language queries. Most existing approaches utilize powerful Vision-Language Models (VLMs), augmented with additional network architectures or specialized modules to supplement temporal reasoning capabilities. Despite achieving impressive performance, these approaches tend to overlook a critical issue that pre-trained visual and textual representations are not specifically optimized for VTG. Particularly, such representations often suffer from inter-modal semantic misalignment referring to the inconsistency between different modalities, and intra-modal semantic confusion, caused by insufficient discriminability within visual modality. To address these limitations, we propose an efficient semantics refinement framework built upon pre-trained models, featuring two core components. First, the Modal Knowledge Bidirectional Propagation (MKBP) component promotes inter-modal semantic alignment via bidirectional enrichment of textual and visual semantics, exploiting their complementary strengths without introducing additional parameters. Second, the Content Context Contrast Learning (C3L) component alleviates intra-modal semantic confusion within visual modality by bringing query-specific visual features closer while separating irrelevant ones. Comprehensive experiments on six benchmark datasets demonstrate the superior performance of our proposed methods.