Answers are grounded in this paper and cite their sources.
Automatic highlight detection in sports broadcasting requires models that can localise brief impact events and longer narrative arcs at the same time, and produce meaningful semantic descriptions across sports with markedly different broadcast grammars. Hand-crafted pipelines and single-scale deep architectures struggle on all three fronts, and the difficulty compounds when a system is asked to transfer from one discipline to another. We propose a framework that couples a hierarchical vision Transformer backbone with a three-branch multi-scale temporal attention module and a contrastively aligned semantic decoder, optimised end-to-end under uncertainty-weighted multi-task losses. The backbone equips tube embedding with a learned shot-grammar prior tailored to broadcast footage; the attention module operates at short, medium and long temporal scales fused through a content-dependent gate that adapts to event duration without any explicit duration supervision. A hierarchical decoder emits three semantic axes—action category, participating subjects and event nature—trained jointly with detection through a shared representation. Experiments on SoccerNet-v2, NCAA Basketball and a tennis benchmark report 51.7 ± 0.4 mAP@0.5 and CIDEr 1.42 ± 0.02 over three random seeds, outperforming six competitive baselines including ActionFormer and MViTv2 at p < 0.01. Component-wise ablations isolate the contribution of the shot-grammar prior, the learned duration-aware gate and the shared decoder, and confirm that the gains do not follow from added parameters alone. A qualitative captioning and failure-mode analysis identifies replay overlays, amateur fixed-camera footage and severe occlusion as the three residual weaknesses. Inference runs at 47 ms per 96-frame clip on a single A100 GPU under batch size 1; sustained streaming on a full 90-minute broadcast reaches roughly 2.1× real time once buffering and causal masking are accounted for. Present evidence covers three sports categories only, so we treat the cross-sport claim as encouraging rather than proven; extending it to gymnastics, motorsports and combat sports remains open.
No takes yet. Share an insight, caveat, or question.
Liu et al. (2026) studied this question.
Synapse has enriched 10 related papers. Consider them for comparative context: