Answers are grounded in this paper and cite their sources.
Video summarisation, a critical task in multimedia analysis, aims to condense lengthy videos into concise representations while preserving essential content. As the volume of video data grows exponentially, efficient and informative summarisation becomes increasingly crucial. Striking the right balance between preserving essential content and adhering to length constraints remains an emerging field of study. In this context, we explore the fusion of 3D VGG16 (Visual Geometry Group 16-layer network) and BERT (Bidirectional Encoder Representations from Transformers) for video summarisation (3D-BERSUM). This method offers comprehensive coverage by leveraging 3D VGG16 to extract visual features and BERT to understand textual context, ensuring that the generated summaries capture both the visual elements of the footage and the key information conveyed through narration. BERT’s contextual understanding enhances the summarisation process by grasping nuances, relationships, and sentiment in the text, enriching the summary with a deeper understanding of the narrative. By integrating visual and textual information, we generate summaries that convey more than just visual scenes. To assess the performance of 3D-BERSUM, we compared it with existing methods using the content coverage measures (recall, precision, and F1-score) and textual quality metrics (ROUGE and BLEU). The findings indicate that the 3D-BERSUM yields enhancements in recall, precision, and F1-score by 5.6%, 3.9%, and 5.2% for the SumMe dataset, and 10.1%, 7.2%, and 6.1% for the TVSum dataset, respectively. Finally, comparison is performed with other state-of-the-art methods, and the result shows that the superiority of 3D-BERSUM. This underscores the efficacy and potential of our method in achieving enhanced video summarisation performance across diverse datasets and scenarios.
No takes yet. Share an insight, caveat, or question.
R et al. (2025) studied this question.
Synapse has enriched 10 related papers. Consider them for comparative context: