PulseExploreJournal ClubDebatesTrendingResearchersJournals
Instagram
HomeExploreJournal ClubTrending
Synapse
⌘+K
Synapse
October 18, 20250 citationsOpen Access

Not in Sync: Unveiling Temporal Bias in Audio Chat Models

View Full Paper
JYJiayu YaoSLShenghua LiuXWXiang Wang

Key Points

  • Models often mispredict timestamps, revealing a substantial temporal bias that affects accuracy.
  • Controlled experiments identified consistent misalignments in timestamps, with errors accumulating to about tens of seconds.
  • The study introduces the Temporal Bias Index, a metric for quantifying systematic timing errors across models and datasets.
  • Findings indicate the necessity for developing architectures that are robust against temporal bias limitations.

Abstract

Large Audio Language Models (LALMs) are increasingly applied to audio understanding and multimodal reasoning, yet their ability to locate when events occur remains underexplored. We present the first systematic study of temporal bias in LALMs, revealing a key limitation in their timestamp prediction. For example, when asked "At which second does the lecturer introduce the key formula?", models often predict timestamps that are consistently earlier or later than the ground truth. Through controlled experiments on timestamped datasets, we find that temporal bias (i) is prevalent across datasets and models, (ii) increases with audio length - even accumulating to tens of seconds in extended recordings, and (iii) varies across event types and positions. We quantify this effect with the Temporal Bias Index (TBI), measuring systematic misalignment in predicted event timings, and complement it with a visualization framework. Our findings highlight a fundamental limitation in current LALMs and call for the development of temporally robust architectures.

Ask AI
Helpful
Bookmark
Share
View Full Paper

Cite This Study

Yao et al. (2025) studied this question.

synapsesocial.com/papers/68f408995de60f8893c6ffcfhttps://doi.org/10.48550/arxiv.2510.12185
Ask AI
Helpful
Bookmark
Share
View Full Paper