Abstract Objective:Functional magnetic resonance imaging (fMRI) is crucial for identifying neurological disorder biomarkers, but current deep learning methods face some limitations. Template-dependent methods lack inter-subject specificity and generalizability due to fixed anatomical priors. Emerging template-free models often separate spatial and temporal processing, discarding temporal continuity. To address these limitations, we propose a novel axial slice-centric model that jointly models spatiotemporal representations through end-to-end processing of native 4D fMRI data. This eliminates template dependency while preserving intrinsic brain activity patterns.Approach:Our framework redefines 4D fMRI analysis by decomposing it into 3D spatiotemporal manifolds along the axial axis, enabling joint learning of spatial and temporal features and preserving individualized structure organization. A hierarchical encoder extracts local spatiotemporal interactions within each slice, progressively aggregating information to capture multi-granularity neural patterns. To maintain temporal continuity and computational efficiency, a differentiable TopK operation adaptively selects informative slices and time points, balancing computational demands with long-range temporal dependencies.Main results:Experimental results on the ADNI dataset (324 subjects) and a private disorder of consciousness dataset (164 subjects) demonstrate the effectiveness of our 4D fMRI framework in classifying neurological disorders. Specifically, on the ADNI dataset, our proposed model achieves 97% classification accuracy with over 25% reduction in FLOPs compared to baseline methods. On the private dataset, our model outperforms state-of-the-art approaches by 5% accuracy. Visualization of slice-level attention maps identify biomarkers consistent with previous research, demonstrating that our template-free framework can discover biomarkers comparable to those identified by template-dependent methods.Significance:Our joint spatiotemporal modeling framework, enabled by axial slice-centric decomposition of 4D fMRI data while preserving temporal continuity, achieves excellent complexity-accuracy trade-offs for brain disorder analysis. Biomarker visualization confirms its template-free capability to identify clinically-relevant neural patterns, offering an efficient and interpretable solution for 4D fMRI-based diagnosis.
Zeng et al. (Wed,) studied this question.