Bidirectional Associative Memory for Multimodal Fusion : a Depression Evaluation Case Study

In this study, we step aside from traditional fusion strategies and propose to use a bidirectional associative memory to combine abstract representations of several modalities. The innovative contribution of our strategy is the fact that the fusion is performed neither at the input data level nor at the output score level. The model achieves outperforming results on depression evaluation from the videos of the AVEC2014 challenge corpus.