Dynamic Replay Training for Class-Incremental Learning

Replay-based methods for Class-Incremental Learning (CIL) typically employ new classes and a limited subset of old classes stored in memory to facilitate the model training. However, these methods often lead to class imbalance and catastrophic forgetting, where the model forgets previously learned tasks. While some studies have attempted to address such a class imbalance issue, they do not fully consider the dynamic nature of forgetting in the model. In this paper, we propose a novel method called Dynamic Replay Training (DRT) to address the dynamic forgetting of previously learned tasks by the model. DRT replays memory data with dynamically changing frequencies, offering a novel perspective to tackle catastrophic forgetting and class imbalance. The proposed method is evaluated on CIFAR-100 and ImageNet-100 in various settings, showing significant improvements of 8.28% and 4.53% in terms of classification accuracy compared to the baseline method on the two datasets, respectively.