REVIEW 4 cited by
Class-Incremental Learning: A Survey
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
Deep models, e.g., CNNs and Vision Transformers, have achieved impressive achievements in many vision tasks in the closed world. However, novel classes emerge from time to time in our ever-changing world, requiring a learning system to acquire new knowledge continually. Class-Incremental Learning (CIL) enables the learner to incorporate the knowledge of new classes incrementally and build a universal classifier among all seen classes. Correspondingly, when directly training the model with new class instances, a fatal problem occurs -- the model tends to catastrophically forget the characteristics of former ones, and its performance drastically degrades. There have been numerous efforts to tackle catastrophic forgetting in the machine learning community. In this paper, we survey comprehensively recent advances in class-incremental learning and summarize these methods from several aspects. We also provide a rigorous and unified evaluation of 17 methods in benchmark image classification tasks to find out the characteristics of different algorithms empirically. Furthermore, we notice that the current comparison protocol ignores the influence of memory budget in model storage, which may result in unfair comparison and biased results. Hence, we advocate fair comparison by aligning the memory budget in evaluation, as well as several memory-agnostic performance measures. The source code is available at https://github.com/zhoudw-zdw/CIL_Survey/
Forward citations
Cited by 4 Pith papers
-
Addressing Imbalanced Domain-Incremental Learning through Dual-Balance Collaborative Experts
DCE trains frequency-aware experts with complementary losses plus a Gaussian-sampled dynamic selector, reporting SOTA accuracy on four imbalanced domain-incremental benchmarks.
-
A Unified Gradient-based Framework for Task-agnostic Continual Learning-Unlearning
UG-CLU derives a four-part gradient update for continual learning and unlearning and shows it outperforms task-level CLU methods on new fine-grained benchmarks.
-
Unsupervised Incremental Learning Using Confidence-Based Pseudo-Labels
ICPL generates pseudo-labels by clustering embeddings with KMeans, keeps only confident ones, and uses them to train class-incremental models without human labels, losing about 10 points versus supervised CIL but beat...
-
C-Flat++: Towards a More Efficient and Powerful Framework for Continual Learning
Adding zeroth- and first-order flatness penalties to continual learning losses yields small consistent accuracy gains across seven methods, with the gated C-Flat++ variant at roughly 30% of the update cost.
Discussion (0). Continue with ORCID to comment.