REVIEW 10 cited by
A Comprehensive Survey of Continual Learning: Theory, Method and Application
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
To cope with real-world dynamics, an intelligent system needs to incrementally acquire, update, accumulate, and exploit knowledge throughout its lifetime. This ability, known as continual learning, provides a foundation for AI systems to develop themselves adaptively. In a general sense, continual learning is explicitly limited by catastrophic forgetting, where learning a new task usually results in a dramatic performance degradation of the old tasks. Beyond this, increasingly numerous advances have emerged in recent years that largely extend the understanding and application of continual learning. The growing and widespread interest in this direction demonstrates its realistic significance as well as complexity. In this work, we present a comprehensive survey of continual learning, seeking to bridge the basic settings, theoretical foundations, representative methods, and practical applications. Based on existing theoretical and empirical results, we summarize the general objectives of continual learning as ensuring a proper stability-plasticity trade-off and an adequate intra/inter-task generalizability in the context of resource efficiency. Then we provide a state-of-the-art and elaborated taxonomy, extensively analyzing how representative methods address continual learning, and how they are adapted to particular challenges in realistic applications. Through an in-depth discussion of promising directions, we believe that such a holistic perspective can greatly facilitate subsequent exploration in this field and beyond.
Forward citations
Cited by 10 Pith papers
-
ReCoLoRA: Spectrum-Aware Recursive Consolidation for Continual LLM Fine-Tuning
Spectrum-initialized LoRA with elbow ranks and recursive SVD consolidation of the effective weight beats rank-swept PEFT baselines on three of four 7–8B models in continual GLUE fine-tuning.
-
Class Incremental Continual Learning with Self-Organizing Maps and Variational Autoencoders Using Synthetic Replay
A SOM-VAE generative replay method stores per-unit Gaussian statistics instead of raw data and reports competitive class-incremental accuracy on standard benchmarks.
-
Continual Learning in Transition
A tri-axial framework of When, Where, and How organizes the ongoing transition of continual learning from parameter-centric updates to system-level capability evolution.
-
Learning to Quantize and Precode in Massive MIMO Systems for Energy Reduction: a Graph Neural Network Approach
A self-supervised GNN with straight-through Gumbel-softmax training performs non-linear quantized precoding, matching 3-bit MRT rate with 1-bit DACs in single-user massive MIMO, though the GNN processing power limits ...
-
Integrating Traditional Technical Analysis with AI: A Multi-Agent LLM-Based Approach to Stock Market Forecasting
An LLM-based multi-agent system that identifies Elliott Wave patterns achieved 44-89% directional accuracy on six US stocks, with deep reinforcement learning backtesting improving accuracy on most but not all test cases.
-
Dealing with the Evil Twins: Improving Random Augmentation by Addressing Catastrophic Forgetting of Diverse Augmentations
Random augmentation can trigger gradient collisions ("evil twins") that cause forgetting; selectively averaging drifted weights with a snapshot improves single-source domain generalization.
-
Continual Speech Learning with Fused Speech Features
Gated fusion of frozen Whisper layers improves continual learning on six speech tasks, with the double-stage variant best overall.
-
Continual Learning Beyond Experience Rehearsal and Full Model Surrogates
SPARC achieves strong continual learning accuracy with a fraction of the parameters of surrogate-based methods by combining task-specific depthwise filters with shared pointwise filters updated by exponential averaging.
-
Information-Theoretic Complementary Prompts for Improved Continual Text Classification
InfoComp learns per-task private prompts and one shared prompt with parameter-alignment and SimSiam-style losses, reporting consistent accuracy gains over prior state-of-the-art continual text classification methods o...
-
Infinite Video Understanding
The paper argues that video understanding research should aim at processing streams of arbitrary, unbounded duration and outlines the challenges, directions, and metrics needed.
Discussion (0). Sign in to comment.