REVIEW 6 cited by
MAEEG: Masked Auto-encoder for EEG Representation Learning
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
Decoding information from bio-signals such as EEG, using machine learning has been a challenge due to the small data-sets and difficulty to obtain labels. We propose a reconstruction-based self-supervised learning model, the masked auto-encoder for EEG (MAEEG), for learning EEG representations by learning to reconstruct the masked EEG features using a transformer architecture. We found that MAEEG can learn representations that significantly improve sleep stage classification (~5% accuracy increase) when only a small number of labels are given. We also found that input sample lengths and different ways of masking during reconstruction-based SSL pretraining have a huge effect on downstream model performance. Specifically, learning to reconstruct a larger proportion and more concentrated masked signal results in better performance on sleep classification. Our findings provide insight into how reconstruction-based SSL could help representation learning for EEG.
Forward citations
Cited by 6 Pith papers
-
Masked Autoencoders for Ultrasound Signals: Robust Representation Learning for Downstream Applications
MAE pre-training on synthetic ultrasound signals transfers to real measured signals and beats from-scratch and CNN baselines on time-of-flight classification, with the biggest gains in low-label regimes.
-
DIVER-0 : A Fully Channel Equivariant EEG Foundation Model
A channel-permutation-equivariant EEG transformer with full spatio-temporal attention achieves competitive BCI performance with only 10% of pretraining data.
-
LSM-2: Learning from Incomplete Wearable Sensor Data
LSM-2 with Adaptive and Inherited Masking learns usable representations directly from incomplete day-long wearable data, outperforming imputation-based baselines on most tasks.
-
MC2SleepNet: Multi-modal Cross-masking with Contrastive Learning for Sleep Stage Classification
MC2SleepNet fuses raw EEG and spectrogram views with contrastive learning and cross-masking to reach state-of-the-art sleep staging accuracy on two public datasets.
-
Omni-Sleep: A Sleep Foundation Model via Hierarchical Contrastive Learning of CNS-ANS Dynamics
Topology-aware hierarchical contrastive pretraining on CNS/ANS PSG partitions yields stronger out-of-domain sleep staging and multi-disease AUROC than SleepFM and SleepGPT under modality ablation.
-
Transformer-based EEG Decoding: A Survey
A survey that classifies Transformer-based EEG decoding models into backbone, hybrid, and customized categories and reviews their applications and limitations.
Discussion (0). Continue with ORCID to comment.