REVIEW 11 cited by
DropEdge: Towards Deep Graph Convolutional Networks on Node Classification
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
\emph{Over-fitting} and \emph{over-smoothing} are two main obstacles of developing deep Graph Convolutional Networks (GCNs) for node classification. In particular, over-fitting weakens the generalization ability on small dataset, while over-smoothing impedes model training by isolating output representations from the input features with the increase in network depth. This paper proposes DropEdge, a novel and flexible technique to alleviate both issues. At its core, DropEdge randomly removes a certain number of edges from the input graph at each training epoch, acting like a data augmenter and also a message passing reducer. Furthermore, we theoretically demonstrate that DropEdge either reduces the convergence speed of over-smoothing or relieves the information loss caused by it. More importantly, our DropEdge is a general skill that can be equipped with many other backbone models (e.g. GCN, ResGCN, GraphSAGE, and JKNet) for enhanced performance. Extensive experiments on several benchmarks verify that DropEdge consistently improves the performance on a variety of both shallow and deep GCNs. The effect of DropEdge on preventing over-smoothing is empirically visualized and validated as well. Codes are released on~\url{https://github.com/DropEdge/DropEdge}.
Forward citations
Cited by 11 Pith papers
-
LAEF: A Lead-Agnostic ECG Foundation Model Towards Point-of-Care Diagnostics
A 7M-parameter graph ECG foundation model pre-trained with random lead dropout matches 12-lead models on full input and beats zero-padded baselines on most datasets with 1-2 leads.
-
Delving into Instance-Dependent Label Noise in Graph Data: A Comprehensive Study and Benchmark
BeGIN provides 10 graph datasets with six label-noise types and a broad evaluation, showing that LLM-simulated noise hurts GNNs more than uniform or pairwise noise.
-
Pruning Spurious Subgraphs for Graph Out-of-Distribution Generalization
PrunE prunes spurious edges with a size constraint and an epsilon-probability alignment, reporting state-of-the-art graph OOD results despite a weak theoretical analysis.
-
Khan-GCL: Kolmogorov-Arnold Network Based Graph Contrastive Learning with Hard Negatives
Khan-GCL combines KAN encoders with coefficient-based critical feature identification to generate hard negatives and reports state-of-the-art graph classification results.
-
From Diffusion to Reaction-Diffusion: A Dynamical-Systems View of Oversmoothing in Hypergraph Neural Networks
Hypergraph diffusion provably collapses node representations, and a reaction term that exactly cancels diffusion dissipation keeps a designed transverse energy level nonzero in Hypergraph Neural Reaction–Diffusion (HNRD).
-
From Moments to Models: Graphon-Mixture Learning for Mixup and Contrastive Learning
A moment-based clustering of graphs into latent graphon mixtures improves graph mixup and contrastive learning, with a claimed tighter motif-density concentration bound.
-
Asynchronous Message Passing for Addressing Oversquashing in Graph Neural Networks
CAMP updates nodes in centrality-ranked batches to spread information across GNN layers and claims to reduce oversquashing without rewiring, but the proof and evidence are not convincing.
-
Towards a deeper GCN: Alleviate over-smoothing with iterative training and fine-tuning
A training strategy that grows GCN depth gradually, using LoRA fine-tuning and identity initialization, is claimed to reduce over-smoothing and improve accuracy of deep vanilla GCNs.
-
SGS-GNN: A Supervised Graph Sparsification method for Graph Neural Networks
A supervised edge-sampling sparsifier that keeps only 20% of edges can match or beat the full graph for GNN node classification, with especially large gains on heterophilic graphs.
-
Graph-Based Deep Learning for Component Segmentation of Maize Plants
EdgeGAT, combining EdgeConv and graph attention with PCA features, reports mIoU of 93.20% on the Pheno4D maize dataset and 73.35% on the Ao dataset for leaf, stem, and soil segmentation.
-
Rethinking Over-Smoothing in Graph Neural Networks: A Perspective from Anderson Localization
A single-author preprint re-frames GNN over-smoothing as Anderson localization, defining a participation-degree metric and proposing degree-dependent edge reweighting as mitigation, without proof or experiments.
Discussion (0). Continue with ORCID to comment.