pith. machine review for the scientific record. sign in

hub

Pitfalls of graph neural network evaluation

14 Pith papers cite this work. Polarity classification is still indexing.

14 Pith papers citing it
abstract

Semi-supervised node classification in graphs is a fundamental problem in graph mining, and the recently proposed graph neural networks (GNNs) have achieved unparalleled results on this task. Due to their massive success, GNNs have attracted a lot of attention, and many novel architectures have been put forward. In this paper we show that existing evaluation strategies for GNN models have serious shortcomings. We show that using the same train/validation/test splits of the same datasets, as well as making significant changes to the training procedure (e.g. early stopping criteria) precludes a fair comparison of different architectures. We perform a thorough empirical evaluation of four prominent GNN models and show that considering different splits of the data leads to dramatically different rankings of models. Even more importantly, our findings suggest that simpler GNN architectures are able to outperform the more sophisticated ones if the hyperparameters and the training procedure are tuned fairly for all models.

hub tools

citation-role summary

background 2

citation-polarity summary

fields

cs.LG 12 cs.AI 2

years

2026 14

verdicts

UNVERDICTED 14

roles

background 2

polarities

background 1 unclear 1

representative citing papers

Neighbourhood Transformer: Switchable Attention for Monophily-Aware Graph Learning

cs.LG · 2026-04-10 · unverdicted · novelty 7.0

Neighbourhood Transformers apply local self-attention for monophily-aware graph learning, guarantee expressiveness at least as strong as message-passing GNNs, and outperform prior methods on node classification across ten datasets while cutting memory and time costs substantially.

Random-Set Graph Neural Networks

cs.AI · 2026-05-12 · unverdicted · novelty 6.0

RS-GNNs predict random sets over classes using belief functions to jointly produce class probabilities and epistemic uncertainty estimates for graph nodes.

Learning Graph Foundation Models on Riemannian Graph-of-Graphs

cs.LG · 2026-05-11 · unverdicted · novelty 6.0

R-GFM constructs multi-scale Riemannian graph-of-graphs to learn geometry-adaptive representations, reducing structural domain generalization error and delivering up to 49% relative gains on downstream graph tasks.

Toward a universal foundation model for graph-structured data

cs.LG · 2026-04-07 · unverdicted · novelty 6.0

A pretrained graph model using feature-agnostic structural prompts matches or exceeds supervised baselines and shows strong zero-shot and few-shot transfer on held-out biomedical graphs, with a 21.8% ROC-AUC gain on SagePPI.

Layer Embedding Deep Fusion Graph Neural Network

cs.LG · 2026-04-25 · unverdicted · novelty 5.0

LEDF-GNN fuses multi-layer embeddings nonlinearly and runs parallel processing on original and reconstructed topologies to capture long-range dependencies and mitigate heterophily-induced misaggregation in deep GNNs.

citing papers explorer

Showing 14 of 14 citing papers.