pith. sign in

arxiv: 2401.08514 · v1 · pith:YVFC3XHXnew · submitted 2024-01-16 · 💻 cs.LG · cs.DM· cs.DS· math.CO

Beyond Weisfeiler-Lehman: A Quantitative Framework for GNN Expressiveness

classification 💻 cs.LG cs.DMcs.DSmath.CO
keywords expressivityhomomorphismexpressivenessmodelspracticalabilitycommunityframework
0
0 comments X
read the original abstract

Designing expressive Graph Neural Networks (GNNs) is a fundamental topic in the graph learning community. So far, GNN expressiveness has been primarily assessed via the Weisfeiler-Lehman (WL) hierarchy. However, such an expressivity measure has notable limitations: it is inherently coarse, qualitative, and may not well reflect practical requirements (e.g., the ability to encode substructures). In this paper, we introduce a unified framework for quantitatively studying the expressiveness of GNN architectures, addressing all the above limitations. Specifically, we identify a fundamental expressivity measure termed homomorphism expressivity, which quantifies the ability of GNN models to count graphs under homomorphism. Homomorphism expressivity offers a complete and practical assessment tool: the completeness enables direct expressivity comparisons between GNN models, while the practicality allows for understanding concrete GNN abilities such as subgraph counting. By examining four classes of prominent GNNs as case studies, we derive simple, unified, and elegant descriptions of their homomorphism expressivity for both invariant and equivariant settings. Our results provide novel insights into a series of previous work, unify the landscape of different subareas in the community, and settle several open questions. Empirically, extensive experiments on both synthetic and real-world tasks verify our theory, showing that the practical performance of GNN models aligns well with the proposed metric.

This paper has not been read by Pith yet.

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Forward citations

Cited by 2 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. Algorithmic Foundations of Deep Learning: Complexity-Theoretic Rates and a Characterization of Universal Approximation

    cs.LG 2026-06 unverdicted novelty 8.0

    Neural networks emulate real-valued circuits with explicit complexity bounds controlled by gate count and structure; any definable model with a parallelization condition is a universal approximator precisely when it c...

  2. QuIC: A Training-Free Quantum Graph Embedding from Ideal Analysis to Practical Hardware Evaluation

    quant-ph 2026-04 unverdicted novelty 7.0

    QuIC provides a training-free quantum graph embedding proven permutation-invariant and injective for labeled graphs under an irrational-angle condition in the ideal case, with empirical separation shown on noisy hardw...