REVIEW 15 cited by
One for All: Towards Training One Graph Model for All Classification Tasks
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
Designing a single model to address multiple tasks has been a long-standing objective in artificial intelligence. Recently, large language models have demonstrated exceptional capability in solving different tasks within the language domain. However, a unified model for various graph tasks remains underexplored, primarily due to the challenges unique to the graph learning domain. First, graph data from different areas carry distinct attributes and follow different distributions. Such discrepancy makes it hard to represent graphs in a single representation space. Second, tasks on graphs diversify into node, link, and graph tasks, requiring distinct embedding strategies. Finally, an appropriate graph prompting paradigm for in-context learning is unclear. We propose \textbf{One for All (OFA)}, the first general framework that can use a single graph model to address the above challenges. Specifically, OFA proposes text-attributed graphs to unify different graph data by describing nodes and edges with natural language and uses language models to encode the diverse and possibly cross-domain text attributes to feature vectors in the same embedding space. Furthermore, OFA introduces the concept of nodes-of-interest to standardize different tasks with a single task representation. For in-context learning on graphs, OFA introduces a novel graph prompting paradigm that appends prompting substructures to the input graph, which enables it to address varied tasks without fine-tuning. We train the OFA model using graph data from multiple domains (including citation networks, molecular graphs, knowledge graphs, etc.) simultaneously and evaluate its ability in supervised, few-shot, and zero-shot learning scenarios. OFA performs well across different tasks, making it the first general-purpose across-domains classification model on graphs.
Forward citations
Cited by 15 Pith papers
-
Delving into Instance-Dependent Label Noise in Graph Data: A Comprehensive Study and Benchmark
BeGIN provides 10 graph datasets with six label-noise types and a broad evaluation, showing that LLM-simulated noise hurts GNNs more than uniform or pairwise noise.
-
Beyond Feature and Structure Alignment: Learning Transferable Propagation Knowledge for Graph Foundation Models
ProGFM transfers graph knowledge across domains by learning a prototype bank of per-edge, per-dimension propagation strengths and using them to modulate message passing on unseen graphs.
-
Both Topology and Text Matter: Revisiting LLM-guided Out-of-Distribution Detection on Text-attributed Graphs
LG-Plug mines pseudo-OOD exposures from clustered unlabeled nodes via iterative LLM prompting and regularizes topology-driven graph OOD detectors, cutting FPR95 by ≥7% across six TAG benchmarks.
-
Graph World Model
The Graph World Model uses action nodes and graph message passing to unify multimodal and graph-structured tasks, but its 'outperforms or matches' claim is contradicted by results on Goodreads.
-
Towards Text-free Graph Foundation Models: Rethinking Multi-Domain Graph Contrastive Learning
MDGCL pre-trains graph encoders on multiple domains using same-domain discrimination and a downstream domain-attention mechanism, outperforming existing text-free graph foundation models.
-
GraphLAMA: Enabling Efficient Adaptation of Graph Language Models with Limited Annotations
A frozen-LLM graph model with a small tuned adapter (about 726k parameters, 3MB) outperforms in-context learning and instruction-tuned graph LLMs in few/zero-shot node classification and summary generation.
-
H$^2$GFM: Towards unifying Homogeneity and Heterogeneity on Text-Attributed Graphs
A graph foundation model with text-encoded meta-relations and a mixture of context-adaptive transformers improves accuracy across homogeneous and heterogeneous text-attributed graphs.
-
Efficient Text-Attributed Graph Learning through Selective Annotation and Graph Alignment
GAGA matches or exceeds state-of-the-art accuracy on several text-attributed graph benchmarks while requiring large language model annotations for only 1% of nodes or edges.
-
GOBench: Benchmarking Geometric Optics Generation and Understanding of MLLMs
GOBench measures how well multimodal AI models generate and understand geometric optics, finding that even top models make frequent physical errors.
-
UNIT: Unleash Large Language Models Potential for Graph Continual Learning
UNIT reaches SOTA graph continual learning by one-shot LLM instruction tuning plus uncertainty-aware semantic and structural class anchors that jointly set classifier weights.
-
OpenRTAG: A Comprehensive Benchmark for Robust Text-Attributed Graph Learning under Data Quality Degradation
OpenRTAG is a benchmark that organizes text-attributed-graph data-quality issues into a 3x3 taxonomy (text/structure/label by sparsity/noise/imbalance) and evaluates model robustness across nine datasets and three tasks.
-
Graph Optimization Foundation Model: Tokenizing Graph via A Language-Model Paradigm
A per-graph BERT-style masked random-walk model is repurposed to generate shortest paths and tours, with mixed quality versus classical solvers and no cross-graph transfer evaluation.
-
GSTBench: A Benchmark Study on the Transferability of Graph Self-Supervised Learning
GSTBench finds that masked feature reconstruction (GraphMAE) is the only one of five graph self-supervised pretraining objectives that consistently transfers across eight datasets, while contrastive methods often perf...
-
A Comprehensive Data-centric Overview of Federated Graph Learning
A data-centric taxonomy for Federated Graph Learning that classifies 79 studies by data characteristics and data utilization, plus a discussion of integration with pre-trained large models.
-
Masked Language Models are Good Heterogeneous Graph Generalizers
A masked language model fine-tuned on metapath-derived text and cloze-style task templates transfers across heterogeneous graph datasets better than HGNN and LLM baselines, though link prediction results are compromis...
Discussion (0). Sign in to comment.