REVIEW 9 cited by
GraphLLM: Boosting Graph Reasoning Ability of Large Language Model
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
The advancement of Large Language Models (LLMs) has remarkably pushed the boundaries towards artificial general intelligence (AGI), with their exceptional ability on understanding diverse types of information, including but not limited to images and audio. Despite this progress, a critical gap remains in empowering LLMs to proficiently understand and reason on graph data. Recent studies underscore LLMs' underwhelming performance on fundamental graph reasoning tasks. In this paper, we endeavor to unearth the obstacles that impede LLMs in graph reasoning, pinpointing the common practice of converting graphs into natural language descriptions (Graph2Text) as a fundamental bottleneck. To overcome this impediment, we introduce GraphLLM, a pioneering end-to-end approach that synergistically integrates graph learning models with LLMs. This synergy equips LLMs with the ability to proficiently interpret and reason on graph data, harnessing the superior expressive power of graph learning models. Our empirical evaluations across four fundamental graph reasoning tasks validate the effectiveness of GraphLLM. The results exhibit a substantial average accuracy enhancement of 54.44%, alongside a noteworthy context reduction of 96.45% across various graph reasoning tasks.
Forward citations
Cited by 9 Pith papers
-
Harnessing Adaptive Topology Representations for Zero-Shot Graph Question Answering
DynamicTRF learns question-level preferences over eight graph representations and routes each query to the best one, improving zero-shot graph QA accuracy and output brevity on seven algorithmic and two downstream tasks.
-
GraphRunner: A Multi-Stage Framework for Efficient and Accurate Graph-Based Retrieval
GraphRunner improves graph-based retrieval by generating and validating a complete traversal plan before executing high-level multi-hop actions, outperforming Graph-CoT on GRBENCH with 10 to 50 percent higher accuracy...
-
Efficient Text-Attributed Graph Learning through Selective Annotation and Graph Alignment
GAGA matches or exceeds state-of-the-art accuracy on several text-attributed graph benchmarks while requiring large language model annotations for only 1% of nodes or edges.
-
The Graph Language: How Knowledge Graphs Speak to Large Language Models
GRALAN uses question-focused subgraphs, a graph encoder, and a learned mediator to let a frozen LLM answer KG questions by classifying entities, reporting state-of-the-art or near-SOTA accuracy on several QA benchmarks.
-
A Comprehensive Data-centric Overview of Federated Graph Learning
A data-centric taxonomy for Federated Graph Learning that classifies 79 studies by data characteristics and data utilization, plus a discussion of integration with pre-trained large models.
-
Masked Language Models are Good Heterogeneous Graph Generalizers
A masked language model fine-tuned on metapath-derived text and cloze-style task templates transfers across heterogeneous graph datasets better than HGNN and LLM baselines, though link prediction results are compromis...
-
Graph Counselor: Adaptive Graph Exploration via Multi-Agent Synergy to Enhance LLM Reasoning
A multi-agent GraphRAG framework with self-reflection improves LLM accuracy on knowledge graph question answering.
-
Walk&Retrieve: Simple Yet Effective Zero-shot Retrieval-Augmented Generation via Knowledge Graph Walks
Offline walks over a knowledge graph, verbalized into text and retrieved by embedding similarity, let a single LLM call answer multi-hop questions competitively without any fine-tuning.
-
Trustworthy GNNs with LLMs: A Systematic Review and Taxonomy
A review that groups LLM-GNN trustworthiness research under four dimensions, reliability, robustness, privacy, and reasoning, with no new experiments.
Discussion (0). Continue with ORCID to comment.