REVIEW 5 cited by
Exploring Large Language Models for Knowledge Graph Completion
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
Knowledge graphs play a vital role in numerous artificial intelligence tasks, yet they frequently face the issue of incompleteness. In this study, we explore utilizing Large Language Models (LLM) for knowledge graph completion. We consider triples in knowledge graphs as text sequences and introduce an innovative framework called Knowledge Graph LLM (KG-LLM) to model these triples. Our technique employs entity and relation descriptions of a triple as prompts and utilizes the response for predictions. Experiments on various benchmark knowledge graphs demonstrate that our method attains state-of-the-art performance in tasks such as triple classification and relation prediction. We also find that fine-tuning relatively smaller models (e.g., LLaMA-7B, ChatGLM-6B) outperforms recent ChatGPT and GPT-4.
Forward citations
Cited by 5 Pith papers
-
Enhancing Large Language Model for Knowledge Graph Completion via Structure-Aware Alignment-Tuning
SAT uses hierarchical contrastive alignment and a unified graph instruction to tune a lightweight adapter for knowledge graph completion, reporting large link prediction gains.
-
K-ON: Stacking Knowledge On the Head Layer of Large Language Model
K-ON stacks K prediction heads onto an LLM to generate entity tokens in one step and uses entity-level contrastive learning, achieving new state-of-the-art results on two knowledge graph completion benchmarks.
-
ReaLM: Residual Quantization Bridging Knowledge Graph Embeddings and Large Language Models
Using residual quantization to represent KG entities as code tokens lets an LLM do link prediction and reach reported state-of-the-art MRR on WN18RR (0.608) and FB15k-237 (0.467) when ontology constraints are added.
-
KG-BiLM: Knowledge Graph Embedding via Bidirectional Language Models
A bidirectional decoder with a graph-aware attention mask, knowledge-masked prediction, and contrastive sub-graph alignment achieves reported state-of-the-art link prediction on Wikidata5M and competitive results on WN18RR.
-
Evo-DKD: Dual-Knowledge Decoding for Autonomous Ontology Evolution in Large Language Models
A proposed dual-decoder LLM for autonomous ontology evolution is described but never implemented; only a prompt-based simulation with a 1.1B model on 120 evaluation examples is tested.
Discussion (0). Continue with ORCID to comment.