REVIEW 10 cited by
Exploring Large Language Models for Knowledge Graph Completion
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
Signed reviews
read the original abstract
Knowledge graphs play a vital role in numerous artificial intelligence tasks, yet they frequently face the issue of incompleteness. In this study, we explore utilizing Large Language Models (LLM) for knowledge graph completion. We consider triples in knowledge graphs as text sequences and introduce an innovative framework called Knowledge Graph LLM (KG-LLM) to model these triples. Our technique employs entity and relation descriptions of a triple as prompts and utilizes the response for predictions. Experiments on various benchmark knowledge graphs demonstrate that our method attains state-of-the-art performance in tasks such as triple classification and relation prediction. We also find that fine-tuning relatively smaller models (e.g., LLaMA-7B, ChatGLM-6B) outperforms recent ChatGPT and GPT-4.
Forward citations
Cited by 10 Pith papers
-
Enhancing Large Language Model for Knowledge Graph Completion via Structure-Aware Alignment-Tuning
SAT uses hierarchical contrastive alignment and a unified graph instruction to tune a lightweight adapter for knowledge graph completion, reporting large link prediction gains.
-
K-ON: Stacking Knowledge On the Head Layer of Large Language Model
K-ON stacks K prediction heads onto an LLM to generate entity tokens in one step and uses entity-level contrastive learning, achieving new state-of-the-art results on two knowledge graph completion benchmarks.
-
Self-supervised Quantized Representation for Seamlessly Integrating Knowledge Graphs with Large Language Models
A self-supervised VQ-VAE with a GCN encoder and semantic distillation learns discrete entity codes that, when used as LLM tokens, improve link prediction and triple classification with only 16 tokens per entity.
-
KG-Retriever: Efficient Knowledge Indexing for Retrieval-Augmented Large Language Models
A retrieval-augmented generation system that combines an entity knowledge graph and a document similarity graph to answer multi-hop questions accurately in a single retrieval pass.
-
Deep Sparse Latent Feature Models for Knowledge Graph Completion
DSLFM-KGC couples sparse latent community models with BERT text features and contrastive learning, improving state-of-the-art scores on Wikidata5M-Ind, WN18RR, and UMLS.
-
Neuro-Symbolic Frameworks: Conceptual Characterization and Empirical Comparative Analysis
A facet-based comparison of DeepProbLog, Scallop, and DomiKnowS with efficiency measurements on four toy tasks, identifying challenges for future neurosymbolic frameworks.
-
Large Language Model-Enhanced Symbolic Reasoning for Knowledge Base Completion
LeSR uses an LLM to propose logic rules from sampled subgraphs, then a trainable reasoner weights those rules against the knowledge base and combines them with RotatE for KBC.
-
ReaLM: Residual Quantization Bridging Knowledge Graph Embeddings and Large Language Models
Using residual quantization to represent KG entities as code tokens lets an LLM do link prediction and reach reported state-of-the-art MRR on WN18RR (0.608) and FB15k-237 (0.467) when ontology constraints are added.
-
KG-BiLM: Knowledge Graph Embedding via Bidirectional Language Models
A bidirectional decoder with a graph-aware attention mask, knowledge-masked prediction, and contrastive sub-graph alignment achieves reported state-of-the-art link prediction on Wikidata5M and competitive results on WN18RR.
-
Evo-DKD: Dual-Knowledge Decoding for Autonomous Ontology Evolution in Large Language Models
A proposed dual-decoder LLM for autonomous ontology evolution is described but never implemented; only a prompt-based simulation with a 1.1B model on 120 evaluation examples is tested.
Discussion (0). Continue with ORCID to comment.