REVIEW 21 cited by
KG-BERT: BERT for Knowledge Graph Completion
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
Knowledge graphs are important resources for many artificial intelligence tasks but often suffer from incompleteness. In this work, we propose to use pre-trained language models for knowledge graph completion. We treat triples in knowledge graphs as textual sequences and propose a novel framework named Knowledge Graph Bidirectional Encoder Representations from Transformer (KG-BERT) to model these triples. Our method takes entity and relation descriptions of a triple as input and computes scoring function of the triple with the KG-BERT language model. Experimental results on multiple benchmark knowledge graphs show that our method can achieve state-of-the-art performance in triple classification, link prediction and relation prediction tasks.
Forward citations
Cited by 21 Pith papers
-
Toward a Unified Statistical Theory of Unsupervised Pretraining and Supervised Neural Knowledge Graph Learning
A four-term oracle inequality decomposes knowledge-graph prediction risk into approximation, estimation, optimization, and multi-view pretraining error, with a subspace-recovery guarantee for kernel PCA pretraining.
-
RADD: Retrieval-Augmented Discrete Diffusion for Multi-Modal Knowledge Graph Completion
RADD decouples retrieval and reranking in multi-modal KGC via a relation-aware KGE retriever and conditional discrete denoiser, reporting state-of-the-art results on three benchmarks.
-
Panning for Gold: Expanding Domain-Specific Knowledge Graphs with General Knowledge
ExeFuse uses learned 'logic' transformations and density checks to fuse general-graph facts into domain knowledge graphs, but the benchmark labels and baseline comparisons are too underspecified to support the claimed gains.
-
Towards Explainable Job Title Matching: Leveraging Semantic Textual Relatedness and Knowledge Graphs
A self-supervised pipeline that pairs fine-tuned SBERT with a skill knowledge graph reduces RMSE for highly related job title pairs to 0.11, about 25% to 39% below strong baselines.
-
Enhancing Large Language Model for Knowledge Graph Completion via Structure-Aware Alignment-Tuning
SAT uses hierarchical contrastive alignment and a unified graph instruction to tune a lightweight adapter for knowledge graph completion, reporting large link prediction gains.
-
Dark Side of Modalities: Reinforced Multimodal Distillation for Multimodal Knowledge Graph Reasoning
A unimodal student model, taught by reinforcement-selected combinations of multimodal teachers via neighbor-decoupled knowledge distillation, sets new state-of-the-art results on five multimodal knowledge graph reason...
-
BioGraphFusion: Graph Knowledge Embedding for Biological Completion and Reasoning
A hybrid semantic-structural graph model with CP decomposition, LSTM-based relation refinement, query-guided subgraph propagation, and a blended scoring function reports state-of-the-art accuracy on three biomedical k...
-
Hyper-modal Imputation Diffusion Embedding with Dual-Distillation for Federated Multimodal Knowledge Graph Completion
A masked diffusion imputer plus dual distillation (MMFeD3-HidE) improves link prediction on a new federated multimodal knowledge graph benchmark with 50% missing visual/textual modalities.
-
Two-dimensional Taxonomy for N-ary Knowledge Representation Learning Methods
A survey of n-ary knowledge representation learning methods proposes a two-dimensional taxonomy based on modeling technique and entity role/position awareness.
-
HERGC: Heterogeneous Experts Representation and Generative Completion for Multimodal Knowledge Graphs
HERGC combines a multimodal expert-based retriever with a fine-tuned LLM re-ranker to achieve state-of-the-art multimodal knowledge graph completion on MKG-W, MKG-Y, and DB15K.
-
K-ON: Stacking Knowledge On the Head Layer of Large Language Model
K-ON stacks K prediction heads onto an LLM to generate entity tokens in one step and uses entity-level contrastive learning, achieving new state-of-the-art results on two knowledge graph completion benchmarks.
-
Sentence Splitter: Uncovering Latent Factual Structure for Self-Supervised Learning
A T5-based sentence splitter trained on verbalized knowledge-graph triples extracts prefix–tail pairs from raw text, and the resulting structure-aware supervision raises few-shot CommonsenseQA and ATOMIC completion scores.
-
mRAKL: Multilingual Retrieval-Augmented Knowledge Graph Construction for Low-Resourced Languages
mRAKL reformulates multilingual knowledge graph completion as question answering and shows that retrieving context from Wikipedia improves tail-entity prediction for Tigrinya and Amharic, with gains up to 8.79 points ...
-
Language Models as Ontology Encoders
OnT combines pretrained language models with hyperbolic embeddings and role rotations to encode EL ontologies, and reports better axiom prediction and inference than existing methods.
-
Flow-Modulated Scoring for Semantic-Aware Knowledge Graph Completion
A relation-prediction model that combines top-K edge message passing with a conditional flow matching auxiliary loss, reporting near-perfect relation prediction and a 25% relative MRR gain in entity prediction.
-
Knowledge Graph Embeddings with Representing Relations as Annular Sectors
SectorE embeds relations as annular sectors in polar coordinates and entities as points, achieving competitive link prediction on FB15k-237, WN18RR, and YAGO3-10.
-
SLiNT: Structure-aware Language Model with Injection and Contrastive Training for Knowledge Graph Completion
A structure-injected frozen-LLM framework with contrastive training achieves small gains on WN18RR and FB15k-237 link prediction.
-
KG-BiLM: Knowledge Graph Embedding via Bidirectional Language Models
A bidirectional decoder with a graph-aware attention mask, knowledge-masked prediction, and contrastive sub-graph alignment achieves reported state-of-the-art link prediction on Wikidata5M and competitive results on WN18RR.
-
GenIC: An LLM-Based Framework for Instance Completion in Knowledge Graphs
GenIC uses a Mistral-based classifier and a T5-based generator to complete knowledge graph facts from a head entity, outperforming simple baselines on FB15k-237, WN18RR, and CoDEx, with evaluation caveats.
-
Rethinking Regularization Methods for Knowledge Graph Completion
A selective sparsity regularizer, SPR, nudges link prediction metrics up on standard benchmarks, but the evidence is single-run and the theoretical justification is mathematically flawed.
-
Towards Structure-aware Model for Multi-modal Knowledge Graph Completion
TSAM combines token-level fusion of visual and textual data with structure-anchored contrastive learning, outperforming prior multi-modal KGC models on DB15K, MKG-W, and MKG-Y.
Discussion (0). Continue with ORCID to comment.