REVIEW 13 cited by
Making Monolingual Sentence Embeddings Multilingual using Knowledge Distillation
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
We present an easy and efficient method to extend existing sentence embedding models to new languages. This allows to create multilingual versions from previously monolingual models. The training is based on the idea that a translated sentence should be mapped to the same location in the vector space as the original sentence. We use the original (monolingual) model to generate sentence embeddings for the source language and then train a new system on translated sentences to mimic the original model. Compared to other methods for training multilingual sentence embeddings, this approach has several advantages: It is easy to extend existing models with relatively few samples to new languages, it is easier to ensure desired properties for the vector space, and the hardware requirements for training is lower. We demonstrate the effectiveness of our approach for 50+ languages from various language families. Code to extend sentence embeddings models to more than 400 languages is publicly available.
Forward citations
Cited by 13 Pith papers
-
Bekko Embedding: Parameter-Efficient Multilingual Retrieval with Ultra-Compact Encoders
Bekko a8m, with 7.7M active parameters, scores 56.2 on MMTEB Multilingual v2 Retrieval, beating mE5 models and BGE-M3, while a25m reaches 57.5, on par with gte-multilingual-base.
-
SMCLM: Semantically Meaningful Causal Language Modeling for Autoregressive Paraphrase Generation
SMCLM prepends a frozen sentence embedding to GPT-2 and trains with causal language modeling, producing paraphrases that the authors find competitive with supervised methods and best among the unsupervised baselines tested.
-
The Missing Link: Joint Legal Citation Prediction using Heterogeneous Graph Enrichment
A graph neural network that enriches legal citation graphs with categorical metadata nodes predicts case and law citations more accurately than prior GNN baselines, and joint training boosts case citation prediction.
-
Locality-Sensitive Hashing for Efficient Hard Negative Sampling in Contrastive Learning
Binary LSH codes found by Hamming distance provide hard negatives for supervised contrastive learning at a fraction of the compute cost of exact pre-epoch sampling, with comparable or better accuracy on six benchmarks.
-
DeMeVa at LeWiDi-2025: Modeling Perspectives with In-Context Learning and Label Distribution Learning
In-context learning with up to 10 demonstrations per annotator can mimic individual annotator behavior well enough to produce competitive soft labels on four disagreement-rich datasets.
-
Leveraging Large Language Models for Accurate Sign Language Translation in Low-Resource Scenarios
A prompting method that links signs to short text descriptions lets large language models translate English and Italian into sign language glosses, beating prior models in low-data settings.
-
CCL-XCoT: An Efficient Cross-Lingual Knowledge Transfer Method for Mitigating Hallucination Generation
CCL-XCoT combines curriculum-based contrastive pretraining with cross-lingual chain-of-thought fine-tuning, lifting hallucination-free rates in low-resource QA from 1-18% to 55-74%.
-
Building a Few-Shot Cross-Domain Multilingual NLU Model for Customer Care
The proposed teacher-student distillation with isotropic regularization improves few-shot multilingual intent detection on proprietary customer care data, though the advertised gains are against baselines not given th...
-
REARANK: Reasoning Re-ranking Agent via Reinforcement Learning
Training a listwise reranker with reinforcement learning and explicit reasoning on only 179 annotated queries yields reranking quality comparable to GPT-4.
-
Private, Verifiable, and Auditable AI Systems
A thesis demonstrating partial prototypes for zk-verifiable model evaluation and privacy-preserving retrieval, and arguing these pieces can compose into end-to-end auditable AI systems.
-
AdaDocVQA: Adaptive Framework for Long Document Visual Question Answering in Low-Resource Settings
A hybrid retrieval, data augmentation, and ensemble inference framework fine-tunes Qwen2.5-VL-72B to 59% on the Japanese LAVA document VQA benchmark.
-
Never Come Up Empty: Adaptive HyDE Retrieval for Improving LLM Developer Support
A HyDE retrieval pipeline with full-answer context and adaptive similarity thresholding improves LLM answers to Stack Overflow questions over zero-shot prompting for three of four open-source models.
-
FullRecall: A Semantic Search-Based Ranking Approach for Maximizing Recall in Patent Retrieval
A three-phase patent retrieval pipeline achieved 100% recall on five examiner-cited test queries, but the score is driven by post hoc cutoff choices and a candidate set that already contains the target patents.
Discussion (0). Sign in to comment.