REVIEW 2 cited by
Advances in Pre-Training Distributed Word Representations
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
Many Natural Language Processing applications nowadays rely on pre-trained word representations estimated from large text corpora such as news collections, Wikipedia and Web Crawl. In this paper, we show how to train high-quality word vector representations by using a combination of known tricks that are however rarely used together. The main result of our work is the new set of publicly available pre-trained models that outperform the current state of the art by a large margin on a number of tasks.
Forward citations
Cited by 2 Pith papers
-
Table Foundation Models: on knowledge pre-training for tabular learning
TARTE is a pre-trained transformer that represents table rows using column names and cell strings, and its frozen or fine-tuned embeddings improve tabular prediction with lower compute cost.
-
Edeflip: Supervised Word Translation between English and Yoruba
For English-Yoruba word translation, normalization greatly improves precision for curated embeddings but only slightly for Wikipedia embeddings.
Discussion (0). Sign in to comment.