A New Pair of GloVes
Reviewed by Pith T0 review T1 audit T2 compute T3 formal T4 kernel pith:HXIEIADFrecord.jsonopen to challenge →
read the original abstract
This report documents, describes, and evaluates new 2024 English GloVe (Global Vectors for Word Representation) models. While the original GloVe models built in 2014 have been widely used and found useful, languages and the world continue to evolve and we thought that current usage could benefit from updated models. Moreover, the 2014 models were not carefully documented as to the exact data versions and preprocessing that were used, and we rectify this by documenting these new models. We trained two sets of word embeddings using Wikipedia, Gigaword, and a subset of Dolma. Evaluation through vocabulary comparison, direct testing, and NER tasks shows that the 2024 vectors incorporate new culturally and linguistically relevant words, perform comparably on structural tasks like analogy and similarity, and demonstrate improved performance on recent, temporally dependent NER datasets such as non-Western newswire data.
This paper has not been read by Pith yet.
Forward citations
Cited by 2 Pith papers
-
The Pinocchio Dimension: Phenomenality of Experience as the Primary Axis of LLM Psychometric Differences
The primary axis of psychometric variation among LLMs is the degree to which they represent themselves as loci of phenomenal experience rather than systems of behavioral responses.
-
Embedding-based Methods for Linear Solver Performance Prediction
An embedding-based method learns solver-problem relationships from performance data to predict optimal configurations for linear solvers on unseen problems, achieving 17% better accuracy than feature-based models on S...
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.