REVIEW 7 cited by
Meltemi: The first open Large Language Model for Greek
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
Signed reviews
read the original abstract
We describe the development and capabilities of Meltemi 7B, the first open Large Language Model for the Greek language. Meltemi 7B has 7 billion parameters and is trained on a 40 billion token Greek corpus. For the development of Meltemi 7B, we adapt Mistral, by continuous pretraining on the Greek Corpus. Meltemi 7B contains up-to-date information up to September 2023. Furthermore, we have translated and curated a Greek instruction corpus, which has been used for the instruction-tuning of a chat model, named Meltemi 7B Instruct. Special care has been given to the alignment and the removal of toxic content for the Meltemi 7B Instruct. The developed models are evaluated on a broad set of collected evaluation corpora, and examples of prompts and responses are presented. Both Meltemi 7B and Meltemi 7B Instruct are available at https://huggingface.co/ilsp under the Apache 2.0 license.
Forward citations
Cited by 7 Pith papers
-
MORFES: A Benchmark for Productive Inflectional Competence in Modern Greek
MORFES is the first expert-verified Modern Greek productive-inflection benchmark; Sophea-Genesis-1 leads it at 84% per-item production without losing general capability.
-
CultureMERT: Continual Pre-Training for Cross-Cultural Music Representation Learning
CultureMERT adapts the MERT-95M music model to Greek, Turkish and Indian traditions via two-stage continual pre-training, improving non-Western auto-tagging by 4.9% on average while keeping Western performance intact.
-
Krikri: Advancing Open Large Language Models for Greek
A Greek-focused continual pretraining and post-training pipeline yields Llama-Krikri-8B, which surpasses prior open models on Greek benchmarks and introduces three new Greek evaluation datasets.
-
Kuwain 1.5B: An Arabic SLM via Language Injection
Kuwain 1.5B, built by freezing TinyLlama's original layers and training eight added layers plus a 26K Arabic tokenizer, improves Arabic benchmark average from 36.95 to 44.49 while keeping English near 53.28.
-
Open or Closed LLM for Lesser-Resourced Languages? Lessons from Greek
Benchmarking Llama-70b against GPT-4o mini on Greek shows task-specific strengths, but the contamination-probe and legal-clustering claims need stronger baselines.
-
SnakModel: Lessons Learned from Training an Open Danish Large Language Model
SnakModel, an open Danish 7B LLM, outperforms other Llama2-7B-based models on the ScandEval Danish benchmark, with analyses of training dynamics and data curation.
-
GR-NLP-TOOLKIT: An Open-Source NLP Toolkit for Modern Greek
GR-NLP-TOOLKIT is a pip-installable Greek NLP toolkit reporting improved scores over spaCy and Stanza on five tasks, built by fine-tuning GreekBERT and ByT5.
Discussion (0). Continue with ORCID to comment.