YOMI-Bench is a new benchmark of four tasks for kanji reading and phonological understanding in LLMs, showing low performance even for Japanese-specific and commercial models.
and Kann, Katharina and Mielke, Sabrina J
2 Pith papers cite this work. Polarity classification is still indexing.
2
Pith papers citing it
fields
cs.CL 2years
2026 2verdicts
UNVERDICTED 2representative citing papers
Proposes CAC prompting to benchmark language models on syntactic and discourse properties of determiners against child acquisition data, finding large models approach but do not match human performance on both.
citing papers explorer
-
YOMI-Bench: A Benchmark for Evaluating Kanji Reading and Phonological Understanding of LLMs for Japanese
YOMI-Bench is a new benchmark of four tasks for kanji reading and phonological understanding in LLMs, showing low performance even for Japanese-specific and commercial models.
-
Measuring Form and Function in Language Models
Proposes CAC prompting to benchmark language models on syntactic and discourse properties of determiners against child acquisition data, finding large models approach but do not match human performance on both.