REVIEW 5 cited by
Does Mapo Tofu Contain Coffee? Probing LLMs for Food-related Cultural Knowledge
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
Recent studies have highlighted the presence of cultural biases in Large Language Models (LLMs), yet often lack a robust methodology to dissect these phenomena comprehensively. Our work aims to bridge this gap by delving into the Food domain, a universally relevant yet culturally diverse aspect of human life. We introduce FmLAMA, a multilingual dataset centered on food-related cultural facts and variations in food practices. We analyze LLMs across various architectures and configurations, evaluating their performance in both monolingual and multilingual settings. By leveraging templates in six different languages, we investigate how LLMs interact with language-specific and cultural knowledge. Our findings reveal that (1) LLMs demonstrate a pronounced bias towards food knowledge prevalent in the United States; (2) Incorporating relevant cultural context significantly improves LLMs' ability to access cultural knowledge; (3) The efficacy of LLMs in capturing cultural nuances is highly dependent on the interplay between the probing language, the specific model architecture, and the cultural context in question. This research underscores the complexity of integrating cultural understanding into LLMs and emphasizes the importance of culturally diverse datasets to mitigate biases and enhance model performance across different cultural domains.
Forward citations
Cited by 5 Pith papers
-
Camellia: Benchmarking Cultural Biases in LLMs for Asian Languages
Across nine Asian languages, multilingual LLMs favor Western cultural entities in 30-40% of culturally grounded contexts, with model-specific sentiment biases and extraction accuracy gaps.
-
Understanding Gender Bias in AI-Generated Product Descriptions
AI-generated product descriptions on eBay show systematic gender bias, including body-size exclusions, stereotyped feature emphasis, and differences in calls to action.
-
Meta-Cultural Competence: Climbing the Right Hill of Cultural Awareness
The paper argues that LLMs should be evaluated and built for meta-cultural competence rather than static knowledge of specific cultures, and gives a first, illustrative measurement of one component.
-
Reading between the Lines: Can LLMs Identify Cross-Cultural Communication Gaps?
A user study of 57 preselected Goodreads reviews finds culture-specific comprehension gaps in most texts, while GPT-4o identifies the relevant spans with 0.49 precision and 0.65 recall across India, Mexico, and the USA.
-
Do We Really Need GNNs with Explicit Structural Modeling? MLPs Suffice for Language Model Representations
MLPs used as feature-transformation modules improve edge probing performance as much as or more than GNNs, while message-passing alone often degrades it.
Discussion (0). Continue with ORCID to comment.