pith. sign in

arxiv: 2502.14865 · v1 · pith:XLTKSK4Znew · submitted 2025-02-20 · 💻 cs.CV · cs.LG

Time Travel: A Comprehensive Benchmark to Evaluate LMMs on Historical and Cultural Artifacts

classification 💻 cs.CV cs.LG
keywords historicalculturaltimetravelbenchmarkmodelsartifactsdiscoveryensuring
0
0 comments X
read the original abstract

Understanding historical and cultural artifacts demands human expertise and advanced computational techniques, yet the process remains complex and time-intensive. While large multimodal models offer promising support, their evaluation and improvement require a standardized benchmark. To address this, we introduce TimeTravel, a benchmark of 10,250 expert-verified samples spanning 266 distinct cultures across 10 major historical regions. Designed for AI-driven analysis of manuscripts, artworks, inscriptions, and archaeological discoveries, TimeTravel provides a structured dataset and robust evaluation framework to assess AI models' capabilities in classification, interpretation, and historical comprehension. By integrating AI with historical research, TimeTravel fosters AI-powered tools for historians, archaeologists, researchers, and cultural tourists to extract valuable insights while ensuring technology contributes meaningfully to historical discovery and cultural heritage preservation. We evaluate contemporary AI models on TimeTravel, highlighting their strengths and identifying areas for improvement. Our goal is to establish AI as a reliable partner in preserving cultural heritage, ensuring that technological advancements contribute meaningfully to historical discovery. Our code is available at: \url{https://github.com/mbzuai-oryx/TimeTravel}.

This paper has not been read by Pith yet.

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Forward citations

Cited by 4 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. ArtiFact: A Large-Scale Multi-Modal Cultural Heritage Dataset

    cs.DB 2026-06 unverdicted novelty 7.0

    ArtiFact is a new multi-modal dataset of 651k museum records used to benchmark cross-modal error detection with seven error categories and semantic query processing challenges.

  2. On the Cultural Anachronism and Temporal Reasoning in Vision Language Models

    cs.CV 2026-05 unverdicted novelty 7.0

    Introduces TAB-VLM benchmark showing state-of-the-art VLMs achieve at most 58.7% accuracy on temporal reasoning for cultural artifacts, with the gap persisting across model scales.

  3. Reasoning4Sciences: Bridging Reasoning Language Models to All Scientific Branches

    cs.AI 2026-05 unverdicted novelty 6.0

    Survey of RLM adoption in 28 disciplines reveals maturity disparities via a new assessment framework, with focus on development, evaluation, and public resources.

  4. Reasoning4Sciences: Bridging Reasoning Language Models to All Scientific Branches

    cs.AI 2026-05 unverdicted novelty 6.0

    A survey of RLM use in 28 disciplines reveals uneven adoption and introduces a maturity assessment framework showing larger gaps when limited to public resources.