Typed states for the displayed outbound observations.
Source: paper_references, paper_reference_links, observed 2026-08-07T05:14:45.204408Z
Paper Citation Record · LEDGER
FlagEvalMM: A Flexible Framework for Comprehensive Multimodal Model Evaluation
As of 17 August 2026, this Paper Citation Record lists 49 of 49 outbound references and 1 inbound Pith citation observation for arXiv:2506.09081.
A citation records a reference. It does not transfer a finding from one paper to another.
Coverage vector
One-hop event checks from named stored sources.
Source: scholarly_work_events, retraction_status_cache, observed 2026-08-16T06:30:59.297886+00:00
Pith citing papers itemized under the disclosed page cap.
Source: paper_references, paper_reference_links, observed 2026-08-06T20:47:28.353756Z
A source-named dated measurement, never combined with another source.
Source: pith, observed 2026-08-06T20:47:31.775994Z
Reference resolution
49 of 49 outbound references displayed
- verified exact1
- verified fuzzy0
- unresolved48
- parse uncertain0
- malformed identifier0
- metadata mismatch0
External citation measurements
No source-named external measurement is stored.
Outbound references
Observation 5a31b596-110c-4d47-b2b9-127034873804 · outbound
This paper cites online" 'onlinestring :=.
FlagEvalMM: A Flexible Framework for Comprehensive Multimodal Model Evaluation online" 'onlinestring :=
Reference 1
- Resolution
- unresolved
- no resolver link, observed 2026-08-07T05:14:41.063512Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 2519771e-0b60-4efe-8d28-49ef60923a6f · outbound
This paper cites write newline.
FlagEvalMM: A Flexible Framework for Comprehensive Multimodal Model Evaluation write newline
Reference 2
- Resolution
- unresolved
- no resolver link, observed 2026-08-07T05:14:41.160343Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 891938aa-a413-4a73-aaff-f6618d169ecd · outbound
This paper cites an unresolved cited work.
FlagEvalMM: A Flexible Framework for Comprehensive Multimodal Model Evaluation Unresolved cited work
Reference 3
- Resolution
- unresolved
- raw_fallback, observed 2026-08-07T05:14:47.548295Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.
Observation 29973b46-2a0f-4189-8a1f-3ec16bab0f6e · outbound
This paper cites an unresolved cited work.
FlagEvalMM: A Flexible Framework for Comprehensive Multimodal Model Evaluation Unresolved cited work
Reference 4
- Resolution
- unresolved
- raw_fallback, observed 2026-08-07T05:14:47.531280Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.
Observation a5ebd1f3-1ec5-41ea-a90f-67ab5abd540d · outbound
This paper cites an unresolved cited work.
FlagEvalMM: A Flexible Framework for Comprehensive Multimodal Model Evaluation Unresolved cited work
Reference 5
- Resolution
- unresolved
- raw_fallback, observed 2026-08-07T05:14:47.514844Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.
Observation c2fc71cf-fc3d-45b5-8f2d-90ae23bacbdc · outbound
This paper cites an unresolved cited work.
FlagEvalMM: A Flexible Framework for Comprehensive Multimodal Model Evaluation Unresolved cited work
Reference 6
- Resolution
- unresolved
- no resolver link, observed 2026-08-07T05:14:41.557487Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation ce75cb03-c927-4c81-bbdb-e1efba100cb0 · outbound
This paper cites an unresolved cited work.
FlagEvalMM: A Flexible Framework for Comprehensive Multimodal Model Evaluation Unresolved cited work
Reference 7
- Resolution
- unresolved
- raw_fallback, observed 2026-08-07T05:14:47.491611Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.
Observation 8c03a673-2d23-4f6b-b86f-79c95841a49e · outbound
This paper cites an unresolved cited work.
FlagEvalMM: A Flexible Framework for Comprehensive Multimodal Model Evaluation Unresolved cited work
Reference 8
- Resolution
- unresolved
- raw_fallback, observed 2026-08-07T05:14:47.475843Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.
Observation a8314ca6-d1f8-4c12-b313-49e1e2c8b439 · outbound
This paper cites Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scaling.
FlagEvalMM: A Flexible Framework for Comprehensive Multimodal Model Evaluation Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scaling
Reference 9
- Resolution
- unresolved
- no resolver link, observed 2026-08-07T05:14:41.852727Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 9c08a132-74bd-44c0-9b89-6fed767c6d92 · outbound
This paper cites an unresolved cited work.
FlagEvalMM: A Flexible Framework for Comprehensive Multimodal Model Evaluation Unresolved cited work
Reference 10
- Resolution
- unresolved
- raw_fallback, observed 2026-08-07T05:14:47.459848Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.
Observation 81f53bc6-bcef-433e-9eeb-2c8f1e025c4d · outbound
This paper cites an unresolved cited work.
FlagEvalMM: A Flexible Framework for Comprehensive Multimodal Model Evaluation Unresolved cited work
Reference 11
- Resolution
- unresolved
- raw_fallback, observed 2026-08-07T05:14:47.439727Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.
Observation 7d2d2c52-8578-4f36-a1c0-dcbc84048971 · outbound
This paper cites an unresolved cited work.
FlagEvalMM: A Flexible Framework for Comprehensive Multimodal Model Evaluation Unresolved cited work
Reference 12
- Resolution
- unresolved
- raw_fallback, observed 2026-08-07T05:14:47.426118Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.
Observation 6d039387-16ef-4d95-8f45-e80d5f180b22 · outbound
This paper cites an unresolved cited work.
FlagEvalMM: A Flexible Framework for Comprehensive Multimodal Model Evaluation Unresolved cited work
Reference 13
- Resolution
- unresolved
- no resolver link, observed 2026-08-07T05:14:42.248429Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 30a7bdd4-7ac2-4f57-be36-7400333d31ec · outbound
This paper cites an unresolved cited work.
FlagEvalMM: A Flexible Framework for Comprehensive Multimodal Model Evaluation Unresolved cited work
Reference 14
- Resolution
- unresolved
- raw_fallback, observed 2026-08-07T05:14:47.402919Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.
Observation 76cd8cc4-815d-44e9-b4d3-b988fbb6a36b · outbound
This paper cites an unresolved cited work.
FlagEvalMM: A Flexible Framework for Comprehensive Multimodal Model Evaluation Unresolved cited work
Reference 15
- Resolution
- unresolved
- raw_fallback, observed 2026-08-07T05:14:47.391709Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.
Observation c8872fbe-494b-4e02-af83-8aa8edeceeb5 · outbound
This paper cites an unresolved cited work.
FlagEvalMM: A Flexible Framework for Comprehensive Multimodal Model Evaluation Unresolved cited work
Reference 16
- Resolution
- unresolved
- no resolver link, observed 2026-08-07T05:14:42.555231Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 3e627055-4a39-4748-931c-9c3f51e2b8a9 · outbound
This paper cites an unresolved cited work.
FlagEvalMM: A Flexible Framework for Comprehensive Multimodal Model Evaluation Unresolved cited work
Reference 17
- Resolution
- unresolved
- raw_fallback, observed 2026-08-07T05:14:47.374404Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.
Observation 92a68a4a-0596-4eb8-989f-1b89e045a3d6 · outbound
This paper cites an unresolved cited work.
FlagEvalMM: A Flexible Framework for Comprehensive Multimodal Model Evaluation Unresolved cited work
Reference 18
- Resolution
- unresolved
- no resolver link, observed 2026-08-07T05:14:42.766268Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation c41d83d2-8f0b-432c-ab1b-7802e752b5c7 · outbound
This paper cites A Survey on LLM-as-a-Judge.
FlagEvalMM: A Flexible Framework for Comprehensive Multimodal Model Evaluation A Survey on LLM-as-a-Judge
Reference 19
- Resolution
- unresolved
- no resolver link, observed 2026-08-07T05:14:42.873142Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation ff2c7259-3842-487b-8b2a-39316d0ac410 · outbound
This paper cites an unresolved cited work.
FlagEvalMM: A Flexible Framework for Comprehensive Multimodal Model Evaluation Unresolved cited work
Reference 20
- Resolution
- unresolved
- raw_fallback, observed 2026-08-07T05:14:47.363741Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.
Observation 7796bfc7-3979-4ff0-87e8-09a60894fa26 · outbound
This paper cites an unresolved cited work.
FlagEvalMM: A Flexible Framework for Comprehensive Multimodal Model Evaluation Unresolved cited work
Reference 21
- Resolution
- unresolved
- raw_fallback, observed 2026-08-07T05:14:47.351337Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.
Observation 935a9ca9-87a4-4040-ba45-a45c133e7c2d · outbound
This paper cites an unresolved cited work.
FlagEvalMM: A Flexible Framework for Comprehensive Multimodal Model Evaluation Unresolved cited work
Reference 22
- Resolution
- unresolved
- no resolver link, observed 2026-08-07T05:14:43.163945Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 8107cbc6-62f7-416b-8e33-5c6eea11e769 · outbound
This paper cites an unresolved cited work.
FlagEvalMM: A Flexible Framework for Comprehensive Multimodal Model Evaluation Unresolved cited work
Reference 23
- Resolution
- unresolved
- raw_fallback, observed 2026-08-07T05:14:47.340488Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.
Observation 6d65d009-66f2-4d64-bb95-f6cd7a9d4739 · outbound
This paper cites HunyuanVideo: A Systematic Framework For Large Video Generative Models.
FlagEvalMM: A Flexible Framework for Comprehensive Multimodal Model Evaluation HunyuanVideo: A Systematic Framework For Large Video Generative Models
Reference 24
- Resolution
- unresolved
- no resolver link, observed 2026-08-07T05:14:43.297090Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 4c0c4c70-b67d-4624-b8eb-90b28b62a064 · outbound
This paper cites Gonzalez, Hao Zhang, and Ion Stoica.
FlagEvalMM: A Flexible Framework for Comprehensive Multimodal Model Evaluation Gonzalez, Hao Zhang, and Ion Stoica
Reference 25
- Resolution
- unresolved
- no resolver link, observed 2026-08-07T05:14:43.359400Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation e5804276-fd65-44b9-a9fe-dba297742306 · outbound
This paper cites an unresolved cited work.
FlagEvalMM: A Flexible Framework for Comprehensive Multimodal Model Evaluation Unresolved cited work
Reference 26
- Resolution
- unresolved
- no resolver link, observed 2026-08-07T05:14:43.451258Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 6b45990b-e557-4164-973b-be23116f7b4d · outbound
This paper cites an unresolved cited work.
FlagEvalMM: A Flexible Framework for Comprehensive Multimodal Model Evaluation Unresolved cited work
Reference 27
- Resolution
- unresolved
- raw_fallback, observed 2026-08-07T05:14:47.310223Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.
Observation 584c1f9d-8076-4e8b-92be-efd0ec4fcc5a · outbound
This paper cites an unresolved cited work.
FlagEvalMM: A Flexible Framework for Comprehensive Multimodal Model Evaluation Unresolved cited work
Reference 28
- Resolution
- unresolved
- raw_fallback, observed 2026-08-07T05:14:47.242799Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.
Observation c609c333-7627-4635-9bbd-fa9e148f5191 · outbound
This paper cites GenAI-Bench: Evaluating and Improving Compositional Text-to-Visual Generation.
FlagEvalMM: A Flexible Framework for Comprehensive Multimodal Model Evaluation GenAI-Bench: Evaluating and Improving Compositional Text-to-Visual Generation
Reference 29
- Resolution
- unresolved
- no resolver link, observed 2026-08-07T05:14:43.654181Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 4e25f433-5a68-4b69-b0ec-849b35998983 · outbound
This paper cites Holistic Evaluation of Language Models.
FlagEvalMM: A Flexible Framework for Comprehensive Multimodal Model Evaluation Holistic Evaluation of Language Models
Reference 30
- Resolution
- unresolved
- no resolver link, observed 2026-08-07T05:14:43.736114Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 8470aa44-5084-4dbb-8da3-8da6b535139e · outbound
This paper cites an unresolved cited work.
FlagEvalMM: A Flexible Framework for Comprehensive Multimodal Model Evaluation Unresolved cited work
Reference 31
- Resolution
- unresolved
- no resolver link, observed 2026-08-07T05:14:43.802055Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation f5f99eac-856d-49b6-a25f-6ff9f3761e19 · outbound
This paper cites an unresolved cited work.
FlagEvalMM: A Flexible Framework for Comprehensive Multimodal Model Evaluation Unresolved cited work
Reference 32
- Resolution
- unresolved
- raw_fallback, observed 2026-08-07T05:14:46.967195Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.
Observation dc6d6699-8336-42c5-a840-0a8c9cdbbd95 · outbound
This paper cites an unresolved cited work.
FlagEvalMM: A Flexible Framework for Comprehensive Multimodal Model Evaluation Unresolved cited work
Reference 33
- Resolution
- unresolved
- raw_fallback, observed 2026-08-07T05:14:46.738800Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.
Observation 1dcab9e6-b2af-49b1-949b-d055a7bb84e8 · outbound
This paper cites an unresolved cited work.
FlagEvalMM: A Flexible Framework for Comprehensive Multimodal Model Evaluation Unresolved cited work
Reference 34
- Resolution
- unresolved
- raw_fallback, observed 2026-08-07T05:14:46.648888Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.
Observation 052a9d2b-25ed-4124-ba73-03ef1ab5ab40 · outbound
This paper cites an unresolved cited work.
FlagEvalMM: A Flexible Framework for Comprehensive Multimodal Model Evaluation Unresolved cited work
Reference 35
- Resolution
- unresolved
- raw_fallback, observed 2026-08-07T05:14:46.533752Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.
Observation bc2a2b58-6222-4dad-b053-a13c4ed05366 · outbound
This paper cites Qwen2.5-VL Technical Report.
FlagEvalMM: A Flexible Framework for Comprehensive Multimodal Model Evaluation Qwen2.5-VL Technical Report
Reference 36
- Resolution
- unresolved
- no resolver link, observed 2026-08-07T05:14:44.255947Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 3ef9d634-ca6e-48a7-bd71-aec8e34554ed · outbound
This paper cites an unresolved cited work.
FlagEvalMM: A Flexible Framework for Comprehensive Multimodal Model Evaluation Unresolved cited work
Reference 37
- Resolution
- unresolved
- raw_fallback, observed 2026-08-07T05:14:46.403526Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.
Observation 9fc84fbf-d3a5-46db-805a-b1b921d5b0ce · outbound
This paper cites an unresolved cited work.
FlagEvalMM: A Flexible Framework for Comprehensive Multimodal Model Evaluation Unresolved cited work
Reference 38
- Resolution
- unresolved
- raw_fallback, observed 2026-08-07T05:14:46.289697Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.
Observation 5674a2ec-d28d-4ce9-9e15-550e00d8d8b3 · outbound
This paper cites Emu3: Next-Token Prediction is All You Need.
FlagEvalMM: A Flexible Framework for Comprehensive Multimodal Model Evaluation Emu3: Next-Token Prediction is All You Need
Reference 39
- Resolution
- unresolved
- no resolver link, observed 2026-08-07T05:14:44.480467Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation af6fb56c-6691-4a5f-8602-d3ddf442677f · outbound
This paper cites an unresolved cited work.
FlagEvalMM: A Flexible Framework for Comprehensive Multimodal Model Evaluation Unresolved cited work
Reference 40
- Resolution
- unresolved
- raw_fallback, observed 2026-08-07T05:14:46.190741Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.
Observation a2e3dfcb-26d0-4f0b-9723-7a226b36009f · outbound
This paper cites an unresolved cited work.
FlagEvalMM: A Flexible Framework for Comprehensive Multimodal Model Evaluation Unresolved cited work
Reference 41
- Resolution
- unresolved
- raw_fallback, observed 2026-08-07T05:14:46.053898Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.
Observation 5c2d2d6d-1592-4354-9563-59a96f206908 · outbound
This paper cites MM-Vet v2: A Challenging Benchmark to Evaluate Large Multimodal Models for Integrated Capabilities.
FlagEvalMM: A Flexible Framework for Comprehensive Multimodal Model Evaluation MM-Vet v2: A Challenging Benchmark to Evaluate Large Multimodal Models for Integrated Capabilities
Reference 42
- Resolution
- unresolved
- no resolver link, observed 2026-08-07T05:14:44.700185Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation f6e6a7a9-81b2-499d-b9ba-ce73b9938d05 · outbound
This paper cites an unresolved cited work.
FlagEvalMM: A Flexible Framework for Comprehensive Multimodal Model Evaluation Unresolved cited work
Reference 43
- Resolution
- unresolved
- raw_fallback, observed 2026-08-07T05:14:45.945489Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.
Observation 70fc21bf-9534-4785-8057-f6b2b7cb9cb8 · outbound
This paper cites MMMU-Pro: A More Robust Multi-discipline Multimodal Understanding Benchmark.
FlagEvalMM: A Flexible Framework for Comprehensive Multimodal Model Evaluation MMMU-Pro: A More Robust Multi-discipline Multimodal Understanding Benchmark
Reference 44
- Resolution
- unresolved
- no resolver link, observed 2026-08-07T05:14:44.826939Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 861c06bc-d32d-4270-907b-df8df47db038 · outbound
This paper cites Can MLLMs Understand the Deep Implication Behind Chinese Images?.
FlagEvalMM: A Flexible Framework for Comprehensive Multimodal Model Evaluation Can MLLMs Understand the Deep Implication Behind Chinese Images?
Reference 45
- Resolution
- verified exact
- local_arxiv, observed 2026-08-07T05:14:45.383760Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.
Observation 8dd42996-6022-4616-9e13-33f11b1ae93e · outbound
This paper cites CMMMU: A Chinese Massive Multi-discipline Multimodal Understanding Benchmark.
FlagEvalMM: A Flexible Framework for Comprehensive Multimodal Model Evaluation CMMMU: A Chinese Massive Multi-discipline Multimodal Understanding Benchmark
Reference 46
- Resolution
- unresolved
- no resolver link, observed 2026-08-07T05:14:44.959144Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 0b2d9593-f06e-45e2-a843-0a5d394ef7e1 · outbound
This paper cites LMMs-Eval: Reality Check on the Evaluation of Large Multimodal Models.
FlagEvalMM: A Flexible Framework for Comprehensive Multimodal Model Evaluation LMMs-Eval: Reality Check on the Evaluation of Large Multimodal Models
Reference 47
- Resolution
- unresolved
- no resolver link, observed 2026-08-07T05:14:45.044853Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation bba3c046-a6b0-4b63-83f6-73f5107ca052 · outbound
This paper cites an unresolved cited work.
FlagEvalMM: A Flexible Framework for Comprehensive Multimodal Model Evaluation Unresolved cited work
Reference 48
- Resolution
- unresolved
- raw_fallback, observed 2026-08-07T05:14:45.841696Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.
Observation 469306f5-483d-47c2-8fac-4272e4070c0e · outbound
This paper cites an unresolved cited work.
FlagEvalMM: A Flexible Framework for Comprehensive Multimodal Model Evaluation Unresolved cited work
Reference 49
- Resolution
- unresolved
- raw_fallback, observed 2026-08-07T05:14:45.711799Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.
Pith citing papers
Observation 079ee21b-024d-408f-aa54-591abe156fb4 · inbound
RoboBrain 2.0 Technical Report cites this paper.
RoboBrain 2.0 Technical Report FlagEvalMM: A Flexible Framework for Comprehensive Multimodal Model Evaluation
Reference 20
- Resolution
- verified exact
- local_arxiv, observed 2026-08-06T20:47:31.781244Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.