Pith. sign in

Paper Citation Record · LEDGER

Evaluate Summarization in Fine-Granularity: Auto Evaluation with LLM

As of 12 August 2026, this Paper Citation Record lists 23 of 23 outbound references and 0 inbound Pith citation observations for arXiv:2412.19906.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2412.19906 v1

Coverage vector

measured 23 of 23 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-10T23:53:12.394002Z

measured 23 of 23 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-11T06:34:44.6726+00:00

measured 0 of 0 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: cited_works

Reference resolution

23 of 23 outbound references displayed

  • verified exact1
  • verified fuzzy0
  • unresolved22
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 09d6967d-e4b2-49a8-9014-2992e10679b6 · outbound

This paper cites URL: " 'urlintro :=.

Evaluate Summarization in Fine-Granularity: Auto Evaluation with LLM URL: " 'urlintro :=

Reference 1

Resolution
unresolved
no resolver link, observed 2026-08-10T23:53:12.280383Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-10T23:53:12.280383Z digest=sha256:185508a474919bce88ed55fccd933520347fd6438cedeed574bcafec340deb7b

Observation edd8a681-df6b-4adc-b1df-dfdb9753f5ff · outbound

This paper cites write newline.

Evaluate Summarization in Fine-Granularity: Auto Evaluation with LLM write newline

Reference 2

Resolution
unresolved
no resolver link, observed 2026-08-10T23:53:12.287039Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-10T23:53:12.287039Z digest=sha256:a5bd8f00bea938378713ea3a71a198375ba9f109ec4d8c2151bf96ff9c5b5728

Observation 62c29abc-1bbe-4b85-840a-51c642a2cad3 · outbound

This paper cites ChatEval: Towards Better LLM-based Evaluators through Multi-Agent Debate.

Evaluate Summarization in Fine-Granularity: Auto Evaluation with LLM ChatEval: Towards Better LLM-based Evaluators through Multi-Agent Debate

Reference 3

Resolution
unresolved
no resolver link, observed 2026-08-10T23:53:12.292844Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-10T23:53:12.292844Z digest=sha256:a798cc8f9e4a42aa563e50c4b187f2bed6a6bf671e2d137af75d7f77845a0062

Observation 8fd6161e-92e6-4b54-886b-d21cd3bd188d · outbound

This paper cites Sub-Sentence Encoder: Contrastive Learning of Propositional Semantic Representations.

Evaluate Summarization in Fine-Granularity: Auto Evaluation with LLM Sub-Sentence Encoder: Contrastive Learning of Propositional Semantic Representations

Reference 4

Resolution
verified exact
local_arxiv, observed 2026-08-10T23:53:12.645299Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=arxiv_source observed=2026-08-10T23:53:12.299906Z digest=sha256:ed2e57d19eba32a1b13b73e98b91e6da31cb4b562e0449e9f6fe92c680795875

Observation f1aff3ac-44e7-48e3-8439-efadec54f4d7 · outbound

This paper cites an unresolved cited work.

Evaluate Summarization in Fine-Granularity: Auto Evaluation with LLM Unresolved cited work

Reference 5

Resolution
unresolved
no resolver link, observed 2026-08-10T23:53:12.305206Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-10T23:53:12.305206Z digest=sha256:42daec64e5171dcbf16be28847f2c2cc844716162c0f412efec0077179ddf0f9

Observation 3b662229-9e95-4331-8a80-2d3f7095c050 · outbound

This paper cites LLM-based NLG Evaluation: Current Status and Challenges.

Evaluate Summarization in Fine-Granularity: Auto Evaluation with LLM LLM-based NLG Evaluation: Current Status and Challenges

Reference 6

Resolution
unresolved
no resolver link, observed 2026-08-10T23:53:12.310589Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-10T23:53:12.310589Z digest=sha256:c023da6aa328a429c59563f17c89a4c4321eb5a6d826191fa88da74f213060ac

Observation 7cc52690-f493-4d43-a8c7-af83d051adaa · outbound

This paper cites Human-like Summarization Evaluation with ChatGPT.

Evaluate Summarization in Fine-Granularity: Auto Evaluation with LLM Human-like Summarization Evaluation with ChatGPT

Reference 7

Resolution
unresolved
no resolver link, observed 2026-08-10T23:53:12.315657Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-10T23:53:12.315657Z digest=sha256:ae4ebfdbbff3bab9dfd4a2dd01aaff2f9f68af9b81908f33380ceec2f97afabd

Observation a4732058-63bf-414b-928e-1d96b5973fd8 · outbound

This paper cites Neural Text Summarization: A Critical Evaluation.

Evaluate Summarization in Fine-Granularity: Auto Evaluation with LLM Neural Text Summarization: A Critical Evaluation

Reference 8

Resolution
unresolved
no resolver link, observed 2026-08-10T23:53:12.320837Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-10T23:53:12.320837Z digest=sha256:2c6eb5ad24ff56a9b22503b2fab443f876c2455db4314f1d0248f58f8e67c0d3

Observation a3b42d6a-3b3e-48a3-82aa-5473911fb4f2 · outbound

This paper cites an unresolved cited work.

Evaluate Summarization in Fine-Granularity: Auto Evaluation with LLM Unresolved cited work

Reference 9

Resolution
unresolved
no resolver link, observed 2026-08-10T23:53:12.326455Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-10T23:53:12.326455Z digest=sha256:48f8221ede36d40e9c038dfe60880e1d2951f8dddce789b66c74462da9810aac

Observation 3e457e3e-7557-4615-9d31-cabd51a88449 · outbound

This paper cites an unresolved cited work.

Evaluate Summarization in Fine-Granularity: Auto Evaluation with LLM Unresolved cited work

Reference 10

Resolution
unresolved
no resolver link, observed 2026-08-10T23:53:12.331031Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-10T23:53:12.331031Z digest=sha256:bb132c9f6b7ad7cfd14e581b59f4b09e1373ec9dff1ffeb3cd2ed9a3dd914a9e

Observation 3bd7b191-c639-4401-9516-c0e4cd3135de · outbound

This paper cites FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generation.

Evaluate Summarization in Fine-Granularity: Auto Evaluation with LLM FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generation

Reference 11

Resolution
unresolved
no resolver link, observed 2026-08-10T23:53:12.336116Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-10T23:53:12.336116Z digest=sha256:b3b5e15135f2cb471c2ae469ab860fe704da0a4ee4ce0e628235962c6a4e0434

Observation b108df9f-5809-4f25-a7ed-832b49fffc32 · outbound

This paper cites Hashimoto.

Evaluate Summarization in Fine-Granularity: Auto Evaluation with LLM Hashimoto

Reference 12

Resolution
unresolved
no resolver link, observed 2026-08-10T23:53:12.341299Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-10T23:53:12.341299Z digest=sha256:7753a032eaba7c70c4099ce2f906a06d8378a104d40461b4291f2320092b7594

Observation eeea721b-332f-47bd-b9a5-6a3963aa821d · outbound

This paper cites Is ChatGPT a Good NLG Evaluator? A Preliminary Study.

Evaluate Summarization in Fine-Granularity: Auto Evaluation with LLM Is ChatGPT a Good NLG Evaluator? A Preliminary Study

Reference 13

Resolution
unresolved
no resolver link, observed 2026-08-10T23:53:12.345574Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-10T23:53:12.345574Z digest=sha256:d685542e76bbf4ff9c80023b18f7723e51c13f15a1be3773e7dcb903773f0d64

Observation da518ba1-ade8-4527-b21c-ac1c2930abd0 · outbound

This paper cites Large Language Models are not Fair Evaluators.

Evaluate Summarization in Fine-Granularity: Auto Evaluation with LLM Large Language Models are not Fair Evaluators

Reference 14

Resolution
unresolved
no resolver link, observed 2026-08-10T23:53:12.350512Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-10T23:53:12.350512Z digest=sha256:9c2a0b59400260848c02e326d6c3f6319d4e8242dc08cf47ec27f2014027760e

Observation de88caad-8600-4a18-ab27-baae8e9fa438 · outbound

This paper cites Self-Consistency Improves Chain of Thought Reasoning in Language Models.

Evaluate Summarization in Fine-Granularity: Auto Evaluation with LLM Self-Consistency Improves Chain of Thought Reasoning in Language Models

Reference 15

Resolution
unresolved
no resolver link, observed 2026-08-10T23:53:12.355340Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-10T23:53:12.355340Z digest=sha256:5b7bb1dc21ceb8479a602a295270298defbd46b3850beeb9a09338ba329bc899

Observation eb5678ae-067b-4754-9ba4-46a0538a337e · outbound

This paper cites Long-form factuality in large language models.

Evaluate Summarization in Fine-Granularity: Auto Evaluation with LLM Long-form factuality in large language models

Reference 16

Resolution
unresolved
no resolver link, observed 2026-08-10T23:53:12.361255Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-10T23:53:12.361255Z digest=sha256:e44961db5a628a7708061b762f5d99042c605aa7b3e9f191cfd9b6a73eae2ea5

Observation dd22d5f3-01bd-43de-b093-86a43ce39373 · outbound

This paper cites A Critical Evaluation of Evaluations for Long-form Question Answering.

Evaluate Summarization in Fine-Granularity: Auto Evaluation with LLM A Critical Evaluation of Evaluations for Long-form Question Answering

Reference 17

Resolution
unresolved
no resolver link, observed 2026-08-10T23:53:12.366205Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-10T23:53:12.366205Z digest=sha256:8d5ce288dfdde08d9e226e21f3e1209c3bd99c9835ae342fab49cd2b65880fb0

Observation 94682877-b445-4ede-bdfb-2b6d20eecd08 · outbound

This paper cites an unresolved cited work.

Evaluate Summarization in Fine-Granularity: Auto Evaluation with LLM Unresolved cited work

Reference 18

Resolution
unresolved
raw_fallback, observed 2026-08-10T23:53:12.844890Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=arxiv_source observed=2026-08-10T23:53:12.371311Z digest=sha256:21edd64d3ab738cc1565d1e6243f550c5174f9119dc3014c932472589a1d3b68

Observation 5e6210f7-ae7a-4871-848c-fbee5906f1e3 · outbound

This paper cites an unresolved cited work.

Evaluate Summarization in Fine-Granularity: Auto Evaluation with LLM Unresolved cited work

Reference 19

Resolution
unresolved
no resolver link, observed 2026-08-10T23:53:12.375481Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-10T23:53:12.375481Z digest=sha256:bbabe4b69ee07c737760f7ed0e11ba563920a9c64c747cf27cf55412bc54da24

Observation 0f7c81f3-6766-48dd-a70a-d1b1b8852a82 · outbound

This paper cites BERTScore: Evaluating Text Generation with BERT.

Evaluate Summarization in Fine-Granularity: Auto Evaluation with LLM BERTScore: Evaluating Text Generation with BERT

Reference 20

Resolution
unresolved
no resolver link, observed 2026-08-10T23:53:12.379736Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-10T23:53:12.379736Z digest=sha256:da8ea8d64ce96feda45e5518296ad83bfc0c43845a5b66bb3352b965bbd8a551

Observation 3782a619-4b3d-4e3e-bf73-ea13ca4d4df6 · outbound

This paper cites MoverScore: Text Generation Evaluating with Contextualized Embeddings and Earth Mover Distance.

Evaluate Summarization in Fine-Granularity: Auto Evaluation with LLM MoverScore: Text Generation Evaluating with Contextualized Embeddings and Earth Mover Distance

Reference 21

Resolution
unresolved
no resolver link, observed 2026-08-10T23:53:12.384608Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-10T23:53:12.384608Z digest=sha256:d53da5ba5f91fdc2a7564c7d1ad6ab73c63376adea4968f0bb5366424955e89b

Observation 345d4e63-7724-4fbe-bc18-82ebe7f1010a · outbound

This paper cites Judging LLM-as-a-Judge with MT-Bench and Chatbot Arena.

Evaluate Summarization in Fine-Granularity: Auto Evaluation with LLM Judging LLM-as-a-Judge with MT-Bench and Chatbot Arena

Reference 22

Resolution
unresolved
no resolver link, observed 2026-08-10T23:53:12.389453Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-10T23:53:12.389453Z digest=sha256:9e92d5e71d59b9aa21088b4a0093172cc088c536e7e9d477d2c2877048c87b54

Observation 4b9f8c6a-269b-46c6-a879-dd7dfe9903dd · outbound

This paper cites Towards a Unified Multi-Dimensional Evaluator for Text Generation.

Evaluate Summarization in Fine-Granularity: Auto Evaluation with LLM Towards a Unified Multi-Dimensional Evaluator for Text Generation

Reference 23

Resolution
unresolved
no resolver link, observed 2026-08-10T23:53:12.394002Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-10T23:53:12.394002Z digest=sha256:88512cfc8ad4138bfc78f397eb065313de3fc55b8240b37bece0418e0b19565f

Pith citing papers

No inbound Pith citation observations are available.