Pith. sign in

Paper Citation Record · LEDGER

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons

As of 20 August 2026, this Paper Citation Record lists 100 of 127 outbound references and 1 inbound Pith citation observation for arXiv:2502.02988.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2502.02988 v1

Coverage vector

measured 100 of 127 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-09T10:26:07.196148Z

measured 101 of 101 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-20T06:33:59.587034+00:00

measured 1 of 1 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-05-12T08:40:40.910461Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-05-12T08:40:41.645465Z

Reference resolution

100 of 127 outbound references displayed

  • verified exact1
  • verified fuzzy5
  • unresolved94
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation be3d46be-6a4b-4285-9b6a-01e813ce598f · outbound

This paper cites an unresolved cited work.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Unresolved cited work

Reference 1

Resolution
unresolved
no resolver link, observed 2026-08-09T10:26:06.817210Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T10:26:06.817210Z digest=sha256:e08138b67855198ef684db383f4146ff974b4d69711fdf01b37d47e728580ab7

Observation 6b1f7a9a-3c21-478d-9009-a9fc405a9a4d · outbound

This paper cites Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedback.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedback

Reference 2

Resolution
unresolved
no resolver link, observed 2026-08-09T10:26:06.822426Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T10:26:06.822426Z digest=sha256:4532f0a10313211dd2c8fef9bce4701df4b19b41267b0d2d87e68fe69b925259

Observation 0b5bcc2c-6a9c-466c-8c08-0f47f57d34b4 · outbound

This paper cites an unresolved cited work.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Unresolved cited work

Reference 3

Resolution
unresolved
no resolver link, observed 2026-08-09T10:26:06.827012Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T10:26:06.827012Z digest=sha256:91ceb7f7582f6c190adc39e6e1cec29916b43f78578a8c9be4a8bcecb7fc833b

Observation b66b2701-1539-4dfd-b7cd-d72ca486d915 · outbound

This paper cites Beyond Human Norms: Unveiling Unique Values of Large Language Models through Interdisciplinary Approaches.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Beyond Human Norms: Unveiling Unique Values of Large Language Models through Interdisciplinary Approaches

Reference 4

Resolution
unresolved
no resolver link, observed 2026-08-09T10:26:06.830821Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T10:26:06.830821Z digest=sha256:be79cc0634a3dfb7f81a52c53fe19a298dac1978b492d5653fbb25d88d1d7e35

Observation d31a6332-3d1c-43d1-bcbd-14e14b2cf2eb · outbound

This paper cites Elephants Never Forget: Testing Language Models for Memorization of Tabular Data.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Elephants Never Forget: Testing Language Models for Memorization of Tabular Data

Reference 5

Resolution
unresolved
no resolver link, observed 2026-08-09T10:26:06.835116Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T10:26:06.835116Z digest=sha256:72d84a262e3eb3a83903723a8fbb552355f24b220aa21055f30a246bedc9cd35

Observation 0defba75-5860-4040-ab04-8de92acdfea3 · outbound

This paper cites How Do Large Language Models Acquire Factual Knowledge During Pretraining?.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons How Do Large Language Models Acquire Factual Knowledge During Pretraining?

Reference 6

Resolution
unresolved
no resolver link, observed 2026-08-09T10:26:06.839189Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T10:26:06.839189Z digest=sha256:5bb653c0121f83159010ec29a54aae0fe5058fbabc972de5d51db2bf36acf581

Observation c48d21eb-34f5-4bb6-94fd-b0728f4f44e9 · outbound

This paper cites Evaluating Large Language Models Trained on Code.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Evaluating Large Language Models Trained on Code

Reference 7

Resolution
unresolved
no resolver link, observed 2026-08-09T10:26:06.843560Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T10:26:06.843560Z digest=sha256:0b00901a3c0a1477b0cef2e69ab73e3e50ac0f1ab91ca3ec3ca3442deeeb630a

Observation a37e6233-d4a7-427f-b753-92dc686d0203 · outbound

This paper cites Chatbot Arena: An Open Platform for Evaluating LLMs by Human Preference.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Chatbot Arena: An Open Platform for Evaluating LLMs by Human Preference

Reference 8

Resolution
unresolved
no resolver link, observed 2026-08-09T10:26:06.848171Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T10:26:06.848171Z digest=sha256:c3f8d574411dc173aa72e159e6e4e238f0a6e046951dd6a97e8d5ae096a3ca2f

Observation e8c9c9a1-1af3-4aec-bfe5-f8f37b16949f · outbound

This paper cites How Abilities in Large Language Models are Affected by Supervised Fine-tuning Data Composition.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons How Abilities in Large Language Models are Affected by Supervised Fine-tuning Data Composition

Reference 9

Resolution
unresolved
no resolver link, observed 2026-08-09T10:26:06.852425Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T10:26:06.852425Z digest=sha256:b879ae213e806926b22c0cf1e234c89aeb1738851e2260ed5e95e0a91275a798

Observation 9b4f2c8c-b709-419b-9656-9261b93f2d2c · outbound

This paper cites Cognitive Bias in Decision-Making with LLMs.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Cognitive Bias in Decision-Making with LLMs

Reference 10

Resolution
unresolved
no resolver link, observed 2026-08-09T10:26:06.856504Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T10:26:06.856504Z digest=sha256:24a06f0c2f8bcbc02baefee420021c2372405d42bd8201b92e8a8436352e69f4

Observation 7f72c403-5571-4b72-b6e3-e6d91972face · outbound

This paper cites an unresolved cited work.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Unresolved cited work

Reference 11

Resolution
unresolved
no resolver link, observed 2026-08-09T10:26:06.860248Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T10:26:06.860248Z digest=sha256:28169c696a44e2c79d57d7f85c4a83b40b65607201dc7368a4e1e50ffc4dca6f

Observation add0e4ed-2a60-43b2-b9bf-7a7b564570ae · outbound

This paper cites Measuring Massive Multitask Language Understanding.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Measuring Massive Multitask Language Understanding

Reference 12

Resolution
unresolved
no resolver link, observed 2026-08-09T10:26:06.864124Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T10:26:06.864124Z digest=sha256:6abc38653357606e7c13ceb0cef6d68a54de72dff686698265fc2d105321e6b9

Observation caf00782-7f33-4abf-add2-4970e7ff18d6 · outbound

This paper cites an unresolved cited work.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Unresolved cited work

Reference 13

Resolution
unresolved
no resolver link, observed 2026-08-09T10:26:06.868011Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T10:26:06.868011Z digest=sha256:e3ee7753c9073524973169c435711f1a97e8d79ea3784e8f88d2559bf3809223

Observation 3cc9abd6-4204-43ca-ae8e-4404f0b0c694 · outbound

This paper cites C-Eval: A Multi-Level Multi-Discipline Chinese Evaluation Suite for Foundation Models.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons C-Eval: A Multi-Level Multi-Discipline Chinese Evaluation Suite for Foundation Models

Reference 14

Resolution
unresolved
no resolver link, observed 2026-08-09T10:26:06.871799Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T10:26:06.871799Z digest=sha256:3e24e7b95dd40e8dd2a8e7a0a77c4a54915a4a47ebdb8968d5f623009182881a

Observation e6552762-4a13-4086-900c-10e6e65bf5f6 · outbound

This paper cites Mercer, Lalit R.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Mercer, Lalit R

Reference 15

Resolution
unresolved
no resolver link, observed 2026-08-09T10:26:06.875671Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T10:26:06.875671Z digest=sha256:d2001c8b29e12610725ef9f81349bc30b6fa26072a48baaa8e039db05de76f24

Observation 12331cd9-c807-45ff-a61d-642d9d7c5173 · outbound

This paper cites Raising the Bar: Investigating the Values of Large Language Models via Generative Evolving Testing.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Raising the Bar: Investigating the Values of Large Language Models via Generative Evolving Testing

Reference 16

Resolution
verified exact
local_arxiv, observed 2026-08-09T10:26:07.561014Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-08-09T10:26:06.879399Z digest=sha256:20a678ffceecd83f0a55fde6785ac4f0f9f81b6808d452d4eed6405793dc1ce3

Observation 8e46a871-a14d-4854-aadb-9229148a2492 · outbound

This paper cites Can Machines Learn Morality? The Delphi Experiment.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Can Machines Learn Morality? The Delphi Experiment

Reference 17

Resolution
unresolved
no resolver link, observed 2026-08-09T10:26:06.883680Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T10:26:06.883680Z digest=sha256:85cb83f0efd2e41521f5940de4c8761f540c65e416b6c1fac3a0355903f67fe1

Observation b509fb7f-c652-42f9-acda-d1d976c1a974 · outbound

This paper cites an unresolved cited work.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Unresolved cited work

Reference 18

Resolution
unresolved
no resolver link, observed 2026-08-09T10:26:06.887711Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T10:26:06.887711Z digest=sha256:9f6300067f74c432ee488a5d8abe3a1573faf3b501fb04aa0afa5786406aec88

Observation f440211e-204c-4471-9d45-923ec4e592b1 · outbound

This paper cites an unresolved cited work.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Unresolved cited work

Reference 19

Resolution
unresolved
no resolver link, observed 2026-08-09T10:26:06.895858Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T10:26:06.895858Z digest=sha256:2d42b2af1052ba8af97aa7452b6ac4f3b6fb32e1fcbdcf90fc419383ea8108b2

Observation 34399e51-cd30-47a2-aa20-dc9673f26f45 · outbound

This paper cites an unresolved cited work.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Unresolved cited work

Reference 20

Resolution
unresolved
no resolver link, observed 2026-08-09T10:26:06.899646Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T10:26:06.899646Z digest=sha256:95c7be30bfb08af12baa6f7c95988cbac13ce808313bedfdd4f7e4b1c9c0f795

Observation 08e40cce-7785-46dc-a878-6922821ff89f · outbound

This paper cites From Quantity to Quality: Boosting LLM Performance with Self-Guided Data Selection for Instruction Tuning.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons From Quantity to Quality: Boosting LLM Performance with Self-Guided Data Selection for Instruction Tuning

Reference 21

Resolution
unresolved
no resolver link, observed 2026-08-09T10:26:06.907720Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T10:26:06.907720Z digest=sha256:3673d9f3453c5630f168b73d4af94ab213a3c6360e752f55a5a01b937b2da2b8

Observation dc0bf80f-caa7-488a-8b38-6a5a8127e90f · outbound

This paper cites From Crowdsourced Data to High-Quality Benchmarks: Arena-Hard and BenchBuilder Pipeline.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons From Crowdsourced Data to High-Quality Benchmarks: Arena-Hard and BenchBuilder Pipeline

Reference 22

Resolution
unresolved
no resolver link, observed 2026-08-09T10:26:06.912272Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T10:26:06.912272Z digest=sha256:f2f893e63c3d95f5421a0cc561874485674cb79977cf1460152f179410db0b87

Observation f547d0bd-4731-4c1f-a920-f54ef4010caa · outbound

This paper cites an unresolved cited work.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Unresolved cited work

Reference 23

Resolution
unresolved
no resolver link, observed 2026-08-09T10:26:06.916238Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T10:26:06.916238Z digest=sha256:02008f118710653d5fa7e0f6dbdd510535e3d399e48d58122f2e97b7e116459b

Observation 6fd91538-2c06-44c8-93b7-3ce0d42b24ed · outbound

This paper cites an unresolved cited work.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Unresolved cited work

Reference 24

Resolution
unresolved
no resolver link, observed 2026-08-09T10:26:06.924394Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T10:26:06.924394Z digest=sha256:a58d98534a1f2a569d6f10623f576972df1c89e97f96140ee7e53aba08cab459

Observation a6ce5c1b-10e3-4142-891d-a6383c32c97c · outbound

This paper cites an unresolved cited work.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Unresolved cited work

Reference 25

Resolution
unresolved
no resolver link, observed 2026-08-09T10:26:06.927917Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T10:26:06.927917Z digest=sha256:fb3462f5b729c8b13d6f9ebac97260fa2d7350ef791ca3f7834a5879a4a901d0

Observation 4cb36887-c76c-494b-9193-9c12d2543941 · outbound

This paper cites WildBench: Benchmarking LLMs with Challenging Tasks from Real Users in the Wild.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons WildBench: Benchmarking LLMs with Challenging Tasks from Real Users in the Wild

Reference 26

Resolution
unresolved
no resolver link, observed 2026-08-09T10:26:06.920314Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T10:26:06.920314Z digest=sha256:865fec9ad4b6a9a630ad0e596fd7a7e76f313dd2dc837ee3216c457ecf609277

Observation 02f74949-ed50-4efe-824d-4ee66f82934a · outbound

This paper cites DyKnow: Dynamically Verifying Time-Sensitive Factual Knowledge in LLMs.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons DyKnow: Dynamically Verifying Time-Sensitive Factual Knowledge in LLMs

Reference 27

Resolution
unresolved
no resolver link, observed 2026-08-09T10:26:06.935195Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T10:26:06.935195Z digest=sha256:4605456ccaf0442c8461e4b894fb6421f75c189bc0a6386d4f1f0c23b91abf15

Observation ddc85e57-5157-4936-8c1c-80fdb85602a4 · outbound

This paper cites Orca: Progressive Learning from Complex Explanation Traces of GPT-4.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Orca: Progressive Learning from Complex Explanation Traces of GPT-4

Reference 28

Resolution
unresolved
no resolver link, observed 2026-08-09T10:26:06.938927Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T10:26:06.938927Z digest=sha256:aa6af5a130b7df4955c648911e6b3787dade7d9e5e1fc9975d0ced6da0eca954

Observation 2effc0c7-cc26-48f1-b2bd-3739b840c7f0 · outbound

This paper cites AlignBench: Benchmarking Chinese Alignment of Large Language Models.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons AlignBench: Benchmarking Chinese Alignment of Large Language Models

Reference 29

Resolution
unresolved
no resolver link, observed 2026-08-09T10:26:06.931661Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T10:26:06.931661Z digest=sha256:6a745d5b1c744a38ac0d906adbb79d9fb384513b05fe5175d73a9c3f98758ad6

Observation 4f33ea1a-0123-4c43-b8ac-85cd8ad5d979 · outbound

This paper cites Training language models to follow instructions with human feedback.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Training language models to follow instructions with human feedback

Reference 30

Resolution
unresolved
no resolver link, observed 2026-08-09T10:26:06.946505Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T10:26:06.946505Z digest=sha256:0c2d14372e21597c11e169fec6f949542acaf9cc323b570ebf9b43f502fc3d24

Observation 86187629-cb05-4a5d-8900-6c9978297955 · outbound

This paper cites Fine-Tuning or Retrieval? Comparing Knowledge Injection in LLMs.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Fine-Tuning or Retrieval? Comparing Knowledge Injection in LLMs

Reference 31

Resolution
unresolved
no resolver link, observed 2026-08-09T10:26:06.950598Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T10:26:06.950598Z digest=sha256:0ae25c27b9a8c02af5ccbd961077a36b09b3601f8e9ebb2004f319fbb44dc19c

Observation 5e99fb3d-655f-45eb-89af-5a4f17be4c4d · outbound

This paper cites GPT-4 Technical Report.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons GPT-4 Technical Report

Reference 32

Resolution
unresolved
no resolver link, observed 2026-08-09T10:26:06.942790Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T10:26:06.942790Z digest=sha256:d783f797f5a382a78633082827dda6db21e5508267dd733299916ef995b4cc8d

Observation 8017578b-3cd1-40d4-bf43-65a3ce7a8fca · outbound

This paper cites Peng, Xi Yang, Aokun Chen, Kaleb E.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Peng, Xi Yang, Aokun Chen, Kaleb E

Reference 33

Resolution
unresolved
no resolver link, observed 2026-08-09T10:26:06.957794Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T10:26:06.957794Z digest=sha256:8fb0df84a6d0f8f7e141dcd25019d117447f7391a766ce79b91adb11b9e1decd

Observation a806afed-7b33-49fc-ae43-0d72fcf3fdcb · outbound

This paper cites an unresolved cited work.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Unresolved cited work

Reference 34

Resolution
unresolved
no resolver link, observed 2026-08-09T10:26:06.961369Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T10:26:06.961369Z digest=sha256:e7b4e8ad4c67031d15245e804849fd200b61a4bdfbcbe57958fd0e51df4b6859

Observation e882d754-624c-4928-8ab1-7c6b44fb55f9 · outbound

This paper cites an unresolved cited work.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Unresolved cited work

Reference 35

Resolution
unresolved
no resolver link, observed 2026-08-09T10:26:06.954234Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T10:26:06.954234Z digest=sha256:233654c4a6705217df53d0b8b32ce475449bbed91c4511a670f504655cfbe55e

Observation dd2e88cc-510f-4582-9440-f23a7b92435e · outbound

This paper cites an unresolved cited work.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Unresolved cited work

Reference 36

Resolution
unresolved
no resolver link, observed 2026-08-09T10:26:06.968348Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T10:26:06.968348Z digest=sha256:78dd14bc65a7eccecc0c648f1c33c6a0a1d35b1ae47bbf98e2b8ef1efde64f9a

Observation e1f4fd36-d6c1-444d-942d-401a9c7b59b1 · outbound

This paper cites Link, Roxana Daneshjou, and Nicolás W Cortés- Penfield.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Link, Roxana Daneshjou, and Nicolás W Cortés- Penfield

Reference 37

Resolution
unresolved
no resolver link, observed 2026-08-09T10:26:06.971926Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T10:26:06.971926Z digest=sha256:015aa745ef7e20f78a95db32c07e176f44f8e18e8ad780aea4cae12b68617d8e

Observation 67d14a92-6227-4e27-a194-ba2ce7f69ad5 · outbound

This paper cites an unresolved cited work.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Unresolved cited work

Reference 38

Resolution
unresolved
no resolver link, observed 2026-08-09T10:26:06.964892Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T10:26:06.964892Z digest=sha256:103ef84419ecdabb498d54f0f96137d3d7d1a8ced38753f09cf22ed583702d11

Observation b447b56b-f7eb-43c7-9f15-7e07cc42e8c8 · outbound

This paper cites TrustLLM: Trustworthiness in Large Language Models.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons TrustLLM: Trustworthiness in Large Language Models

Reference 39

Resolution
unresolved
no resolver link, observed 2026-08-09T10:26:06.983198Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T10:26:06.983198Z digest=sha256:7970ba8e3d52cb4e8b5efad435bbc6153fa54d632492b4f0f410b89504912ea3

Observation ba93b126-4dc7-4203-ad72-4e7c3eb6e680 · outbound

This paper cites Hashimoto.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Hashimoto

Reference 40

Resolution
unresolved
no resolver link, observed 2026-08-09T10:26:06.986899Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T10:26:06.986899Z digest=sha256:822a73570d8c9dfcca4dd524d54e371c69c07daa713465a07dae11efae3099d9

Observation 94dd0f13-a279-420c-9074-382b70b94005 · outbound

This paper cites an unresolved cited work.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Unresolved cited work

Reference 41

Resolution
unresolved
no resolver link, observed 2026-08-09T10:26:06.975429Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T10:26:06.975429Z digest=sha256:afa297683fd8bd46807a0c8936abc562fafbe0c4279c82aa87eca1ca848b2621

Observation 449c8f6a-fd07-4389-968e-0a2d2e54d28b · outbound

This paper cites Balanced Data Sampling for Language Model Training with Clustering.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Balanced Data Sampling for Language Model Training with Clustering

Reference 42

Resolution
unresolved
no resolver link, observed 2026-08-09T10:26:06.979516Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T10:26:06.979516Z digest=sha256:a0adaa345cd77414276dde0e061e1281c473db04a758f998575ef6251fbd9a08

Observation af6ecb3f-2016-40f0-95d1-db9311c2b413 · outbound

This paper cites Foundational Autoraters: Taming Large Language Models for Better Automatic Evaluation.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Foundational Autoraters: Taming Large Language Models for Better Automatic Evaluation

Reference 43

Resolution
unresolved
no resolver link, observed 2026-08-09T10:26:06.997800Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T10:26:06.997800Z digest=sha256:f67d2d01a977860f7d8b1b57bbc692b3e62a338a44bf4a4022b278ad976d55ff

Observation ebeebc30-5e2c-46d2-a248-aaab702056d3 · outbound

This paper cites Self-Instruct: Aligning Language Models with Self-Generated Instructions.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Self-Instruct: Aligning Language Models with Self-Generated Instructions

Reference 44

Resolution
unresolved
no resolver link, observed 2026-08-09T10:26:07.001623Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T10:26:07.001623Z digest=sha256:888e60e4dfe7a67e195c419790367f8f2db6c2b268b0b91ab13e91568e587960

Observation 31178b6e-4d8f-4ba0-81a9-7f7a7ba630f5 · outbound

This paper cites Gemini: A Family of Highly Capable Multimodal Models.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Gemini: A Family of Highly Capable Multimodal Models

Reference 45

Resolution
unresolved
no resolver link, observed 2026-08-09T10:26:06.990380Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T10:26:06.990380Z digest=sha256:12be082c5c5aebda56773bdb624d38f8bfbc979569a9932a8c41c279ba9c653c

Observation d5fa3378-1e24-4054-88d6-b8547c91307e · outbound

This paper cites Qwen2 Technical Report.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Qwen2 Technical Report

Reference 46

Resolution
unresolved
no resolver link, observed 2026-08-09T10:26:06.994040Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T10:26:06.994040Z digest=sha256:f1426c4720494f0a600b9e8ee86cf0cf7fdfe4db20746f66b9313aa9209c4a48

Observation 41883e9e-f47e-41de-8fe4-7089df947271 · outbound

This paper cites an unresolved cited work.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Unresolved cited work

Reference 47

Resolution
unresolved
no resolver link, observed 2026-08-09T10:26:07.017644Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T10:26:07.017644Z digest=sha256:edbbb3ded6ac6b8d259ba70b636047417efe74c0dd4ece00579b3b9d2a6849fe

Observation afc84953-b666-4491-a485-dd8475913de0 · outbound

This paper cites an unresolved cited work.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Unresolved cited work

Reference 48

Resolution
unresolved
no resolver link, observed 2026-08-09T10:26:07.025199Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T10:26:07.025199Z digest=sha256:3c2f801c2402a90b21a253f40f77e19bea7aae70adbeb56504f2dbb7c2f5c900

Observation 736eabad-522a-4488-8b12-0f99501b77ef · outbound

This paper cites an unresolved cited work.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Unresolved cited work

Reference 49

Resolution
unresolved
no resolver link, observed 2026-08-09T10:26:07.005480Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T10:26:07.005480Z digest=sha256:fdc3af82babc2a9b3393c46d7e4a4ee3e445cdb0530c2da6b50fa6f4afc0a184

Observation dcdb9dd1-b7da-4657-910f-2a062a02b86d · outbound

This paper cites an unresolved cited work.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Unresolved cited work

Reference 50

Resolution
unresolved
no resolver link, observed 2026-08-09T10:26:07.009288Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T10:26:07.009288Z digest=sha256:0e13d63fc0a2b7f4eb8c1a8ee8814e78d7d9703d6b10def2406cf5b4a56d371b

Observation 3cdad77c-5806-4c65-a766-405eb59b9d5f · outbound

This paper cites SmallToLarge (S2L): Scalable Data Selection for Fine-tuning Large Language Models by Summarizing Training Trajectories of Small Models.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons SmallToLarge (S2L): Scalable Data Selection for Fine-tuning Large Language Models by Summarizing Training Trajectories of Small Models

Reference 51

Resolution
unresolved
no resolver link, observed 2026-08-09T10:26:07.012786Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T10:26:07.012786Z digest=sha256:9deeb8516ed46e939f9cf84bd480454067ee78c7c488580e16f699fb4b3a9b7b

Observation daa1fa42-6884-49d6-8aee-e3ace2c9d895 · outbound

This paper cites AGIEval: A Human-Centric Benchmark for Evaluating Foundation Models.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons AGIEval: A Human-Centric Benchmark for Evaluating Foundation Models

Reference 52

Resolution
unresolved
no resolver link, observed 2026-08-09T10:26:07.043089Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T10:26:07.043089Z digest=sha256:3816dc9441f87188e3ac0d0d400c74da05ccab8950a49e28bda0fb9b8e9acb9e

Observation 740895cd-dda9-4473-8fc9-dbb30f9541cd · outbound

This paper cites Data Mixing Laws: Optimizing Data Mixtures by Predicting Language Modeling Performance.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Data Mixing Laws: Optimizing Data Mixtures by Predicting Language Modeling Performance

Reference 53

Resolution
unresolved
no resolver link, observed 2026-08-09T10:26:07.021278Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T10:26:07.021278Z digest=sha256:ecd415d10571dcbb9b2fcaa9bd92ec608898f22983f76efed1949243270ba365

Observation 2a8e2467-5cb0-4dd7-b4cb-eaa0a4abcbc9 · outbound

This paper cites an unresolved cited work.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Unresolved cited work

Reference 55

Resolution
unresolved
no resolver link, observed 2026-08-09T10:26:07.028606Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T10:26:07.028606Z digest=sha256:f3bb37e668cd80fb807ce6b21e82d6ac2bca8d880eb01e6099df43d72ebb4870

Observation dc33ccdc-86ba-45bc-8512-66a8af32cd4b · outbound

This paper cites Assessing and Understanding Creativity in Large Language Models.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Assessing and Understanding Creativity in Large Language Models

Reference 56

Resolution
unresolved
no resolver link, observed 2026-08-09T10:26:07.032116Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T10:26:07.032116Z digest=sha256:bfa5cabd3806fa19ce8daed63adfce36805ce33ff8f6cc31fed27da291424fd3

Observation e2406660-7881-4991-b79e-1e8687a5bc08 · outbound

This paper cites LMSYS-Chat-1M: A Large-Scale Real-World LLM Conversation Dataset.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons LMSYS-Chat-1M: A Large-Scale Real-World LLM Conversation Dataset

Reference 57

Resolution
unresolved
no resolver link, observed 2026-08-09T10:26:07.035838Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T10:26:07.035838Z digest=sha256:4cc718d6678fe8f4a41293e2988ef01914be9877967ffe742397ec5a1cc04b48

Observation 079248f0-27bb-4433-8901-4b813b7bc10b · outbound

This paper cites Gonzalez, and Ion Stoica.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Gonzalez, and Ion Stoica

Reference 58

Resolution
unresolved
no resolver link, observed 2026-08-09T10:26:07.039751Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T10:26:07.039751Z digest=sha256:8ce2fbfda701369fe311e1033a023808e497fa394dc719ab5a0a54e416920df2

Observation baffcdb0-75e8-4e3c-ba63-4cef2ebc7c87 · outbound

This paper cites Don't Make Your LLM an Evaluation Benchmark Cheater.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Don't Make Your LLM an Evaluation Benchmark Cheater

Reference 60

Resolution
unresolved
no resolver link, observed 2026-08-09T10:26:07.046518Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T10:26:07.046518Z digest=sha256:0853fd79c1fd25c04ed3fc6405e3fa28fa24d2a9b50e2df95b8054ef9a84d493

Observation 474f3143-8449-4e7d-9abe-4fe56a3cbb6c · outbound

This paper cites an unresolved cited work.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Unresolved cited work

Reference 61

Resolution
unresolved
no resolver link, observed 2026-08-09T10:26:07.050876Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T10:26:07.050876Z digest=sha256:e3444629ae372cf849b73abd6aa6118d99285a8ffd32a00b4468fe8e9143564b

Observation 1385e0d1-96c9-44b5-a532-e660174ecd53 · outbound

This paper cites an unresolved cited work.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Unresolved cited work

Reference 62

Resolution
unresolved
no resolver link, observed 2026-08-09T10:26:07.054391Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T10:26:07.054391Z digest=sha256:ec5631cba67fcdbea2660e5de010a0def4718e084a203be72f0ff7a45a037065

Observation a081cb06-f31d-42f6-9232-6a20dc5d78ef · outbound

This paper cites an unresolved cited work.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Unresolved cited work

Reference 63

Resolution
unresolved
no resolver link, observed 2026-08-09T10:26:07.058052Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T10:26:07.058052Z digest=sha256:40503699f90396feda9773c2db342325105ae438e89ca5248082bc9ee1f36d74

Observation e452ce85-2756-4dbe-b226-2ac1e1256bf9 · outbound

This paper cites 3.Instruction compli- ance: The output should strictly follow the specific requirements of the instructions, including action steps and any constraints.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons 3.Instruction compli- ance: The output should strictly follow the specific requirements of the instructions, including action steps and any constraints

Reference 64

Resolution
unresolved
no resolver link, observed 2026-08-09T10:26:07.061558Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T10:26:07.061558Z digest=sha256:60f48a7e031a38be9c30676af444b18f9163f7d439a3a0eb2b66b9133ea53c96

Observation 2e46225c-6049-4568-817d-57d5cd8cd8b7 · outbound

This paper cites an unresolved cited work.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Unresolved cited work

Reference 65

Resolution
unresolved
no resolver link, observed 2026-08-09T10:26:07.064933Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T10:26:07.064933Z digest=sha256:683764460c5ad50a1b0bf5a5b696036eee1dfa4952edc322ef681c5331da752f

Observation 8578f05c-7e30-4006-b069-2e162d1d0981 · outbound

This paper cites (9) Role-playing.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons (9) Role-playing

Reference 66

Resolution
unresolved
no resolver link, observed 2026-08-09T10:26:07.068681Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T10:26:07.068681Z digest=sha256:185fdb7c4900ef563fdb53f06bdcd56e06ef2e85dcc53df1d4df37b05aafbc5a

Observation 741285a0-f600-4d92-87e2-f91d2a239ee0 · outbound

This paper cites an unresolved cited work.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Unresolved cited work

Reference 67

Resolution
unresolved
no resolver link, observed 2026-08-09T10:26:07.072732Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T10:26:07.072732Z digest=sha256:253c50e20cce1ac176e7ddb580346239243088ab0ff9d97f66588907114a4ba1

Observation 6d9a6233-5b67-4724-899a-3605d6de5f27 · outbound

This paper cites an unresolved cited work.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Unresolved cited work

Reference 68

Resolution
unresolved
no resolver link, observed 2026-08-09T10:26:07.076622Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T10:26:07.076622Z digest=sha256:47e96a5f1cc83d6821e390e057cd0ac24e9e0bf6f1aee2c1bef9e63e0e0ea600

Observation 158abd19-0ce3-40c9-b338-1e83da2ebcd4 · outbound

This paper cites an unresolved cited work.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Unresolved cited work

Reference 69

Resolution
unresolved
no resolver link, observed 2026-08-09T10:26:07.080525Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T10:26:07.080525Z digest=sha256:39408064c5714b8576231da5fb98a8697e7fc16bb9a550001d671b22c0011973

Observation dcc2aaa7-b9d5-4889-8098-81240d8e567e · outbound

This paper cites an unresolved cited work.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Unresolved cited work

Reference 70

Resolution
unresolved
no resolver link, observed 2026-08-09T10:26:07.084242Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T10:26:07.084242Z digest=sha256:207adb3fd5a45e6909d9be7d58ecf6f449cb3c3149b45d0874e0cbaa767a07ba

Observation 35f1365f-ad6e-4aa5-bd0f-1b4ca5d1449f · outbound

This paper cites The same output requirement and format as in Table 1.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons The same output requirement and format as in Table 1

Reference 71

Resolution
unresolved
no resolver link, observed 2026-08-09T10:26:07.087822Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T10:26:07.087822Z digest=sha256:ad07b99919470c82f0315d1ee511852eb136716fd6ba8bf340abd16a75b42722

Observation b51ba750-e9c9-4142-be8f-f013df2dd02f · outbound

This paper cites Requirements for the scenario: Name: {scenario name } Definition: {scenario description } Reference Text: {reference text } Requirements:.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Requirements for the scenario: Name: {scenario name } Definition: {scenario description } Reference Text: {reference text } Requirements:

Reference 72

Resolution
unresolved
no resolver link, observed 2026-08-09T10:26:07.091650Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T10:26:07.091650Z digest=sha256:0828ccf1ee578199e3aba3612a21dbe42ba67c7691737394a6bc514710e66209

Observation 82af8738-c8e6-4739-a06e-fb9b18e8edb6 · outbound

This paper cites an unresolved cited work.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Unresolved cited work

Reference 73

Resolution
unresolved
no resolver link, observed 2026-08-09T10:26:07.095181Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T10:26:07.095181Z digest=sha256:14a7243024bd1f8d275f2c8169364519e35597e3a9cddd0cf989d9cac717894c

Observation 578cf78f-f429-43c2-9a05-ba66a0076001 · outbound

This paper cites an unresolved cited work.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Unresolved cited work

Reference 74

Resolution
unresolved
no resolver link, observed 2026-08-09T10:26:07.099401Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T10:26:07.099401Z digest=sha256:f7f71b5b791372073beb3181d1a75f183b3441b6ebf9a13d8da88e488d6069b7

Observation d6fd51ea-6759-4f9c-b3a6-83a42bbb3aa3 · outbound

This paper cites Sorry, this article does not contain enough information related to {scenario name } to generate relevant questions and answers.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Sorry, this article does not contain enough information related to {scenario name } to generate relevant questions and answers

Reference 75

Resolution
unresolved
no resolver link, observed 2026-08-09T10:26:07.103621Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T10:26:07.103621Z digest=sha256:1fe75731d1c7319cb58948d6469ed2b22e76a7d5c1c0d3d528ae2cf4da11acf5

Observation 41963ea3-372d-48d4-a8c9-70b3ad72f2ea · outbound

This paper cites an unresolved cited work.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Unresolved cited work

Reference 76

Resolution
unresolved
no resolver link, observed 2026-08-09T10:26:07.107062Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T10:26:07.107062Z digest=sha256:d8e13520b88c31af3e05a2bae55d8d5fb923052c28188410cd013f173926bde2

Observation 27935d7d-3675-4a21-9ae0-52f3815b7045 · outbound

This paper cites an unresolved cited work.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Unresolved cited work

Reference 77

Resolution
unresolved
no resolver link, observed 2026-08-09T10:26:07.110270Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T10:26:07.110270Z digest=sha256:2a7df521d024d3ef259af01f91245167c97d34f0b1bb3154b95e47b297329424

Observation 42f63cfa-5dd8-4e39-91e2-a427376ebdb1 · outbound

This paper cites question.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons question

Reference 78

Resolution
unresolved
no resolver link, observed 2026-08-09T10:26:07.113484Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T10:26:07.113484Z digest=sha256:975df193b23c5ed8a516f763e9c5c1f5e4a06166da4d49cf1732dac8b557655d

Observation a033202f-2a09-44b6-8d0d-5fcaf05cbf35 · outbound

This paper cites an unresolved cited work.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Unresolved cited work

Reference 79

Resolution
unresolved
no resolver link, observed 2026-08-09T10:26:07.116888Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T10:26:07.116888Z digest=sha256:c1ffd1eb65142d05cbb6f0e8698a6b3165867b053c6f59c858dadcae3337ad53

Observation da25a752-bb6c-40f8-acaf-29464a326859 · outbound

This paper cites an unresolved cited work.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Unresolved cited work

Reference 80

Resolution
unresolved
no resolver link, observed 2026-08-09T10:26:07.120376Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T10:26:07.120376Z digest=sha256:1d750c0ffc425e77c5e55ac1fe74ed2d1180bdf37b1df49636151f15808d3f7f

Observation b71bebb5-c71d-4127-a373-ddd457bf2a1e · outbound

This paper cites an unresolved cited work.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Unresolved cited work

Reference 81

Resolution
unresolved
no resolver link, observed 2026-08-09T10:26:07.123609Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T10:26:07.123609Z digest=sha256:b1f3b4b2ba4b1bdb1e870d2640c5ce823f7cb5e7c0e37ab383bb8ea9c1bb1fb5

Observation 4b9b8cf7-ef28-408b-b5ca-60c90db9940f · outbound

This paper cites an unresolved cited work.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Unresolved cited work

Reference 82

Resolution
unresolved
no resolver link, observed 2026-08-09T10:26:07.127171Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T10:26:07.127171Z digest=sha256:3d9d5f3ab297c1163e34ca5ebc4bb2c74075233965fe7f06e774a84ec902865f

Observation 2d0f0a54-ae8e-48c0-ab30-f024d5bb9eb7 · outbound

This paper cites an unresolved cited work.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Unresolved cited work

Reference 83

Resolution
unresolved
raw_fallback, observed 2026-08-09T10:26:08.109294Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-08-09T10:26:07.130463Z digest=sha256:428382b5da293fc2fbf573fdcce5c4ebadb759d2b44447114962b38a764f6b63

Observation 419b57d7-70fc-400e-9868-716ac2a79fcb · outbound

This paper cites an unresolved cited work.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Unresolved cited work

Reference 84

Resolution
unresolved
raw_fallback, observed 2026-08-09T10:26:08.099447Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-08-09T10:26:07.133915Z digest=sha256:9d160234d9e76fa5321ce6b67ae441438e805ef18b4e89ec67b540132c966dbf

Observation 8fba1f61-0ca7-4ffa-bce1-ef08edc05161 · outbound

This paper cites an unresolved cited work.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Unresolved cited work

Reference 85

Resolution
unresolved
raw_fallback, observed 2026-08-09T10:26:08.089628Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-08-09T10:26:07.137261Z digest=sha256:ecbd71c902c516923d1e48de39508a2a2b5115d2d320baff2dd6e62c53402162

Observation d6f5a985-953c-453f-8a91-64ff1daeb949 · outbound

This paper cites an unresolved cited work.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Unresolved cited work

Reference 86

Resolution
unresolved
raw_fallback, observed 2026-08-09T10:26:08.079165Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-08-09T10:26:07.140462Z digest=sha256:020e1f2e7494d6148014d02682db099fb87a8234cd27447088018190a7760090

Observation 5a6415ea-619f-42cc-ad9c-7c47c787752a · outbound

This paper cites an unresolved cited work.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Unresolved cited work

Reference 87

Resolution
unresolved
raw_fallback, observed 2026-08-09T10:26:08.069611Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-08-09T10:26:07.143846Z digest=sha256:13c58ad5fd3570d220b7dcbd95dc840d897939033668200dad5809427e43caab

Observation 7d92f8d6-27bf-4b39-85eb-919b89c6d79e · outbound

This paper cites answering mathematical questions.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons answering mathematical questions

Reference 88

Resolution
verified fuzzy
raw_fallback, observed 2026-08-09T10:26:08.059991Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-08-09T10:26:07.147208Z digest=sha256:d347bf111312ddae198e9d0512ad623560c89392cd32405f389b44d5a788f1fc

Observation 2f0e63f4-6606-4498-8e80-5be63eda0730 · outbound

This paper cites an unresolved cited work.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Unresolved cited work

Reference 89

Resolution
unresolved
raw_fallback, observed 2026-08-09T10:26:08.049961Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-08-09T10:26:07.150817Z digest=sha256:f1fd188464d4067ccc05e8ab85983b9890f4c3bf84fc19f57b94daf5b403d744

Observation bee8ab36-431f-4d95-a01c-d69b02d92d48 · outbound

This paper cites an unresolved cited work.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Unresolved cited work

Reference 90

Resolution
unresolved
raw_fallback, observed 2026-08-09T10:26:08.040625Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-08-09T10:26:07.154679Z digest=sha256:58517080c449d8714cb45d6bb7d6ebece5d415a2e0321c28ea84095dbbb6ba6d

Observation 77247908-1df8-488d-9bca-d5aeaf148899 · outbound

This paper cites an unresolved cited work.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Unresolved cited work

Reference 91

Resolution
unresolved
raw_fallback, observed 2026-08-09T10:26:08.030964Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-08-09T10:26:07.158121Z digest=sha256:da19a3714c819eeafc0594511395a010959b641c493b01d99ad4b972c049de5b

Observation ad00961e-cbf8-4957-be63-01bf446f8a09 · outbound

This paper cites an unresolved cited work.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Unresolved cited work

Reference 92

Resolution
unresolved
raw_fallback, observed 2026-08-09T10:26:08.021706Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-08-09T10:26:07.161630Z digest=sha256:c611c57068eb04db5a0e46f0317a55d1768ae7fc0c7a5b3329ab8c5f9e5382e1

Observation ba33ef3a-c86e-445a-a03e-f93ddd0c2eea · outbound

This paper cites an unresolved cited work.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Unresolved cited work

Reference 93

Resolution
unresolved
raw_fallback, observed 2026-08-09T10:26:08.011969Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-08-09T10:26:07.165059Z digest=sha256:f8af48f4ebb0d68291adc703d9967077301612e58c29c80fb04e2b4d7879f7df

Observation 4a783726-0f8b-45b7-997f-45b635ae97d6 · outbound

This paper cites an unresolved cited work.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Unresolved cited work

Reference 94

Resolution
unresolved
raw_fallback, observed 2026-08-09T10:26:08.002138Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-08-09T10:26:07.168408Z digest=sha256:3230f8370d1002a436c5e6ddb35e6795b216ecec4094b112ab1f38bbdbef66e1

Observation b5e25f44-9539-4884-a32d-ef4e0143c4a9 · outbound

This paper cites answering mathematical questions.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons answering mathematical questions

Reference 95

Resolution
verified fuzzy
raw_fallback, observed 2026-08-09T10:26:07.992644Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-08-09T10:26:07.171943Z digest=sha256:0263283e80cf3006b5eb0c1e9c2ec2b8af2db7b4c54bd9b91ffa4c226c118626

Observation 82c591b6-5a96-46c1-a092-56d85dfb17cc · outbound

This paper cites an unresolved cited work.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Unresolved cited work

Reference 96

Resolution
unresolved
raw_fallback, observed 2026-08-09T10:26:07.982876Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-08-09T10:26:07.175557Z digest=sha256:3dd09183770741732785a60b527e06bc96590e3b5faa73260542a7f785916168

Observation 6b597b12-3ee6-46d2-846b-c291354a95d4 · outbound

This paper cites an unresolved cited work.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Unresolved cited work

Reference 97

Resolution
unresolved
raw_fallback, observed 2026-08-09T10:26:07.973017Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-08-09T10:26:07.179032Z digest=sha256:a450521ff20d58b68985993b86e84a6e8690295bd708c14ee9d651409eb0949f

Observation d5f4c378-aaa6-404d-a1ff-5b99e76dc791 · outbound

This paper cites an unresolved cited work.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Unresolved cited work

Reference 98

Resolution
unresolved
raw_fallback, observed 2026-08-09T10:26:07.962812Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-08-09T10:26:07.182542Z digest=sha256:cda0ca58bfc62545e4265cc23a77b460e12692adebafc809d717b880a7179338

Observation 905e1a75-c732-4d9b-b8a0-d610f199af37 · outbound

This paper cites Think carefully for a moment, then give your conclusion.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Think carefully for a moment, then give your conclusion

Reference 99

Resolution
verified fuzzy
raw_fallback, observed 2026-08-09T10:26:07.953122Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-08-09T10:26:07.185935Z digest=sha256:45eb2c26c6b912932033c3bc0011abe9dbcf66e171e8677f86670e650d1eef90

Observation a0bf0c0e-4abe-4396-b4e5-128b6049f4b9 · outbound

This paper cites an unresolved cited work.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Unresolved cited work

Reference 100

Resolution
unresolved
raw_fallback, observed 2026-08-09T10:26:07.943013Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-08-09T10:26:07.189312Z digest=sha256:b918f903d9d4a730be9222fc54589be21aca1494c13545267ddfdf204b610d0c

Observation b8cfcbf2-c3c9-4af4-897f-8e72c222cebc · outbound

This paper cites GPT-4’s response I believe the overall rating for this reply is [[1]] for the following reasons: Advantages of the current reply:.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons GPT-4’s response I believe the overall rating for this reply is [[1]] for the following reasons: Advantages of the current reply:

Reference 101

Resolution
verified fuzzy
raw_fallback, observed 2026-08-09T10:26:07.933203Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-08-09T10:26:07.192887Z digest=sha256:ea0e821e9707abc5b43c2450ed412a4e2b5d35317f7f89a55406392367e793b0

Observation 26c1c9bf-8dc7-4568-bb35-c477c232a335 · outbound

This paper cites [[3]] Shortcomings of the current reply:.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons [[3]] Shortcomings of the current reply:

Reference 102

Resolution
verified fuzzy
raw_fallback, observed 2026-08-09T10:26:07.921431Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-08-09T10:26:07.196148Z digest=sha256:c83f6a8e58de9c3326d4f2a8008c61f8c83c20c952845d4cc89cc72221d2d45d

Pith citing papers

Observation bf223e65-e5a7-4420-ac2d-3453d7ca8f34 · inbound

Towards Reasoning Era: A Survey of Long Chain-of-Thought for Reasoning Large Language Models cites this paper.

Towards Reasoning Era: A Survey of Long Chain-of-Thought for Reasoning Large Language Models Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons

Reference 279

Resolution
verified exact
arxiv_id, observed 2026-05-12T08:40:41.647942Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-05-12T08:40:40.910461Z digest=sha256:1992825c750ee700d355f89172b60793b027896407ed60667ea2065126cdf8a6