Pith. sign in

Paper Citation Record · LEDGER

LLM-as-a-Judge for Reference-less Automatic Code Validation and Refinement for Natural Language to Bash in IT Automation

As of 9 August 2026, this Paper Citation Record lists 14 of 14 outbound references and 0 inbound Pith citation observations for arXiv:2506.11237.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2506.11237 v1

Coverage vector

measured 14 of 14 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-07T04:15:57.248959Z

measured 14 of 14 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-09T06:31:02.800959+00:00

measured 0 of 0 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: cited_works

Reference resolution

14 of 14 outbound references displayed

  • verified exact1
  • verified fuzzy0
  • unresolved13
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 322da3ed-11c6-47b4-8417-0a365e6a6b7c · outbound

This paper cites an unresolved cited work.

LLM-as-a-Judge for Reference-less Automatic Code Validation and Refinement for Natural Language to Bash in IT Automation Unresolved cited work

Reference 1

Resolution
unresolved
no resolver link, observed 2026-08-07T04:15:56.108897Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T04:15:56.108897Z digest=sha256:b142a42be035f15484c565910779df8ab411bac0940cda22b804f0a2afb6e89b

Observation 2af61963-1fb7-4272-869b-c5ce447f49e3 · outbound

This paper cites an unresolved cited work.

LLM-as-a-Judge for Reference-less Automatic Code Validation and Refinement for Natural Language to Bash in IT Automation Unresolved cited work

Reference 2

Resolution
unresolved
no resolver link, observed 2026-08-07T04:15:56.175034Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T04:15:56.175034Z digest=sha256:43a7f6519a27e79d53792adb693855686b7dcbe476a69a7a1206003db6a29e64

Observation ed8ce834-b70a-48a8-8a37-b4855c869ef8 · outbound

This paper cites GPTScore: Evaluate as You Desire.

LLM-as-a-Judge for Reference-less Automatic Code Validation and Refinement for Natural Language to Bash in IT Automation GPTScore: Evaluate as You Desire

Reference 3

Resolution
unresolved
no resolver link, observed 2026-08-07T04:15:56.303867Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T04:15:56.303867Z digest=sha256:6a44b55f4fc7c9979c91e79cdd06ef3eeb0d2fba43abd5c32e6a282ee34a2aa7

Observation 1c79f0e6-8d8c-45d9-ad65-d6c0a5bb5213 · outbound

This paper cites an unresolved cited work.

LLM-as-a-Judge for Reference-less Automatic Code Validation and Refinement for Natural Language to Bash in IT Automation Unresolved cited work

Reference 4

Resolution
unresolved
no resolver link, observed 2026-08-07T04:15:56.379860Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T04:15:56.379860Z digest=sha256:46692d03846ea9673d466aa5e36876f53d3e03964367a4d235162fa6cc8975cb

Observation fc854bf4-b478-4cd9-98f2-95c32856f6de · outbound

This paper cites G-Eval: NLG Evaluation using GPT-4 with Better Human Alignment.

LLM-as-a-Judge for Reference-less Automatic Code Validation and Refinement for Natural Language to Bash in IT Automation G-Eval: NLG Evaluation using GPT-4 with Better Human Alignment

Reference 5

Resolution
unresolved
no resolver link, observed 2026-08-07T04:15:56.484331Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T04:15:56.484331Z digest=sha256:ef1efd99411256662552657f9203bcc418ae5bbc7f458b96f7d5de20c7d43250

Observation d6037926-308a-47f5-8264-043df51d932c · outbound

This paper cites GPT-4 Technical Report.

LLM-as-a-Judge for Reference-less Automatic Code Validation and Refinement for Natural Language to Bash in IT Automation GPT-4 Technical Report

Reference 6

Resolution
unresolved
no resolver link, observed 2026-08-07T04:15:56.569558Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T04:15:56.569558Z digest=sha256:222d155ea42c5e65056d902154ff6767a748507c7d4b392b016f960662de2d3b

Observation 01736c5d-2db0-43dc-8a6b-4f5247f98262 · outbound

This paper cites an unresolved cited work.

LLM-as-a-Judge for Reference-less Automatic Code Validation and Refinement for Natural Language to Bash in IT Automation Unresolved cited work

Reference 7

Resolution
unresolved
no resolver link, observed 2026-08-07T04:15:56.645607Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T04:15:56.645607Z digest=sha256:d5366dc0c2709bb343a2feeed458d8c3d6c843bbf81be13fa7aaf119cb42409b

Observation a27aa9c3-4bc7-425f-9b83-79a79f7cac0a · outbound

This paper cites CodeBLEU: a Method for Automatic Evaluation of Code Synthesis.

LLM-as-a-Judge for Reference-less Automatic Code Validation and Refinement for Natural Language to Bash in IT Automation CodeBLEU: a Method for Automatic Evaluation of Code Synthesis

Reference 8

Resolution
unresolved
no resolver link, observed 2026-08-07T04:15:56.728459Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T04:15:56.728459Z digest=sha256:dee6ac57d3af4e87f1fa1492fa7e1a1ead67fa5238a1e4fc99cbe45da0946807

Observation 03b70daa-2187-4ed2-9f0a-7fd0610ab354 · outbound

This paper cites Execution-Based Evaluation of Natural Language to Bash and PowerShell for Incident Remediation.

LLM-as-a-Judge for Reference-less Automatic Code Validation and Refinement for Natural Language to Bash in IT Automation Execution-Based Evaluation of Natural Language to Bash and PowerShell for Incident Remediation

Reference 9

Resolution
verified exact
local_arxiv, observed 2026-08-07T04:15:57.437306Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=arxiv_source observed=2026-08-07T04:15:56.808012Z digest=sha256:2aa8c02331742616b2d02d73737940856027a1b13ad46f873ada128a86ecc602

Observation 455c4b78-3140-4a1b-9c67-4a77c259d479 · outbound

This paper cites an unresolved cited work.

LLM-as-a-Judge for Reference-less Automatic Code Validation and Refinement for Natural Language to Bash in IT Automation Unresolved cited work

Reference 10

Resolution
unresolved
raw_fallback, observed 2026-08-07T04:15:57.931865Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=arxiv_source observed=2026-08-07T04:15:56.864925Z digest=sha256:8dbd6ab02769efe48e22473b28a9f5c787dec0b1dfda68f2f39c03c5d0648328

Observation 0d63beb1-a575-47a6-9b4b-1e27ab0d1bac · outbound

This paper cites CodeBERTScore: Evaluating Code Generation with Pretrained Models of Code.

LLM-as-a-Judge for Reference-less Automatic Code Validation and Refinement for Natural Language to Bash in IT Automation CodeBERTScore: Evaluating Code Generation with Pretrained Models of Code

Reference 11

Resolution
unresolved
no resolver link, observed 2026-08-07T04:15:56.956169Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T04:15:56.956169Z digest=sha256:31c09e558ef492398a0288bcf249d6fd9be1868f8cd8ba6c0d8713760cbbd06d

Observation 60b6cb92-cccd-46da-b332-65b0935fbba7 · outbound

This paper cites an unresolved cited work.

LLM-as-a-Judge for Reference-less Automatic Code Validation and Refinement for Natural Language to Bash in IT Automation Unresolved cited work

Reference 12

Resolution
unresolved
raw_fallback, observed 2026-08-07T04:15:57.789791Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=arxiv_source observed=2026-08-07T04:15:57.080553Z digest=sha256:761a543eccc288e5436f49dc6bf7f6e7e600f8612cfaf0740651fc94b21f4127

Observation e7d5dccd-102a-4386-b46b-011d92567cb0 · outbound

This paper cites online" 'onlinestring :=.

LLM-as-a-Judge for Reference-less Automatic Code Validation and Refinement for Natural Language to Bash in IT Automation online" 'onlinestring :=

Reference 13

Resolution
unresolved
no resolver link, observed 2026-08-07T04:15:57.151356Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T04:15:57.151356Z digest=sha256:c8071d738f23956363fdc07d539b76d148c7931af55f83aee84a7a809f62cbf3

Observation e0b919a5-7f07-4c85-9e21-d6a1af4bfeb5 · outbound

This paper cites write newline.

LLM-as-a-Judge for Reference-less Automatic Code Validation and Refinement for Natural Language to Bash in IT Automation write newline

Reference 14

Resolution
unresolved
no resolver link, observed 2026-08-07T04:15:57.248959Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T04:15:57.248959Z digest=sha256:288ef5b508ac33b4c2282815952f1327f29030c5a0d4d89de7b4a342f4527921

Pith citing papers

No inbound Pith citation observations are available.