Pith. sign in

Paper Citation Record · LEDGER

ParEval-Repo: A Benchmark Suite for Evaluating LLMs with Repository-level HPC Translation Tasks

As of 19 August 2026, this Paper Citation Record lists 30 of 30 outbound references and 0 inbound Pith citation observations for arXiv:2506.20938.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2506.20938 v2

Coverage vector

measured 30 of 30 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-06T22:43:51.670221Z

measured 30 of 30 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-19T06:32:44.657259+00:00

measured 0 of 0 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: cited_works

Reference resolution

30 of 30 outbound references displayed

  • verified exact3
  • verified fuzzy8
  • unresolved19
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 841ca845-a418-4cd1-8e28-d22336d2dbb4 · outbound

This paper cites Llama 3.3 Model Card and Prompt Format.

ParEval-Repo: A Benchmark Suite for Evaluating LLMs with Repository-level HPC Translation Tasks Llama 3.3 Model Card and Prompt Format

Reference 1

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T22:43:55.474269Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-06T22:43:49.639271Z digest=sha256:16dd40aba4a5ba137d27a4d011110133f41a6e891d90c642cf9f597ed25770d2

Observation 33698bf7-3e7f-4914-86a8-4b31f61bfacf · outbound

This paper cites QwQ: Reflect Deeply on the Boundaries of the Unknown.

ParEval-Repo: A Benchmark Suite for Evaluating LLMs with Repository-level HPC Translation Tasks QwQ: Reflect Deeply on the Boundaries of the Unknown

Reference 2

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T22:43:55.310183Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-06T22:43:49.705891Z digest=sha256:fee17600a1f630d281d14dfde53526a3cdf2b27f9e25d24207a32c3b04347622

Observation 503843b7-6e60-4eb7-a251-0384227857db · outbound

This paper cites o3 and o4-mini System Card.

ParEval-Repo: A Benchmark Suite for Evaluating LLMs with Repository-level HPC Translation Tasks o3 and o4-mini System Card

Reference 3

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T22:43:55.154081Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-06T22:43:49.755156Z digest=sha256:15d91a7e17d7663a420367f3228de8a3d047695fd65b78963225872405bdc67b

Observation e7c88d72-de0c-431f-90a8-9f6fc5ea56d7 · outbound

This paper cites an unresolved cited work.

ParEval-Repo: A Benchmark Suite for Evaluating LLMs with Repository-level HPC Translation Tasks Unresolved cited work

Reference 4

Resolution
unresolved
raw_fallback, observed 2026-08-06T22:43:55.024775Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-06T22:43:49.824417Z digest=sha256:e9ddd2dc3f47aadd1ddd619b8709a241662576bbf3e674bedb00a1027906931a

Observation fe4b6679-f2af-48d3-9af5-602aeae78c10 · outbound

This paper cites an unresolved cited work.

ParEval-Repo: A Benchmark Suite for Evaluating LLMs with Repository-level HPC Translation Tasks Unresolved cited work

Reference 5

Resolution
unresolved
raw_fallback, observed 2026-08-06T22:43:54.857080Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-06T22:43:49.877645Z digest=sha256:3924582025d0272020aa180966b3d4e09ec6a2cbb10f8566e0b332a8e1acf677

Observation c51e9fe1-b6e5-4728-b573-1d5c08c30832 · outbound

This paper cites Davis, Pranav Sivaraman, Joy Kitson, Konstantinos Parasyris, Harshitha Menon, Isaac Minn, Giorgis Georgakoudis, and Abhinav Bhatele.

ParEval-Repo: A Benchmark Suite for Evaluating LLMs with Repository-level HPC Translation Tasks Davis, Pranav Sivaraman, Joy Kitson, Konstantinos Parasyris, Harshitha Menon, Isaac Minn, Giorgis Georgakoudis, and Abhinav Bhatele

Reference 6

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T22:43:54.709734Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-06T22:43:49.932225Z digest=sha256:17a561483aaaa792381a65d02e339e84af1a470611c86464d30e31da4529b6e0

Observation 8600b02a-9010-4fc6-8e68-26a6e04a8c80 · outbound

This paper cites an unresolved cited work.

ParEval-Repo: A Benchmark Suite for Evaluating LLMs with Repository-level HPC Translation Tasks Unresolved cited work

Reference 7

Resolution
unresolved
raw_fallback, observed 2026-08-06T22:43:54.555505Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-06T22:43:49.996355Z digest=sha256:6ea6613cd788043a7bfb41dfbe23b95107ac31a42b12d86b7540111fb6c825fd

Observation 7496726f-d371-44a5-87f5-38e847e17f4c · outbound

This paper cites DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning.

ParEval-Repo: A Benchmark Suite for Evaluating LLMs with Repository-level HPC Translation Tasks DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning

Reference 8

Resolution
unresolved
no resolver link, observed 2026-08-06T22:43:50.061336Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T22:43:50.061336Z digest=sha256:c23eb2ff211f07bd578c5c0c44376b8b273b5167f0e8d7429dc65ca7a1a79c61

Observation 2a269638-e603-4dcb-a438-5ecae533e38d · outbound

This paper cites an unresolved cited work.

ParEval-Repo: A Benchmark Suite for Evaluating LLMs with Repository-level HPC Translation Tasks Unresolved cited work

Reference 9

Resolution
verified exact
raw_fallback, observed 2026-08-06T22:43:52.531527Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-06T22:43:50.128126Z digest=sha256:4e7bfd678c5ba8784faf4bc0abd095117a7f645b5826909ba407ed844af44de8

Observation e6ad57c8-4000-4993-98f8-6deb4d45b694 · outbound

This paper cites 2024.The Llama 3 Herd of Models.

ParEval-Repo: A Benchmark Suite for Evaluating LLMs with Repository-level HPC Translation Tasks 2024.The Llama 3 Herd of Models

Reference 10

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T22:43:54.420107Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-06T22:43:50.192077Z digest=sha256:c5283a8bd9c59fbb8a458a1f6f672ed2cfccd8bdf0c95f3eb35a1242d36b0447

Observation 56e678ba-ad4b-47b8-9b51-8f3d4341cdc0 · outbound

This paper cites an unresolved cited work.

ParEval-Repo: A Benchmark Suite for Evaluating LLMs with Repository-level HPC Translation Tasks Unresolved cited work

Reference 11

Resolution
unresolved
no resolver link, observed 2026-08-06T22:43:50.244187Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T22:43:50.244187Z digest=sha256:04449bbea50a40c5d37f86f895fcede2c08252e3061001f108ab36514cd8b845

Observation 6118fa1c-1ffd-46d9-a43e-e46b36b07a54 · outbound

This paper cites an unresolved cited work.

ParEval-Repo: A Benchmark Suite for Evaluating LLMs with Repository-level HPC Translation Tasks Unresolved cited work

Reference 12

Resolution
unresolved
raw_fallback, observed 2026-08-06T22:43:54.241180Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-06T22:43:50.305104Z digest=sha256:676101a0c53a826cbc91598732eb0a92612e9d5c26814aaa199163c4c61adf65

Observation 1be5578c-08eb-415e-8bc2-1b6ee6c408d7 · outbound

This paper cites AlphaTrans: A Neuro-Symbolic Compositional Approach for Repository-Level Code Translation and Validation.

ParEval-Repo: A Benchmark Suite for Evaluating LLMs with Repository-level HPC Translation Tasks AlphaTrans: A Neuro-Symbolic Compositional Approach for Repository-Level Code Translation and Validation

Reference 13

Resolution
unresolved
no resolver link, observed 2026-08-06T22:43:50.356264Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T22:43:50.356264Z digest=sha256:9ea87f42451a0f37a2e701af1a2cffe74b43add719b18afaf4ae53008426f5ac

Observation e2127d97-5b1f-4164-ad47-2fdd96525e6b · outbound

This paper cites Creating a Dataset for High-Performance Computing Code Translation using LLMs: A Bridge Between OpenMP Fortran and C++.

ParEval-Repo: A Benchmark Suite for Evaluating LLMs with Repository-level HPC Translation Tasks Creating a Dataset for High-Performance Computing Code Translation using LLMs: A Bridge Between OpenMP Fortran and C++

Reference 14

Resolution
unresolved
no resolver link, observed 2026-08-06T22:43:50.410301Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T22:43:50.410301Z digest=sha256:c4a25a3d80307d92a899e615f954e835fb4aabb93d1b10f2aef41e62eaa895d7

Observation 6e7a7b10-5c13-48ad-bd6e-aa10a900bd87 · outbound

This paper cites an unresolved cited work.

ParEval-Repo: A Benchmark Suite for Evaluating LLMs with Repository-level HPC Translation Tasks Unresolved cited work

Reference 15

Resolution
unresolved
raw_fallback, observed 2026-08-06T22:43:54.058996Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-06T22:43:50.499419Z digest=sha256:20c4025ef966209a74d030e08f9ab36dcef6ae0277ca3fa80d6e4c16c607264c

Observation 1f5edbc7-a56f-41b3-b708-6a31e7f09cd5 · outbound

This paper cites Efficient Estimation of Word Representations in Vector Space.

ParEval-Repo: A Benchmark Suite for Evaluating LLMs with Repository-level HPC Translation Tasks Efficient Estimation of Word Representations in Vector Space

Reference 16

Resolution
unresolved
no resolver link, observed 2026-08-06T22:43:50.551019Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T22:43:50.551019Z digest=sha256:c920c38ad785315ca0724056965f1809d49a73dc7bf7f05465091e4c4555a6ab

Observation 3adc42ec-f295-4063-8eca-ff3595151def · outbound

This paper cites LLM4VV: Developing LLM-Driven Testsuite for Compiler Validation.

ParEval-Repo: A Benchmark Suite for Evaluating LLMs with Repository-level HPC Translation Tasks LLM4VV: Developing LLM-Driven Testsuite for Compiler Validation

Reference 17

Resolution
verified exact
local_arxiv, observed 2026-08-06T22:43:52.247106Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-06T22:43:50.604016Z digest=sha256:26b03d7014119975f75f533c1395e30255c19ee5911ac6937b05c46494cb6c19

Observation 8bd00500-5a89-4849-bd70-7d788f66dff9 · outbound

This paper cites Davis, Zhaojun Xie, Arjun Rajaram, and Abhinav Bhatele.

ParEval-Repo: A Benchmark Suite for Evaluating LLMs with Repository-level HPC Translation Tasks Davis, Zhaojun Xie, Arjun Rajaram, and Abhinav Bhatele

Reference 18

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T22:43:53.892742Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-06T22:43:50.653934Z digest=sha256:94d7a2c7576723ad5c62b5766419c021efffdbc441875604a9d45f4e474cf51a

Observation 42933a52-274f-4cd5-a852-0a8d3f0d6319 · outbound

This paper cites GPT-4o System Card.

ParEval-Repo: A Benchmark Suite for Evaluating LLMs with Repository-level HPC Translation Tasks GPT-4o System Card

Reference 19

Resolution
unresolved
no resolver link, observed 2026-08-06T22:43:50.739906Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T22:43:50.739906Z digest=sha256:d26aef705e527ca8876521720d79fd4309f582eab67a15dc1a6cdb6858321914

Observation 92126a03-1bd1-458b-8a96-feef41081b64 · outbound

This paper cites OpenMP Application Program Interface.

ParEval-Repo: A Benchmark Suite for Evaluating LLMs with Repository-level HPC Translation Tasks OpenMP Application Program Interface

Reference 20

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T22:43:53.709049Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-06T22:43:50.793514Z digest=sha256:c165089830c097ed770931f3ea6d2bcbe7dab67301dab3bdd572709cb93aec1a

Observation c2713b67-37ac-4205-8d28-031ac6eaedf9 · outbound

This paper cites Gemini: A Family of Highly Capable Multimodal Models.

ParEval-Repo: A Benchmark Suite for Evaluating LLMs with Repository-level HPC Translation Tasks Gemini: A Family of Highly Capable Multimodal Models

Reference 21

Resolution
unresolved
no resolver link, observed 2026-08-06T22:43:50.865671Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T22:43:50.865671Z digest=sha256:6d21652416acf695be8ca6d2fe1d24aa1533244dca0b3c30071fe183f8342a99

Observation bff33345-ab52-4632-a3f2-2cbb9785c1a6 · outbound

This paper cites an unresolved cited work.

ParEval-Repo: A Benchmark Suite for Evaluating LLMs with Repository-level HPC Translation Tasks Unresolved cited work

Reference 22

Resolution
unresolved
raw_fallback, observed 2026-08-06T22:43:53.508715Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-06T22:43:50.943723Z digest=sha256:ba86e088f19fb15054ae5d70effe4ec8a98f74c531419787075870c9d2c63b49

Observation b84857ed-94cd-450d-95a6-ecd82e61bd2d · outbound

This paper cites Tramm, Geoffrey Gunow, Tim He, Kord S.

ParEval-Repo: A Benchmark Suite for Evaluating LLMs with Repository-level HPC Translation Tasks Tramm, Geoffrey Gunow, Tim He, Kord S

Reference 23

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T22:43:53.312669Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-06T22:43:51.019395Z digest=sha256:57ceca415790ce8c9c6a0c839cc55f96e9cdd44399336bc974996b72217407d0

Observation 099fdc7a-0be5-4633-a44d-dcd5bde88628 · outbound

This paper cites an unresolved cited work.

ParEval-Repo: A Benchmark Suite for Evaluating LLMs with Repository-level HPC Translation Tasks Unresolved cited work

Reference 24

Resolution
unresolved
raw_fallback, observed 2026-08-06T22:43:53.128108Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-06T22:43:51.182317Z digest=sha256:035d7aa75c24f5c97ec90cb9b0b55d35d24b1d0b15ff77029f311b645959c921

Observation 8b57d7cd-86c3-4d55-9a75-a492d5e931ba · outbound

This paper cites Trott, Damien Lebrun-Grandié, Daniel Arndt, Jan Ciesko, Vinh Dang, Nathan Ellingwood, Rahulkumar Gayatri, Evan Harvey, Daisy S.

ParEval-Repo: A Benchmark Suite for Evaluating LLMs with Repository-level HPC Translation Tasks Trott, Damien Lebrun-Grandié, Daniel Arndt, Jan Ciesko, Vinh Dang, Nathan Ellingwood, Rahulkumar Gayatri, Evan Harvey, Daisy S

Reference 25

Resolution
unresolved
no resolver link, observed 2026-08-06T22:43:51.291366Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T22:43:51.291366Z digest=sha256:32598ea0cb4587d72eafef56e874d15ef28d91b92296c5583e4c856ecfaef04b

Observation e295de9a-ee80-4191-88b0-04a65f5ebe9e · outbound

This paper cites an unresolved cited work.

ParEval-Repo: A Benchmark Suite for Evaluating LLMs with Repository-level HPC Translation Tasks Unresolved cited work

Reference 26

Resolution
unresolved
raw_fallback, observed 2026-08-06T22:43:52.930565Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-06T22:43:51.398502Z digest=sha256:a0fc29c856cbceafae0cb0689619ae3c959a47038694c1026c85101bd73056bb

Observation a007e12a-fc1b-43a2-a7fb-9db8ae32dccd · outbound

This paper cites an unresolved cited work.

ParEval-Repo: A Benchmark Suite for Evaluating LLMs with Repository-level HPC Translation Tasks Unresolved cited work

Reference 27

Resolution
unresolved
raw_fallback, observed 2026-08-06T22:43:52.718873Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-06T22:43:51.491845Z digest=sha256:55221f6e38acab8a091257f155ed554873bbfd3cd0587ef5bc201d67a884f196

Observation 50f99404-03bc-458c-8e29-671c3341787a · outbound

This paper cites an unresolved cited work.

ParEval-Repo: A Benchmark Suite for Evaluating LLMs with Repository-level HPC Translation Tasks Unresolved cited work

Reference 28

Resolution
unresolved
no resolver link, observed 2026-08-06T22:43:51.575175Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T22:43:51.575175Z digest=sha256:d3478dad8cb6a515ff9f95cc41a6e80e1f6c4a89980a31c641d17eb26ab3fa22

Observation 2e6de089-4649-488c-b5c8-0d92bed82f1a · outbound

This paper cites an unresolved cited work.

ParEval-Repo: A Benchmark Suite for Evaluating LLMs with Repository-level HPC Translation Tasks Unresolved cited work

Reference 29

Resolution
unresolved
no resolver link, observed 2026-08-06T22:43:51.670221Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T22:43:51.670221Z digest=sha256:f3a95ed063c4a3a78841b93667824d0d4e07df2ad2fa493eb9bb73a4ad964f4e

Observation 9fb9630a-18e3-4938-954e-a5bb656a8357 · outbound

This paper cites an unresolved cited work.

ParEval-Repo: A Benchmark Suite for Evaluating LLMs with Repository-level HPC Translation Tasks Unresolved cited work

Reference 150

Resolution
verified exact
doi, observed 2026-08-06T22:43:51.878367Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-06T22:43:51.106825Z digest=sha256:bc1c8638cc7f97d26ad299ac8967f137cb2defc72cf24457bc56ccb23b79d71c

Pith citing papers

No inbound Pith citation observations are available.