Pith. sign in

Paper Citation Record · LEDGER

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics

As of 8 August 2026, this Paper Citation Record lists 63 of 63 outbound references and 1 inbound Pith citation observation for arXiv:2505.15469.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2505.15469 v1

Coverage vector

measured 63 of 63 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-07T15:20:52.902763Z

measured 64 of 64 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-08T06:32:00.761636+00:00

measured 1 of 1 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-05-19T10:19:07.701197Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-05-19T10:22:14.539749Z

Reference resolution

63 of 63 outbound references displayed

  • verified exact4
  • verified fuzzy4
  • unresolved55
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation aee76ef4-e86d-4eba-81cd-cd428e923f11 · outbound

This paper cites an unresolved cited work.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Unresolved cited work

Reference 1

Resolution
unresolved
no resolver link, observed 2026-08-07T15:20:46.487084Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:20:46.487084Z digest=sha256:cd2eab2f7df94ee8ac789518a5e4760bda7281f8346697c6e20645d1425693c7

Observation e599388a-0125-4bdf-a77e-5c4eec1c5903 · outbound

This paper cites an unresolved cited work.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Unresolved cited work

Reference 2

Resolution
verified exact
doi, observed 2026-08-07T15:20:53.481909Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:20:46.734381Z digest=sha256:bc17d9b02741b84049f9656bdac0a319387ccd1cfa44f60893276ad0985f0ef6

Observation 62797bf6-45e3-46c5-bfa8-92a50622c814 · outbound

This paper cites an unresolved cited work.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Unresolved cited work

Reference 3

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:21:00.314250Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:20:46.821296Z digest=sha256:0967721e759271cb6b10d55ab63c3d0cd54e3470ac3ec9a8952fccedab4ded3c

Observation f7d2e336-3e15-499c-aa8a-123c97c28b26 · outbound

This paper cites Efficient Training of Language Models to Fill in the Middle.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Efficient Training of Language Models to Fill in the Middle

Reference 4

Resolution
unresolved
no resolver link, observed 2026-08-07T15:20:46.957316Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:20:46.957316Z digest=sha256:8d7dae322ab73ec1a7ff5ca5e93dbcd0aff1f34748e857a2a6ac22da8cb86cf2

Observation fab25d9c-e76d-4daa-9641-d30685f9f165 · outbound

This paper cites an unresolved cited work.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Unresolved cited work

Reference 5

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:21:00.187552Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:20:47.035386Z digest=sha256:c926be9ad469d8d3ea61a8d526f57bc3d7f3bbef164f05c8401085fa15d9f2eb

Observation 2f4d310b-f238-446f-bfc5-aa0c10bc4864 · outbound

This paper cites an unresolved cited work.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Unresolved cited work

Reference 6

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:21:00.036105Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:20:47.148094Z digest=sha256:2a17e0d142e95d6d12d0c7d83eb433888a90d4d583ad3ab8c61acfd1bdf758a5

Observation f7aa3615-1f3e-4520-a7b5-e96606f9fbb2 · outbound

This paper cites an unresolved cited work.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Unresolved cited work

Reference 7

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:20:59.845352Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:20:47.288313Z digest=sha256:eeb56f8becb9a83cf9d4621c7203521a94c20cc3032140818981abd3c40b60e0

Observation d31e0e58-756e-4519-b606-4bbe034f94bb · outbound

This paper cites an unresolved cited work.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Unresolved cited work

Reference 8

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:20:59.713155Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:20:47.401300Z digest=sha256:e4762e9925ff598f0c306985808b89550dc32fb960c8c5ed6f3e0d36830cba4a

Observation 51e9f5fc-08c9-4dde-a05b-6dee9f767d3c · outbound

This paper cites an unresolved cited work.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Unresolved cited work

Reference 9

Resolution
verified exact
doi, observed 2026-08-07T15:20:53.328616Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:20:47.508110Z digest=sha256:d86f33f5184e93ca1b91856079b26fe456bf1d15a3496e68a77a4fbc70b8d217

Observation 36d0ed6c-07c1-4748-a4d3-6b55698c7b3f · outbound

This paper cites an unresolved cited work.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Unresolved cited work

Reference 10

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:20:59.552892Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:20:47.572575Z digest=sha256:12586f6cacd5489d0102d0be9234e6135d17fc905f02c77067b85198da4601d6

Observation 62050d25-3c15-49cc-a25b-0790630c6fe4 · outbound

This paper cites an unresolved cited work.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Unresolved cited work

Reference 11

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:20:59.359286Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:20:47.624702Z digest=sha256:e3618983f40512aa9c3b9fb649e930ccdd94a736f239695e6d748e8905d1fa84

Observation b92c6d34-4f0c-4e0c-be69-525b8300cf84 · outbound

This paper cites an unresolved cited work.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Unresolved cited work

Reference 12

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:20:59.163043Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:20:47.722014Z digest=sha256:8f3d706403a4916d80539f5b5cb1864109d9e597e40636a97776a3a4e55c9778

Observation feac6d7f-505f-4772-8bc9-92deac8440d4 · outbound

This paper cites A Survey on Large Language Models for Code Generation.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics A Survey on Large Language Models for Code Generation

Reference 13

Resolution
unresolved
no resolver link, observed 2026-08-07T15:20:47.806822Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:20:47.806822Z digest=sha256:e76d4a4e91d9de7fcf6c4c68c6fd76ef723884c615a5848a14030610010c0ae8

Observation 10b3618f-546d-43fd-86c7-b04d20b2e0a2 · outbound

This paper cites an unresolved cited work.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Unresolved cited work

Reference 14

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:20:58.976027Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:20:47.885209Z digest=sha256:ed5679d4f6e4e3e0e150871d77855d08beb1cf92079c0c876e94291a9f89de3e

Observation 9dc8e610-ad90-453a-991e-0eda77692dff · outbound

This paper cites an unresolved cited work.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Unresolved cited work

Reference 15

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:20:58.751310Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:20:47.998000Z digest=sha256:c7ad5ae7444585cbd1e45355ff595ec4023bb96962f1fe33f417ed23e5eb8986

Observation 85f9f119-d691-498c-abb6-4b654e461279 · outbound

This paper cites Automatic Code Documentation Generation Using GPT-3.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Automatic Code Documentation Generation Using GPT-3

Reference 16

Resolution
verified exact
local_arxiv, observed 2026-08-07T15:20:53.913759Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:20:48.108019Z digest=sha256:86742eaa9e4f1753c3b77152f97282a584bf97a95da6d8f6de5ac3d368930e46

Observation ed38a35b-c46a-4b67-8c17-51ab52067b6e · outbound

This paper cites an unresolved cited work.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Unresolved cited work

Reference 17

Resolution
unresolved
no resolver link, observed 2026-08-07T15:20:48.217206Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:20:48.217206Z digest=sha256:09f2f3366be492e27f2a922b9985f8c3c9c0af8d6191fd8815cb848b1c387fc1

Observation bb014937-5742-4133-9bdc-4cc0ba7a9d96 · outbound

This paper cites an unresolved cited work.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Unresolved cited work

Reference 18

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:20:58.584458Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:20:48.363196Z digest=sha256:4d813351539da65432d98ffa4541ebc6056ccebd1a5259c4a50afb707eef8af4

Observation f802cb32-a484-4600-b12b-4a4570eded92 · outbound

This paper cites Liang, Chenyang Yang, and Brad A.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Liang, Chenyang Yang, and Brad A

Reference 19

Resolution
unresolved
no resolver link, observed 2026-08-07T15:20:48.498296Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:20:48.498296Z digest=sha256:6708be2a7a1997cf46dd202ca7b6eb4c01cec076646f376eb266e7100d55afaa

Observation 404ba66a-a4df-4f6e-80db-33fdf7c84638 · outbound

This paper cites an unresolved cited work.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Unresolved cited work

Reference 20

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:20:58.362506Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:20:48.607374Z digest=sha256:ce664cb38cdd540292fe693b644289cc93cd4de0b261b4f1154450fecb1856da

Observation c6b0bec7-c83b-428a-816c-7ff9abb0963d · outbound

This paper cites an unresolved cited work.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Unresolved cited work

Reference 21

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:20:58.095782Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:20:48.732104Z digest=sha256:91f08215be06ba38978401c664eb1fc4b21a9cad3d458605f21b8eb3e0e985a8

Observation 495a5318-6ed5-4868-a1a2-4b6d94fdfa15 · outbound

This paper cites RoBERTa: A Robustly Optimized BERT Pretraining Approach.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics RoBERTa: A Robustly Optimized BERT Pretraining Approach

Reference 22

Resolution
unresolved
no resolver link, observed 2026-08-07T15:20:48.844391Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:20:48.844391Z digest=sha256:03aa7bf84d6014a9eec4f2457594f492dac376306bdac0632f8dfd68edd15f81

Observation 4bd50e4e-4b59-4879-be8a-3c9a9dd31f63 · outbound

This paper cites an unresolved cited work.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Unresolved cited work

Reference 23

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:20:57.917258Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:20:48.933750Z digest=sha256:0cabe45ffc87dc82b3a4946ef9c4e1dff255ba4e7fdc8a66f767b033d12dfcd0

Observation 1b191ffd-d8bb-41eb-aa38-33f3c93e8044 · outbound

This paper cites StarCoder 2 and The Stack v2: The Next Generation.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics StarCoder 2 and The Stack v2: The Next Generation

Reference 24

Resolution
unresolved
no resolver link, observed 2026-08-07T15:20:49.072231Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:20:49.072231Z digest=sha256:b350b3268fc2a4e06981bc333516c272b364d5e2d986085a612fe6de815a99dc

Observation d5081326-f24b-4508-b8ba-2cdc1a0bdd3e · outbound

This paper cites an unresolved cited work.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Unresolved cited work

Reference 25

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:20:57.763683Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:20:49.185550Z digest=sha256:614c40aa7cb4e97cd2a72cbc5705232a25414d8fdf6638e1fda0e6058ebfa294

Observation 5a06c56b-6916-4296-b4cf-d36e98f25901 · outbound

This paper cites an unresolved cited work.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Unresolved cited work

Reference 26

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:20:57.634688Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:20:49.278106Z digest=sha256:eae973d35032a8a290fb2743202b27c4d3807b7e230f4ffcd328a8d8faf9a34f

Observation 5a51117e-e432-4cb4-9da0-f5a0bebf6215 · outbound

This paper cites Efficient Estimation of Word Representations in Vector Space.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Efficient Estimation of Word Representations in Vector Space

Reference 27

Resolution
unresolved
no resolver link, observed 2026-08-07T15:20:49.381977Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:20:49.381977Z digest=sha256:d87be68e186c6b52a1c02f3706b1f2a45956e7fb2ce86051325ec32464ba5dfb

Observation a1091bbb-eec8-4547-b227-eb9583d20d4f · outbound

This paper cites Granite Code Models: A Family of Open Foundation Models for Code Intelligence.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Granite Code Models: A Family of Open Foundation Models for Code Intelligence

Reference 28

Resolution
unresolved
no resolver link, observed 2026-08-07T15:20:49.511222Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:20:49.511222Z digest=sha256:0be7bbc51462c1f5cf500fb89338fff205640c579ab02fd7a0d31da0d56013d7

Observation c299f4b6-7596-45da-938e-e3508cc33b8e · outbound

This paper cites an unresolved cited work.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Unresolved cited work

Reference 29

Resolution
unresolved
no resolver link, observed 2026-08-07T15:20:49.638318Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:20:49.638318Z digest=sha256:f78727a2648f7d5134f8ebb3df578ca453ae28a8eacc78d66a842d9094a43802

Observation 52f2af0d-47cf-4fc0-a1dc-831015004064 · outbound

This paper cites an unresolved cited work.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Unresolved cited work

Reference 30

Resolution
unresolved
no resolver link, observed 2026-08-07T15:20:49.723813Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:20:49.723813Z digest=sha256:2bceadded84c2ced2f77c1979d4bf44ac740c5026ac38512a67543ac9694f46a

Observation b06cadb3-9acc-409e-9e59-e4d75bca6197 · outbound

This paper cites an unresolved cited work.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Unresolved cited work

Reference 31

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:20:57.485773Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:20:49.834835Z digest=sha256:8be5244b2f8224c8d281ab74945818cdd5f4b452daa8b019b20335c8a5da6e58

Observation 8d8b30bc-7ebf-4f3c-8223-8d31208afc92 · outbound

This paper cites an unresolved cited work.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Unresolved cited work

Reference 32

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:20:57.315450Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:20:49.951493Z digest=sha256:1f2ff29d532c8e8cf9d533b1eb568a741e6ca0d84b410c35d5ffd42c6fa90f54

Observation d0cbc8a7-1c4c-4806-bc60-c1f7d4eac6ea · outbound

This paper cites an unresolved cited work.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Unresolved cited work

Reference 33

Resolution
verified exact
doi, observed 2026-08-07T15:20:53.113117Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:20:50.181924Z digest=sha256:3bca46fb8ab4173e92075ea9481b3100205ec85d93400a8cafb98cc9a7267b65

Observation e361b070-12c5-4993-8774-8754cb7c6ad1 · outbound

This paper cites an unresolved cited work.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Unresolved cited work

Reference 34

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:20:57.029027Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:20:50.314446Z digest=sha256:2c2fea2c16cd70e49930223aebafc50f686461ace1f6d3c2e8dd0a0be4803bb2

Observation 71987109-4f36-4e91-8ea8-133f6a7e7211 · outbound

This paper cites an unresolved cited work.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Unresolved cited work

Reference 35

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:20:56.873872Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:20:50.417629Z digest=sha256:622af68e64f58f953bef96a924e47122188e896480fcabc12531d48f6d4743f7

Observation 3460e378-3466-437a-ad49-ce632e2c5c0b · outbound

This paper cites an unresolved cited work.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Unresolved cited work

Reference 36

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:20:56.700849Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:20:50.489267Z digest=sha256:0d454bda2cef1fa0bc00fa7f42b0a3baacdb81809d4adf43fccfea3e07a33e9f

Observation 49923556-ae3c-48d9-b93c-a25c101af8fa · outbound

This paper cites an unresolved cited work.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Unresolved cited work

Reference 37

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:20:56.553704Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:20:50.619929Z digest=sha256:a2d1f1f2b44d7b0f1289437c7e55f39b1f48026448a686070a45529834b26b16

Observation 7a85e8bb-9ad7-4825-9cb2-4851b4ffd61f · outbound

This paper cites Code Llama: Open Foundation Models for Code.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Code Llama: Open Foundation Models for Code

Reference 38

Resolution
unresolved
no resolver link, observed 2026-08-07T15:20:50.753776Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:20:50.753776Z digest=sha256:ed5c33e208f516f6b055147336cc8db1b131b4d17185fecd5201f02669d82da8

Observation b122e0ed-2bfb-41c6-98bf-3cc5b198cbbc · outbound

This paper cites Sai, Tanay Dixit, Dev Yashpal Sheth, Sreyas Mohan, and Mitesh M.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Sai, Tanay Dixit, Dev Yashpal Sheth, Sreyas Mohan, and Mitesh M

Reference 39

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:20:56.417276Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:20:50.854897Z digest=sha256:7b0334104db0e02c65258fa7c50cd08b6c252c1711e6170cb50bea6da863b93e

Observation 682d8869-9e59-451f-a363-9d167b67a1a7 · outbound

This paper cites Reproducibility in Machine Learning-based Research: Overview, Barriers and Drivers.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Reproducibility in Machine Learning-based Research: Overview, Barriers and Drivers

Reference 40

Resolution
unresolved
no resolver link, observed 2026-08-07T15:20:50.934765Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:20:50.934765Z digest=sha256:89450ec1a69a0cbb7404ddf6979102685bdcc8ac19d1771feb32883509255681

Observation e5a943bb-e2cf-47ba-ae18-52e2c35389ef · outbound

This paper cites an unresolved cited work.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Unresolved cited work

Reference 41

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:20:56.251837Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:20:51.067575Z digest=sha256:58091774ae337c51f479ae1ef19ee217d304583b7ec18730f13fae84c204eebf

Observation 86767d71-985d-42b0-a165-a42c4925a1ea · outbound

This paper cites CodeGemma: Open Code Models Based on Gemma.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics CodeGemma: Open Code Models Based on Gemma

Reference 42

Resolution
unresolved
no resolver link, observed 2026-08-07T15:20:51.134531Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:20:51.134531Z digest=sha256:b248273937bfabbc15bef590edccfbcb63d661828469fd9aef5296fc139a0a48

Observation a7e49ac4-5528-4234-a552-cde82b56cd28 · outbound

This paper cites Gemma: Open Models Based on Gemini Research and Technology.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Gemma: Open Models Based on Gemini Research and Technology

Reference 43

Resolution
unresolved
no resolver link, observed 2026-08-07T15:20:51.225398Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:20:51.225398Z digest=sha256:4b4a5010bb6d5fee47c6d81eeb2fcfc68d99a867c7f205982f20684365e12aa2

Observation 220c80ca-0093-482a-87ca-a5f88019f130 · outbound

This paper cites an unresolved cited work.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Unresolved cited work

Reference 44

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:20:56.092417Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:20:51.346574Z digest=sha256:59e2cd38f628ac9b3fe005fa9b100cfd49b09d8695de57fa693cd87f1189fb3b

Observation 88102446-ca89-401e-bb04-d8121dd65381 · outbound

This paper cites an unresolved cited work.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Unresolved cited work

Reference 45

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:20:55.905978Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:20:51.466805Z digest=sha256:7aec249910521a49f95bd515284f66b83fc858b6d68d8ff47713b2c3f2ecd8e2

Observation fcc8625a-b1d8-4230-9005-d942b5d27d98 · outbound

This paper cites an unresolved cited work.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Unresolved cited work

Reference 46

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:20:55.726548Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:20:51.539046Z digest=sha256:2cd88d626ec649df99e7f0a3ee0f52189b00ae2df868f05c2dbabf9802b116b4

Observation f36dbc48-0b8b-42d8-8f41-7707fb0c8929 · outbound

This paper cites an unresolved cited work.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Unresolved cited work

Reference 47

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:20:55.581700Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:20:51.619713Z digest=sha256:07d227faa62e89960935afee9482fc692eb0fcfa28902ed9fec675f3a5a458de

Observation 778fee85-27aa-4582-8e3b-e06de84987da · outbound

This paper cites Llama 2: Open Foundation and Fine-Tuned Chat Models.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Llama 2: Open Foundation and Fine-Tuned Chat Models

Reference 48

Resolution
unresolved
no resolver link, observed 2026-08-07T15:20:51.693738Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:20:51.693738Z digest=sha256:d8458c196909245f29540dec504b6eeb93906153449b828298ea49377761316f

Observation f001a3c9-9c4c-432c-817a-cacc404b2a4e · outbound

This paper cites an unresolved cited work.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Unresolved cited work

Reference 49

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:20:55.427351Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:20:51.774228Z digest=sha256:322d515384180813f501262c274ed351bd10ec8f92aa7d5c41293d34949091e0

Observation 9fd2cd3a-fcc4-4b18-bb10-1a537dea1d69 · outbound

This paper cites an unresolved cited work.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Unresolved cited work

Reference 50

Resolution
unresolved
no resolver link, observed 2026-08-07T15:20:51.870535Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:20:51.870535Z digest=sha256:b6deeea81e5bf07c8b77269a9b622b39870b789c9ac18f49d34c591f47f7be98

Observation aadc31c8-38b3-4281-a715-a1587106bd73 · outbound

This paper cites an unresolved cited work.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Unresolved cited work

Reference 51

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:20:55.220074Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:20:51.952565Z digest=sha256:82d68a5ea84b2021ae184bff037803a6f7ed009820b26656f46a424a4f7b2a16

Observation c7d109a9-5785-4573-a6e2-f90714ff9806 · outbound

This paper cites an unresolved cited work.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Unresolved cited work

Reference 52

Resolution
unresolved
no resolver link, observed 2026-08-07T15:20:52.037377Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:20:52.037377Z digest=sha256:12dc2aaac582ff5dbb022c30ac87fa1ad8cca3c4a3bf7932342ca46ab11a31fd

Observation 27656cc5-d700-4162-89f5-1909418e58bd · outbound

This paper cites an unresolved cited work.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Unresolved cited work

Reference 53

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:20:55.077647Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:20:52.158447Z digest=sha256:55628b948c1e642d7282927e2bc143294db30c1afe5814c3647ed38e626a08b6

Observation b7bfdbd0-052f-422f-a0be-da9ed8ef6dd6 · outbound

This paper cites Witchel, Christopher I.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Witchel, Christopher I

Reference 54

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:20:54.917761Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:20:52.252558Z digest=sha256:8b6e1d3ebe2cb5e294ede8eb4e05343ac4ff482f70aaa070e779f2c1ab4682fa

Observation a4283ada-82b8-4446-8b75-cc0db0c10155 · outbound

This paper cites an unresolved cited work.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Unresolved cited work

Reference 55

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:20:54.617394Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:20:52.429199Z digest=sha256:a9d69c1c7b2a12a9b218aa232dee47f44cb1c310f7900c4e3288a283af09f8d0

Observation cf2d77e5-6c9f-441c-a379-aa8386fca7a9 · outbound

This paper cites an unresolved cited work.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Unresolved cited work

Reference 56

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:20:54.476112Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:20:52.538790Z digest=sha256:14f75eec0a77664cd7c2ebb65305109f06f3ff864ddfaf61e4c97ad07c7604db

Observation 09c30082-122c-4dad-9f39-d6062c6aed2a · outbound

This paper cites Don't Trust ChatGPT when Your Question is not in English: A Study of Multilingual Abilities and Types of LLMs.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Don't Trust ChatGPT when Your Question is not in English: A Study of Multilingual Abilities and Types of LLMs

Reference 57

Resolution
unresolved
no resolver link, observed 2026-08-07T15:20:52.641310Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:20:52.641310Z digest=sha256:40de8726253829b9b1c9f3bfcead5fd37984fa594cab25432b03efbed6fa40a1

Observation 9ba06270-9a7e-46b7-b613-181ce6ff5f7a · outbound

This paper cites Weinberger, and Yoav Artzi.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Weinberger, and Yoav Artzi

Reference 58

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:20:54.294855Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:20:52.701026Z digest=sha256:9a01802aea35aacfb63f7b60859513a0e02bad8371067a8df0bd3c22fb9e6acc

Observation 091d7c87-99f6-471d-bad4-e14d1b625f3c · outbound

This paper cites an unresolved cited work.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Unresolved cited work

Reference 59

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:20:54.150485Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:20:52.798547Z digest=sha256:3d46024251cab26e3a7efc37499731530fe9eff0e81ce1f456bee7f9b77609f1

Observation 89e40cbe-707c-4e72-b339-0d0b12a6cfcc · outbound

This paper cites Productivity Assessment of Neural Code Completion.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Productivity Assessment of Neural Code Completion

Reference 60

Resolution
unresolved
no resolver link, observed 2026-08-07T15:20:52.902763Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:20:52.902763Z digest=sha256:c16f1b2c0cb68768f3fec27d1e5dc8a8ad671617198728c060d9188ad9f3c1c6

Observation 73557d92-368c-48b3-b5eb-6b3f39f92ca1 · outbound

This paper cites Frontiers in Psychology, 13, 873844.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Frontiers in Psychology, 13, 873844

Reference 2022

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:20:54.757288Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:20:52.325156Z digest=sha256:a6012c8feb384ddb18494c1f542d76bad5d115e0fb81204bf278f3db2b7ffc1c

Observation 147107d5-bb97-445e-96df-467741c195db · outbound

This paper cites an unresolved cited work.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Unresolved cited work

Reference 2024

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:20:57.174233Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:20:50.062042Z digest=sha256:a3c7081db2b3a1d1e141f2a7cc84a98a835aaef970eebb5d8f2fa9d58d18cb8c

Observation 8453bbfc-0511-4425-99a2-cf16a3f2442d · outbound

This paper cites an unresolved cited work.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Unresolved cited work

Reference 2025

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:21:00.456326Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:20:46.577952Z digest=sha256:8573c4f57665efef279e0d562db9013c8d8269b61f1a7dd0863f3a9a729f8b43

Pith citing papers

Observation facb7a0e-03b0-4913-adc7-da28166ae9f9 · inbound

AdaDec: A Uncertainty-Guided Lookahead Decoding Framework for LLM-Based Code Generation cites this paper.

AdaDec: A Uncertainty-Guided Lookahead Decoding Framework for LLM-Based Code Generation A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics

Reference 35

Resolution
verified exact
arxiv_id, observed 2026-05-19T10:22:14.541296Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-05-19T10:19:07.701197Z digest=sha256:0eabe4a8c99bf7d6cd68c0515b84ac8686519c21f422e05b009d0b511c3b5dc3