Pith. sign in

Paper Citation Record · LEDGER

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics

As of 10 August 2026, this Paper Citation Record lists 63 of 63 outbound references and 1 inbound Pith citation observation for arXiv:2505.15469.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2505.15469 v1

Coverage vector

measured 63 of 63 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-07T15:20:52.902763Z

measured 64 of 64 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-09T06:31:02.800959+00:00

measured 1 of 1 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-05-19T10:19:07.701197Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-05-19T10:22:14.539749Z

Reference resolution

63 of 63 outbound references displayed

  • verified exact4
  • verified fuzzy4
  • unresolved55
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation aee76ef4-e86d-4eba-81cd-cd428e923f11 · outbound

This paper cites an unresolved cited work.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Unresolved cited work

Reference 1

Resolution
unresolved
no resolver link, observed 2026-08-07T15:20:46.487084Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:20:46.487084Z digest=sha256:2e43d4f5d143e9dd032f9befd856f78b027bd636b8a8316c993a0c332d3c1325

Observation e599388a-0125-4bdf-a77e-5c4eec1c5903 · outbound

This paper cites an unresolved cited work.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Unresolved cited work

Reference 2

Resolution
verified exact
doi, observed 2026-08-07T15:20:53.481909Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-07T15:20:46.734381Z digest=sha256:f3d5ba756395fcbb6f6ff8f9efb6e2c4cfda7cc216fdc27a3ffa2ac01239b986

Observation 62797bf6-45e3-46c5-bfa8-92a50622c814 · outbound

This paper cites an unresolved cited work.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Unresolved cited work

Reference 3

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:21:00.314250Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-07T15:20:46.821296Z digest=sha256:2529af88f6f10f7a41fa7f13f4cabd307602bac8d2a7fc351c9efb33315a985a

Observation f7d2e336-3e15-499c-aa8a-123c97c28b26 · outbound

This paper cites Efficient Training of Language Models to Fill in the Middle.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Efficient Training of Language Models to Fill in the Middle

Reference 4

Resolution
unresolved
no resolver link, observed 2026-08-07T15:20:46.957316Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:20:46.957316Z digest=sha256:c2a3e641835059d26f20f1ae6245a59120eedaeb8fba7d321a4170e4f8dd9002

Observation fab25d9c-e76d-4daa-9641-d30685f9f165 · outbound

This paper cites an unresolved cited work.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Unresolved cited work

Reference 5

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:21:00.187552Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-07T15:20:47.035386Z digest=sha256:cac03cb47f4c5fcab922cabb8355e9b8958e0c47acf9bce6227f1c675fb3fceb

Observation 2f4d310b-f238-446f-bfc5-aa0c10bc4864 · outbound

This paper cites an unresolved cited work.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Unresolved cited work

Reference 6

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:21:00.036105Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-07T15:20:47.148094Z digest=sha256:e39378b9f0965080c8982f7ceb5be4d1686ba855714be469217efea1890eba1a

Observation f7aa3615-1f3e-4520-a7b5-e96606f9fbb2 · outbound

This paper cites an unresolved cited work.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Unresolved cited work

Reference 7

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:20:59.845352Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-07T15:20:47.288313Z digest=sha256:4bf2ff2867013a7eff30b9faa9fb8003263b370d4ff69c8e6d0b6e02a2d6b9d6

Observation d31e0e58-756e-4519-b606-4bbe034f94bb · outbound

This paper cites an unresolved cited work.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Unresolved cited work

Reference 8

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:20:59.713155Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-07T15:20:47.401300Z digest=sha256:27e8c50ec2fd7fd1f298990357e3e16d2273631d86c9bdacd8ac31a536779a9d

Observation 51e9f5fc-08c9-4dde-a05b-6dee9f767d3c · outbound

This paper cites an unresolved cited work.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Unresolved cited work

Reference 9

Resolution
verified exact
doi, observed 2026-08-07T15:20:53.328616Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-07T15:20:47.508110Z digest=sha256:fba8a36952af19bcea2e5368ca57845ebe2bc4906494df842de0102c8f3ccaaa

Observation 36d0ed6c-07c1-4748-a4d3-6b55698c7b3f · outbound

This paper cites an unresolved cited work.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Unresolved cited work

Reference 10

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:20:59.552892Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-07T15:20:47.572575Z digest=sha256:7749dad260d49c7be0325f84e14e45860f9ef954c19e1fca4644c8abde83c064

Observation 62050d25-3c15-49cc-a25b-0790630c6fe4 · outbound

This paper cites an unresolved cited work.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Unresolved cited work

Reference 11

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:20:59.359286Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-07T15:20:47.624702Z digest=sha256:3c3278adbeeb2852d13664e229805eb4f8f5db4b394d03b655c9c86ddd694d59

Observation b92c6d34-4f0c-4e0c-be69-525b8300cf84 · outbound

This paper cites an unresolved cited work.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Unresolved cited work

Reference 12

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:20:59.163043Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-07T15:20:47.722014Z digest=sha256:649e0969400a2f4018ddac360d81efb2d51546f68ae125e051b7e265a3e253dd

Observation feac6d7f-505f-4772-8bc9-92deac8440d4 · outbound

This paper cites A Survey on Large Language Models for Code Generation.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics A Survey on Large Language Models for Code Generation

Reference 13

Resolution
unresolved
no resolver link, observed 2026-08-07T15:20:47.806822Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:20:47.806822Z digest=sha256:1e746c52314b5150cd27eb187f8925ed0e393bdabb6f8cddb1990ee77905f1c2

Observation 10b3618f-546d-43fd-86c7-b04d20b2e0a2 · outbound

This paper cites an unresolved cited work.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Unresolved cited work

Reference 14

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:20:58.976027Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-07T15:20:47.885209Z digest=sha256:77598adcc3b829cd6dff4599eb5429d6d62953c637372f6a301ac775305991c6

Observation 9dc8e610-ad90-453a-991e-0eda77692dff · outbound

This paper cites an unresolved cited work.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Unresolved cited work

Reference 15

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:20:58.751310Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-07T15:20:47.998000Z digest=sha256:66666647a5ecb913efbd5849c91fdcd1749061932858c261fb370af352e5d5e4

Observation 85f9f119-d691-498c-abb6-4b654e461279 · outbound

This paper cites Automatic Code Documentation Generation Using GPT-3.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Automatic Code Documentation Generation Using GPT-3

Reference 16

Resolution
verified exact
local_arxiv, observed 2026-08-07T15:20:53.913759Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-07T15:20:48.108019Z digest=sha256:05d09d4870d6205f6111d2bb59e75e1a7495e88b2c5963cb3549e7b979e1e04a

Observation ed38a35b-c46a-4b67-8c17-51ab52067b6e · outbound

This paper cites an unresolved cited work.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Unresolved cited work

Reference 17

Resolution
unresolved
no resolver link, observed 2026-08-07T15:20:48.217206Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:20:48.217206Z digest=sha256:f5c366eec4cedf603e7194bc9f17884479fb6fdd3adc3474ef4b39d13c34bc1c

Observation bb014937-5742-4133-9bdc-4cc0ba7a9d96 · outbound

This paper cites an unresolved cited work.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Unresolved cited work

Reference 18

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:20:58.584458Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-07T15:20:48.363196Z digest=sha256:3b6973e906f6f7014bf49c458b5ca8325b89be1c85792780023954d40681bbda

Observation f802cb32-a484-4600-b12b-4a4570eded92 · outbound

This paper cites Liang, Chenyang Yang, and Brad A.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Liang, Chenyang Yang, and Brad A

Reference 19

Resolution
unresolved
no resolver link, observed 2026-08-07T15:20:48.498296Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:20:48.498296Z digest=sha256:b2cd98702035b1d02d216ac863c3dfbf5368e75517bd4d72e795155f96e681eb

Observation 404ba66a-a4df-4f6e-80db-33fdf7c84638 · outbound

This paper cites an unresolved cited work.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Unresolved cited work

Reference 20

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:20:58.362506Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-07T15:20:48.607374Z digest=sha256:13803f09c5b7547fef974f413bdbf52f3b86056df26bfd53163f5e63419cd870

Observation c6b0bec7-c83b-428a-816c-7ff9abb0963d · outbound

This paper cites an unresolved cited work.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Unresolved cited work

Reference 21

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:20:58.095782Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-07T15:20:48.732104Z digest=sha256:e7846498474eb2db46ca0e7dcc986c2395f2351309afcbffdbc5ba457923a3c0

Observation 495a5318-6ed5-4868-a1a2-4b6d94fdfa15 · outbound

This paper cites RoBERTa: A Robustly Optimized BERT Pretraining Approach.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics RoBERTa: A Robustly Optimized BERT Pretraining Approach

Reference 22

Resolution
unresolved
no resolver link, observed 2026-08-07T15:20:48.844391Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:20:48.844391Z digest=sha256:2c190bd73a6d84cbf848849a5e8b88b349d5cfb73d8cc3a7db5281e04776acf2

Observation 4bd50e4e-4b59-4879-be8a-3c9a9dd31f63 · outbound

This paper cites an unresolved cited work.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Unresolved cited work

Reference 23

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:20:57.917258Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-07T15:20:48.933750Z digest=sha256:6fdfdf9e1cd3a5acb293665a1189503159d32f2d3c412edf45d032f7e3cf1285

Observation 1b191ffd-d8bb-41eb-aa38-33f3c93e8044 · outbound

This paper cites StarCoder 2 and The Stack v2: The Next Generation.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics StarCoder 2 and The Stack v2: The Next Generation

Reference 24

Resolution
unresolved
no resolver link, observed 2026-08-07T15:20:49.072231Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:20:49.072231Z digest=sha256:07a04f73f088d8e773fea36e3d5a6f7fa6d4ba2bf494e348dcc27c80b8391403

Observation d5081326-f24b-4508-b8ba-2cdc1a0bdd3e · outbound

This paper cites an unresolved cited work.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Unresolved cited work

Reference 25

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:20:57.763683Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-07T15:20:49.185550Z digest=sha256:1eecc7fb508c71cdb210cbac5452400769d56a1ed860ff5b68724f075c786d45

Observation 5a06c56b-6916-4296-b4cf-d36e98f25901 · outbound

This paper cites an unresolved cited work.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Unresolved cited work

Reference 26

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:20:57.634688Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-07T15:20:49.278106Z digest=sha256:b38de898e267d9e451ffd6723dce1b24f9fcb16ffad322182aead282fdee2ec0

Observation 5a51117e-e432-4cb4-9da0-f5a0bebf6215 · outbound

This paper cites Efficient Estimation of Word Representations in Vector Space.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Efficient Estimation of Word Representations in Vector Space

Reference 27

Resolution
unresolved
no resolver link, observed 2026-08-07T15:20:49.381977Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:20:49.381977Z digest=sha256:2503fcef6f6d2396fec2774ceccf0f46bebe3b77f4094825977e0b2595646f3d

Observation a1091bbb-eec8-4547-b227-eb9583d20d4f · outbound

This paper cites Granite Code Models: A Family of Open Foundation Models for Code Intelligence.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Granite Code Models: A Family of Open Foundation Models for Code Intelligence

Reference 28

Resolution
unresolved
no resolver link, observed 2026-08-07T15:20:49.511222Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:20:49.511222Z digest=sha256:aff48ff13b8693aa68bcab36ca701445b6b75626e8a7b57e1ac4baaebebef074

Observation c299f4b6-7596-45da-938e-e3508cc33b8e · outbound

This paper cites an unresolved cited work.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Unresolved cited work

Reference 29

Resolution
unresolved
no resolver link, observed 2026-08-07T15:20:49.638318Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:20:49.638318Z digest=sha256:fb6e796b254938b92a31617f78beddf761425b161189424922b8fdb79921ce27

Observation 52f2af0d-47cf-4fc0-a1dc-831015004064 · outbound

This paper cites an unresolved cited work.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Unresolved cited work

Reference 30

Resolution
unresolved
no resolver link, observed 2026-08-07T15:20:49.723813Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:20:49.723813Z digest=sha256:135ff7532bbe3df7eb3fb06e921d87a2cd99f5f36e8acf78c2cfa7706742f2ec

Observation b06cadb3-9acc-409e-9e59-e4d75bca6197 · outbound

This paper cites an unresolved cited work.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Unresolved cited work

Reference 31

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:20:57.485773Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-07T15:20:49.834835Z digest=sha256:413a5d99f63e4ff555b05d07d8ed3fec2c9691d02529c781033261a63c9037f3

Observation 8d8b30bc-7ebf-4f3c-8223-8d31208afc92 · outbound

This paper cites an unresolved cited work.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Unresolved cited work

Reference 32

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:20:57.315450Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-07T15:20:49.951493Z digest=sha256:7461fcdf99e826d4bce27467e0134bc03a0b4afd33c6948876423cc0389d94fb

Observation d0cbc8a7-1c4c-4806-bc60-c1f7d4eac6ea · outbound

This paper cites an unresolved cited work.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Unresolved cited work

Reference 33

Resolution
verified exact
doi, observed 2026-08-07T15:20:53.113117Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-07T15:20:50.181924Z digest=sha256:ac62a8ea5e0ae8859f59fa164400403f2c83a8ce5c4dd516cbe7c9bacfe277db

Observation e361b070-12c5-4993-8774-8754cb7c6ad1 · outbound

This paper cites an unresolved cited work.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Unresolved cited work

Reference 34

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:20:57.029027Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-07T15:20:50.314446Z digest=sha256:d48790126940aee28ce1ee122c1c29e839e5f99bad3e4129b8288cc1ff765ff5

Observation 71987109-4f36-4e91-8ea8-133f6a7e7211 · outbound

This paper cites an unresolved cited work.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Unresolved cited work

Reference 35

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:20:56.873872Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-07T15:20:50.417629Z digest=sha256:c922a8797d6efcfd245a601b2f3efcbc67c218b4e51ef1b6b77b294393dcc04a

Observation 3460e378-3466-437a-ad49-ce632e2c5c0b · outbound

This paper cites an unresolved cited work.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Unresolved cited work

Reference 36

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:20:56.700849Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-07T15:20:50.489267Z digest=sha256:e5f0c826ea32665dbcede1d84f82b4c0a906ee8be22038e41e578c0d9d0b1971

Observation 49923556-ae3c-48d9-b93c-a25c101af8fa · outbound

This paper cites an unresolved cited work.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Unresolved cited work

Reference 37

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:20:56.553704Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-07T15:20:50.619929Z digest=sha256:c4936d7706af22e392a1cab5920ae44c7e661f1d81673af2df61ddefa59873e9

Observation 7a85e8bb-9ad7-4825-9cb2-4851b4ffd61f · outbound

This paper cites Code Llama: Open Foundation Models for Code.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Code Llama: Open Foundation Models for Code

Reference 38

Resolution
unresolved
no resolver link, observed 2026-08-07T15:20:50.753776Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:20:50.753776Z digest=sha256:91d3eea0768c70fa78e53ab817c827f40b4579da2bec507e5bef939177a5538c

Observation b122e0ed-2bfb-41c6-98bf-3cc5b198cbbc · outbound

This paper cites Sai, Tanay Dixit, Dev Yashpal Sheth, Sreyas Mohan, and Mitesh M.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Sai, Tanay Dixit, Dev Yashpal Sheth, Sreyas Mohan, and Mitesh M

Reference 39

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:20:56.417276Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-07T15:20:50.854897Z digest=sha256:89d32f772a650002d43713d7d4f95c342e4943475dab3da150c3a772f8e43454

Observation 682d8869-9e59-451f-a363-9d167b67a1a7 · outbound

This paper cites Reproducibility in Machine Learning-based Research: Overview, Barriers and Drivers.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Reproducibility in Machine Learning-based Research: Overview, Barriers and Drivers

Reference 40

Resolution
unresolved
no resolver link, observed 2026-08-07T15:20:50.934765Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:20:50.934765Z digest=sha256:b0c7de6bf564edcaa27460ad26cbad00b39a6bf2ffea0606c3631fcea9ac211d

Observation e5a943bb-e2cf-47ba-ae18-52e2c35389ef · outbound

This paper cites an unresolved cited work.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Unresolved cited work

Reference 41

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:20:56.251837Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-07T15:20:51.067575Z digest=sha256:aa07dc82ab25eb20106df470161d3d5a2f74570ea3eef0a00d5b63e704c20833

Observation 86767d71-985d-42b0-a165-a42c4925a1ea · outbound

This paper cites CodeGemma: Open Code Models Based on Gemma.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics CodeGemma: Open Code Models Based on Gemma

Reference 42

Resolution
unresolved
no resolver link, observed 2026-08-07T15:20:51.134531Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:20:51.134531Z digest=sha256:de4b054e7a0827ecb68eeff6c1398f3d97414085d2c9a5b2bddc7752bb855fa3

Observation a7e49ac4-5528-4234-a552-cde82b56cd28 · outbound

This paper cites Gemma: Open Models Based on Gemini Research and Technology.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Gemma: Open Models Based on Gemini Research and Technology

Reference 43

Resolution
unresolved
no resolver link, observed 2026-08-07T15:20:51.225398Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:20:51.225398Z digest=sha256:1298e288204fe690c185a0b0d4c7ffc609bb814747eb314c608d1ff524d62b53

Observation 220c80ca-0093-482a-87ca-a5f88019f130 · outbound

This paper cites an unresolved cited work.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Unresolved cited work

Reference 44

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:20:56.092417Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-07T15:20:51.346574Z digest=sha256:3f99a7792bf39af671479cdc50bc74a4789407bcd371d72379f94e51d107d6d8

Observation 88102446-ca89-401e-bb04-d8121dd65381 · outbound

This paper cites an unresolved cited work.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Unresolved cited work

Reference 45

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:20:55.905978Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-07T15:20:51.466805Z digest=sha256:9aedac0156285b51cd990bf8d084697d2e49d1b1a6c9fb81b54e60b09150c8a1

Observation fcc8625a-b1d8-4230-9005-d942b5d27d98 · outbound

This paper cites an unresolved cited work.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Unresolved cited work

Reference 46

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:20:55.726548Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-07T15:20:51.539046Z digest=sha256:4ad6cc1c27dc375adb4c18446b03994fa9343615d60876580e8ecaf341388fdf

Observation f36dbc48-0b8b-42d8-8f41-7707fb0c8929 · outbound

This paper cites an unresolved cited work.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Unresolved cited work

Reference 47

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:20:55.581700Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-07T15:20:51.619713Z digest=sha256:77efc1095e7fefe83d577cab41a1280425adddb525624aec96d472b03a4d99fa

Observation 778fee85-27aa-4582-8e3b-e06de84987da · outbound

This paper cites Llama 2: Open Foundation and Fine-Tuned Chat Models.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Llama 2: Open Foundation and Fine-Tuned Chat Models

Reference 48

Resolution
unresolved
no resolver link, observed 2026-08-07T15:20:51.693738Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:20:51.693738Z digest=sha256:da705e4df2ab482053ada283dd2f81457e36ee3a96a997955336328d32f6b716

Observation f001a3c9-9c4c-432c-817a-cacc404b2a4e · outbound

This paper cites an unresolved cited work.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Unresolved cited work

Reference 49

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:20:55.427351Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-07T15:20:51.774228Z digest=sha256:451dc6c19a02f4a0568fd1e4dfc7b42a1291e1191082cd50dde31cee49f8df82

Observation 9fd2cd3a-fcc4-4b18-bb10-1a537dea1d69 · outbound

This paper cites an unresolved cited work.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Unresolved cited work

Reference 50

Resolution
unresolved
no resolver link, observed 2026-08-07T15:20:51.870535Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:20:51.870535Z digest=sha256:78fd7186efc113198ac3e660e78b20b0629ad33b22a366b73cb5e7d5427d5bcc

Observation aadc31c8-38b3-4281-a715-a1587106bd73 · outbound

This paper cites an unresolved cited work.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Unresolved cited work

Reference 51

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:20:55.220074Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-07T15:20:51.952565Z digest=sha256:1390a6dffdd4a1769bbd207d95738c554781348ce40f23b7cbdb1d9ad0aef4de

Observation c7d109a9-5785-4573-a6e2-f90714ff9806 · outbound

This paper cites an unresolved cited work.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Unresolved cited work

Reference 52

Resolution
unresolved
no resolver link, observed 2026-08-07T15:20:52.037377Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:20:52.037377Z digest=sha256:693d26e9044cac367a4420fa7a689d88f04cf8dc405c6f3237f485a938c2848a

Observation 27656cc5-d700-4162-89f5-1909418e58bd · outbound

This paper cites an unresolved cited work.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Unresolved cited work

Reference 53

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:20:55.077647Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-07T15:20:52.158447Z digest=sha256:0894d9a641229724c748d45baff77e10cef7314bbfeb3944b5e35386c60a68c1

Observation b7bfdbd0-052f-422f-a0be-da9ed8ef6dd6 · outbound

This paper cites Witchel, Christopher I.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Witchel, Christopher I

Reference 54

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:20:54.917761Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-07T15:20:52.252558Z digest=sha256:27e3c55d95def0473ad54ef5a2d090985edc3d915ac06fda240d7a870375a8f4

Observation a4283ada-82b8-4446-8b75-cc0db0c10155 · outbound

This paper cites an unresolved cited work.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Unresolved cited work

Reference 55

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:20:54.617394Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-07T15:20:52.429199Z digest=sha256:d68628ecd0f11cd175b087a1c12fb88e3d3f899478e1d40f75132d9ad7fbc45f

Observation cf2d77e5-6c9f-441c-a379-aa8386fca7a9 · outbound

This paper cites an unresolved cited work.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Unresolved cited work

Reference 56

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:20:54.476112Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-07T15:20:52.538790Z digest=sha256:15a12892e0fc602a6d1cd1e15cc5ab784389fe9c6a29ae2c7a70a6b15589b20f

Observation 09c30082-122c-4dad-9f39-d6062c6aed2a · outbound

This paper cites Don't Trust ChatGPT when Your Question is not in English: A Study of Multilingual Abilities and Types of LLMs.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Don't Trust ChatGPT when Your Question is not in English: A Study of Multilingual Abilities and Types of LLMs

Reference 57

Resolution
unresolved
no resolver link, observed 2026-08-07T15:20:52.641310Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:20:52.641310Z digest=sha256:70ea97418d74440c18bbd1d659cc2010c5342d687184e4aef15fd2464845eb9d

Observation 9ba06270-9a7e-46b7-b613-181ce6ff5f7a · outbound

This paper cites Weinberger, and Yoav Artzi.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Weinberger, and Yoav Artzi

Reference 58

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:20:54.294855Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-07T15:20:52.701026Z digest=sha256:13f6e23b371f2b0fa177e7cc3fc76be607c36f8caeb8b5c25fc5ed86de5b20a7

Observation 091d7c87-99f6-471d-bad4-e14d1b625f3c · outbound

This paper cites an unresolved cited work.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Unresolved cited work

Reference 59

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:20:54.150485Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-07T15:20:52.798547Z digest=sha256:6211c1b3bbce21292f0ec5a0b1c6fda5e45d85903515659c18b2c05d9ba536fd

Observation 89e40cbe-707c-4e72-b339-0d0b12a6cfcc · outbound

This paper cites Productivity Assessment of Neural Code Completion.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Productivity Assessment of Neural Code Completion

Reference 60

Resolution
unresolved
no resolver link, observed 2026-08-07T15:20:52.902763Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:20:52.902763Z digest=sha256:f24041c83ab29d35196c700044a3c516233e9c6760a40e40fbfe688ae7e29847

Observation 73557d92-368c-48b3-b5eb-6b3f39f92ca1 · outbound

This paper cites Frontiers in Psychology, 13, 873844.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Frontiers in Psychology, 13, 873844

Reference 2022

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:20:54.757288Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-07T15:20:52.325156Z digest=sha256:1f099bade4edb792decae9a6cbfcec6e938cf945d262186f66226d673050be77

Observation 147107d5-bb97-445e-96df-467741c195db · outbound

This paper cites an unresolved cited work.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Unresolved cited work

Reference 2024

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:20:57.174233Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-07T15:20:50.062042Z digest=sha256:141be37243e651da3d7853a773d5896aa0070b149aae1770b7003463efb454d1

Observation 8453bbfc-0511-4425-99a2-cf16a3f2442d · outbound

This paper cites an unresolved cited work.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Unresolved cited work

Reference 2025

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:21:00.456326Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-07T15:20:46.577952Z digest=sha256:08e43a9f0085cb488c92f086fedbceb7ae94f1850a649a658cd19735aca2c021

Pith citing papers

Observation facb7a0e-03b0-4913-adc7-da28166ae9f9 · inbound

AdaDec: A Uncertainty-Guided Lookahead Decoding Framework for LLM-Based Code Generation cites this paper.

AdaDec: A Uncertainty-Guided Lookahead Decoding Framework for LLM-Based Code Generation A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics

Reference 35

Resolution
verified exact
arxiv_id, observed 2026-05-19T10:22:14.541296Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-05-19T10:19:07.701197Z digest=sha256:b1f4815f94215fa94b000ca39d1c5fb170ab662e2a66ad68e329bfa910b162b0