PROBE: Benchmarking Code Generation in Large Language Models | Paper Citation Record

Observation a410a632-1763-4eae-b526-daed9a6618b6 · outbound

This paper cites an unresolved cited work.

PROBE: Benchmarking Code Generation in Large Language Models Unresolved cited work

Reference 1

Resolution: unresolved; no resolver link, observed 2026-08-02T03:40:59.041633Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 46f6024f-dc71-42bb-9e7d-8536f2e661b7 · outbound

This paper cites , title =.

PROBE: Benchmarking Code Generation in Large Language Models , title =

Reference 2

Resolution: unresolved; no resolver link, observed 2026-08-02T03:40:59.077840Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 5555c998-53eb-458d-a936-7eccee424179 · outbound

This paper cites , title =.

PROBE: Benchmarking Code Generation in Large Language Models , title =

Reference 3

Resolution: unresolved; no resolver link, observed 2026-08-02T03:40:59.127050Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 04b2ea7e-5742-4ea3-8061-20c2378e1832 · outbound

This paper cites an unresolved cited work.

PROBE: Benchmarking Code Generation in Large Language Models Unresolved cited work

Reference 4

Resolution: unresolved; no resolver link, observed 2026-08-02T03:40:59.187776Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation ca44938c-c300-45e0-baed-3f7865d2123a · outbound

This paper cites 2021 , eprint=.

PROBE: Benchmarking Code Generation in Large Language Models 2021 , eprint=

Reference 5

Resolution: unresolved; no resolver link, observed 2026-08-02T03:40:59.240390Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation db678837-a4c4-4847-947b-1c4be834457f · outbound

This paper cites Alice and Rice, Andrew and Rifkin, Devon and Simister, Shawn and Sittampalam, Ganesh and Aftandilian, Edward , title =.

PROBE: Benchmarking Code Generation in Large Language Models Alice and Rice, Andrew and Rifkin, Devon and Simister, Shawn and Sittampalam, Ganesh and Aftandilian, Edward , title =

Reference 6

Resolution: unresolved; no resolver link, observed 2026-08-02T03:40:59.328176Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation b8194cc0-d9d1-4ecd-8966-eb885e5e2480 · outbound

This paper cites 2024 , eprint=.

PROBE: Benchmarking Code Generation in Large Language Models 2024 , eprint=

Reference 7

Resolution: unresolved; no resolver link, observed 2026-08-02T03:40:59.428297Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 481876de-ea26-4800-8cc8-012518bb2298 · outbound

This paper cites Qwen2.5 Technical Report.

PROBE: Benchmarking Code Generation in Large Language Models Qwen2.5 Technical Report

Reference 8

Resolution: unresolved; no resolver link, observed 2026-08-02T03:40:59.516100Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 56a8bc06-989c-4ddc-b604-4033f04747ee · outbound

This paper cites 2024 , publisher=.

PROBE: Benchmarking Code Generation in Large Language Models 2024 , publisher=

Reference 9

Resolution: unresolved; no resolver link, observed 2026-08-02T03:40:59.591302Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation bc7dcfd6-2643-4eed-b818-f124e6e1eb63 · outbound

This paper cites Language Models are Few-Shot Learners , url =.

PROBE: Benchmarking Code Generation in Large Language Models Language Models are Few-Shot Learners , url =

Reference 10

Resolution: unresolved; no resolver link, observed 2026-08-02T03:40:59.681179Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation b1d2a032-cfc3-4f04-a76a-bc1b15b2d774 · outbound

This paper cites 2021 , eprint=.

PROBE: Benchmarking Code Generation in Large Language Models 2021 , eprint=

Reference 11

Resolution: unresolved; no resolver link, observed 2026-08-02T03:40:59.764700Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 34e701d1-0d7c-482a-a9e8-58ae65754832 · outbound

This paper cites 2021 , eprint=.

PROBE: Benchmarking Code Generation in Large Language Models 2021 , eprint=

Reference 12

Resolution: unresolved; no resolver link, observed 2026-08-02T03:40:59.836997Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 737ed91b-eb48-4f57-820f-35a99cf0d527 · outbound

This paper cites 2023 , eprint=.

PROBE: Benchmarking Code Generation in Large Language Models 2023 , eprint=

Reference 13

Resolution: unresolved; no resolver link, observed 2026-08-02T03:40:59.912370Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation c286d5d3-bd91-4dcf-ba30-de49db1c824d · outbound

This paper cites 2021 , eprint=.

PROBE: Benchmarking Code Generation in Large Language Models 2021 , eprint=

Reference 14

Resolution: unresolved; no resolver link, observed 2026-08-02T03:40:59.994552Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation ab136e6a-125f-46b0-86a6-c37ca5c5311f · outbound

This paper cites Attention is All you Need , url =.

PROBE: Benchmarking Code Generation in Large Language Models Attention is All you Need , url =

Reference 15

Resolution: unresolved; no resolver link, observed 2026-08-02T03:41:00.032812Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 0f4253f5-7891-434b-b9fe-eea90dcd8fdc · outbound

This paper cites Long Short-Term Memory.

PROBE: Benchmarking Code Generation in Large Language Models Long Short-Term Memory

Reference 16

Resolution: verified exact; doi, observed 2026-08-02T03:43:22.735297Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation e8829be0-b76f-406a-811d-5261067a277c · outbound

This paper cites an unresolved cited work.

PROBE: Benchmarking Code Generation in Large Language Models Unresolved cited work

Reference 17

Resolution: unresolved; no resolver link, observed 2026-08-02T03:41:00.142904Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 5f7b12dd-6f89-4f12-9f6d-4a0a5ac213ac · outbound

This paper cites 2024 , eprint=.

PROBE: Benchmarking Code Generation in Large Language Models 2024 , eprint=

Reference 18

Resolution: unresolved; no resolver link, observed 2026-08-02T03:41:00.197477Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 4b13adc5-9e79-44a0-a88e-5032b32c363e · outbound

This paper cites 2002 , publisher =.

PROBE: Benchmarking Code Generation in Large Language Models 2002 , publisher =

Reference 19

Resolution: unresolved; no resolver link, observed 2026-08-02T03:41:00.254344Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation cef076cf-bbeb-417f-a1df-92be8bb7f835 · outbound

This paper cites Text summarization branches out , pages=.

PROBE: Benchmarking Code Generation in Large Language Models Text summarization branches out , pages=

Reference 20

Resolution: unresolved; no resolver link, observed 2026-08-02T03:41:00.340873Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 2543796d-21fe-43a7-bb3e-8c34101e8b3c · outbound

This paper cites Proceedings of the acl workshop on intrinsic and extrinsic evaluation measures for machine translation and/or summarization , pages=.

PROBE: Benchmarking Code Generation in Large Language Models Proceedings of the acl workshop on intrinsic and extrinsic evaluation measures for machine translation and/or summarization , pages=

Reference 21

Resolution: unresolved; no resolver link, observed 2026-08-02T03:41:00.403280Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 527405ba-9a91-436e-846c-d94289d7ef8d · outbound

This paper cites 2020 , eprint=.

PROBE: Benchmarking Code Generation in Large Language Models 2020 , eprint=

Reference 22

Resolution: unresolved; no resolver link, observed 2026-08-02T03:41:00.462363Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 2bc85aca-64f6-414d-86b1-2419ec2fc1d0 · outbound

This paper cites 1992 , publisher=.

PROBE: Benchmarking Code Generation in Large Language Models 1992 , publisher=

Reference 23

Resolution: unresolved; no resolver link, observed 2026-08-02T03:41:00.535796Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 11f245cf-2c48-476d-a9ad-d23f72615d46 · outbound

This paper cites Synthesize, Execute and Debug: Learning to Repair for Neural Program Synthesis , url =.

PROBE: Benchmarking Code Generation in Large Language Models Synthesize, Execute and Debug: Learning to Repair for Neural Program Synthesis , url =

Reference 24

Resolution: unresolved; no resolver link, observed 2026-08-02T03:41:00.598390Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 9ba4e8c5-9750-471e-b948-7261049bf8cc · outbound

This paper cites 2024 , eprint=.

PROBE: Benchmarking Code Generation in Large Language Models 2024 , eprint=

Reference 25

Resolution: unresolved; no resolver link, observed 2026-08-02T03:41:00.682028Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation df89dfc2-c769-4ba0-9626-0a7a2e75aaa0 · outbound

This paper cites 2023 , eprint=.

PROBE: Benchmarking Code Generation in Large Language Models 2023 , eprint=

Reference 26

Resolution: unresolved; no resolver link, observed 2026-08-02T03:41:00.751011Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 957690fe-b84f-4000-ad60-393ca88e9371 · outbound

This paper cites 2024 , eprint=.

PROBE: Benchmarking Code Generation in Large Language Models 2024 , eprint=

Reference 27

Resolution: unresolved; no resolver link, observed 2026-08-02T03:41:00.833125Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation bb6c933d-b19c-42cb-bdfa-d60bca05576b · outbound

This paper cites 2017 , volume =.

PROBE: Benchmarking Code Generation in Large Language Models 2017 , volume =

Reference 28

Resolution: unresolved; no resolver link, observed 2026-08-02T03:41:00.896613Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 7a3fc547-5788-410d-a981-6dfcc876fe09 · outbound

This paper cites Predicting a Correct Program in Programming by Example.

PROBE: Benchmarking Code Generation in Large Language Models Predicting a Correct Program in Programming by Example

Reference 29

Resolution: unresolved; no resolver link, observed 2026-08-02T03:41:00.949870Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation d0cfd897-0205-4523-8c02-61ed823bd4c1 · outbound

This paper cites SPoC: Search-based Pseudocode to Code , url =.

PROBE: Benchmarking Code Generation in Large Language Models SPoC: Search-based Pseudocode to Code , url =

Reference 30

Resolution: unresolved; no resolver link, observed 2026-08-02T03:41:01.006976Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 4f7c1253-f23b-4c76-8a62-dad4aa3e61ae · outbound

This paper cites Neural Attribution for Semantic Bug-Localization in Student Programs , url =.

PROBE: Benchmarking Code Generation in Large Language Models Neural Attribution for Semantic Bug-Localization in Student Programs , url =

Reference 31

Resolution: unresolved; no resolver link, observed 2026-08-02T03:41:01.101322Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation e7f33a20-97cd-4cd7-b250-1b049ce514a2 · outbound

This paper cites 2021 , eprint=.

PROBE: Benchmarking Code Generation in Large Language Models 2021 , eprint=

Reference 32

Resolution: unresolved; no resolver link, observed 2026-08-02T03:41:01.162778Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation b57e87ba-a056-40b5-86b1-beeba0e1b69b · outbound

This paper cites Liu , title =.

PROBE: Benchmarking Code Generation in Large Language Models Liu , title =

Reference 33

Resolution: unresolved; no resolver link, observed 2026-08-02T03:41:01.232166Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 040faf8b-a86b-492f-9022-c124e6de4d4f · outbound

This paper cites Distributed Representations of Words and Phrases and their Compositionality , url =.

PROBE: Benchmarking Code Generation in Large Language Models Distributed Representations of Words and Phrases and their Compositionality , url =

Reference 34

Resolution: unresolved; no resolver link, observed 2026-08-02T03:41:01.286929Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation b2ec3db1-d854-47de-9cd7-6919cdd8b47d · outbound

This paper cites Proceedings of the 2014 conference on empirical methods in natural language processing (EMNLP) , pages=.

PROBE: Benchmarking Code Generation in Large Language Models Proceedings of the 2014 conference on empirical methods in natural language processing (EMNLP) , pages=

Reference 35

Resolution: unresolved; no resolver link, observed 2026-08-02T03:41:01.377487Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 493145d8-bd80-4e8e-8ae1-32cbcfaf7242 · outbound

This paper cites and Fei-Fei, Li , title =.

PROBE: Benchmarking Code Generation in Large Language Models and Fei-Fei, Li , title =

Reference 36

Resolution: unresolved; no resolver link, observed 2026-08-02T03:41:01.424056Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 31fc5312-2cc7-4b43-9667-843c3dc6e76f · outbound

This paper cites 2024 , eprint=.

PROBE: Benchmarking Code Generation in Large Language Models 2024 , eprint=

Reference 37

Resolution: unresolved; no resolver link, observed 2026-08-02T03:41:01.474006Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation daf10398-a8ed-44b7-a6de-9a31f26315b4 · outbound

This paper cites 2019 , eprint=.

PROBE: Benchmarking Code Generation in Large Language Models 2019 , eprint=

Reference 38

Resolution: unresolved; no resolver link, observed 2026-08-02T03:41:01.522051Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 563c8154-874e-47b5-ad18-dd3fec4f8107 · outbound

This paper cites 2021 , eprint=.

PROBE: Benchmarking Code Generation in Large Language Models 2021 , eprint=

Reference 39

Resolution: unresolved; no resolver link, observed 2026-08-02T03:41:01.585939Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 2468b25b-588c-4326-a3b9-8032da3bf6f4 · outbound

This paper cites OpenAI blog , volume=.

PROBE: Benchmarking Code Generation in Large Language Models OpenAI blog , volume=

Reference 40

Resolution: unresolved; no resolver link, observed 2026-08-02T03:41:01.639757Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 652c8d91-ed11-4f33-85fa-d18e4c36dfdf · outbound

This paper cites 2023 , eprint=.

PROBE: Benchmarking Code Generation in Large Language Models 2023 , eprint=

Reference 41

Resolution: unresolved; no resolver link, observed 2026-08-02T03:41:01.675781Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 932c8d21-35d5-41ac-bac5-cb0944d16ccc · outbound

This paper cites 2021 , eprint=.

PROBE: Benchmarking Code Generation in Large Language Models 2021 , eprint=

Reference 42

Resolution: unresolved; no resolver link, observed 2026-08-02T03:41:01.718188Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation a2f7f0e5-ae73-4fd4-b1a3-90c92128c65f · outbound

This paper cites Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing , pages=.

PROBE: Benchmarking Code Generation in Large Language Models Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing , pages=

Reference 43

Resolution: unresolved; no resolver link, observed 2026-08-02T03:41:01.769383Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation e6940600-7ed7-43d8-bca9-0c5d656ae65d · outbound

This paper cites 2021 , eprint=.

PROBE: Benchmarking Code Generation in Large Language Models 2021 , eprint=

Reference 44

Resolution: unresolved; no resolver link, observed 2026-08-02T03:41:01.803262Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation dc5f6d40-fcae-4e47-b8ef-bf8447568779 · outbound

This paper cites 2022 , eprint=.

PROBE: Benchmarking Code Generation in Large Language Models 2022 , eprint=

Reference 45

Resolution: unresolved; no resolver link, observed 2026-08-02T03:41:01.871602Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 50612aee-d8d4-49cf-a4f6-b19898bee443 · outbound

This paper cites , title =.

PROBE: Benchmarking Code Generation in Large Language Models , title =

Reference 46

Resolution: unresolved; no resolver link, observed 2026-08-02T03:41:01.924993Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 96776520-2829-4aac-8e21-a59e9828117e · outbound

This paper cites 2023 , eprint=.

PROBE: Benchmarking Code Generation in Large Language Models 2023 , eprint=

Reference 47

Resolution: unresolved; no resolver link, observed 2026-08-02T03:41:01.977621Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation fcfae5a5-ebf1-4e7b-ad33-06f6bb59bbfc · outbound

This paper cites 2023 , eprint=.

PROBE: Benchmarking Code Generation in Large Language Models 2023 , eprint=

Reference 48

Resolution: unresolved; no resolver link, observed 2026-08-02T03:41:02.029969Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation d0708426-74c3-442a-bb29-d852c03f1b56 · outbound

This paper cites Right for the Wrong Reasons: Diagnosing Syntactic Heuristics in Natural Language Inference.

PROBE: Benchmarking Code Generation in Large Language Models Right for the Wrong Reasons: Diagnosing Syntactic Heuristics in Natural Language Inference

Reference 49

Resolution: unresolved; no resolver link, observed 2026-08-02T03:41:02.119264Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation c50e8c9f-9f79-4861-8750-e87aca657167 · outbound

This paper cites 2019 , eprint=.

PROBE: Benchmarking Code Generation in Large Language Models 2019 , eprint=

Reference 50

Resolution: unresolved; no resolver link, observed 2026-08-02T03:41:02.196404Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 00153917-8540-4ace-ad5b-d0ab58743f6b · outbound

This paper cites 2022 , eprint=.

PROBE: Benchmarking Code Generation in Large Language Models 2022 , eprint=

Reference 51

Resolution: unresolved; no resolver link, observed 2026-08-02T03:41:02.276767Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 8cdbf6bf-c228-48bb-9068-74f0e2fb4e12 · outbound

This paper cites 2023 , eprint=.

PROBE: Benchmarking Code Generation in Large Language Models 2023 , eprint=

Reference 52

Resolution: unresolved; no resolver link, observed 2026-08-02T03:41:02.328305Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 77bc4aa6-e016-447c-9548-7885e188a949 · outbound

This paper cites 2020 , eprint=.

PROBE: Benchmarking Code Generation in Large Language Models 2020 , eprint=

Reference 53

Resolution: unresolved; no resolver link, observed 2026-08-02T03:41:02.435612Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation f4eab490-835d-4dcf-a8ae-814740c7fdc1 · outbound

This paper cites 2023 , eprint=.

PROBE: Benchmarking Code Generation in Large Language Models 2023 , eprint=

Reference 54

Resolution: unresolved; no resolver link, observed 2026-08-02T03:41:02.486791Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 1421c880-32d1-474a-ac36-7f6084a89b1d · outbound

This paper cites 2024 , eprint=.

PROBE: Benchmarking Code Generation in Large Language Models 2024 , eprint=

Reference 55

Resolution: unresolved; no resolver link, observed 2026-08-02T03:41:02.489711Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 49c2f4be-60da-4c7b-87cd-8254a55b813b · outbound

This paper cites Training language models to follow instructions with human feedback , url =.

PROBE: Benchmarking Code Generation in Large Language Models Training language models to follow instructions with human feedback , url =

Reference 56

Resolution: unresolved; no resolver link, observed 2026-08-02T03:41:02.555293Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation bd143f87-cee7-4d53-b105-b3510a51e39d · outbound

This paper cites 2024 , eprint=.

PROBE: Benchmarking Code Generation in Large Language Models 2024 , eprint=

Reference 57

Resolution: unresolved; no resolver link, observed 2026-08-02T03:41:02.693353Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 0cdc6d04-4602-4cbe-9183-6aa0d4f67aba · outbound

This paper cites 2023 , eprint=.

PROBE: Benchmarking Code Generation in Large Language Models 2023 , eprint=

Reference 58

Resolution: unresolved; no resolver link, observed 2026-08-02T03:41:02.855468Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation fc2a8aa5-5343-4316-9cc9-3159358ed8aa · outbound

This paper cites HaluEval: A Large-Scale Hallucination Evaluation Benchmark for Large Language Models.

PROBE: Benchmarking Code Generation in Large Language Models HaluEval: A Large-Scale Hallucination Evaluation Benchmark for Large Language Models

Reference 59

Resolution: unresolved; no resolver link, observed 2026-08-02T03:41:02.990486Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 0cedbebf-9d83-4555-9b52-d2d936a808d5 · outbound

This paper cites Advances in neural information processing systems , volume=.

PROBE: Benchmarking Code Generation in Large Language Models Advances in neural information processing systems , volume=

Reference 60

Resolution: unresolved; no resolver link, observed 2026-08-02T03:41:03.113431Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation e145c4ee-625c-401d-8199-49cc5785808a · outbound

This paper cites Proceedings 2003 VLDB Conference , pages=.

PROBE: Benchmarking Code Generation in Large Language Models Proceedings 2003 VLDB Conference , pages=

Reference 61

Resolution: unresolved; no resolver link, observed 2026-08-02T03:41:03.187782Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation f10755b6-7956-4da4-9cfb-391268150286 · outbound

This paper cites 2021 , publisher =.

PROBE: Benchmarking Code Generation in Large Language Models 2021 , publisher =

Reference 62

Resolution: unresolved; no resolver link, observed 2026-08-02T03:41:03.310408Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation df0dfbb5-133d-40d1-8560-6176b9010b83 · outbound

This paper cites an unresolved cited work.

PROBE: Benchmarking Code Generation in Large Language Models Unresolved cited work

Reference 63

Resolution: unresolved; no resolver link, observed 2026-08-02T03:41:03.430829Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 7a7ba2e0-ce04-4245-875e-29e24b32a7e0 · outbound

This paper cites Mapping Language to Code in Programmatic Context.

PROBE: Benchmarking Code Generation in Large Language Models Mapping Language to Code in Programmatic Context

Reference 64

Resolution: unresolved; no resolver link, observed 2026-08-02T03:41:03.553027Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation e9b2af0c-f4eb-4659-8862-7a2d63f61952 · outbound

This paper cites 2024 , eprint=.

PROBE: Benchmarking Code Generation in Large Language Models 2024 , eprint=

Reference 65

Resolution: unresolved; no resolver link, observed 2026-08-02T03:41:03.670850Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 1d9daa2e-6d8a-459d-b00e-f3f679847326 · outbound

This paper cites 2022 , eprint=.

PROBE: Benchmarking Code Generation in Large Language Models 2022 , eprint=

Reference 66

Resolution: unresolved; no resolver link, observed 2026-08-02T03:41:03.792906Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 485e5059-decb-40fe-9846-dd5874deaa3b · outbound

This paper cites 2022 , eprint=.

PROBE: Benchmarking Code Generation in Large Language Models 2022 , eprint=

Reference 67

Resolution: unresolved; no resolver link, observed 2026-08-02T03:41:03.873151Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation c0bba666-ab21-4e44-866a-0539991f3d35 · outbound

This paper cites 2024 , eprint=.

PROBE: Benchmarking Code Generation in Large Language Models 2024 , eprint=

Reference 68

Resolution: unresolved; no resolver link, observed 2026-08-02T03:41:03.997658Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation a5989be4-e0d2-47cf-8527-6545042c4728 · outbound

This paper cites 2024 , eprint=.

PROBE: Benchmarking Code Generation in Large Language Models 2024 , eprint=

Reference 69

Resolution: unresolved; no resolver link, observed 2026-08-02T03:41:04.116893Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 0ef7664c-32b3-40ae-9415-9e80a88179af · outbound

This paper cites International conference on machine learning , pages=.

PROBE: Benchmarking Code Generation in Large Language Models International conference on machine learning , pages=

Reference 70

Resolution: unresolved; no resolver link, observed 2026-08-02T03:41:04.236798Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 4370a0a0-4ad2-4be9-b247-33a7b29c51c6 · outbound

This paper cites Distilling Knowledge from Reader to Retriever for Question Answering.

PROBE: Benchmarking Code Generation in Large Language Models Distilling Knowledge from Reader to Retriever for Question Answering

Reference 71

Resolution: unresolved; no resolver link, observed 2026-08-02T03:41:04.355532Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 46c049ac-8041-4a70-b333-fc67f9a7f2de · outbound

This paper cites Let's Verify Step by Step.

PROBE: Benchmarking Code Generation in Large Language Models Let's Verify Step by Step

Reference 72

Resolution: unresolved; no resolver link, observed 2026-08-02T03:41:04.479139Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 39316138-77e0-4488-9ed2-8989be2131aa · outbound

This paper cites Generating Natural Language Proofs with Verifier-Guided Search.

PROBE: Benchmarking Code Generation in Large Language Models Generating Natural Language Proofs with Verifier-Guided Search

Reference 73

Resolution: unresolved; no resolver link, observed 2026-08-02T03:41:04.562180Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation b91aafdb-bc61-4327-91df-217fb0944e1d · outbound

This paper cites StarCoder: may the source be with you!.

PROBE: Benchmarking Code Generation in Large Language Models StarCoder: may the source be with you!

Reference 74

Resolution: unresolved; no resolver link, observed 2026-08-02T03:41:04.657260Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation fba60d61-8335-44a9-becd-1728c132b945 · outbound

This paper cites Annotation Artifacts in Natural Language Inference Data.

PROBE: Benchmarking Code Generation in Large Language Models Annotation Artifacts in Natural Language Inference Data

Reference 75

Resolution: unresolved; no resolver link, observed 2026-08-02T03:41:04.739473Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 7e65b358-3a1f-4f0f-b8ae-b5d39fada2a7 · outbound

This paper cites Non-Determinism of "Deterministic" LLM Settings.

PROBE: Benchmarking Code Generation in Large Language Models Non-Determinism of "Deterministic" LLM Settings

Reference 76

Resolution: unresolved; no resolver link, observed 2026-08-02T03:41:04.881119Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation c1899611-320c-41f7-9c33-ebae04e3f7ce · outbound

This paper cites Large Language Models are Zero-Shot Reasoners , url =.

PROBE: Benchmarking Code Generation in Large Language Models Large Language Models are Zero-Shot Reasoners , url =

Reference 77

Resolution: unresolved; no resolver link, observed 2026-08-02T03:41:05.042606Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation dbd2cbc5-ae6f-4ab3-8bab-0d48cb393f64 · outbound

This paper cites Density-Based Clustering in Spatial Databases: The Algorithm GDBSCAN and Its Applications , journal =.

PROBE: Benchmarking Code Generation in Large Language Models Density-Based Clustering in Spatial Databases: The Algorithm GDBSCAN and Its Applications , journal =

Reference 78

Resolution: unresolved; no resolver link, observed 2026-08-02T03:41:05.143110Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 747fa17c-127d-4c4e-a779-9cd649416b2a · outbound

This paper cites A Survey on Mixture of Experts in Large Language Models.

PROBE: Benchmarking Code Generation in Large Language Models A Survey on Mixture of Experts in Large Language Models

Reference 79

Resolution: unresolved; no resolver link, observed 2026-08-02T03:41:05.245748Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation e168f7ef-749e-474a-b1b4-521536b62bc4 · outbound

This paper cites Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layer.

PROBE: Benchmarking Code Generation in Large Language Models Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layer

Reference 80

Resolution: unresolved; no resolver link, observed 2026-08-02T03:41:05.393633Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 4a630a48-8142-4033-9285-d8cd0de50098 · outbound

This paper cites Journal of Machine Learning Research , volume=.

PROBE: Benchmarking Code Generation in Large Language Models Journal of Machine Learning Research , volume=

Reference 81

Resolution: unresolved; no resolver link, observed 2026-08-02T03:41:05.619368Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 42a60d18-10d9-41e5-b4f0-24799f274b3b · outbound

This paper cites DeepSeek-V3 Technical Report.

PROBE: Benchmarking Code Generation in Large Language Models DeepSeek-V3 Technical Report

Reference 82

Resolution: unresolved; no resolver link, observed 2026-08-02T03:41:05.769361Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 769737aa-f3e4-413d-9705-1ceb5af6b6c1 · outbound

This paper cites DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning.

PROBE: Benchmarking Code Generation in Large Language Models DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning

Reference 83

Resolution: unresolved; no resolver link, observed 2026-08-02T03:41:05.979493Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 2358ba9e-178d-4abc-a77b-bc30fbaf5b3d · outbound

This paper cites Journal of medical Internet research , volume=.

PROBE: Benchmarking Code Generation in Large Language Models Journal of medical Internet research , volume=

Reference 84

Resolution: unresolved; no resolver link, observed 2026-08-02T03:41:06.143522Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation b71dbb2c-c9f4-4dac-a76b-c9a7de4fbbf6 · outbound

This paper cites AutoPrompt: Eliciting Knowledge from Language Models with Automatically Generated Prompts.

PROBE: Benchmarking Code Generation in Large Language Models AutoPrompt: Eliciting Knowledge from Language Models with Automatically Generated Prompts

Reference 85

Resolution: unresolved; no resolver link, observed 2026-08-02T03:41:06.319054Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 1ac0563e-4fa9-4ef9-be9e-8daf2fca9e16 · outbound

This paper cites The Prompt Report: A Systematic Survey of Prompt Engineering Techniques.

PROBE: Benchmarking Code Generation in Large Language Models The Prompt Report: A Systematic Survey of Prompt Engineering Techniques

Reference 86

Resolution: unresolved; no resolver link, observed 2026-08-02T03:41:06.532907Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation fcaac1ac-3bfd-4fa4-bdd8-21277b31af47 · outbound

This paper cites DeepSeek-Coder-V2: Breaking the Barrier of Closed-Source Models in Code Intelligence.

PROBE: Benchmarking Code Generation in Large Language Models DeepSeek-Coder-V2: Breaking the Barrier of Closed-Source Models in Code Intelligence

Reference 87

Resolution: unresolved; no resolver link, observed 2026-08-02T03:41:06.722239Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 6358adc9-4ed3-470e-bc4b-ae51a0f6c75f · outbound

This paper cites 2022 , eprint=.

PROBE: Benchmarking Code Generation in Large Language Models 2022 , eprint=

Reference 88

Resolution: unresolved; no resolver link, observed 2026-08-02T03:41:06.967903Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 1560eeaa-801d-4787-91b3-738f50d41df5 · outbound

This paper cites 2022 , howpublished =.

PROBE: Benchmarking Code Generation in Large Language Models 2022 , howpublished =

Reference 89

Resolution: unresolved; no resolver link, observed 2026-08-02T03:41:07.110645Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 5ad28b35-bab2-47d3-a96e-b9758d94c614 · outbound

This paper cites 2021 , howpublished =.

PROBE: Benchmarking Code Generation in Large Language Models 2021 , howpublished =

Reference 90

Resolution: unresolved; no resolver link, observed 2026-08-02T03:41:07.278414Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation e37ec71f-ade4-46eb-8efc-d89a0023d08f · outbound

This paper cites Empirical Software Engineering , volume=.

PROBE: Benchmarking Code Generation in Large Language Models Empirical Software Engineering , volume=

Reference 91

Resolution: unresolved; no resolver link, observed 2026-08-02T03:41:07.452672Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 69407b16-ed76-4352-98df-340f2499e617 · outbound

This paper cites Proceedings of the 48th International ACM SIGIR Conference on Research and Development in Information Retrieval , pages =.

PROBE: Benchmarking Code Generation in Large Language Models Proceedings of the 48th International ACM SIGIR Conference on Research and Development in Information Retrieval , pages =

Reference 92

Resolution: unresolved; no resolver link, observed 2026-08-02T03:41:07.666893Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation d60e3f7d-e07a-4d3b-837e-f5e9fa85aa1e · outbound

This paper cites 2025 , eprint=.

PROBE: Benchmarking Code Generation in Large Language Models 2025 , eprint=

Reference 93

Resolution: unresolved; no resolver link, observed 2026-08-02T03:41:07.920990Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation a0eee248-7769-4830-b340-f57da7e2c468 · outbound

This paper cites ToolQA: A Dataset for LLM Question Answering with External Tools , url =.

PROBE: Benchmarking Code Generation in Large Language Models ToolQA: A Dataset for LLM Question Answering with External Tools , url =

Reference 94

Resolution: unresolved; no resolver link, observed 2026-08-02T03:41:08.032344Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 8ee1e01c-d416-474a-8eed-95e9839d8040 · outbound

This paper cites 2024 , eprint=.

PROBE: Benchmarking Code Generation in Large Language Models 2024 , eprint=

Reference 95

Resolution: unresolved; no resolver link, observed 2026-08-02T03:41:08.194423Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation f36c1a84-4bb8-40e1-b9bd-89e80020aeab · outbound

This paper cites 2024 , publisher=.

PROBE: Benchmarking Code Generation in Large Language Models 2024 , publisher=

Reference 96

Resolution: unresolved; no resolver link, observed 2026-08-02T03:41:08.365693Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 51cd0afb-c0df-48d3-8770-e7dc51a85d4a · outbound

This paper cites Journal of Systems and Software , volume=.

PROBE: Benchmarking Code Generation in Large Language Models Journal of Systems and Software , volume=

Reference 97

Resolution: unresolved; no resolver link, observed 2026-08-02T03:41:08.536430Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Coverage vector

Reference resolution

Outbound references

Pith citing papers