Paper Citation Record · LEDGER

COFFE: A Code Efficiency Benchmark for Code Generation

As of 19 August 2026, this Paper Citation Record lists 100 of 101 outbound references and 5 inbound Pith citation observations for arXiv:2502.02827.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2502.02827 v1

Coverage vector

measured 100 of 101 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-09T11:01:28.173937Z

measured 105 of 105 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-19T06:32:44.657259+00:00

measured 5 of 5 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-07T12:39:57.465250Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-05-19T12:22:17.217268Z

Reference resolution

100 of 101 outbound references displayed

verified exact0
verified fuzzy8
unresolved90
parse uncertain0
malformed identifier2
metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 2861173f-471c-47f3-8f0c-ae494a372200 · outbound

This paper cites Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone.

COFFE: A Code Efficiency Benchmark for Code Generation Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone

Reference 1

Resolution: unresolved; no resolver link, observed 2026-08-09T11:01:27.546055Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 62b8ba0d-a905-45b9-a522-05812ecd27b5 · outbound

This paper cites SantaCoder: don't reach for the stars!.

COFFE: A Code Efficiency Benchmark for Code Generation SantaCoder: don't reach for the stars!

Reference 2

Resolution: unresolved; no resolver link, observed 2026-08-09T11:01:27.555183Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 2e14cc25-07a2-4d5f-b4be-c4c87ad867c3 · outbound

This paper cites an unresolved cited work.

COFFE: A Code Efficiency Benchmark for Code Generation Unresolved cited work

Reference 3

Resolution: unresolved; no resolver link, observed 2026-08-09T11:01:27.561285Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 576a0a70-1cfa-4d4e-b99d-631ff457c814 · outbound

This paper cites an unresolved cited work.

COFFE: A Code Efficiency Benchmark for Code Generation Unresolved cited work

Reference 4

Resolution: unresolved; no resolver link, observed 2026-08-09T11:01:27.565960Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 02589864-ef5a-4f9b-aca8-abf79d94b5f5 · outbound

This paper cites Program Synthesis with Large Language Models.

COFFE: A Code Efficiency Benchmark for Code Generation Program Synthesis with Large Language Models

Reference 5

Resolution: unresolved; no resolver link, observed 2026-08-09T11:01:27.571440Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 97bd49c3-03cf-4327-898f-c9dff9251f2b · outbound

This paper cites an unresolved cited work.

COFFE: A Code Efficiency Benchmark for Code Generation Unresolved cited work

Reference 6

Resolution: unresolved; no resolver link, observed 2026-08-09T11:01:27.578803Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation f7743c57-c178-44ff-9e86-3c1de53cf894 · outbound

This paper cites Unit Test Generation using Generative AI : A Comparative Performance Analysis of Autogeneration Tools.

COFFE: A Code Efficiency Benchmark for Code Generation Unit Test Generation using Generative AI : A Comparative Performance Analysis of Autogeneration Tools

Reference 7

Resolution: unresolved; no resolver link, observed 2026-08-09T11:01:27.586030Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation d1841ed1-cc45-499f-93dd-18c0956940d5 · outbound

This paper cites Evaluating Large Language Models Trained on Code.

COFFE: A Code Efficiency Benchmark for Code Generation Evaluating Large Language Models Trained on Code

Reference 9

Resolution: unresolved; no resolver link, observed 2026-08-09T11:01:27.598250Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation db902b5d-3c7f-41e0-8367-c96c489f084a · outbound

This paper cites Teaching Large Language Models to Self-Debug.

COFFE: A Code Efficiency Benchmark for Code Generation Teaching Large Language Models to Self-Debug

Reference 10

Resolution: unresolved; no resolver link, observed 2026-08-09T11:01:27.603903Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation f2b86ad6-5fb8-402a-8135-cc885c82671b · outbound

This paper cites an unresolved cited work.

COFFE: A Code Efficiency Benchmark for Code Generation Unresolved cited work

Reference 11

Resolution: malformed identifier; no resolver link, observed 2026-08-09T11:01:27.609674Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 805dcc58-2f3e-4665-9a16-a9f186287ca4 · outbound

This paper cites Scaling Instruction-Finetuned Language Models.

COFFE: A Code Efficiency Benchmark for Code Generation Scaling Instruction-Finetuned Language Models

Reference 12

Resolution: unresolved; no resolver link, observed 2026-08-09T11:01:27.615524Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 3d9eb3a9-e986-4202-9450-e1879be7a0a6 · outbound

This paper cites an unresolved cited work.

COFFE: A Code Efficiency Benchmark for Code Generation Unresolved cited work

Reference 13

Resolution: unresolved; no resolver link, observed 2026-08-09T11:01:27.621454Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 68ecdabb-2919-4ced-95da-7be39945e203 · outbound

This paper cites an unresolved cited work.

COFFE: A Code Efficiency Benchmark for Code Generation Unresolved cited work

Reference 14

Resolution: unresolved; no resolver link, observed 2026-08-09T11:01:27.626938Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 3f5ceeec-ced3-4e6f-a755-e672ca929054 · outbound

This paper cites an unresolved cited work.

COFFE: A Code Efficiency Benchmark for Code Generation Unresolved cited work

Reference 15

Resolution: unresolved; no resolver link, observed 2026-08-09T11:01:27.632898Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 2558f0b6-7fca-402f-a2b0-af24642dc7cf · outbound

This paper cites DeepSeek-V2: A Strong, Economical, and Efficient Mixture-of-Experts Language Model.

COFFE: A Code Efficiency Benchmark for Code Generation DeepSeek-V2: A Strong, Economical, and Efficient Mixture-of-Experts Language Model

Reference 16

Resolution: unresolved; no resolver link, observed 2026-08-09T11:01:27.638350Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 66e1ef42-f30e-40f7-9831-b52e7c8ad030 · outbound

This paper cites an unresolved cited work.

COFFE: A Code Efficiency Benchmark for Code Generation Unresolved cited work

Reference 17

Resolution: unresolved; no resolver link, observed 2026-08-09T11:01:27.644414Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 8d5870fe-6d1b-4be3-909f-cbdf60d58788 · outbound

This paper cites an unresolved cited work.

COFFE: A Code Efficiency Benchmark for Code Generation Unresolved cited work

Reference 18

Resolution: unresolved; no resolver link, observed 2026-08-09T11:01:27.649564Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 66749a5b-ebfd-4c84-be86-e4bc6e4993ec · outbound

This paper cites an unresolved cited work.

COFFE: A Code Efficiency Benchmark for Code Generation Unresolved cited work

Reference 19

Resolution: unresolved; no resolver link, observed 2026-08-09T11:01:27.654354Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 451af2e4-55ed-40cc-be6c-643faf878719 · outbound

This paper cites an unresolved cited work.

COFFE: A Code Efficiency Benchmark for Code Generation Unresolved cited work

Reference 20

Resolution: unresolved; no resolver link, observed 2026-08-09T11:01:27.659939Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 3fcc2efe-067f-4ee1-b0a8-73fc0656a78b · outbound

This paper cites an unresolved cited work.

COFFE: A Code Efficiency Benchmark for Code Generation Unresolved cited work

Reference 21

Resolution: unresolved; no resolver link, observed 2026-08-09T11:01:27.667595Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 70af421b-7878-489f-999f-d69d30bb2380 · outbound

This paper cites an unresolved cited work.

COFFE: A Code Efficiency Benchmark for Code Generation Unresolved cited work

Reference 22

Resolution: unresolved; no resolver link, observed 2026-08-09T11:01:27.673026Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation ac7af819-edf7-4b44-9007-5801c455215d · outbound

This paper cites an unresolved cited work.

COFFE: A Code Efficiency Benchmark for Code Generation Unresolved cited work

Reference 23

Resolution: unresolved; no resolver link, observed 2026-08-09T11:01:27.678301Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 64921342-b131-4912-a10b-56b369ee39c4 · outbound

This paper cites an unresolved cited work.

COFFE: A Code Efficiency Benchmark for Code Generation Unresolved cited work

Reference 24

Resolution: unresolved; no resolver link, observed 2026-08-09T11:01:27.683720Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 50bd2c19-35df-4d29-8d1c-c76169b2db54 · outbound

This paper cites an unresolved cited work.

COFFE: A Code Efficiency Benchmark for Code Generation Unresolved cited work

Reference 25

Resolution: unresolved; no resolver link, observed 2026-08-09T11:01:27.688863Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 08d3dbfa-f5b5-45d0-ac99-7ff3dcb3d8bf · outbound

This paper cites DeepSeek-Coder: When the Large Language Model Meets Programming -- The Rise of Code Intelligence.

COFFE: A Code Efficiency Benchmark for Code Generation DeepSeek-Coder: When the Large Language Model Meets Programming -- The Rise of Code Intelligence

Reference 26

Resolution: unresolved; no resolver link, observed 2026-08-09T11:01:27.694547Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 2d03be14-bfed-482f-bafd-8228b52c2f25 · outbound

This paper cites On the Impacts of Contexts on Repository-Level Code Generation.

COFFE: A Code Efficiency Benchmark for Code Generation On the Impacts of Contexts on Repository-Level Code Generation

Reference 27

Resolution: unresolved; no resolver link, observed 2026-08-09T11:01:27.700470Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 38be2714-b51b-43ab-86e3-113ed3db2636 · outbound

This paper cites an unresolved cited work.

COFFE: A Code Efficiency Benchmark for Code Generation Unresolved cited work

Reference 28

Resolution: unresolved; no resolver link, observed 2026-08-09T11:01:27.705653Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 0564e0db-060b-46dc-8c00-92506efebb9c · outbound

This paper cites L2MAC: Large Language Model Automatic Computer for Extensive Code Generation.

COFFE: A Code Efficiency Benchmark for Code Generation L2MAC: Large Language Model Automatic Computer for Extensive Code Generation

Reference 29

Resolution: unresolved; no resolver link, observed 2026-08-09T11:01:27.709873Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 3fb0fda2-d138-4593-aed3-0a1756173e01 · outbound

This paper cites an unresolved cited work.

COFFE: A Code Efficiency Benchmark for Code Generation Unresolved cited work

Reference 30

Resolution: unresolved; no resolver link, observed 2026-08-09T11:01:27.715744Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 629cf6be-89ad-463c-8a48-37c777e023de · outbound

This paper cites TOGLL: Correct and Strong Test Oracle Generation with LLMs.

COFFE: A Code Efficiency Benchmark for Code Generation TOGLL: Correct and Strong Test Oracle Generation with LLMs

Reference 31

Resolution: unresolved; no resolver link, observed 2026-08-09T11:01:27.720307Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 0f2de358-2068-4143-b91a-4ea4267eac6e · outbound

This paper cites AgentCoder: Multi-Agent-based Code Generation with Iterative Testing and Optimisation.

COFFE: A Code Efficiency Benchmark for Code Generation AgentCoder: Multi-Agent-based Code Generation with Iterative Testing and Optimisation

Reference 32

Resolution: unresolved; no resolver link, observed 2026-08-09T11:01:27.725234Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation e890235c-b66d-41f0-a450-b2dee59f3b14 · outbound

This paper cites EffiBench: Benchmarking the Efficiency of Automatically Generated Code.

COFFE: A Code Efficiency Benchmark for Code Generation EffiBench: Benchmarking the Efficiency of Automatically Generated Code

Reference 33

Resolution: unresolved; no resolver link, observed 2026-08-09T11:01:27.730591Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 826199b8-ea4c-4a8b-b6af-e91aeed82810 · outbound

This paper cites an unresolved cited work.

COFFE: A Code Efficiency Benchmark for Code Generation Unresolved cited work

Reference 34

Resolution: unresolved; no resolver link, observed 2026-08-09T11:01:27.739917Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 6ef81ecb-335e-4822-be91-8c1a51ee4826 · outbound

This paper cites Mixtral of Experts.

COFFE: A Code Efficiency Benchmark for Code Generation Mixtral of Experts

Reference 35

Resolution: unresolved; no resolver link, observed 2026-08-09T11:01:27.748900Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 696279b5-6f90-40b9-8d33-8c5058421d69 · outbound

This paper cites SWE-bench: Can Language Models Resolve Real-World GitHub Issues?.

COFFE: A Code Efficiency Benchmark for Code Generation SWE-bench: Can Language Models Resolve Real-World GitHub Issues?

Reference 36

Resolution: unresolved; no resolver link, observed 2026-08-09T11:01:27.756916Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 8e06412e-c5c0-44b2-b131-9755e24b4e84 · outbound

This paper cites an unresolved cited work.

COFFE: A Code Efficiency Benchmark for Code Generation Unresolved cited work

Reference 37

Resolution: unresolved; no resolver link, observed 2026-08-09T11:01:27.766139Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 6d2e6050-5b12-48d2-99b8-949d9c6ddbce · outbound

This paper cites Saiful Bari, Xuan Long Do, Weishi Wang, Md.

COFFE: A Code Efficiency Benchmark for Code Generation Saiful Bari, Xuan Long Do, Weishi Wang, Md

Reference 38

Resolution: unresolved; no resolver link, observed 2026-08-09T11:01:27.779819Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 9942c049-851d-487d-8c17-062b82c6b07a · outbound

This paper cites Gall, and Philipp Leitner.

COFFE: A Code Efficiency Benchmark for Code Generation Gall, and Philipp Leitner

Reference 39

Resolution: unresolved; no resolver link, observed 2026-08-09T11:01:27.792235Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation e22b1833-b9c2-48c5-aa2c-6162f575fc75 · outbound

This paper cites an unresolved cited work.

COFFE: A Code Efficiency Benchmark for Code Generation Unresolved cited work

Reference 40

Resolution: unresolved; no resolver link, observed 2026-08-09T11:01:27.798571Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 4ffa50f1-9a19-4f62-8455-b5d2995fb53f · outbound

This paper cites Large Language Models as Test Case Generators: Performance Evaluation and Enhancement.

COFFE: A Code Efficiency Benchmark for Code Generation Large Language Models as Test Case Generators: Performance Evaluation and Enhancement

Reference 41

Resolution: unresolved; no resolver link, observed 2026-08-09T11:01:27.805110Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation bc6e170d-be68-48e4-9e23-b6066857ca7a · outbound

This paper cites StarCoder: may the source be with you!.

COFFE: A Code Efficiency Benchmark for Code Generation StarCoder: may the source be with you!

Reference 42

Resolution: unresolved; no resolver link, observed 2026-08-09T11:01:27.810767Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation d32eb340-d6ea-4d9b-8b55-5b544c8052a8 · outbound

This paper cites Mankowitz, Esme Sutherland Robson, Pushmeet Kohli, Nando de Freitas, Koray Kavukcuoglu, and Oriol Vinyals.

COFFE: A Code Efficiency Benchmark for Code Generation Mankowitz, Esme Sutherland Robson, Pushmeet Kohli, Nando de Freitas, Koray Kavukcuoglu, and Oriol Vinyals

Reference 43

Resolution: unresolved; no resolver link, observed 2026-08-09T11:01:27.817718Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 90356811-4075-44d3-b53f-9665a1ab5c37 · outbound

This paper cites Learning Code Preference via Synthetic Evolution.

COFFE: A Code Efficiency Benchmark for Code Generation Learning Code Preference via Synthetic Evolution

Reference 44

Resolution: unresolved; no resolver link, observed 2026-08-09T11:01:27.824172Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 841cb8a7-bb20-4ad9-9b1d-0dc26b1bf766 · outbound

This paper cites an unresolved cited work.

COFFE: A Code Efficiency Benchmark for Code Generation Unresolved cited work

Reference 45

Resolution: unresolved; raw_fallback, observed 2026-08-09T11:01:30.185541Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation e9840d26-3e74-4595-9e40-47ceecd1d09e · outbound

This paper cites an unresolved cited work.

COFFE: A Code Efficiency Benchmark for Code Generation Unresolved cited work

Reference 46

Resolution: unresolved; raw_fallback, observed 2026-08-09T11:01:30.169427Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation b4383681-f35a-4161-891c-dc8f2ecf7b91 · outbound

This paper cites an unresolved cited work.

COFFE: A Code Efficiency Benchmark for Code Generation Unresolved cited work

Reference 47

Resolution: unresolved; raw_fallback, observed 2026-08-09T11:01:30.151706Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation 6ef479bb-d7bd-4a3c-a3b4-d7d6147f8e8b · outbound

This paper cites Evaluating Language Models for Efficient Code Generation.

COFFE: A Code Efficiency Benchmark for Code Generation Evaluating Language Models for Efficient Code Generation

Reference 48

Resolution: unresolved; no resolver link, observed 2026-08-09T11:01:27.848936Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 8c5ac90d-eae4-4aba-9efa-86cf27f62d49 · outbound

This paper cites LLM-Powered Test Case Generation for Detecting Bugs in Plausible Programs.

COFFE: A Code Efficiency Benchmark for Code Generation LLM-Powered Test Case Generation for Detecting Bugs in Plausible Programs

Reference 49

Resolution: unresolved; no resolver link, observed 2026-08-09T11:01:27.854500Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 2d439915-888d-4d30-9f9c-8bf703d01172 · outbound

This paper cites an unresolved cited work.

COFFE: A Code Efficiency Benchmark for Code Generation Unresolved cited work

Reference 50

Resolution: unresolved; raw_fallback, observed 2026-08-09T11:01:30.131310Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation b5d96dd9-ea98-4459-a447-fbe6b1b296a8 · outbound

This paper cites RepoBench: Benchmarking Repository-Level Code Auto-Completion Systems.

COFFE: A Code Efficiency Benchmark for Code Generation RepoBench: Benchmarking Repository-Level Code Auto-Completion Systems

Reference 51

Resolution: unresolved; no resolver link, observed 2026-08-09T11:01:27.866380Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation c25ebc54-e05a-464e-b424-77a4e28db153 · outbound

This paper cites StarCoder 2 and The Stack v2: The Next Generation.

COFFE: A Code Efficiency Benchmark for Code Generation StarCoder 2 and The Stack v2: The Next Generation

Reference 52

Resolution: unresolved; no resolver link, observed 2026-08-09T11:01:27.873127Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 9477b9e8-fd45-41c9-b61b-797c03b4649d · outbound

This paper cites WizardCoder: Empowering Code Large Language Models with Evol-Instruct.

COFFE: A Code Efficiency Benchmark for Code Generation WizardCoder: Empowering Code Large Language Models with Evol-Instruct

Reference 53

Resolution: unresolved; no resolver link, observed 2026-08-09T11:01:27.878875Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 316ff6a8-1b26-4f8e-866f-d9f99315d8f3 · outbound

This paper cites an unresolved cited work.

COFFE: A Code Efficiency Benchmark for Code Generation Unresolved cited work

Reference 54

Resolution: unresolved; raw_fallback, observed 2026-08-09T11:01:30.113152Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation ce7cc4a0-a82a-4b90-bbb0-93020d9e0124 · outbound

This paper cites an unresolved cited work.

COFFE: A Code Efficiency Benchmark for Code Generation Unresolved cited work

Reference 55

Resolution: unresolved; raw_fallback, observed 2026-08-09T11:01:30.096754Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation 18ba5637-6507-479e-9361-badc9b2af453 · outbound

This paper cites an unresolved cited work.

COFFE: A Code Efficiency Benchmark for Code Generation Unresolved cited work

Reference 56

Resolution: unresolved; raw_fallback, observed 2026-08-09T11:01:30.080623Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation 0ebc691d-d01c-46f6-bb7d-91bd5fee1899 · outbound

This paper cites SWT-Bench: Testing and Validating Real-World Bug-Fixes with Code Agents.

COFFE: A Code Efficiency Benchmark for Code Generation SWT-Bench: Testing and Validating Real-World Bug-Fixes with Code Agents

Reference 57

Resolution: unresolved; no resolver link, observed 2026-08-09T11:01:27.898502Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation e5b6ebfe-1dc8-464b-8dbd-6f8312ef5b02 · outbound

This paper cites Wang, and Xi Victoria Lin.

COFFE: A Code Efficiency Benchmark for Code Generation Wang, and Xi Victoria Lin

Reference 58

Resolution: verified fuzzy; raw_fallback, observed 2026-08-09T11:01:30.055279Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation 31ba6f2e-7ea5-4953-bdea-244441ce724b · outbound

This paper cites CodeGen2: Lessons for Training LLMs on Programming and Natural Languages.

COFFE: A Code Efficiency Benchmark for Code Generation CodeGen2: Lessons for Training LLMs on Programming and Natural Languages

Reference 59

Resolution: unresolved; no resolver link, observed 2026-08-09T11:01:27.910143Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 24894ea6-cc86-44d4-bbac-62095fc8e673 · outbound

This paper cites an unresolved cited work.

COFFE: A Code Efficiency Benchmark for Code Generation Unresolved cited work

Reference 60

Resolution: unresolved; no resolver link, observed 2026-08-09T11:01:27.916561Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 1fdeb614-f4b3-4e05-9464-cc8f3baddcbc · outbound

This paper cites an unresolved cited work.

COFFE: A Code Efficiency Benchmark for Code Generation Unresolved cited work

Reference 61

Resolution: unresolved; raw_fallback, observed 2026-08-09T11:01:30.003550Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation 3d39e27c-2bf7-4b1d-988d-787666d9fa73 · outbound

This paper cites GPT-4 Technical Report.

COFFE: A Code Efficiency Benchmark for Code Generation GPT-4 Technical Report

Reference 62

Resolution: unresolved; no resolver link, observed 2026-08-09T11:01:27.933278Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 4997876d-6c1c-4aec-ba10-8e3cbedd9b0b · outbound

This paper cites In The Eleventh International Conference on Learning Representations, ICLR 2023, Kigali, Rwanda, May 1-5, 2023.

COFFE: A Code Efficiency Benchmark for Code Generation In The Eleventh International Conference on Learning Representations, ICLR 2023, Kigali, Rwanda, May 1-5, 2023

Reference 63

Resolution: verified fuzzy; raw_fallback, observed 2026-08-09T11:01:30.021279Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation b7f67494-1b00-4b4f-9328-e3f34d6d2e4d · outbound

This paper cites an unresolved cited work.

COFFE: A Code Efficiency Benchmark for Code Generation Unresolved cited work

Reference 64

Resolution: unresolved; raw_fallback, observed 2026-08-09T11:01:29.968127Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation 60244f9c-2b78-4bd8-942a-4b9c11d6d2c7 · outbound

This paper cites Wainwright, Pamela Mishkin, Chong Zhang, et al.

COFFE: A Code Efficiency Benchmark for Code Generation Wainwright, Pamela Mishkin, Chong Zhang, et al

Reference 65

Resolution: verified fuzzy; raw_fallback, observed 2026-08-09T11:01:29.949390Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation 5f1e09bd-f276-4b50-9c60-0c38c147c052 · outbound

This paper cites an unresolved cited work.

COFFE: A Code Efficiency Benchmark for Code Generation Unresolved cited work

Reference 66

Resolution: unresolved; raw_fallback, observed 2026-08-09T11:01:29.985183Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation c2100dc2-7426-4eb5-9d7f-20611a45224d · outbound

This paper cites Rizwan Parvez, Wasi Uddin Ahmad, Saikat Chakraborty, Baishakhi Ray, and Kai-Wei Chang.

COFFE: A Code Efficiency Benchmark for Code Generation Rizwan Parvez, Wasi Uddin Ahmad, Saikat Chakraborty, Baishakhi Ray, and Kai-Wei Chang

Reference 67

Resolution: unresolved; no resolver link, observed 2026-08-09T11:01:27.961023Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation f8e2b0be-acd5-465a-9c44-75596c7ceb0c · outbound

This paper cites Patterson and John L.

COFFE: A Code Efficiency Benchmark for Code Generation Patterson and John L

Reference 68

Resolution: verified fuzzy; raw_fallback, observed 2026-08-09T11:01:29.927141Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation 1b2b1eb8-6585-479b-873b-4759ce87daf2 · outbound

This paper cites Ouédraogo, Kader Kaboré, Haoye Tian, Yewei Song, Anil Koyuncu, Jacques Klein, David Lo, and Tegawendé F.

COFFE: A Code Efficiency Benchmark for Code Generation Ouédraogo, Kader Kaboré, Haoye Tian, Yewei Song, Anil Koyuncu, Jacques Klein, David Lo, and Tegawendé F

Reference 69

Resolution: unresolved; no resolver link, observed 2026-08-09T11:01:27.956007Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 57c2031e-7f91-4477-a4ae-b9e06ada4e0f · outbound

This paper cites Code Generation with AlphaCodium: From Prompt Engineering to Flow Engineering.

COFFE: A Code Efficiency Benchmark for Code Generation Code Generation with AlphaCodium: From Prompt Engineering to Flow Engineering

Reference 70

Resolution: unresolved; no resolver link, observed 2026-08-09T11:01:27.976791Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 2f8f4d18-0282-48d9-8c9a-0d3fc7a3bb58 · outbound

This paper cites Code Llama: Open Foundation Models for Code.

COFFE: A Code Efficiency Benchmark for Code Generation Code Llama: Open Foundation Models for Code

Reference 71

Resolution: unresolved; no resolver link, observed 2026-08-09T11:01:27.983143Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation e6a3fae2-d1cf-4053-8170-e36c31054c6c · outbound

This paper cites PerfCodeGen: Improving Performance of LLM Generated Code with Execution Feedback.

COFFE: A Code Efficiency Benchmark for Code Generation PerfCodeGen: Improving Performance of LLM Generated Code with Execution Feedback

Reference 72

Resolution: unresolved; no resolver link, observed 2026-08-09T11:01:27.970994Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 0c06d152-e6db-44d3-be5a-0b1820049d9e · outbound

This paper cites an unresolved cited work.

COFFE: A Code Efficiency Benchmark for Code Generation Unresolved cited work

Reference 73

Resolution: unresolved; no resolver link, observed 2026-08-09T11:01:28.002731Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 1ce7d485-c639-46c3-a003-ea7135f190ed · outbound

This paper cites an unresolved cited work.

COFFE: A Code Efficiency Benchmark for Code Generation Unresolved cited work

Reference 74

Resolution: unresolved; raw_fallback, observed 2026-08-09T11:01:29.890410Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation ee7218ea-f8b1-4929-9b7e-26adf840ffd4 · outbound

This paper cites an unresolved cited work.

COFFE: A Code Efficiency Benchmark for Code Generation Unresolved cited work

Reference 75

Resolution: unresolved; raw_fallback, observed 2026-08-09T11:01:29.909348Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation 79c8c4e5-18ff-4361-9c93-a3a4e010a898 · outbound

This paper cites A Tool for Test Case Scenarios Generation Using Large Language Models.

COFFE: A Code Efficiency Benchmark for Code Generation A Tool for Test Case Scenarios Generation Using Large Language Models

Reference 76

Resolution: unresolved; no resolver link, observed 2026-08-09T11:01:27.994594Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation fe01a149-1152-400e-8dea-0f63b6684d79 · outbound

This paper cites EVOR: Evolving Retrieval for Code Generation.

COFFE: A Code Efficiency Benchmark for Code Generation EVOR: Evolving Retrieval for Code Generation

Reference 77

Resolution: unresolved; no resolver link, observed 2026-08-09T11:01:28.028734Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 2db13087-fc95-4352-8226-13eb8c1b23aa · outbound

This paper cites an unresolved cited work.

COFFE: A Code Efficiency Benchmark for Code Generation Unresolved cited work

Reference 78

Resolution: unresolved; no resolver link, observed 2026-08-09T11:01:28.036297Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 5f22ea9d-f5d8-4c6c-9cc1-9fe84750a3a6 · outbound

This paper cites Gardner, Yiming Yang, Milad Hashemi, Graham Neubig, Parthasarathy Ranganathan, Osbert Bastani, and Amir Yazdanbakhsh.

COFFE: A Code Efficiency Benchmark for Code Generation Gardner, Yiming Yang, Milad Hashemi, Graham Neubig, Parthasarathy Ranganathan, Osbert Bastani, and Amir Yazdanbakhsh

Reference 79

Resolution: verified fuzzy; raw_fallback, observed 2026-08-09T11:01:29.870625Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation 723bb15b-b5f8-47ed-9036-b079d38f1e2d · outbound

This paper cites Kinoshita, and Donald Lee.

COFFE: A Code Efficiency Benchmark for Code Generation Kinoshita, and Donald Lee

Reference 80

Resolution: verified fuzzy; raw_fallback, observed 2026-08-09T11:01:29.847517Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation 51eff561-1c2c-4b82-92d4-549eee775b1c · outbound

This paper cites an unresolved cited work.

COFFE: A Code Efficiency Benchmark for Code Generation Unresolved cited work

Reference 81

Resolution: unresolved; no resolver link, observed 2026-08-09T11:01:28.053368Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation fb21d99c-ced5-49ba-a18c-a44970140e3d · outbound

This paper cites Joty, and Steven C.

COFFE: A Code Efficiency Benchmark for Code Generation Joty, and Steven C

Reference 82

Resolution: unresolved; no resolver link, observed 2026-08-09T11:01:28.062354Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation a62b8d6b-1162-4109-ad1e-f8491b2341ad · outbound

This paper cites TESTEVAL: Benchmarking Large Language Models for Test Case Generation.

COFFE: A Code Efficiency Benchmark for Code Generation TESTEVAL: Benchmarking Large Language Models for Test Case Generation

Reference 83

Resolution: unresolved; no resolver link, observed 2026-08-09T11:01:28.042521Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 40953331-f0e2-41ab-9fdc-93f95fd4d805 · outbound

This paper cites Executable Code Actions Elicit Better LLM Agents.

COFFE: A Code Efficiency Benchmark for Code Generation Executable Code Actions Elicit Better LLM Agents

Reference 84

Resolution: unresolved; no resolver link, observed 2026-08-09T11:01:28.047912Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation cd8d16a3-f92b-48eb-9627-601f2b8e3891 · outbound

This paper cites an unresolved cited work.

COFFE: A Code Efficiency Benchmark for Code Generation Unresolved cited work

Reference 85

Resolution: unresolved; raw_fallback, observed 2026-08-09T11:01:29.779420Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation 2ada420f-c3ed-4371-9f1c-317de3e21410 · outbound

This paper cites an unresolved cited work.

COFFE: A Code Efficiency Benchmark for Code Generation Unresolved cited work

Reference 86

Resolution: unresolved; raw_fallback, observed 2026-08-09T11:01:29.760589Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation ecb57bff-dcba-4d6b-88d1-83d18ad348e5 · outbound

This paper cites Jimenez, Alexander Wettig, Kilian Lieret, Shunyu Yao, Karthik Narasimhan, and Ofir Press.

COFFE: A Code Efficiency Benchmark for Code Generation Jimenez, Alexander Wettig, Kilian Lieret, Shunyu Yao, Karthik Narasimhan, and Ofir Press

Reference 87

Resolution: unresolved; no resolver link, observed 2026-08-09T11:01:28.099706Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation c207b9ff-2b48-4563-a9aa-c9a6220747a6 · outbound

This paper cites Chi, Tatsunori Hashimoto, Oriol Vinyals, Percy Liang, Jeff Dean, and William Fedus.

COFFE: A Code Efficiency Benchmark for Code Generation Chi, Tatsunori Hashimoto, Oriol Vinyals, Percy Liang, Jeff Dean, and William Fedus

Reference 88

Resolution: verified fuzzy; raw_fallback, observed 2026-08-09T11:01:29.798130Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation 3f99a981-3e91-45b9-82a0-8dbf99a69fb7 · outbound

This paper cites Magicoder: Empowering Code Generation with OSS-Instruct.

COFFE: A Code Efficiency Benchmark for Code Generation Magicoder: Empowering Code Generation with OSS-Instruct

Reference 89

Resolution: unresolved; no resolver link, observed 2026-08-09T11:01:28.080365Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation c629af8d-24f5-493d-8d5b-6c24d8c2a2bd · outbound

This paper cites an unresolved cited work.

COFFE: A Code Efficiency Benchmark for Code Generation Unresolved cited work

Reference 91

Resolution: unresolved; no resolver link, observed 2026-08-09T11:01:28.136071Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 552dfd8c-f71b-4623-adae-564d7884f8fc · outbound

This paper cites AutoCodeRover: Autonomous Program Improvement.

COFFE: A Code Efficiency Benchmark for Code Generation AutoCodeRover: Autonomous Program Improvement

Reference 92

Resolution: unresolved; no resolver link, observed 2026-08-09T11:01:28.149694Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 43d2f080-b21e-4de6-ba29-4a55aed17c5a · outbound

This paper cites SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineering.

COFFE: A Code Efficiency Benchmark for Code Generation SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineering

Reference 93

Resolution: unresolved; no resolver link, observed 2026-08-09T11:01:28.105672Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation c8762213-a808-4ce3-b741-a40b7903ec32 · outbound

This paper cites an unresolved cited work.

COFFE: A Code Efficiency Benchmark for Code Generation Unresolved cited work

Reference 94

Resolution: unresolved; no resolver link, observed 2026-08-09T11:01:28.112679Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 0c549d71-f1b8-41cb-99a8-6d5d3b3b18d9 · outbound

This paper cites an unresolved cited work.

COFFE: A Code Efficiency Benchmark for Code Generation Unresolved cited work

Reference 95

Resolution: malformed identifier; raw_fallback, observed 2026-08-09T11:01:29.099074Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation e4d5c3b3-4d90-4554-a80e-e458940802cb · outbound

This paper cites DeepSeek-Coder-V2: Breaking the Barrier of Closed-Source Models in Code Intelligence.

COFFE: A Code Efficiency Benchmark for Code Generation DeepSeek-Coder-V2: Breaking the Barrier of Closed-Source Models in Code Intelligence

Reference 96

Resolution: unresolved; no resolver link, observed 2026-08-09T11:01:28.173937Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 646b082e-bc17-4900-871a-776ff40c2714 · outbound

This paper cites In Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, EMNLP 2023, Singapore, December 6-10, 2023.

COFFE: A Code Efficiency Benchmark for Code Generation In Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, EMNLP 2023, Singapore, December 6-10, 2023

Reference 99

Resolution: unresolved; no resolver link, observed 2026-08-09T11:01:28.143453Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 38625d8a-dcc7-4d2c-859c-263623ed0152 · outbound

This paper cites CodeGeeX: A Pre-Trained Model for Code Generation with Multilingual Benchmarking on HumanEval-X.

COFFE: A Code Efficiency Benchmark for Code Generation CodeGeeX: A Pre-Trained Model for Code Generation with Multilingual Benchmarking on HumanEval-X

Reference 101

Resolution: unresolved; no resolver link, observed 2026-08-09T11:01:28.155586Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation cef39351-900b-4a71-ba0f-470190061671 · outbound

This paper cites Language Agent Tree Search Unifies Reasoning Acting and Planning in Language Models.

COFFE: A Code Efficiency Benchmark for Code Generation Language Agent Tree Search Unifies Reasoning Acting and Planning in Language Models

Reference 102

Resolution: unresolved; no resolver link, observed 2026-08-09T11:01:28.162800Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation c19b806e-c5c1-4996-b3e5-5813ada8d505 · outbound

This paper cites Xu, Zhengbao Jiang, and Graham Neubig.

COFFE: A Code Efficiency Benchmark for Code Generation Xu, Zhengbao Jiang, and Graham Neubig

Reference 103

Resolution: verified fuzzy; raw_fallback, observed 2026-08-09T11:01:29.714608Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation acd3711e-23ff-4f18-8f1f-428ad2eb72a9 · outbound

This paper cites https://doi.org/10.18653/V1/2021.EMNLP-MAIN.685.

COFFE: A Code Efficiency Benchmark for Code Generation https://doi.org/10.18653/V1/2021.EMNLP-MAIN.685

Reference 2021

Resolution: unresolved; no resolver link, observed 2026-08-09T11:01:28.068709Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 83b506bb-45da-4628-9654-70099c0ad959 · outbound

This paper cites xCodeEval: A Large Scale Multilingual Multitask Benchmark for Code Understanding, Generation, Translation and Retrieval.

COFFE: A Code Efficiency Benchmark for Code Generation xCodeEval: A Large Scale Multilingual Multitask Benchmark for Code Understanding, Generation, Translation and Retrieval

Reference 2023

Resolution: unresolved; no resolver link, observed 2026-08-09T11:01:27.786095Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Pith citing papers

Observation aa34b9b4-ffad-4aa3-83ca-aa3829bb7f6f · inbound

HardTests: Synthesizing High-Quality Test Cases for LLM Coding cites this paper.

HardTests: Synthesizing High-Quality Test Cases for LLM Coding COFFE: A Code Efficiency Benchmark for Code Generation

Reference 20

Resolution: unresolved; no resolver link, observed 2026-08-07T12:39:57.465250Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 803e126c-3653-467b-bf88-4e12d2e5e7fa · inbound

SysLLMatic: Large Language Models are Software System Optimizers cites this paper.

SysLLMatic: Large Language Models are Software System Optimizers COFFE: A Code Efficiency Benchmark for Code Generation

Reference 87

Resolution: verified exact; arxiv_id, observed 2026-05-19T12:22:17.219309Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation 2d7b2803-3b92-4247-a6d5-4b876b2ff61f · inbound

SimdBench: Benchmarking Large Language Models for SIMD-Intrinsic Code Generation cites this paper.

SimdBench: Benchmarking Large Language Models for SIMD-Intrinsic Code Generation COFFE: A Code Efficiency Benchmark for Code Generation

Reference 48

Resolution: unresolved; no resolver link, observed 2026-08-06T15:43:39.090108Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 9600db74-d376-4cf2-b7c4-38c2cce36eb4 · inbound

Approximating the universal thermal climate index using sparse regression with orthogonal polynomials cites this paper.

Approximating the universal thermal climate index using sparse regression with orthogonal polynomials COFFE: A Code Efficiency Benchmark for Code Generation

Reference 20

Resolution: unresolved; no resolver link, observed 2026-08-05T20:04:42.799703Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation cb1aaeb0-0d75-417b-8e2d-a269497b3c15 · inbound

Bridging Generation and Training: A Systematic Review of Quality Issues in LLMs for Code cites this paper.

Bridging Generation and Training: A Systematic Review of Quality Issues in LLMs for Code COFFE: A Code Efficiency Benchmark for Code Generation

Reference 98

Resolution: verified exact; arxiv_id, observed 2026-05-11T17:26:04.815262Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.