Typed states for the displayed outbound observations.
Source: paper_references, paper_reference_links, observed 2026-07-09T05:16:58.549058Z
Paper Citation Record · LEDGER
Rethinking Code Performance Benchmarks for LLMs
As of 18 August 2026, this Paper Citation Record lists 100 of 161 outbound references and 1 inbound Pith citation observation for arXiv:2607.07619.
A citation records a reference. It does not transfer a finding from one paper to another.
Coverage vector
One-hop event checks from named stored sources.
Source: scholarly_work_events, retraction_status_cache, observed 2026-08-17T06:30:58.91139+00:00
Pith citing papers itemized under the disclosed page cap.
Source: paper_references, paper_reference_links, observed 2026-08-01T10:53:08.900571Z
A source-named dated measurement, never combined with another source.
Source: cited_works
Reference resolution
100 of 161 outbound references displayed
- verified exact23
- verified fuzzy56
- unresolved10
- parse uncertain0
- malformed identifier0
- metadata mismatch11
External citation measurements
No source-named external measurement is stored.
Outbound references
Observation 3dc05d99-6545-4cb5-8cb8-6cb59d2262ad · outbound
This paper cites Breakthroughs in statistics: Methodology and distribution , pages=.
Rethinking Code Performance Benchmarks for LLMs Breakthroughs in statistics: Methodology and distribution , pages=
Reference 1
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-07-09T05:36:01.148720Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.
Observation acfb784e-67c3-47a4-8f9a-c293c511fe68 · outbound
This paper cites author Ralph, P.
Rethinking Code Performance Benchmarks for LLMs author Ralph, P
Reference 2
- Resolution
- verified exact
- doi, observed 2026-07-09T05:26:01.109354Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.
Observation d34e65bf-9ed2-471e-9233-913e05179d33 · outbound
This paper cites Educational and psychological measurement , volume=.
Rethinking Code Performance Benchmarks for LLMs Educational and psychological measurement , volume=
Reference 3
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-07-09T05:36:01.216623Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.
Observation fe24e569-5235-495e-8778-02cb696b51be · outbound
This paper cites Biometrika , pages=.
Rethinking Code Performance Benchmarks for LLMs Biometrika , pages=
Reference 4
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-07-09T05:36:01.163104Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.
Observation fd78b4db-1995-47ae-9a75-a254d04906e1 · outbound
This paper cites Breakthroughs in statistics: Methodology and distribution , pages=.
Rethinking Code Performance Benchmarks for LLMs Breakthroughs in statistics: Methodology and distribution , pages=
Reference 5
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-07-09T05:36:01.223370Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.
Observation dca09601-3147-446f-80d2-1c4acc0cdea6 · outbound
This paper cites an unresolved cited work.
Rethinking Code Performance Benchmarks for LLMs Unresolved cited work
Reference 6
- Resolution
- unresolved
- raw_fallback, observed 2026-07-09T05:46:02.122374Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.
Observation f9d0b908-ac58-463c-8952-ae9b9214289b · outbound
This paper cites IOWA , author=.
Rethinking Code Performance Benchmarks for LLMs IOWA , author=
Reference 7
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-07-09T05:36:01.267905Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.
Observation bec1610c-c54d-4c47-8e4f-25402746903e · outbound
This paper cites Biometrika , volume=.
Rethinking Code Performance Benchmarks for LLMs Biometrika , volume=
Reference 8
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-07-09T05:36:02.647556Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.
Observation 8b607199-d697-40fe-b552-57c8dc90bda7 · outbound
This paper cites 2009 , publisher=.
Rethinking Code Performance Benchmarks for LLMs 2009 , publisher=
Reference 9
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-07-09T05:36:02.649714Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.
Observation 1e8f7f04-8804-41ce-9993-36935cbda212 · outbound
This paper cites Information and Software Technology , volume=.
Rethinking Code Performance Benchmarks for LLMs Information and Software Technology , volume=
Reference 10
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-07-09T05:36:02.636423Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.
Observation 002f5173-df22-4d6c-93a8-ba36247a9163 · outbound
This paper cites , author=.
Reference 11
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-07-09T05:36:02.654341Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.
Observation ce30ab09-cb96-419f-8948-5d2a941fd5aa · outbound
This paper cites Biometrics bulletin , volume=.
Rethinking Code Performance Benchmarks for LLMs Biometrics bulletin , volume=
Reference 12
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-07-09T05:46:02.088696Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.
Observation c70f330e-d95a-4f5f-8be0-065ba12e66f3 · outbound
This paper cites The Journal of Nervous and Mental Disease , volume=.
Rethinking Code Performance Benchmarks for LLMs The Journal of Nervous and Mental Disease , volume=
Reference 13
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-07-09T05:36:02.611608Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.
Observation da3d9738-4d0e-4556-a515-442a6ea6a0e6 · outbound
This paper cites Devanbu, Christoph Treude, and Michael Pradel.
Rethinking Code Performance Benchmarks for LLMs Devanbu, Christoph Treude, and Michael Pradel
Reference 14
- Resolution
- metadata mismatch
- arxiv_id, observed 2026-07-09T05:26:01.136701Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.
Observation da2efc50-d426-43e3-b0ad-b580e25bcdc7 · outbound
This paper cites From generation to judg- ment: Opportunities and challenges of llm-as-a-judge.
Rethinking Code Performance Benchmarks for LLMs From generation to judg- ment: Opportunities and challenges of llm-as-a-judge
Reference 15
- Resolution
- verified exact
- arxiv_id, observed 2026-07-09T05:26:01.089108Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.
Observation d63cd483-321c-4a1e-8dc5-6f159ee94db9 · outbound
This paper cites Proceedings of the 18th.
Rethinking Code Performance Benchmarks for LLMs Proceedings of the 18th
Reference 16
- Resolution
- metadata mismatch
- arxiv_id, observed 2026-07-09T05:26:01.174380Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.
Observation 75bd5282-35ce-4f69-845b-02fd26065bbb · outbound
This paper cites DeepSeek Chat , howpublished =.
Rethinking Code Performance Benchmarks for LLMs DeepSeek Chat , howpublished =
Reference 17
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-07-09T05:36:01.151418Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.
Observation 09eaa7ce-a107-4eb9-a789-4b29ab00c273 · outbound
This paper cites DeepSeek Model , howpublished =.
Rethinking Code Performance Benchmarks for LLMs DeepSeek Model , howpublished =
Reference 18
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-07-09T05:36:01.239298Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.
Observation 3593a4a1-49ef-4a1c-9e79-9e4a92269d0b · outbound
This paper cites ChatGPT , howpublished =.
Rethinking Code Performance Benchmarks for LLMs ChatGPT , howpublished =
Reference 19
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-07-09T05:36:01.213591Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.
Observation bf392ddf-d045-42a4-b749-b5adfa973bad · outbound
This paper cites Gemini25 , howpublished =.
Rethinking Code Performance Benchmarks for LLMs Gemini25 , howpublished =
Reference 20
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-07-09T05:36:01.234230Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.
Observation 67b7d851-4c75-4fd4-a8bb-392987f63ccd · outbound
This paper cites claudesonnet45 , howpublished =.
Rethinking Code Performance Benchmarks for LLMs claudesonnet45 , howpublished =
Reference 21
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-07-09T05:36:01.172238Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.
Observation cd2ee14b-3790-4f90-8531-b80ed1616774 · outbound
This paper cites , author =.
Reference 22
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-07-09T05:36:01.165779Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.
Observation fcc426f8-6dde-42e8-a42c-5f4e608b4cb8 · outbound
This paper cites Journal of Machine learning research , volume=.
Rethinking Code Performance Benchmarks for LLMs Journal of Machine learning research , volume=
Reference 23
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-07-09T05:36:01.184980Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.
Observation 1232e5c0-4553-4a5c-94c3-179905eb8afc · outbound
This paper cites The annals of mathematical statistics , pages=.
Rethinking Code Performance Benchmarks for LLMs The annals of mathematical statistics , pages=
Reference 24
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-07-09T05:36:01.160417Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.
Observation 131881fe-6e7f-40a8-b6fe-ed8246c091b4 · outbound
This paper cites an unresolved cited work.
Rethinking Code Performance Benchmarks for LLMs Unresolved cited work
Reference 25
- Resolution
- unresolved
- raw_fallback, observed 2026-07-09T05:46:02.105787Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.
Observation 9ecce98e-2188-4ac6-bf3c-97461a7e38b4 · outbound
This paper cites an unresolved cited work.
Rethinking Code Performance Benchmarks for LLMs Unresolved cited work
Reference 26
- Resolution
- unresolved
- raw_fallback, observed 2026-07-09T05:36:02.590323Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.
Observation 0c2f5bdd-b131-4300-b97b-c493b13a97e9 · outbound
This paper cites TestEval : Benchmarking Large Language Models for Test Case Generation.
Rethinking Code Performance Benchmarks for LLMs TestEval : Benchmarking Large Language Models for Test Case Generation
Reference 27
- Resolution
- metadata mismatch
- doi, observed 2026-07-09T05:26:01.182655Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.
Observation f3a21cfc-654f-4d83-9484-3509ef71d1d8 · outbound
This paper cites Robust benchmarking in noisy environments.
Rethinking Code Performance Benchmarks for LLMs Robust benchmarking in noisy environments
Reference 28
- Resolution
- verified exact
- local_arxiv, observed 2026-07-09T05:26:02.127013Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.
Observation 175216fa-9799-409d-8d00-9b4c47baa496 · outbound
This paper cites Proceedings of the 19th Annual International Conference on Supercomputing,.
Rethinking Code Performance Benchmarks for LLMs Proceedings of the 19th Annual International Conference on Supercomputing,
Reference 29
- Resolution
- verified exact
- arxiv_id, observed 2026-07-09T05:26:01.118433Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.
Observation a3e96f8d-0b26-4b8f-8f9e-fc2af429bed4 · outbound
This paper cites Mogul and Anita Borg , title =.
Rethinking Code Performance Benchmarks for LLMs Mogul and Anita Borg , title =
Reference 30
- Resolution
- verified exact
- arxiv_id, observed 2026-07-09T05:26:01.179288Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.
Observation 2c1fe6bc-282b-45b7-9167-17afa9b8e7b7 · outbound
This paper cites Tyson and Matthew K.
Rethinking Code Performance Benchmarks for LLMs Tyson and Matthew K
Reference 31
- Resolution
- verified exact
- doi, observed 2026-07-09T05:26:01.101433Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.
Observation d410037b-3811-4b88-a02a-e2f338c29737 · outbound
This paper cites Tyson and others , title =.
Rethinking Code Performance Benchmarks for LLMs Tyson and others , title =
Reference 32
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-07-09T05:36:02.605587Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.
Observation 9a758395-9f83-4893-a6fa-41b9df04ceff · outbound
This paper cites 1999 , url =.
Rethinking Code Performance Benchmarks for LLMs 1999 , url =
Reference 33
- Resolution
- verified exact
- doi, observed 2026-07-09T05:26:01.081703Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.
Observation c07b46fd-a812-47a1-a574-a2cc46901fe1 · outbound
This paper cites The Twelfth International Conference on Learning Representations,.
Rethinking Code Performance Benchmarks for LLMs The Twelfth International Conference on Learning Representations,
Reference 34
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-07-09T05:36:02.575326Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.
Observation 3eddb141-00ad-4841-b88b-3a2aed730b3e · outbound
This paper cites an unresolved cited work.
Rethinking Code Performance Benchmarks for LLMs Unresolved cited work
Reference 35
- Resolution
- verified exact
- doi, observed 2026-07-09T05:26:01.018502Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.
Observation 6f251ed2-c4c3-4a5f-ace8-0d11013bde83 · outbound
This paper cites NoFunEval: Funny How Code LMs Falter on Requirements Beyond Functional Correctness.
Rethinking Code Performance Benchmarks for LLMs NoFunEval: Funny How Code LMs Falter on Requirements Beyond Functional Correctness
Reference 36
- Resolution
- verified exact
- local_arxiv, observed 2026-07-09T05:26:01.002164Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.
Observation e340eaad-bcae-43a1-8b69-8fb9a37cd780 · outbound
This paper cites Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) , pages=.
Rethinking Code Performance Benchmarks for LLMs Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) , pages=
Reference 37
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-07-09T05:36:02.595190Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.
Observation 8facd045-87ef-43d2-a3a5-1ab6d8c22dcc · outbound
This paper cites Proceedings of the ACM/IEEE 42nd International Conference on Software Engineering , pages=.
Rethinking Code Performance Benchmarks for LLMs Proceedings of the ACM/IEEE 42nd International Conference on Software Engineering , pages=
Reference 38
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-07-09T05:36:02.613991Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.
Observation 6c939dc0-c918-492b-b3ab-5c1a90c9449a · outbound
This paper cites IEEE Transactions on Software Engineering , volume=.
Rethinking Code Performance Benchmarks for LLMs IEEE Transactions on Software Engineering , volume=
Reference 39
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-07-09T05:36:02.173007Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.
Observation 907cc97e-f9cf-46b9-8692-dca6caa951ed · outbound
This paper cites IEEE Transactions on Software Engineering , volume=.
Rethinking Code Performance Benchmarks for LLMs IEEE Transactions on Software Engineering , volume=
Reference 40
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-07-09T05:36:02.180435Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.
Observation cf6fe173-407d-4b1f-9d17-894d3ca4fc8b · outbound
This paper cites Proceedings of the 38th international conference on software engineering , pages=.
Rethinking Code Performance Benchmarks for LLMs Proceedings of the 38th international conference on software engineering , pages=
Reference 41
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-07-09T05:36:02.587304Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.
Observation ab3260c3-45c7-4c8f-b344-de75ed63c2f0 · outbound
This paper cites Journal of Systems and Software , volume=.
Rethinking Code Performance Benchmarks for LLMs Journal of Systems and Software , volume=
Reference 42
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-07-09T05:36:02.652238Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.
Observation f604e6a7-bd4d-43f0-a540-0fc5dfe46f29 · outbound
This paper cites Proceedings of the IEEE/ACM 46th International Conference on Software Engineering , pages=.
Rethinking Code Performance Benchmarks for LLMs Proceedings of the IEEE/ACM 46th International Conference on Software Engineering , pages=
Reference 43
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-07-09T05:36:01.178117Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.
Observation d0f53d18-cd9b-43c1-95a0-d8154c578290 · outbound
This paper cites IEEE Access , volume=.
Rethinking Code Performance Benchmarks for LLMs IEEE Access , volume=
Reference 44
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-07-09T05:36:01.157088Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.
Observation 20541f37-aae0-4864-b8b7-a454d2fb2bda · outbound
This paper cites IEEE Access , volume=.
Rethinking Code Performance Benchmarks for LLMs IEEE Access , volume=
Reference 45
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-07-09T05:36:01.244350Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.
Observation 2c420f38-9fab-47dc-80c3-f24f43f6dcd9 · outbound
This paper cites 2023 IEEE/ACM 45th International Conference on Software Engineering (ICSE) , pages=.
Rethinking Code Performance Benchmarks for LLMs 2023 IEEE/ACM 45th International Conference on Software Engineering (ICSE) , pages=
Reference 46
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-07-09T05:36:01.197483Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.
Observation a56f1596-5f88-430a-b335-4129261f59bd · outbound
This paper cites Information and Software Technology , volume=.
Rethinking Code Performance Benchmarks for LLMs Information and Software Technology , volume=
Reference 47
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-07-09T05:36:01.175079Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.
Observation 8cb649b0-311a-4c5b-ba59-8b49f5673e4d · outbound
This paper cites 2023 38th IEEE/ACM International Conference on Automated Software Engineering (ASE) , pages=.
Rethinking Code Performance Benchmarks for LLMs 2023 38th IEEE/ACM International Conference on Automated Software Engineering (ASE) , pages=
Reference 48
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-07-09T05:46:02.085408Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.
Observation 7c37771a-cd44-45bf-942e-d1f762178006 · outbound
This paper cites Proceedings of the 33rd ACM SIGSOFT International Symposium on Software Testing and Analysis , pages=.
Rethinking Code Performance Benchmarks for LLMs Proceedings of the 33rd ACM SIGSOFT International Symposium on Software Testing and Analysis , pages=
Reference 49
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-07-09T05:36:01.181727Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.
Observation f547b1ae-5aab-4844-adab-55af4b30c67e · outbound
This paper cites IEEE Transactions on Software Engineering , volume=.
Rethinking Code Performance Benchmarks for LLMs IEEE Transactions on Software Engineering , volume=
Reference 50
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-07-09T05:36:01.194201Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.
Observation e18e37f9-3f1f-445c-8073-72f0a1eb9358 · outbound
This paper cites Proceedings of the ACM on Software Engineering , volume=.
Rethinking Code Performance Benchmarks for LLMs Proceedings of the ACM on Software Engineering , volume=
Reference 51
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-07-09T05:36:01.210964Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.
Observation 01a0de30-6fd4-4288-aea6-18978835a55c · outbound
This paper cites Proceedings of the 27th ACM SIGSOFT international symposium on software testing and analysis , pages=.
Rethinking Code Performance Benchmarks for LLMs Proceedings of the 27th ACM SIGSOFT international symposium on software testing and analysis , pages=
Reference 52
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-07-09T05:36:01.220351Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.
Observation 337665cb-881f-468d-adae-1c59ca0a4425 · outbound
This paper cites Proceedings of the 2017 ACM SIGSAC conference on computer and communications security , pages=.
Rethinking Code Performance Benchmarks for LLMs Proceedings of the 2017 ACM SIGSAC conference on computer and communications security , pages=
Reference 53
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-07-09T05:36:02.592773Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.
Observation 7c554f65-41fd-4dfa-9a5e-9c05b416b4b7 · outbound
This paper cites Proceedings of the ACM/IEEE 44th International Conference on Software Engineering: Companion Proceedings , pages=.
Rethinking Code Performance Benchmarks for LLMs Proceedings of the ACM/IEEE 44th International Conference on Software Engineering: Companion Proceedings , pages=
Reference 54
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-07-09T05:36:01.169194Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.
Observation 4edbe300-8d74-452e-b799-8b5c334ab5e4 · outbound
This paper cites an unresolved cited work.
Rethinking Code Performance Benchmarks for LLMs Unresolved cited work
Reference 55
- Resolution
- unresolved
- raw_fallback, observed 2026-07-09T05:36:01.251943Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.
Observation ed2840f6-bdff-48a1-8555-d6f1f08d9e4f · outbound
This paper cites Forty-second International Conference on Machine Learning,.
Rethinking Code Performance Benchmarks for LLMs Forty-second International Conference on Machine Learning,
Reference 56
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-07-09T05:36:01.274104Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.
Observation 4b7d47f7-e172-4a6e-8beb-f6c2375c95b2 · outbound
This paper cites LLM4EFFI: Leveraging Large Language Models to Enhance Code Efficiency and Correctness.
Rethinking Code Performance Benchmarks for LLMs LLM4EFFI: Leveraging Large Language Models to Enhance Code Efficiency and Correctness
Reference 57
- Resolution
- verified exact
- local_arxiv, observed 2026-07-09T05:26:01.122754Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.
Observation 6bd5dfd4-3990-4fbe-bb1a-65a125f79080 · outbound
This paper cites Towards Better Correctness and Efficiency in Code Generation.
Rethinking Code Performance Benchmarks for LLMs Towards Better Correctness and Efficiency in Code Generation
Reference 58
- Resolution
- verified exact
- local_arxiv, observed 2026-07-09T05:26:01.063164Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.
Observation 222379f6-1f7c-441e-a3bb-67954cf7fff7 · outbound
This paper cites Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers),.
Rethinking Code Performance Benchmarks for LLMs Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers),
Reference 59
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-07-09T05:36:01.231582Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.
Observation 363b706f-b518-43ef-9cac-f1d1d6850e6a · outbound
This paper cites 2025 , url =.
Rethinking Code Performance Benchmarks for LLMs 2025 , url =
Reference 60
- Resolution
- verified exact
- arxiv_id, observed 2026-07-09T05:26:01.131122Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.
Observation b7632066-662c-4420-b287-2253f7fe7a85 · outbound
This paper cites an unresolved cited work.
Rethinking Code Performance Benchmarks for LLMs Unresolved cited work
Reference 61
- Resolution
- unresolved
- raw_fallback, observed 2026-07-09T05:46:02.108334Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.
Observation 06895d48-b862-4717-8233-abc4ca6d2d21 · outbound
This paper cites an unresolved cited work.
Rethinking Code Performance Benchmarks for LLMs Unresolved cited work
Reference 62
- Resolution
- unresolved
- raw_fallback, observed 2026-07-09T05:46:02.052193Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.
Observation 70a49bd6-6160-4d79-946c-c35cf4b57846 · outbound
This paper cites 2025 , booktitle=.
Rethinking Code Performance Benchmarks for LLMs 2025 , booktitle=
Reference 63
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-07-09T05:46:02.059319Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.
Observation 9ef1df8e-ec1e-4bee-9e8d-20252471d1f1 · outbound
This paper cites Simon , title =.
Rethinking Code Performance Benchmarks for LLMs Simon , title =
Reference 64
- Resolution
- verified exact
- arxiv_id, observed 2026-07-09T05:26:01.114097Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.
Observation 6e91cc5f-f75a-46df-93a2-85c12be4269c · outbound
This paper cites Shaw and others , title =.
Rethinking Code Performance Benchmarks for LLMs Shaw and others , title =
Reference 65
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-07-09T05:36:01.254539Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.
Observation a4ce6a93-8519-483c-890c-d82f54fd5027 · outbound
This paper cites In: POPL (2011).
Rethinking Code Performance Benchmarks for LLMs In: POPL (2011)
Reference 66
- Resolution
- metadata mismatch
- arxiv_id, observed 2026-07-09T05:26:01.039755Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.
Observation 3539dbfa-2e26-4f8d-b88e-affce2135793 · outbound
This paper cites Waldinger and Richard C.
Rethinking Code Performance Benchmarks for LLMs Waldinger and Richard C
Reference 67
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-07-09T05:36:01.249679Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.
Observation aa4eb889-b347-463d-b1e1-154e5eacfd53 · outbound
This paper cites Waldinger.
Reference 68
- Resolution
- verified exact
- arxiv_id, observed 2026-07-09T05:26:01.054980Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.
Observation 05bdd701-2eb0-4ab0-a4e6-3ebecddc6bf2 · outbound
This paper cites Cordell Green , title =.
Rethinking Code Performance Benchmarks for LLMs Cordell Green , title =
Reference 69
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-07-09T05:36:01.208084Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.
Observation 8d6accf6-d999-4443-981a-5e3bd4ade773 · outbound
This paper cites 6th International Conference on Learning Representations,.
Rethinking Code Performance Benchmarks for LLMs 6th International Conference on Learning Representations,
Reference 70
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-07-09T05:46:02.096776Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.
Observation b1611c7e-97d8-4a1d-9878-af02dc5d75e1 · outbound
This paper cites an unresolved cited work.
Rethinking Code Performance Benchmarks for LLMs Unresolved cited work
Reference 71
- Resolution
- unresolved
- raw_fallback, observed 2026-07-09T05:36:01.191262Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.
Observation d026c53f-b64e-4bc8-a598-531dcee893f8 · outbound
This paper cites Foundations and Trends.
Rethinking Code Performance Benchmarks for LLMs Foundations and Trends
Reference 72
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-07-09T05:46:02.079578Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.
Observation 77e5cd76-c43f-48e6-868a-e6446d139c28 · outbound
This paper cites Competition-Level Code Generation with AlphaCode.
Rethinking Code Performance Benchmarks for LLMs Competition-Level Code Generation with AlphaCode
Reference 73
- Resolution
- verified exact
- local_arxiv, observed 2026-07-09T05:26:01.144105Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.
Observation 1247bc9e-46de-4ad8-bb8b-64a88aa3b93d · outbound
This paper cites CodeGen: An Open Large Language Model for Code with Multi-Turn Program Synthesis.
Rethinking Code Performance Benchmarks for LLMs CodeGen: An Open Large Language Model for Code with Multi-Turn Program Synthesis
Reference 74
- Resolution
- metadata mismatch
- local_arxiv, observed 2026-07-09T05:26:02.119353Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.
Observation 0cbfa65f-c166-427b-8a5a-03d1dc53dcfa · outbound
This paper cites In Proceedings of the Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, December, 2023, Singapore.
Rethinking Code Performance Benchmarks for LLMs In Proceedings of the Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, December, 2023, Singapore
Reference 75
- Resolution
- verified exact
- doi, observed 2026-07-09T05:26:01.066720Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.
Observation 1cdf3c40-124e-4554-839a-8ac2652d59bf · outbound
This paper cites an unresolved cited work.
Rethinking Code Performance Benchmarks for LLMs Unresolved cited work
Reference 76
- Resolution
- unresolved
- raw_fallback, observed 2026-07-09T05:46:02.102413Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.
Observation bbe5679d-44b9-43ca-b627-2af5fb9ba813 · outbound
This paper cites an unresolved cited work.
Rethinking Code Performance Benchmarks for LLMs Unresolved cited work
Reference 77
- Resolution
- unresolved
- raw_fallback, observed 2026-07-09T05:36:01.276676Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.
Observation b4645939-b944-485e-9a44-f72731931aab · outbound
This paper cites InCoder: A Generative Model for Code Infilling and Synthesis.
Rethinking Code Performance Benchmarks for LLMs InCoder: A Generative Model for Code Infilling and Synthesis
Reference 78
- Resolution
- metadata mismatch
- local_arxiv, observed 2026-07-09T05:26:02.096721Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.
Observation 70853840-a8d6-487a-ab3d-982586435e2d · outbound
This paper cites SantaCoder: don't reach for the stars!.
Rethinking Code Performance Benchmarks for LLMs SantaCoder: don't reach for the stars!
Reference 79
- Resolution
- verified exact
- local_arxiv, observed 2026-07-09T05:26:01.048861Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.
Observation bc90ff6c-ec32-4bb3-96a4-d14ecf167a69 · outbound
This paper cites Language Models are Few-Shot Learners.
Rethinking Code Performance Benchmarks for LLMs Language Models are Few-Shot Learners
Reference 80
- Resolution
- metadata mismatch
- local_arxiv, observed 2026-07-09T05:26:02.115697Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.
Observation 0cb8bd0c-01d1-42e8-873a-6479ea1e19a0 · outbound
This paper cites Llama 2: Open Foundation and Fine-Tuned Chat Models.
Rethinking Code Performance Benchmarks for LLMs Llama 2: Open Foundation and Fine-Tuned Chat Models
Reference 81
- Resolution
- metadata mismatch
- local_arxiv, observed 2026-07-09T05:26:01.126601Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.
Observation 654025cc-6061-4682-bf08-567956349037 · outbound
This paper cites Code Llama: Open Foundation Models for Code.
Rethinking Code Performance Benchmarks for LLMs Code Llama: Open Foundation Models for Code
Reference 82
- Resolution
- verified exact
- local_arxiv, observed 2026-07-09T05:26:00.996749Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.
Observation 63158b33-9d39-4c6d-b802-5857273c2c2d · outbound
This paper cites Astraios: Parameter-Efficient Instruction Tuning Code Large Language Models.
Rethinking Code Performance Benchmarks for LLMs Astraios: Parameter-Efficient Instruction Tuning Code Large Language Models
Reference 83
- Resolution
- verified exact
- local_arxiv, observed 2026-07-09T05:26:01.075601Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.
Observation c2a040a2-0cf0-41b5-9465-f474eb124094 · outbound
This paper cites GPT-4 Technical Report.
Rethinking Code Performance Benchmarks for LLMs GPT-4 Technical Report
Reference 84
- Resolution
- metadata mismatch
- local_arxiv, observed 2026-07-09T05:26:01.148862Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.
Observation 8558cbea-3730-4633-b8c1-e8a1a81d565f · outbound
This paper cites Llama , howpublished =.
Rethinking Code Performance Benchmarks for LLMs Llama , howpublished =
Reference 85
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-07-09T05:36:02.638824Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.
Observation 857b7a33-6bc3-421a-b3af-88b9b30255b7 · outbound
This paper cites Anthropic , howpublished =.
Rethinking Code Performance Benchmarks for LLMs Anthropic , howpublished =
Reference 86
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-07-09T05:36:02.631833Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.
Observation b642fd0b-5eb1-4abd-93ad-ad2cf96c0cbc · outbound
This paper cites Gemini 1.5: Unlocking multimodal understanding across millions of tokens of context.
Rethinking Code Performance Benchmarks for LLMs Gemini 1.5: Unlocking multimodal understanding across millions of tokens of context
Reference 87
- Resolution
- verified exact
- local_arxiv, observed 2026-07-09T05:26:01.015668Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.
Observation 55bd9041-6d7d-4cca-8e49-ec24a0677a41 · outbound
This paper cites Mixtral of Experts.
Rethinking Code Performance Benchmarks for LLMs Mixtral of Experts
Reference 88
- Resolution
- metadata mismatch
- local_arxiv, observed 2026-07-09T05:26:01.010795Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.
Observation e164568e-c3d3-4981-91e2-85f1d44d3d52 · outbound
This paper cites 2025.IRFuzzer: Specialized Fuzzing for LLVM Backend Code Generation.
Rethinking Code Performance Benchmarks for LLMs 2025.IRFuzzer: Specialized Fuzzing for LLVM Backend Code Generation
Reference 89
- Resolution
- metadata mismatch
- arxiv_id, observed 2026-07-09T05:26:01.105667Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.
Observation 8d769afd-e257-4eac-977b-2723e0160da7 · outbound
This paper cites Crash report enhancement with large language models: An empirical study,.
Rethinking Code Performance Benchmarks for LLMs Crash report enhancement with large language models: An empirical study,
Reference 90
- Resolution
- verified exact
- arxiv_id, observed 2026-07-09T05:26:00.990580Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.
Observation 99af4452-8485-45f8-a4f7-43892cf8e401 · outbound
This paper cites IEEE Transactions on Software Engineering , volume=.
Rethinking Code Performance Benchmarks for LLMs IEEE Transactions on Software Engineering , volume=
Reference 91
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-07-09T05:36:02.634196Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.
Observation 1382c003-154e-4081-8fdd-0f9514fdc0a8 · outbound
This paper cites Proceedings of the 29th International Conference on Evaluation and Assessment in Software Engineering , pages=.
Rethinking Code Performance Benchmarks for LLMs Proceedings of the 29th International Conference on Evaluation and Assessment in Software Engineering , pages=
Reference 92
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-07-09T05:36:02.641152Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.
Observation b6d9865a-4ec0-49c2-ab5e-0d9244f2a7ba · outbound
This paper cites Proceedings of the 29th International Conference on Evaluation and Assessment in Software Engineering , pages=.
Rethinking Code Performance Benchmarks for LLMs Proceedings of the 29th International Conference on Evaluation and Assessment in Software Engineering , pages=
Reference 93
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-07-09T05:36:02.627088Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.
Observation cac72df3-d98a-4078-a8e4-1c51ad67112e · outbound
This paper cites Proceedings of the 2024 IEEE/ACM First International Conference on AI Foundation Models and Software Engineering , pages=.
Rethinking Code Performance Benchmarks for LLMs Proceedings of the 2024 IEEE/ACM First International Conference on AI Foundation Models and Software Engineering , pages=
Reference 94
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-07-09T05:36:02.629457Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.
Observation b4b288dc-4b9e-4073-bd4b-64da2a3d7d92 · outbound
This paper cites Is Functional Correctness Enough to Evaluate Code Language Models? Exploring Diversity of Generated Codes.
Rethinking Code Performance Benchmarks for LLMs Is Functional Correctness Enough to Evaluate Code Language Models? Exploring Diversity of Generated Codes
Reference 95
- Resolution
- verified exact
- local_arxiv, observed 2026-07-09T05:26:02.133748Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.
Observation b6792b08-cc59-40e8-bedd-e0c0deab4fb0 · outbound
This paper cites ACM Sigplan Notices , volume=.
Rethinking Code Performance Benchmarks for LLMs ACM Sigplan Notices , volume=
Reference 96
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-07-09T05:36:02.645017Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.
Observation e544fd1b-0ea2-4ed6-95f3-3c842f4804c7 · outbound
This paper cites ACM SIGPLAN Notices , volume=.
Rethinking Code Performance Benchmarks for LLMs ACM SIGPLAN Notices , volume=
Reference 97
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-07-09T05:36:02.656462Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.
Observation 7c261bed-8a12-4839-bacf-c4da5422c85a · outbound
This paper cites ACM SIGARCH Computer Architecture News , volume=.
Rethinking Code Performance Benchmarks for LLMs ACM SIGARCH Computer Architecture News , volume=
Reference 98
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-07-09T05:36:02.609232Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.
Observation 2c284cb9-cfad-49e7-a13b-aa1c28eee140 · outbound
This paper cites Evaluating Language Models for Efficient Code Generation.
Rethinking Code Performance Benchmarks for LLMs Evaluating Language Models for Efficient Code Generation
Reference 99
- Resolution
- verified exact
- local_arxiv, observed 2026-07-09T05:26:01.186731Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.
Observation ef2278a7-81c0-4b47-b429-ec0ac5164477 · outbound
This paper cites an unresolved cited work.
Rethinking Code Performance Benchmarks for LLMs Unresolved cited work
Reference 100
- Resolution
- unresolved
- raw_fallback, observed 2026-07-09T05:36:02.569738Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.
Pith citing papers
Observation 1b53eb0d-ebe6-4be9-9aee-8b7a819913ef · inbound
RLPF: Reinforcement Learning from Performance Feedback for Code Generation cites this paper.
RLPF: Reinforcement Learning from Performance Feedback for Code Generation Rethinking Code Performance Benchmarks for LLMs
Reference 11
- Resolution
- unresolved
- no resolver link, observed 2026-08-01T10:53:08.900571Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.