Pith. sign in

Paper Citation Record · LEDGER

IFEvalCode: Controlled Code Generation

As of 19 August 2026, this Paper Citation Record lists 81 of 81 outbound references and 2 inbound Pith citation observations for arXiv:2507.22462.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2507.22462 v2

Coverage vector

measured 81 of 81 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-06T11:44:34.161071Z

measured 83 of 83 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-19T06:32:44.657259+00:00

measured 2 of 2 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-05T10:16:51.306423Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-05-15T18:01:25.418827Z

Reference resolution

81 of 81 outbound references displayed

  • verified exact2
  • verified fuzzy23
  • unresolved56
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 2b1cde7f-1a7b-4bf4-a509-0f2eaca51ef9 · outbound

This paper cites Introducing meta llama 3: The most capable openly available llm to date.

IFEvalCode: Controlled Code Generation Introducing meta llama 3: The most capable openly available llm to date

Reference 1

Resolution
unresolved
no resolver link, observed 2026-08-06T11:44:33.898368Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T11:44:33.898368Z digest=sha256:307aa31bdb52942a10e82666e8b88dfdae31b2ec337889c96840b097cab3cf4f

Observation ce5187cf-1362-44df-bf8a-a3d6ac86e8d4 · outbound

This paper cites SantaCoder: don't reach for the stars!.

IFEvalCode: Controlled Code Generation SantaCoder: don't reach for the stars!

Reference 2

Resolution
unresolved
no resolver link, observed 2026-08-06T11:44:33.902101Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T11:44:33.902101Z digest=sha256:5e552911d4622f8c800e3846440cee265f9239b2afbe9fee29e037950b94f150

Observation 17e1a036-737f-4f7c-8612-1f3bdd1c9343 · outbound

This paper cites Self-supervised bug de- tection and repair.

IFEvalCode: Controlled Code Generation Self-supervised bug de- tection and repair

Reference 3

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T11:44:35.025095Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-06T11:44:33.905726Z digest=sha256:22dd6c47d69845acf5d5e6be12d2c69f387d0cfbd1aad5be09f6be6786ef49cb

Observation 8d2cc9e9-f698-451d-b8b7-27dce38c1717 · outbound

This paper cites Introducing Claude, 2023.

IFEvalCode: Controlled Code Generation Introducing Claude, 2023

Reference 4

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T11:44:35.014318Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-06T11:44:33.908937Z digest=sha256:6b1bc24128468a3a12bdaf65cab7b05a10bbb16bb418121b11d5b0fd1f2f9e3c

Observation 98d61c57-fba8-4760-aece-6299b3891d77 · outbound

This paper cites Claude 3.7 sonnet and claude code, 2025.

IFEvalCode: Controlled Code Generation Claude 3.7 sonnet and claude code, 2025

Reference 5

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T11:44:35.004232Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-06T11:44:33.911945Z digest=sha256:bd337fbef189a56399f514eef9f38e79b8afbb810d2d9844374741512d928c6a

Observation 6f255543-c92e-477d-9082-dc5a85092b19 · outbound

This paper cites Program Synthesis with Large Language Models.

IFEvalCode: Controlled Code Generation Program Synthesis with Large Language Models

Reference 6

Resolution
unresolved
no resolver link, observed 2026-08-06T11:44:33.914955Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T11:44:33.914955Z digest=sha256:afc968ba903f709451a8f0456a6a6673e4f19a0bb0bf38349b228e150e122892

Observation 9b263c73-afd7-4c02-8708-37a5ff5c592e · outbound

This paper cites Qwen Technical Report.

IFEvalCode: Controlled Code Generation Qwen Technical Report

Reference 7

Resolution
unresolved
no resolver link, observed 2026-08-06T11:44:33.918703Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T11:44:33.918703Z digest=sha256:ceffb78618143bd2cb4fa12e8c9d586492d83ea456677b1ef339fd7531bf95c0

Observation 51e7f8ca-1bbd-4fee-bcaf-24d82fb5da27 · outbound

This paper cites Efficient Training of Language Models to Fill in the Middle.

IFEvalCode: Controlled Code Generation Efficient Training of Language Models to Fill in the Middle

Reference 8

Resolution
unresolved
no resolver link, observed 2026-08-06T11:44:33.922242Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T11:44:33.922242Z digest=sha256:196aca572b63f81a11dbd43190d3aa96dac121675ee0c5203ac0dff41b2f0ee4

Observation d090bae9-b229-45e6-93a8-986e30615d79 · outbound

This paper cites Multipl- e: A scalable and polyglot approach to benchmarking neural code generation.IEEE Transactions on Software Engineering, 2023.

IFEvalCode: Controlled Code Generation Multipl- e: A scalable and polyglot approach to benchmarking neural code generation.IEEE Transactions on Software Engineering, 2023

Reference 9

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T11:44:34.994673Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-06T11:44:33.926211Z digest=sha256:7b4adf5a889608097c0d061ae0a985a683b290bc81e943d675a7dddc88c8a7d2

Observation a13a7ba1-b2df-4ae4-ba2e-1fe447eda54e · outbound

This paper cites Multipl-e: A scalable and polyglot approach to benchmarking neural code generation.

IFEvalCode: Controlled Code Generation Multipl-e: A scalable and polyglot approach to benchmarking neural code generation

Reference 10

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T11:44:34.984042Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-06T11:44:33.929264Z digest=sha256:a63150fdbed5f552310dd7ab77c23633a88c077b3347ace26fe4bca3eba8df7e

Observation 9ee78b49-bb5b-4db8-965f-165df7a3f088 · outbound

This paper cites McEval: Massively Multilingual Code Evaluation.

IFEvalCode: Controlled Code Generation McEval: Massively Multilingual Code Evaluation

Reference 11

Resolution
unresolved
no resolver link, observed 2026-08-06T11:44:33.932446Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T11:44:33.932446Z digest=sha256:8b33c84ccbd28f5377d00be16f2706c76ee56e44915a27419da64173293710ea

Observation cbf0d535-edf2-4566-83e2-dff1564a2799 · outbound

This paper cites CodeR: Issue Resolving with Multi-Agent and Task Graphs.

IFEvalCode: Controlled Code Generation CodeR: Issue Resolving with Multi-Agent and Task Graphs

Reference 12

Resolution
unresolved
no resolver link, observed 2026-08-06T11:44:33.935674Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T11:44:33.935674Z digest=sha256:15990b429161d820f672aa8527d137485609fbe6c251f218938f7e2f1fb5db3f

Observation ffa315e2-5cdd-473a-bb68-ea81626204e8 · outbound

This paper cites Evaluating Large Language Models Trained on Code.

IFEvalCode: Controlled Code Generation Evaluating Large Language Models Trained on Code

Reference 14

Resolution
unresolved
no resolver link, observed 2026-08-06T11:44:33.942269Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T11:44:33.942269Z digest=sha256:fc13e14868c2528789987021b6c94c22a000f5de456d592bd60d283a773d4a7f

Observation 0f7da07a-f020-4aed-9382-c8018de1d572 · outbound

This paper cites Large language models are zero-shot fuzzers: Fuzzing deep-learning libraries via large language models.

IFEvalCode: Controlled Code Generation Large language models are zero-shot fuzzers: Fuzzing deep-learning libraries via large language models

Reference 15

Resolution
unresolved
no resolver link, observed 2026-08-06T11:44:33.945067Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T11:44:33.945067Z digest=sha256:170021746e0519c3ad9eebc1cad63f1c9f842481e7da47051738d3905fa5cc35

Observation 148a721a-d7c8-417f-8f0b-b02daf97b67e · outbound

This paper cites BERT: pre-training of deep bidirectional transformers for language understanding.

IFEvalCode: Controlled Code Generation BERT: pre-training of deep bidirectional transformers for language understanding

Reference 16

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T11:44:34.966709Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-06T11:44:33.948449Z digest=sha256:9045571d469e7a4e78b6fe58ca50195895182dde55f20c37feabc07ec757355f

Observation b20d0f6b-0d68-4750-96c0-db1bc09ec681 · outbound

This paper cites Codebert: A pre-trained model for programming and natural languages.

IFEvalCode: Controlled Code Generation Codebert: A pre-trained model for programming and natural languages

Reference 17

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T11:44:34.955570Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-06T11:44:33.951178Z digest=sha256:8142b1479a4e9145c385f8700f0fa4000e735ac6234a93abd2491928e7cd9771

Observation cdf36e89-8c02-4a28-923f-64d8238ca220 · outbound

This paper cites Gemma: Open Models Based on Gemini Research and Technology.

IFEvalCode: Controlled Code Generation Gemma: Open Models Based on Gemini Research and Technology

Reference 18

Resolution
unresolved
no resolver link, observed 2026-08-06T11:44:33.953910Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T11:44:33.953910Z digest=sha256:b506a6c23cdc68a4449a24fff0a56674268b12dad8500e2879f60a2f3aa59267

Observation 778c414e-befc-4378-9c5d-0c3cc238de8c · outbound

This paper cites The Counterfeit Conundrum: Can Code Language Models Grasp the Nuances of Their Incorrect Generations?.

IFEvalCode: Controlled Code Generation The Counterfeit Conundrum: Can Code Language Models Grasp the Nuances of Their Incorrect Generations?

Reference 19

Resolution
unresolved
no resolver link, observed 2026-08-06T11:44:33.957061Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T11:44:33.957061Z digest=sha256:21748dd1e2dea072465992571105f4023ed58c94bef6ad893e95ffb221309b8c

Observation 5600bca9-d8cf-4c5c-a332-6ddf35b86b85 · outbound

This paper cites Cruxeval: A benchmark for code reasoning, understanding and execution.

IFEvalCode: Controlled Code Generation Cruxeval: A benchmark for code reasoning, understanding and execution

Reference 20

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T11:44:34.945203Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-06T11:44:33.959914Z digest=sha256:b217c424002b395744e8f44dbe4518d11f6b5f66111e027ce5666ea00d04431d

Observation 0b498e57-2deb-4ca9-b3f6-d5e68945a35d · outbound

This paper cites DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning.

IFEvalCode: Controlled Code Generation DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning

Reference 21

Resolution
unresolved
no resolver link, observed 2026-08-06T11:44:33.962752Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T11:44:33.962752Z digest=sha256:c7905a0acc40e0fb8002e5c6ca769745e6e6505e8f6290bec85090e3de51e94d

Observation a057b0ce-536b-48ec-9221-fdead6e12435 · outbound

This paper cites DeepSeek-Coder: When the Large Language Model Meets Programming -- The Rise of Code Intelligence.

IFEvalCode: Controlled Code Generation DeepSeek-Coder: When the Large Language Model Meets Programming -- The Rise of Code Intelligence

Reference 22

Resolution
unresolved
no resolver link, observed 2026-08-06T11:44:33.965729Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T11:44:33.965729Z digest=sha256:fc1e1c76a75193b16da4a9ea85b74716ece5c818f22bb6cee359367c581518fe

Observation 5f913df0-5f5a-4f54-9e18-336c9aecf12b · outbound

This paper cites OpenCoder: The Open Cookbook for Top-Tier Code Large Language Models.

IFEvalCode: Controlled Code Generation OpenCoder: The Open Cookbook for Top-Tier Code Large Language Models

Reference 23

Resolution
unresolved
no resolver link, observed 2026-08-06T11:44:33.968595Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T11:44:33.968595Z digest=sha256:e1e5bb2f357fc80a380b564f26607ffd434e687c691e2fcdb0954a04ece913ff

Observation b699703f-49df-44ab-a06f-a4748ac70d0b · outbound

This paper cites Qwen2.5-Coder Technical Report.

IFEvalCode: Controlled Code Generation Qwen2.5-Coder Technical Report

Reference 26

Resolution
unresolved
no resolver link, observed 2026-08-06T11:44:33.977919Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T11:44:33.977919Z digest=sha256:379349c57d69456b4afade97c910ee1fc479d05c335240971a963457ea2e28c3

Observation deb1175b-56d1-4853-9012-5bdf2720c268 · outbound

This paper cites OpenAI o1 System Card.

IFEvalCode: Controlled Code Generation OpenAI o1 System Card

Reference 27

Resolution
unresolved
no resolver link, observed 2026-08-06T11:44:33.980473Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T11:44:33.980473Z digest=sha256:ba14346156813782ba31aac5365840a5da023ff1f6cf7a9bda6b6e1e9531139d

Observation ff729ac6-a93f-4df9-9d11-a1a72213a093 · outbound

This paper cites LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Code.

IFEvalCode: Controlled Code Generation LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Code

Reference 28

Resolution
unresolved
no resolver link, observed 2026-08-06T11:44:33.983541Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T11:44:33.983541Z digest=sha256:6a867e3b65150aa3339c424724a43041d3f7cd7a8a081c8f76928dea6f588a2d

Observation 3a93902b-3557-45ed-b715-cce83aeb19a3 · outbound

This paper cites SWE-bench: Can Language Models Resolve Real-World GitHub Issues?.

IFEvalCode: Controlled Code Generation SWE-bench: Can Language Models Resolve Real-World GitHub Issues?

Reference 29

Resolution
unresolved
no resolver link, observed 2026-08-06T11:44:33.986613Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T11:44:33.986613Z digest=sha256:bf5ace32fefb9413c624f134e36187dd96be1926770c1be13c7b871a4f1aa9a5

Observation 3767eb63-a810-494b-ab5f-cf4329209d74 · outbound

This paper cites xCodeEval: A Large Scale Multilingual Multitask Benchmark for Code Understanding, Generation, Translation and Retrieval.

IFEvalCode: Controlled Code Generation xCodeEval: A Large Scale Multilingual Multitask Benchmark for Code Understanding, Generation, Translation and Retrieval

Reference 30

Resolution
unresolved
no resolver link, observed 2026-08-06T11:44:33.989642Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T11:44:33.989642Z digest=sha256:d5e9ad9b601904ea60a823354fc6427753136ef323b32dc7d5a9d6da30974064

Observation 6306c10a-684f-4788-a908-f8a398318d00 · outbound

This paper cites Wang, and Tao Yu.

IFEvalCode: Controlled Code Generation Wang, and Tao Yu

Reference 31

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T11:44:34.934720Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-06T11:44:33.993232Z digest=sha256:ff7ca28b7bcf20d69813d0eb9ad90946765b65d6fea5254926d9a4764f813d92

Observation 6484caf8-ed1d-4fec-b317-d68421e08f8b · outbound

This paper cites StarCoder: may the source be with you!.

IFEvalCode: Controlled Code Generation StarCoder: may the source be with you!

Reference 32

Resolution
unresolved
no resolver link, observed 2026-08-06T11:44:33.996518Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T11:44:33.996518Z digest=sha256:76a974f99614fb4a7d35bb6c1864f721dfae2f7ec4e71edcbb89fffbe0d47ee2

Observation a73de673-870e-4c52-b245-396a9c0d9ea2 · outbound

This paper cites Competition-Level Code Generation with AlphaCode.

IFEvalCode: Controlled Code Generation Competition-Level Code Generation with AlphaCode

Reference 33

Resolution
unresolved
no resolver link, observed 2026-08-06T11:44:33.999631Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T11:44:33.999631Z digest=sha256:0efd53ee2f7b2ac68761db28af1d24d16c2e0167faacc589ed312fbac4fde10a

Observation e4ec9551-eb9f-42f8-8a87-a18bd4ec5166 · outbound

This paper cites AutoKaggle: A Multi-Agent Framework for Autonomous Data Science Competitions.

IFEvalCode: Controlled Code Generation AutoKaggle: A Multi-Agent Framework for Autonomous Data Science Competitions

Reference 34

Resolution
unresolved
no resolver link, observed 2026-08-06T11:44:34.002594Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T11:44:34.002594Z digest=sha256:8ec1e0dc961b1161be7f6f39f5cab9dabc09815ce0ec01e1b7ed46c6a2aceaa1

Observation d01cea9e-00d7-4d9f-bab5-0f83c09e68fd · outbound

This paper cites Quixbugs: a multi- lingual program repair benchmark set based on the quixey challenge.

IFEvalCode: Controlled Code Generation Quixbugs: a multi- lingual program repair benchmark set based on the quixey challenge

Reference 35

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T11:44:34.923989Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-06T11:44:34.005809Z digest=sha256:0b49681d337cdb787033893bb8ecbaafa98582a018f117bc58f681cf8dfec567

Observation e9650e24-cbf3-405d-952b-7877e14a26b4 · outbound

This paper cites DeepSeek-V3 Technical Report.

IFEvalCode: Controlled Code Generation DeepSeek-V3 Technical Report

Reference 36

Resolution
unresolved
no resolver link, observed 2026-08-06T11:44:34.008468Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T11:44:34.008468Z digest=sha256:ed1cdea26ed07f32d10e3d9ba9afad1b35ab1390e2a578941979459b17fe209a

Observation e4d4cff7-bc60-480a-b542-f557db50255e · outbound

This paper cites Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation.

IFEvalCode: Controlled Code Generation Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation

Reference 37

Resolution
unresolved
no resolver link, observed 2026-08-06T11:44:34.011164Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T11:44:34.011164Z digest=sha256:5ca0f13e6454f8554c920a4ac4cf8d2d52cb3c4843928b82d620b424f8e1525a

Observation c8b9f4fd-2e53-4df6-b04d-0659926fbb87 · outbound

This paper cites MdEval: Massively Multilingual Code Debugging.

IFEvalCode: Controlled Code Generation MdEval: Massively Multilingual Code Debugging

Reference 39

Resolution
unresolved
no resolver link, observed 2026-08-06T11:44:34.018182Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T11:44:34.018182Z digest=sha256:f227118ad5e6d8b2c176c4d565f657ccda0e87b93409fd4659e9b097c59c3e91

Observation cc06240c-ddf5-42b5-bc80-efc8a971c01d · outbound

This paper cites FullStack Bench: Evaluating LLMs as Full Stack Coders.

IFEvalCode: Controlled Code Generation FullStack Bench: Evaluating LLMs as Full Stack Coders

Reference 40

Resolution
unresolved
no resolver link, observed 2026-08-06T11:44:34.021098Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T11:44:34.021098Z digest=sha256:9c42aed2e94cb27e7dccf8059422ff4dd0df16e71313e755b73049c1f3a88eea

Observation 693eb746-7bc5-4985-b17d-d386f377d4aa · outbound

This paper cites Decoupled Weight Decay Regularization.

IFEvalCode: Controlled Code Generation Decoupled Weight Decay Regularization

Reference 41

Resolution
unresolved
no resolver link, observed 2026-08-06T11:44:34.024212Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T11:44:34.024212Z digest=sha256:d1bdbee3a2251d7c61b6b549387ecaf1a048b334e7049e2d36f2191b2cc14e5c

Observation 80588d29-a675-4413-813a-dae8a1df0663 · outbound

This paper cites StarCoder 2 and The Stack v2: The Next Generation.

IFEvalCode: Controlled Code Generation StarCoder 2 and The Stack v2: The Next Generation

Reference 42

Resolution
unresolved
no resolver link, observed 2026-08-06T11:44:34.027525Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T11:44:34.027525Z digest=sha256:a8b7264f9fc5fe2d8bbcc191128d99b78d20eb484b895f204b25f3dda1563945

Observation 38c74e37-176f-4773-b5db-28f79a0ebfde · outbound

This paper cites GPT-4 Technical Report.

IFEvalCode: Controlled Code Generation GPT-4 Technical Report

Reference 43

Resolution
unresolved
no resolver link, observed 2026-08-06T11:44:34.030436Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T11:44:34.030436Z digest=sha256:6a53a004b54a1136ef794cd5c7e0218dc4ae2ea4e60ba15033f898c6b8ad73d3

Observation 4bfff7d9-29d6-462c-ba0c-1005aa520f37 · outbound

This paper cites Introducing gpt-4.5, 2025.

IFEvalCode: Controlled Code Generation Introducing gpt-4.5, 2025

Reference 44

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T11:44:34.914359Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-06T11:44:34.033434Z digest=sha256:c863bcbf01e63ea21e8affac4ecca8c6c9177b2e818844b19cfed282ea0e1f25

Observation 876b9b81-71c4-448f-8eac-77ea6c081128 · outbound

This paper cites Measuring the impact of programming language distribution.

IFEvalCode: Controlled Code Generation Measuring the impact of programming language distribution

Reference 45

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T11:44:34.904759Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-06T11:44:34.036701Z digest=sha256:02cb380c41d9f08a4e9603170d3731aa4a4b1f0486993276fb9dd17ac812d599

Observation 24a17240-c4ed-4d38-ba41-796d63c0ff58 · outbound

This paper cites HumanEval-XL: A Multilingual Code Generation Benchmark for Cross-lingual Natural Language Generalization.

IFEvalCode: Controlled Code Generation HumanEval-XL: A Multilingual Code Generation Benchmark for Cross-lingual Natural Language Generalization

Reference 46

Resolution
unresolved
no resolver link, observed 2026-08-06T11:44:34.039524Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T11:44:34.039524Z digest=sha256:f8839b83d21b983c8d4d3dd047dde485d2b0823589f6fc29018d8e6b6c3710d8

Observation 251d32d9-d7f6-464f-98f6-a6760529860f · outbound

This paper cites Deepbugs: A learning approach to name-based bug detection.

IFEvalCode: Controlled Code Generation Deepbugs: A learning approach to name-based bug detection

Reference 47

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T11:44:34.894214Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-06T11:44:34.042559Z digest=sha256:cbfdd4ead7e8618c2d33a6db7d1110428d8498780904de3d95e70b737c73c5aa

Observation 168577c1-3494-40ef-9252-b04c4d93f294 · outbound

This paper cites Can openai’s codex fix bugs? an evaluation on quixbugs.

IFEvalCode: Controlled Code Generation Can openai’s codex fix bugs? an evaluation on quixbugs

Reference 48

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T11:44:34.883656Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-06T11:44:34.045483Z digest=sha256:60fb01376467571120eea246d846771db724846153727c27b279d3a895840b49

Observation 7d4685ae-a6ba-4211-88fa-5b2236f47e3b · outbound

This paper cites RunBugRun -- An Executable Dataset for Automated Program Repair.

IFEvalCode: Controlled Code Generation RunBugRun -- An Executable Dataset for Automated Program Repair

Reference 49

Resolution
unresolved
no resolver link, observed 2026-08-06T11:44:34.048317Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T11:44:34.048317Z digest=sha256:de9e79c3233205da79b62d9a6834c836d9392d541fbb391b97ab9fe1eca1a7f1

Observation 1e07aeb6-7577-4eec-a152-401656ddacac · outbound

This paper cites CodeElo: Benchmarking Competition-level Code Generation of LLMs with Human-comparable Elo Ratings.

IFEvalCode: Controlled Code Generation CodeElo: Benchmarking Competition-level Code Generation of LLMs with Human-comparable Elo Ratings

Reference 50

Resolution
unresolved
no resolver link, observed 2026-08-06T11:44:34.051268Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T11:44:34.051268Z digest=sha256:024517a6131d3d56e89a51e1a893b8920df54718add63db122cae0cb368c568e

Observation d51c59f4-9e7d-40b3-9e2c-d8d97992a772 · outbound

This paper cites Improving language understanding by generative pre-training.

IFEvalCode: Controlled Code Generation Improving language understanding by generative pre-training

Reference 51

Resolution
unresolved
no resolver link, observed 2026-08-06T11:44:34.054170Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T11:44:34.054170Z digest=sha256:cd50acaf99acc558552d4f563cf18fb0f1adc6a09281edd0044975d79ad58302

Observation 9d659666-6f7a-4427-a0bb-3795ca2f202a · outbound

This paper cites Code Llama: Open Foundation Models for Code.

IFEvalCode: Controlled Code Generation Code Llama: Open Foundation Models for Code

Reference 52

Resolution
unresolved
no resolver link, observed 2026-08-06T11:44:34.056924Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T11:44:34.056924Z digest=sha256:1724f2c71a869c8a9c5e328230b8345f1248c7b36d3ec53d631fc50e39858cab

Observation c0ee4cdf-d920-4019-8e31-68a27e62ecfe · outbound

This paper cites Code llama: Open foundation models for code.

IFEvalCode: Controlled Code Generation Code llama: Open foundation models for code

Reference 53

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T11:44:34.866897Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-06T11:44:34.059906Z digest=sha256:96820a24d3799dd9e356941aa2c4fa91d44b57f2c8b4bd02bb918e169309c6e9

Observation 479820ba-01ca-44dd-a7ac-9a04766bf366 · outbound

This paper cites BLOOM: A 176B-Parameter Open-Access Multilingual Language Model.

IFEvalCode: Controlled Code Generation BLOOM: A 176B-Parameter Open-Access Multilingual Language Model

Reference 54

Resolution
unresolved
no resolver link, observed 2026-08-06T11:44:34.062586Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T11:44:34.062586Z digest=sha256:7f129d7c61e13ceda2d7c951d3fbe62658a06870e8aa60109f47b71e01ba5477

Observation f7e94bf1-a015-426f-b753-58859c757742 · outbound

This paper cites An analysis of the automatic bug fixing performance of chatgpt.

IFEvalCode: Controlled Code Generation An analysis of the automatic bug fixing performance of chatgpt

Reference 55

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T11:44:34.856378Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-06T11:44:34.066089Z digest=sha256:cd11c8a3e0bb64e89ea4b671e31288c42b44ed9d87a1daa8a061885d284fa6fd

Observation 9a6340c3-009c-4a74-a149-3e50282c6250 · outbound

This paper cites TableGPT2: A Large Multimodal Model with Tabular Data Integration.

IFEvalCode: Controlled Code Generation TableGPT2: A Large Multimodal Model with Tabular Data Integration

Reference 56

Resolution
unresolved
no resolver link, observed 2026-08-06T11:44:34.069005Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T11:44:34.069005Z digest=sha256:f3aaf8e122509a67b90e7c339306cd3c3dc71991c2fde006052ae6c8b836fbcd

Observation b7016602-e6fe-4c45-b3b5-3fd720fca8bf · outbound

This paper cites UniCoder: Scaling code large language model via universal code.

IFEvalCode: Controlled Code Generation UniCoder: Scaling code large language model via universal code

Reference 57

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T11:44:34.846151Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-06T11:44:34.071805Z digest=sha256:0e30d1c9ce768ec3a38a471c84af5a4bf1bf7a26a2dd76ddbbac91c0851ea813

Observation 4149321e-2e6f-441c-891d-ccfc7248a5cc · outbound

This paper cites Bugs in large language models generated code: An empirical study.

IFEvalCode: Controlled Code Generation Bugs in large language models generated code: An empirical study

Reference 58

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T11:44:34.836045Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-06T11:44:34.074394Z digest=sha256:15b22c9ef4f2a0cbaafe7ed37fb20958ae83e214643344d591cab44a8cc34ef0

Observation f962a576-452d-4071-804d-1b6bbbdc35f7 · outbound

This paper cites MAGIS: LLM-Based Multi-Agent Framework for GitHub Issue Resolution.

IFEvalCode: Controlled Code Generation MAGIS: LLM-Based Multi-Agent Framework for GitHub Issue Resolution

Reference 59

Resolution
unresolved
no resolver link, observed 2026-08-06T11:44:34.077446Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T11:44:34.077446Z digest=sha256:cbe3502f95663a2e1cc06c43a2f06a2c3b24fe728548dfcded13f6e0f4836adf

Observation 503f05db-9fab-434d-8262-f0ac38f4ae8e · outbound

This paper cites DebugBench: Evaluating Debugging Capability of Large Language Models.

IFEvalCode: Controlled Code Generation DebugBench: Evaluating Debugging Capability of Large Language Models

Reference 60

Resolution
unresolved
no resolver link, observed 2026-08-06T11:44:34.080293Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T11:44:34.080293Z digest=sha256:82b54e2b92e805ce964006072af20878c71e4b7e30a2731af88c2b3aa78aaa5b

Observation b78dfbb9-f9db-4148-9578-843008eeb680 · outbound

This paper cites Llama 2: Open Foundation and Fine-Tuned Chat Models.

IFEvalCode: Controlled Code Generation Llama 2: Open Foundation and Fine-Tuned Chat Models

Reference 61

Resolution
unresolved
no resolver link, observed 2026-08-06T11:44:34.083297Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T11:44:34.083297Z digest=sha256:503562e648a1cf9d1b3a61ada3217fc80ae7ab835ecdcd4a854281abbc141dff

Observation 2d9d2f5f-48de-4e6e-8ddf-559f726cea5a · outbound

This paper cites CodeT5: Identifier-aware Unified Pre-trained Encoder-Decoder Models for Code Understanding and Generation.

IFEvalCode: Controlled Code Generation CodeT5: Identifier-aware Unified Pre-trained Encoder-Decoder Models for Code Understanding and Generation

Reference 62

Resolution
unresolved
no resolver link, observed 2026-08-06T11:44:34.086522Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T11:44:34.086522Z digest=sha256:5b6089e687567bb023d89569d92fd4c71653599c87405385d98315c9311949b1

Observation af89213e-c3c5-4ced-9cf6-1b78822ece50 · outbound

This paper cites Towards Understanding the Characteristics of Code Generation Errors Made by Large Language Models.

IFEvalCode: Controlled Code Generation Towards Understanding the Characteristics of Code Generation Errors Made by Large Language Models

Reference 63

Resolution
unresolved
no resolver link, observed 2026-08-06T11:44:34.089621Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T11:44:34.089621Z digest=sha256:f10bc9a7125ac60d22365cb2e8fb95b26b4042244b9f75d3450ef7ed27c7bdf4

Observation ab989e33-9bb8-4e70-8eda-ee8788613bda · outbound

This paper cites Fixing Function-Level Code Generation Errors for Foundation Large Language Models.

IFEvalCode: Controlled Code Generation Fixing Function-Level Code Generation Errors for Foundation Large Language Models

Reference 64

Resolution
unresolved
no resolver link, observed 2026-08-06T11:44:34.093023Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T11:44:34.093023Z digest=sha256:40899ca27a015b0e0414dd25f31d71a3339d9a9599e9febb538e5efe8ce2393e

Observation 28813f0b-f4ec-48ff-b742-b83bb72bde2c · outbound

This paper cites TableBench: A Comprehensive and Complex Benchmark for Table Question Answering.

IFEvalCode: Controlled Code Generation TableBench: A Comprehensive and Complex Benchmark for Table Question Answering

Reference 65

Resolution
unresolved
no resolver link, observed 2026-08-06T11:44:34.096049Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T11:44:34.096049Z digest=sha256:5ae835b7baaeafc80c03d2c1afcf384aaff7deb366bf9f4bc880899668245041

Observation f21a47c3-c5a2-4814-a984-2caef03010ca · outbound

This paper cites Fuzz4all: Universal fuzzing with large language models.

IFEvalCode: Controlled Code Generation Fuzz4all: Universal fuzzing with large language models

Reference 66

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T11:44:34.826174Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-06T11:44:34.099015Z digest=sha256:2d752f12058dd32659149f4bade368cf01ff6dad1b74b6de0201458b2ff92a21

Observation 34ebc2de-27e2-4f9b-8c36-4884c5a170f9 · outbound

This paper cites Conversational Automated Program Repair.

IFEvalCode: Controlled Code Generation Conversational Automated Program Repair

Reference 67

Resolution
unresolved
no resolver link, observed 2026-08-06T11:44:34.101527Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T11:44:34.101527Z digest=sha256:4394c69ccda1b98e91dc70cf0f99667224d47157e0c0a7ea98ab409a7e9efaf2

Observation e72084b2-dd24-4550-9c64-bec2c7bafd28 · outbound

This paper cites CodeTransOcean: A comprehensive multilingual benchmark for code translation.

IFEvalCode: Controlled Code Generation CodeTransOcean: A comprehensive multilingual benchmark for code translation

Reference 68

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T11:44:34.815921Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-06T11:44:34.104752Z digest=sha256:22ebdc8c07518ab8afe8e82cfa43d80b61bfc7da16e3732708769d9b0949c448

Observation 204c6c90-24da-40c6-ac65-6bd1a87dc8bf · outbound

This paper cites Evaluating and Aligning CodeLLMs on Human Preference.

IFEvalCode: Controlled Code Generation Evaluating and Aligning CodeLLMs on Human Preference

Reference 69

Resolution
unresolved
no resolver link, observed 2026-08-06T11:44:34.107700Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T11:44:34.107700Z digest=sha256:53d596871606fbe8f4b63d8c0285a92bb0a2be35f2b720460958d9716f26decb

Observation aa17bbc9-7d08-4266-ae45-1a641dd568aa · outbound

This paper cites FuzzCoder: Byte-level Fuzzing Test via Large Language Model.

IFEvalCode: Controlled Code Generation FuzzCoder: Byte-level Fuzzing Test via Large Language Model

Reference 70

Resolution
unresolved
no resolver link, observed 2026-08-06T11:44:34.110841Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T11:44:34.110841Z digest=sha256:9c621893581c5945c4efc8926d5f1d659f6f05c906cf5724372250199a2c442c

Observation fdc1b170-28b8-486d-abf5-3c18a6694d8e · outbound

This paper cites COAST: Enhancing the Code Debugging Ability of LLMs through Communicative Agent Based Data Synthesis.

IFEvalCode: Controlled Code Generation COAST: Enhancing the Code Debugging Ability of LLMs through Communicative Agent Based Data Synthesis

Reference 71

Resolution
unresolved
no resolver link, observed 2026-08-06T11:44:34.114160Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T11:44:34.114160Z digest=sha256:127df09a87f70b364ec7a56730a9e09d7dc04f558eba301e12401e53ffcc6ea4

Observation 80db9502-0f9a-4f60-8e07-90fc173b4009 · outbound

This paper cites Natural language to code generation in interactive data science notebooks.

IFEvalCode: Controlled Code Generation Natural language to code generation in interactive data science notebooks

Reference 72

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T11:44:34.806079Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-06T11:44:34.117617Z digest=sha256:6e6a3297a82908a450dcc058e4a8144b8a0f30d9841eaf7d350d66cd467b9a83

Observation 17cf36fb-dcff-4c15-a521-0592126c7729 · outbound

This paper cites Codereval: A benchmark of pragmatic code generation with generative pre-trained models.

IFEvalCode: Controlled Code Generation Codereval: A benchmark of pragmatic code generation with generative pre-trained models

Reference 73

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T11:44:34.795466Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-06T11:44:34.120385Z digest=sha256:8b1befb2c170cb21e0bfac1ccdd8df42c48964ccd4ac3c2623cf7503a9be9ac9

Observation 206e38da-14f4-4e7e-9702-a5b07d5bf678 · outbound

This paper cites Evaluating Instruction-Tuned Large Language Models on Code Comprehension and Generation.

IFEvalCode: Controlled Code Generation Evaluating Instruction-Tuned Large Language Models on Code Comprehension and Generation

Reference 74

Resolution
unresolved
no resolver link, observed 2026-08-06T11:44:34.123108Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T11:44:34.123108Z digest=sha256:fe4ce259bb8ca984b922658fabb9ca8af806b63d8657b1ab70dcfc41ecd31858

Observation 33721b64-c380-41c5-a00a-e4e9b6b54103 · outbound

This paper cites MAmmoTH2: Scaling Instructions from the Web.

IFEvalCode: Controlled Code Generation MAmmoTH2: Scaling Instructions from the Web

Reference 75

Resolution
unresolved
no resolver link, observed 2026-08-06T11:44:34.126248Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T11:44:34.126248Z digest=sha256:2e8e473a9fc20288d1c5a2c7f3d42b469a1284abc286fc67f493f9caaf799174

Observation 5fcfa97e-8831-4857-aefd-b09a7e658211 · outbound

This paper cites Prompt-enhanced software vulnerability detection using chatgpt.

IFEvalCode: Controlled Code Generation Prompt-enhanced software vulnerability detection using chatgpt

Reference 76

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T11:44:34.785555Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-06T11:44:34.129352Z digest=sha256:9fe3b532fb6ad34105b107839b29d31b0d04ce1b2cb7ef2e2c420bedeb5fb84f

Observation 7a2ee541-305b-43b5-91e4-ac7a8fcda50c · outbound

This paper cites RepoCoder: Repository-Level Code Completion Through Iterative Retrieval and Generation.

IFEvalCode: Controlled Code Generation RepoCoder: Repository-Level Code Completion Through Iterative Retrieval and Generation

Reference 77

Resolution
unresolved
no resolver link, observed 2026-08-06T11:44:34.132984Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T11:44:34.132984Z digest=sha256:318de46e2561f16192cebc6df7ca0b89ed3975b3f30cf6f3a1fb87deed85c3f6

Observation 0e2c3d9a-3222-43e7-b1ea-822612aa3606 · outbound

This paper cites A Critical Review of Large Language Model on Software Engineering: An Example from ChatGPT and Automated Program Repair.

IFEvalCode: Controlled Code Generation A Critical Review of Large Language Model on Software Engineering: An Example from ChatGPT and Automated Program Repair

Reference 78

Resolution
unresolved
no resolver link, observed 2026-08-06T11:44:34.136098Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T11:44:34.136098Z digest=sha256:3bdad235d374c1dd5c9d41c2449cdbef39497d413d9575372180830018ecbca3

Observation 852763eb-388f-4f56-a45b-c50e763b21d6 · outbound

This paper cites NaturalCodeBench: Examining Coding Performance Mismatch on HumanEval and Natural User Prompts.

IFEvalCode: Controlled Code Generation NaturalCodeBench: Examining Coding Performance Mismatch on HumanEval and Natural User Prompts

Reference 79

Resolution
unresolved
no resolver link, observed 2026-08-06T11:44:34.139423Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T11:44:34.139423Z digest=sha256:65f09552e1b448ae75d958aba890d6a39969fc288fd1215ed5a02202702d7928

Observation b9ad5ffd-16ca-4124-b89b-c3c53f724865 · outbound

This paper cites Judging llm-as-a-judge with mt-bench and chatbot arena.

IFEvalCode: Controlled Code Generation Judging llm-as-a-judge with mt-bench and chatbot arena

Reference 80

Resolution
unresolved
no resolver link, observed 2026-08-06T11:44:34.142536Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T11:44:34.142536Z digest=sha256:0ce10b375a84e276d7d79b226c8fe33d99d7748d52124d5da89d012cf5f2a60b

Observation 509c10e8-28c6-4bcf-8dbc-b00e2bb83aec · outbound

This paper cites CodeGeeX: A Pre-Trained Model for Code Generation with Multilingual Benchmarking on HumanEval-X.

IFEvalCode: Controlled Code Generation CodeGeeX: A Pre-Trained Model for Code Generation with Multilingual Benchmarking on HumanEval-X

Reference 82

Resolution
unresolved
no resolver link, observed 2026-08-06T11:44:34.148774Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T11:44:34.148774Z digest=sha256:ab636c5f9ee3fe0e0c42ea2f2086be276cd77b11f059717ef080d076335a50ac

Observation 4ebef622-4814-4549-af3d-e66d9a735f52 · outbound

This paper cites Kun: Answer Polishment for Chinese Self-Alignment with Instruction Back-Translation.

IFEvalCode: Controlled Code Generation Kun: Answer Polishment for Chinese Self-Alignment with Instruction Back-Translation

Reference 83

Resolution
verified exact
local_arxiv, observed 2026-08-06T11:44:34.293599Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-06T11:44:34.151738Z digest=sha256:6f71f07a8342cca08256dcc2932646656dfc1f3f6592638ea4588228f8e2619d

Observation 44b0c14f-de6e-4c33-9496-151764e9cf70 · outbound

This paper cites Advancing bug detection in fastjson2 with large language models driven unit test generation.

IFEvalCode: Controlled Code Generation Advancing bug detection in fastjson2 with large language models driven unit test generation

Reference 84

Resolution
verified exact
raw_fallback, observed 2026-08-06T11:44:34.277834Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-06T11:44:34.155183Z digest=sha256:2f49c73684cda4d42b63085219cec873a88fdf364f72292f68eaaa28557612bc

Observation 9f100bc8-ef8d-492e-8428-cf0450c25456 · outbound

This paper cites Instruction-Following Evaluation for Large Language Models.

IFEvalCode: Controlled Code Generation Instruction-Following Evaluation for Large Language Models

Reference 85

Resolution
unresolved
no resolver link, observed 2026-08-06T11:44:34.158059Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T11:44:34.158059Z digest=sha256:ba20d7783cdc8d5d87c576f23c6d7299e13481f7ab5a49e17f6712c31a48c160

Observation a00e778a-58a7-4bda-b05a-7dba11cab770 · outbound

This paper cites BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructions.

IFEvalCode: Controlled Code Generation BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructions

Reference 86

Resolution
unresolved
no resolver link, observed 2026-08-06T11:44:34.161071Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T11:44:34.161071Z digest=sha256:a75683fbd48880c3543ac24b5f5aa523eed40d78b940dc0a68d4c60ac06c798e

Pith citing papers

Observation 4758e4af-8282-45aa-9616-4a8647fcf296 · inbound

Inverse IFEval: Can LLMs Unlearn Stubborn Training Conventions to Follow Real Instructions? cites this paper.

Inverse IFEval: Can LLMs Unlearn Stubborn Training Conventions to Follow Real Instructions? IFEvalCode: Controlled Code Generation

Reference 31

Resolution
unresolved
no resolver link, observed 2026-08-05T10:16:51.306423Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-05T10:16:51.306423Z digest=sha256:26d3d118a6f2e605d703680fdb2596d6921a385920b08421a80e955ba621df3d

Observation ebbc2e6e-0aba-496e-b0b6-aaf38c03ca96 · inbound

Steerable Instruction Following Coding Data Synthesis with Actor-Parametric Schema Co-Evolution cites this paper.

Steerable Instruction Following Coding Data Synthesis with Actor-Parametric Schema Co-Evolution IFEvalCode: Controlled Code Generation

Reference 34

Resolution
verified exact
arxiv_id, observed 2026-05-15T18:01:25.421896Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-05-15T18:00:39.404711Z digest=sha256:4f88132fa78ea80f1e55aa2a84d847fe1fbbcd627d07933a2b8bd7320c2bd9f2