SONAR: Task-Aware Code Summary Evaluation for LLM Consumers Without References | Paper Citation Record

Observation 2a5364de-c8d9-4ebf-80a8-77fd376c18a6 · outbound

This paper cites A Survey on Machine Learning Techniques for Source Code Analysis.

SONAR: Task-Aware Code Summary Evaluation for LLM Consumers Without References A Survey on Machine Learning Techniques for Source Code Analysis

Reference 1

Resolution: unresolved; no resolver link, observed 2026-08-15T14:48:10.420271Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation e7c1857b-f3c4-434d-9108-6cc2fb0e5aed · outbound

This paper cites Source Code Summarization in the Era of Large Language Models.

SONAR: Task-Aware Code Summary Evaluation for LLM Consumers Without References Source Code Summarization in the Era of Large Language Models

Reference 2

Resolution: unresolved; no resolver link, observed 2026-08-15T14:48:10.425655Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 24a31dbc-54d4-40a1-bb98-6170e2447382 · outbound

This paper cites Calibration of large language models on code summarization,.

SONAR: Task-Aware Code Summary Evaluation for LLM Consumers Without References Calibration of large language models on code summarization,

Reference 3

Resolution: unresolved; no resolver link, observed 2026-08-15T14:48:10.430348Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation e467b685-37d5-4066-9ade-8a4c18d8f3f7 · outbound

This paper cites Bleu: a method for automatic evaluation of machine translation,.

SONAR: Task-Aware Code Summary Evaluation for LLM Consumers Without References Bleu: a method for automatic evaluation of machine translation,

Reference 4

Resolution: unresolved; no resolver link, observed 2026-08-15T14:48:10.434658Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 249460e6-b777-4ce6-ae1b-0cd156886b96 · outbound

This paper cites Simllm: Calculating semantic similarity in code summaries using a large language model-based approach,.

SONAR: Task-Aware Code Summary Evaluation for LLM Consumers Without References Simllm: Calculating semantic similarity in code summaries using a large language model-based approach,

Reference 5

Resolution: verified exact; doi, observed 2026-08-15T14:48:10.797591Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

Observation c01bcd49-f3ab-4bb8-975e-83997036b19e · outbound

This paper cites Evaluating Code Summarization Techniques: A New Metric and an Empirical Characterization.

SONAR: Task-Aware Code Summary Evaluation for LLM Consumers Without References Evaluating Code Summarization Techniques: A New Metric and an Empirical Characterization

Reference 6

Resolution: unresolved; no resolver link, observed 2026-08-15T14:48:10.443137Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation f9c3d10e-7d02-4132-9d0d-e996ad291bf1 · outbound

This paper cites METEOR: An automatic metric for MT evaluation with improved correlation with human judgments,.

SONAR: Task-Aware Code Summary Evaluation for LLM Consumers Without References METEOR: An automatic metric for MT evaluation with improved correlation with human judgments,

Reference 7

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T14:48:12.563284Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

Observation 632d443d-ae30-4dbf-8841-b1a670c4353a · outbound

This paper cites Rouge: A package for automatic evaluation of summaries,.

SONAR: Task-Aware Code Summary Evaluation for LLM Consumers Without References Rouge: A package for automatic evaluation of summaries,

Reference 8

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T14:48:12.540097Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

Observation 5073aef9-4247-4b5d-ae4a-780ea613824a · outbound

This paper cites On the Effectiveness of LLM-as-a-judge for Code Generation and Summarization.

SONAR: Task-Aware Code Summary Evaluation for LLM Consumers Without References On the Effectiveness of LLM-as-a-judge for Code Generation and Summarization

Reference 9

Resolution: unresolved; no resolver link, observed 2026-08-15T14:48:10.455446Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 1510a3ee-8bfb-4415-b560-02723184fd7c · outbound

This paper cites Can large language models serve as evaluators for code summarization?.

SONAR: Task-Aware Code Summary Evaluation for LLM Consumers Without References Can large language models serve as evaluators for code summarization?

Reference 10

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T14:48:12.519395Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

Observation 20847f32-47e3-4c45-8f48-d2443ae49378 · outbound

This paper cites Artificial intelligence for software engi- neering: The journey so far and the road ahead,.

SONAR: Task-Aware Code Summary Evaluation for LLM Consumers Without References Artificial intelligence for software engi- neering: The journey so far and the road ahead,

Reference 11

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T14:48:12.500826Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

Observation 17dc11db-f503-49d2-b6fd-3274f34faf77 · outbound

This paper cites Optimizing Datasets for Code Summarization: Is Code-Comment Coherence Enough?.

SONAR: Task-Aware Code Summary Evaluation for LLM Consumers Without References Optimizing Datasets for Code Summarization: Is Code-Comment Coherence Enough?

Reference 12

Resolution: unresolved; no resolver link, observed 2026-08-15T14:48:10.467087Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 1c3fb1ff-5922-41c9-8b18-197625bd6690 · outbound

This paper cites Unicor: Modality collaboration for robust cross-language hybrid code retrieval,.

SONAR: Task-Aware Code Summary Evaluation for LLM Consumers Without References Unicor: Modality collaboration for robust cross-language hybrid code retrieval,

Reference 13

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T14:48:12.483474Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

Observation 4271ddf4-6e6c-4785-8503-b6ed8ca27834 · outbound

This paper cites Doc2oracll: Investigating the impact of documentation on llm-based test oracle generation,.

SONAR: Task-Aware Code Summary Evaluation for LLM Consumers Without References Doc2oracll: Investigating the impact of documentation on llm-based test oracle generation,

Reference 14

Resolution: unresolved; no resolver link, observed 2026-08-15T14:48:10.479562Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation d670c376-5279-4293-96a2-7ee47f91e977 · outbound

This paper cites Nl in the middle: Code translation with llms and intermediate representations,.

SONAR: Task-Aware Code Summary Evaluation for LLM Consumers Without References Nl in the middle: Code translation with llms and intermediate representations,

Reference 15

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T14:48:12.470163Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

Observation cab6f69e-f4bd-4629-b164-bc33b76231b3 · outbound

This paper cites Summarize and generate to back-translate: Unsupervised translation of programming languages,.

SONAR: Task-Aware Code Summary Evaluation for LLM Consumers Without References Summarize and generate to back-translate: Unsupervised translation of programming languages,

Reference 16

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T14:48:12.455933Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

Observation ec3592b6-89a5-4021-bb67-473e2cbf60e2 · outbound

This paper cites Unsupervised evaluation of code llms with round-trip correctness,.

SONAR: Task-Aware Code Summary Evaluation for LLM Consumers Without References Unsupervised evaluation of code llms with round-trip correctness,

Reference 17

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T14:48:12.441421Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

Observation 97a82b6d-6048-4548-9343-8fb8b41ce3cd · outbound

This paper cites Simple and Effective Baselines for Code Summarisation Evaluation.

SONAR: Task-Aware Code Summary Evaluation for LLM Consumers Without References Simple and Effective Baselines for Code Summarisation Evaluation

Reference 18

Resolution: verified exact; local_arxiv, observed 2026-08-15T14:48:11.929428Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

Observation c7e6f3d9-374f-4b16-82ee-1c1de32151e2 · outbound

This paper cites Beyond Accuracy: Evaluating Self-Consistency of Code Large Language Models with IdentityChain.

SONAR: Task-Aware Code Summary Evaluation for LLM Consumers Without References Beyond Accuracy: Evaluating Self-Consistency of Code Large Language Models with IdentityChain

Reference 19

Resolution: unresolved; no resolver link, observed 2026-08-15T14:48:10.503740Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 4b25ac53-e860-426b-9625-ed4ffb4adaea · outbound

This paper cites Reassessing automatic evaluation metrics for code summarization tasks,.

SONAR: Task-Aware Code Summary Evaluation for LLM Consumers Without References Reassessing automatic evaluation metrics for code summarization tasks,

Reference 20

Resolution: unresolved; no resolver link, observed 2026-08-15T14:48:10.507937Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation ec53721d-ec47-4a8b-b52f-3c034f892e23 · outbound

This paper cites Bertscore: Evaluating text generation with bert,.

SONAR: Task-Aware Code Summary Evaluation for LLM Consumers Without References Bertscore: Evaluating text generation with bert,

Reference 21

Resolution: unresolved; no resolver link, observed 2026-08-15T14:48:10.511860Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation e52ba98f-8fb6-47c1-94c9-5a62aaac74b8 · outbound

This paper cites Bleurt: Learning robust metrics for text generation,.

SONAR: Task-Aware Code Summary Evaluation for LLM Consumers Without References Bleurt: Learning robust metrics for text generation,

Reference 22

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T14:48:12.418960Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

Observation 0d1cfdcd-1a8c-42e8-beef-ed5667339cac · outbound

This paper cites Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks.

SONAR: Task-Aware Code Summary Evaluation for LLM Consumers Without References Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks

Reference 23

Resolution: unresolved; no resolver link, observed 2026-08-15T14:48:10.520657Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 0b6a3606-a82f-400c-8c07-00f854b923b5 · outbound

This paper cites A large-scale empirical study on code-comment inconsistencies,.

SONAR: Task-Aware Code Summary Evaluation for LLM Consumers Without References A large-scale empirical study on code-comment inconsistencies,

Reference 24

Resolution: unresolved; no resolver link, observed 2026-08-15T14:48:10.525983Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation a01a08b5-d30e-4446-a03e-22be3ce95331 · outbound

This paper cites Automated Test Generation from Program Documentation Encoded in Code Comments.

SONAR: Task-Aware Code Summary Evaluation for LLM Consumers Without References Automated Test Generation from Program Documentation Encoded in Code Comments

Reference 25

Resolution: unresolved; no resolver link, observed 2026-08-15T14:48:10.530326Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation a8cac817-34a1-42b0-ac37-4b52b71e8d5c · outbound

This paper cites Automatic generation of oracles for exceptional behaviors,.

SONAR: Task-Aware Code Summary Evaluation for LLM Consumers Without References Automatic generation of oracles for exceptional behaviors,

Reference 26

Resolution: unresolved; no resolver link, observed 2026-08-15T14:48:10.534524Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation bbc6b428-fd31-423e-9af4-490a80fba0ee · outbound

This paper cites An approach of method-level bug localization,.

SONAR: Task-Aware Code Summary Evaluation for LLM Consumers Without References An approach of method-level bug localization,

Reference 27

Resolution: verified exact; doi, observed 2026-08-15T14:48:10.773762Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

Observation 1422a61c-dd28-4eeb-81b5-11e652ccec76 · outbound

This paper cites Natural language summarization enables multi-repository bug localization by llms in microservice architectures,.

SONAR: Task-Aware Code Summary Evaluation for LLM Consumers Without References Natural language summarization enables multi-repository bug localization by llms in microservice architectures,

Reference 28

Resolution: verified exact; raw_fallback, observed 2026-08-15T14:48:11.650503Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

Observation d05e6474-fb21-4f8b-b498-e51b8768e2b4 · outbound

This paper cites Human or LLM? A Comparative Study on Accessible Code Generation Capability.

SONAR: Task-Aware Code Summary Evaluation for LLM Consumers Without References Human or LLM? A Comparative Study on Accessible Code Generation Capability

Reference 29

Resolution: unresolved; no resolver link, observed 2026-08-15T14:48:10.547183Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation f683f13f-b940-49cd-a3de-cd2a417628cb · outbound

This paper cites Inside out: Uncovering how comment internalization steers llms for better or worse,.

SONAR: Task-Aware Code Summary Evaluation for LLM Consumers Without References Inside out: Uncovering how comment internalization steers llms for better or worse,

Reference 30

Resolution: unresolved; no resolver link, observed 2026-08-15T14:48:10.551314Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation b9232efc-9246-4b28-bdcf-17ca231b3d92 · outbound

This paper cites Analyzing and mitigating surface bias in code evaluation metrics,.

SONAR: Task-Aware Code Summary Evaluation for LLM Consumers Without References Analyzing and mitigating surface bias in code evaluation metrics,

Reference 31

Resolution: unresolved; no resolver link, observed 2026-08-15T14:48:10.555599Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 372dfcb4-14d2-41c0-9aef-0457d822a29d · outbound

This paper cites A differential fuzzing-based evaluation of functional equivalence in llm-generated code refactorings,.

SONAR: Task-Aware Code Summary Evaluation for LLM Consumers Without References A differential fuzzing-based evaluation of functional equivalence in llm-generated code refactorings,

Reference 32

Resolution: verified exact; raw_fallback, observed 2026-08-15T14:48:11.395313Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

Observation 613ec06b-4d60-4a14-bdaf-d94dba481623 · outbound

This paper cites CodeBLEU: a Method for Automatic Evaluation of Code Synthesis.

SONAR: Task-Aware Code Summary Evaluation for LLM Consumers Without References CodeBLEU: a Method for Automatic Evaluation of Code Synthesis

Reference 33

Resolution: unresolved; no resolver link, observed 2026-08-15T14:48:10.565089Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation a447d867-b78b-48f9-afa1-22a4186cf002 · outbound

This paper cites CodeSearchNet Challenge: Evaluating the State of Semantic Code Search.

SONAR: Task-Aware Code Summary Evaluation for LLM Consumers Without References CodeSearchNet Challenge: Evaluating the State of Semantic Code Search

Reference 34

Resolution: unresolved; no resolver link, observed 2026-08-15T14:48:10.569101Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation d7dff7d7-4b4f-429b-a22f-5babdf5cd078 · outbound

This paper cites A neural model for generating natural language summaries of program subroutines,.

SONAR: Task-Aware Code Summary Evaluation for LLM Consumers Without References A neural model for generating natural language summaries of program subroutines,

Reference 35

Resolution: unresolved; no resolver link, observed 2026-08-15T14:48:10.573196Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation bc3a79a4-51de-46e4-b1e7-9a8f829a0fce · outbound

This paper cites Joern - the bug hunter’s workbench,.

SONAR: Task-Aware Code Summary Evaluation for LLM Consumers Without References Joern - the bug hunter’s workbench,

Reference 36

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T14:48:12.405433Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

Observation 8053ac61-111a-463e-bc3d-dee563edcc73 · outbound

This paper cites Deep learning code fragments for code clone detection,.

SONAR: Task-Aware Code Summary Evaluation for LLM Consumers Without References Deep learning code fragments for code clone detection,

Reference 37

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T14:48:12.393390Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

Observation 65b87af2-93d0-480c-a83d-e2decd68a9ed · outbound

This paper cites Supervised deep features for software functional clone detection by exploiting lexical and syntactical information in source code,.

SONAR: Task-Aware Code Summary Evaluation for LLM Consumers Without References Supervised deep features for software functional clone detection by exploiting lexical and syntactical information in source code,

Reference 38

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T14:48:12.382689Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

Observation ba10e571-1205-4097-bd0a-1cb00921790a · outbound

This paper cites A systematic literature review on source code similarity measurement and clone detection: Techniques, applications, and challenges,.

SONAR: Task-Aware Code Summary Evaluation for LLM Consumers Without References A systematic literature review on source code similarity measurement and clone detection: Techniques, applications, and challenges,

Reference 39

Resolution: metadata mismatch; raw_fallback, observed 2026-08-15T14:48:11.225856Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

Observation 313fcf24-8cb3-43eb-a4ad-a6c6601f6d63 · outbound

This paper cites Sebyte: Scalable clone and similarity search for bytecode,.

SONAR: Task-Aware Code Summary Evaluation for LLM Consumers Without References Sebyte: Scalable clone and similarity search for bytecode,

Reference 40

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T14:48:12.370874Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

Observation 2e77a828-5c4f-46e1-88b5-92caf5b21a9a · outbound

This paper cites DExperts: Decoding-time controlled text generation with experts and anti-experts,.

SONAR: Task-Aware Code Summary Evaluation for LLM Consumers Without References DExperts: Decoding-time controlled text generation with experts and anti-experts,

Reference 41

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T14:48:12.358970Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

Observation 724d8148-fe51-4538-bafa-5eeb91c2ebd9 · outbound

This paper cites A contrastive framework for neural text generation,.

SONAR: Task-Aware Code Summary Evaluation for LLM Consumers Without References A contrastive framework for neural text generation,

Reference 42

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T14:48:12.346704Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

Observation 600dcc45-b3e0-4070-bb97-608304525de8 · outbound

This paper cites Summarizing source code with transferred api knowledge,.

SONAR: Task-Aware Code Summary Evaluation for LLM Consumers Without References Summarizing source code with transferred api knowledge,

Reference 43

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T14:48:12.335087Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

Observation ad6af319-ba8c-478b-8afc-e8110c5338b4 · outbound

This paper cites A parallel corpus of Python functions and documentation strings for automated code documentation and code generation.

SONAR: Task-Aware Code Summary Evaluation for LLM Consumers Without References A parallel corpus of Python functions and documentation strings for automated code documentation and code generation

Reference 44

Resolution: unresolved; no resolver link, observed 2026-08-15T14:48:10.607922Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 68fcea5b-60f1-4bb7-90dd-b84d02185511 · outbound

This paper cites Evaluating Large Language Models Trained on Code.

SONAR: Task-Aware Code Summary Evaluation for LLM Consumers Without References Evaluating Large Language Models Trained on Code

Reference 45

Resolution: unresolved; no resolver link, observed 2026-08-15T14:48:10.612185Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation c5eafffb-23d2-4e97-af35-d7f2f08ddce0 · outbound

This paper cites Program Synthesis with Large Language Models.

SONAR: Task-Aware Code Summary Evaluation for LLM Consumers Without References Program Synthesis with Large Language Models

Reference 46

Resolution: unresolved; no resolver link, observed 2026-08-15T14:48:10.616191Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 81ca12d9-6f40-427b-957d-a4c99e31fd4f · outbound

This paper cites BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructions.

SONAR: Task-Aware Code Summary Evaluation for LLM Consumers Without References BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructions

Reference 47

Resolution: unresolved; no resolver link, observed 2026-08-15T14:48:10.620014Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 977a9998-81b4-42de-b0d0-6a452b7d21c3 · outbound

This paper cites The vault: A comprehensive multilingual dataset for advancing code understanding and generation,.

SONAR: Task-Aware Code Summary Evaluation for LLM Consumers Without References The vault: A comprehensive multilingual dataset for advancing code understanding and generation,

Reference 48

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T14:48:12.323956Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

Observation 93c0b63f-f616-46a9-8e36-10a09384cb08 · outbound

This paper cites Olmo 3: Charting a path through the model flow to lead open- source ai,.

SONAR: Task-Aware Code Summary Evaluation for LLM Consumers Without References Olmo 3: Charting a path through the model flow to lead open- source ai,

Reference 49

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T14:48:12.310825Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

Observation 47fcc651-540f-4b69-9212-25aeb317dc84 · outbound

This paper cites Bigcodebench (hard) leaderboard,.

SONAR: Task-Aware Code Summary Evaluation for LLM Consumers Without References Bigcodebench (hard) leaderboard,

Reference 50

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T14:48:12.298772Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

Observation 8a793a59-cb89-42b9-9256-6f6be19b8e98 · outbound

This paper cites Docstringeval: Evaluating the effectiveness of language models for code explanation through docstring generation,.

SONAR: Task-Aware Code Summary Evaluation for LLM Consumers Without References Docstringeval: Evaluating the effectiveness of language models for code explanation through docstring generation,

Reference 51

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T14:48:12.285265Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

Observation fb11dabf-d275-484d-a1e6-d841a65f60c4 · outbound

This paper cites Best ai for reasoning in 2026,.

SONAR: Task-Aware Code Summary Evaluation for LLM Consumers Without References Best ai for reasoning in 2026,

Reference 52

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T14:48:12.272577Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

Observation 4821814a-a0dd-4064-8c30-e08b739886b2 · outbound

This paper cites Data augmentation for code translation with comparable corpora and multiple references,.

SONAR: Task-Aware Code Summary Evaluation for LLM Consumers Without References Data augmentation for code translation with comparable corpora and multiple references,

Reference 53

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T14:48:12.258990Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

Observation 07bff73b-281e-421f-97b0-21fd0d51d77d · outbound

This paper cites Who evaluates the evaluators? on automatic metrics for assessing ai-based offensive code generators,.

SONAR: Task-Aware Code Summary Evaluation for LLM Consumers Without References Who evaluates the evaluators? on automatic metrics for assessing ai-based offensive code generators,

Reference 54

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T14:48:12.244833Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

Observation ed2123e5-8c7d-48b8-ab6f-9198e2f74bcc · outbound

This paper cites Coffe: A code efficiency benchmark for code generation,.

SONAR: Task-Aware Code Summary Evaluation for LLM Consumers Without References Coffe: A code efficiency benchmark for code generation,

Reference 55

Resolution: unresolved; no resolver link, observed 2026-08-15T14:48:10.651007Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 41f87812-808d-4e4a-8d60-c15459c4e9b9 · outbound

This paper cites Togll: Correct and strong test oracle generation with llms,.

SONAR: Task-Aware Code Summary Evaluation for LLM Consumers Without References Togll: Correct and strong test oracle generation with llms,

Reference 56

Resolution: unresolved; no resolver link, observed 2026-08-15T14:48:10.657124Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation b93b66ef-e379-46e1-b791-6b409b966cd4 · outbound

This paper cites CoIR: A comprehensive benchmark for code information retrieval models,.

SONAR: Task-Aware Code Summary Evaluation for LLM Consumers Without References CoIR: A comprehensive benchmark for code information retrieval models,

Reference 57

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T14:48:12.232169Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

Observation 804df050-87c2-44f9-b7fc-0644f266bcbc · outbound

This paper cites [research paper] crolsim: Cross language software similarity detector using api documentation,.

SONAR: Task-Aware Code Summary Evaluation for LLM Consumers Without References [research paper] crolsim: Cross language software similarity detector using api documentation,

Reference 58

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T14:48:12.217595Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

Observation 83d2f6e3-893c-4224-8826-77312f6e557a · outbound

This paper cites Directional diffusion-style code editing pre-training,.

SONAR: Task-Aware Code Summary Evaluation for LLM Consumers Without References Directional diffusion-style code editing pre-training,

Reference 59

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T14:48:12.202905Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

Observation ac00f775-e56d-433d-a46a-c6fee4ef19ec · outbound

This paper cites Naturaledit: Code modification through direct interaction with adaptive natural language representation,.

SONAR: Task-Aware Code Summary Evaluation for LLM Consumers Without References Naturaledit: Code modification through direct interaction with adaptive natural language representation,

Reference 60

Resolution: verified exact; raw_fallback, observed 2026-08-15T14:48:10.894667Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

Observation a2fff36e-2b3a-4d27-8192-edfa311d6b54 · outbound

This paper cites Bridging Functional Correctness and Runtime Efficiency Gaps in LLM-Based Code Translation.

SONAR: Task-Aware Code Summary Evaluation for LLM Consumers Without References Bridging Functional Correctness and Runtime Efficiency Gaps in LLM-Based Code Translation

Reference 61

Resolution: verified exact; local_arxiv, observed 2026-08-15T14:48:10.824261Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

Observation da1e9790-7b65-44a3-b818-04a181df1cf8 · outbound

This paper cites The fault in our stars: Quality assessment of code generation benchmarks,.

SONAR: Task-Aware Code Summary Evaluation for LLM Consumers Without References The fault in our stars: Quality assessment of code generation benchmarks,

Reference 62

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T14:48:12.190200Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

Observation 2da0c5ba-085b-4ce0-b95e-b761a0727304 · outbound

This paper cites The proof and measurement of association between two things,.

SONAR: Task-Aware Code Summary Evaluation for LLM Consumers Without References The proof and measurement of association between two things,

Reference 63

Resolution: unresolved; no resolver link, observed 2026-08-15T14:48:10.692142Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation f9de22de-6aa1-42f7-a9de-5c41f1519af6 · outbound

This paper cites An analysis of variance test for normality (complete samples)†,.

SONAR: Task-Aware Code Summary Evaluation for LLM Consumers Without References An analysis of variance test for normality (complete samples)†,

Reference 64

Resolution: malformed identifier; no resolver link, observed 2026-08-15T14:48:10.696361Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation a9aa3d10-1a6c-46e0-ba38-003ab40b633c · outbound

This paper cites Averaging correlations: Expected values and bias in combined pearson rs and fisher’s z transformations,.

SONAR: Task-Aware Code Summary Evaluation for LLM Consumers Without References Averaging correlations: Expected values and bias in combined pearson rs and fisher’s z transformations,

Reference 65

Resolution: verified exact; doi, observed 2026-08-15T14:48:10.745814Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

Observation 490672f9-6c5b-478d-ae0b-80122d8a05b9 · outbound

This paper cites Odds ratios and logistic regression: further examples of their use and interpretation,.

SONAR: Task-Aware Code Summary Evaluation for LLM Consumers Without References Odds ratios and logistic regression: further examples of their use and interpretation,

Reference 66

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T14:48:12.166354Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

Observation a1b021e8-ec4f-4142-9b6b-a58c347068d7 · outbound

This paper cites Available: https://arxiv.org/abs/2501.12079.

SONAR: Task-Aware Code Summary Evaluation for LLM Consumers Without References Available: https://arxiv.org/abs/2501.12079

Reference 2025

Resolution: verified exact; raw_fallback, observed 2026-08-15T14:48:10.980231Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

Observation 461c3d0d-5ede-4795-afe0-f09434fc143f · outbound

This paper cites Available: https://arxiv.org/abs/2512.10452.

SONAR: Task-Aware Code Summary Evaluation for LLM Consumers Without References Available: https://arxiv.org/abs/2512.10452

Reference 2026

Resolution: verified exact; raw_fallback, observed 2026-08-15T14:48:12.009027Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

Coverage vector

Reference resolution

Outbound references

Pith citing papers