Pith. sign in

Paper Citation Record · LEDGER

TypyBench: Evaluating LLM Type Inference for Untyped Python Repositories

As of 20 August 2026, this Paper Citation Record lists 20 of 20 outbound references and 0 inbound Pith citation observations for arXiv:2507.22086.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2507.22086 v1

Coverage vector

measured 20 of 20 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-06T13:12:27.279857Z

measured 20 of 20 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-20T06:33:59.587034+00:00

measured 0 of 0 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: cited_works

Reference resolution

20 of 20 outbound references displayed

  • verified exact1
  • verified fuzzy5
  • unresolved14
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 8522e1f7-83b8-4382-8ada-484bc2d8e6fa · outbound

This paper cites GPT-4 Technical Report.

TypyBench: Evaluating LLM Type Inference for Untyped Python Repositories GPT-4 Technical Report

Reference 1

Resolution
unresolved
no resolver link, observed 2026-08-06T13:12:25.144642Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T13:12:25.144642Z digest=sha256:b19fa3472aaa3dbd39adfd63400ed4eefd26ff65654231e7f061d0ccf01aa528

Observation ec4ecc15-ae91-4602-96e3-e0e07251f99c · outbound

This paper cites The Llama 3 Herd of Models.

TypyBench: Evaluating LLM Type Inference for Untyped Python Repositories The Llama 3 Herd of Models

Reference 5

Resolution
unresolved
no resolver link, observed 2026-08-06T13:12:25.587220Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T13:12:25.587220Z digest=sha256:687d685eeedf0d2cac39e89ba95242585492bbe12dfc9653125d441ae14f4a54

Observation a2053efd-16bd-41ca-9a2e-829bd07f44ba · outbound

This paper cites J., Bird, C., Barr, E.

TypyBench: Evaluating LLM Type Inference for Untyped Python Repositories J., Bird, C., Barr, E

Reference 6

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T13:12:29.306879Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-08-06T13:12:25.670459Z digest=sha256:94c98ad164f33691a9bbcf0761da42f344e67bd7b30d88a8641398bdf06f0586

Observation 313ae3af-7d69-4a9a-991c-b8d67e535382 · outbound

This paper cites DeepSeek-V3 Technical Report.

TypyBench: Evaluating LLM Type Inference for Untyped Python Repositories DeepSeek-V3 Technical Report

Reference 8

Resolution
unresolved
no resolver link, observed 2026-08-06T13:12:25.896581Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T13:12:25.896581Z digest=sha256:7e52f74ef3a1145268c73e8a44a6570049a0055fe7c969f60374bea0bf265a54

Observation 3d0ffcb1-2cfd-4476-a5c5-b2a92334c48d · outbound

This paper cites an unresolved cited work.

TypyBench: Evaluating LLM Type Inference for Untyped Python Repositories Unresolved cited work

Reference 10

Resolution
unresolved
raw_fallback, observed 2026-08-06T13:12:28.816108Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-08-06T13:12:26.149430Z digest=sha256:cac6768174977ae37cec4bd1fd0a954843e8645f4db6831336aef3d1f2df67cc

Observation 62677a37-6445-43a2-a151-546f381c4141 · outbound

This paper cites P., Sabu, S., Wang, J., M.

TypyBench: Evaluating LLM Type Inference for Untyped Python Repositories P., Sabu, S., Wang, J., M

Reference 12

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T13:12:28.579917Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-08-06T13:12:26.369220Z digest=sha256:1324f686ba6db254ca56a01ba2d4d95464612617e482ae03c42684b63e4d0871

Observation b9adfcaf-32a1-4c59-8e7d-4503dcc2fa11 · outbound

This paper cites Repotrans- bench: A real-world benchmark for repository-level code translation.

TypyBench: Evaluating LLM Type Inference for Untyped Python Repositories Repotrans- bench: A real-world benchmark for repository-level code translation

Reference 13

Resolution
unresolved
no resolver link, observed 2026-08-06T13:12:26.467618Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T13:12:26.467618Z digest=sha256:127009d81648f8bd7d69ac56b3a1bad93f5da61e1f71782033832aa5f086e73b

Observation 8addf16b-77ef-4ab1-8250-d51afb7b2ac5 · outbound

This paper cites Qwen2.5 Technical Report.

TypyBench: Evaluating LLM Type Inference for Untyped Python Repositories Qwen2.5 Technical Report

Reference 14

Resolution
unresolved
no resolver link, observed 2026-08-06T13:12:26.605674Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T13:12:26.605674Z digest=sha256:b578bf3560773bb45547e6a54b7240b5677b306681908466defbdfa86d7ac627

Observation d619baaa-5ab7-4ab6-94c7-115876ba40bb · outbound

This paper cites BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructions.

TypyBench: Evaluating LLM Type Inference for Untyped Python Repositories BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructions

Reference 15

Resolution
unresolved
no resolver link, observed 2026-08-06T13:12:26.731265Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T13:12:26.731265Z digest=sha256:1f5a2c5f3fb288afa127c075a04b646059d7844baa259b13f7f2df8b2bf99b48

Observation 0f4ab164-89c7-4161-bd98-8b34d370b2b0 · outbound

This paper cites an unresolved cited work.

TypyBench: Evaluating LLM Type Inference for Untyped Python Repositories Unresolved cited work

Reference 16

Resolution
unresolved
raw_fallback, observed 2026-08-06T13:12:28.329334Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-08-06T13:12:26.835649Z digest=sha256:93c1ad3ff2f1bcd21d98c0a8213daffedbca9888a9c5f42f4ca2ae9cde027d9e

Observation c42e22cd-197f-4ada-9a83-c266a5426851 · outbound

This paper cites The test sets are further split into two test1 and test2 based on the date created to test the data contamination issue.

TypyBench: Evaluating LLM Type Inference for Untyped Python Repositories The test sets are further split into two test1 and test2 based on the date created to test the data contamination issue

Reference 17

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T13:12:28.216862Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-08-06T13:12:26.928560Z digest=sha256:4aea6d21bf4c368b6dadd978c8afc9c621c80f0c96e56b8168f25967ef5630fc

Observation 8ceb5ea3-078b-43e0-b82f-5fee4bfd689f · outbound

This paper cites an unresolved cited work.

TypyBench: Evaluating LLM Type Inference for Untyped Python Repositories Unresolved cited work

Reference 18

Resolution
unresolved
raw_fallback, observed 2026-08-06T13:12:28.100105Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-08-06T13:12:27.069811Z digest=sha256:83550b0c58e10d7236191ca394e0fe3c110f3944864e0b837d49f94cc69f258e

Observation ff0cbb13-768b-4a6b-aba0-9004afde136c · outbound

This paper cites an unresolved cited work.

TypyBench: Evaluating LLM Type Inference for Untyped Python Repositories Unresolved cited work

Reference 19

Resolution
unresolved
raw_fallback, observed 2026-08-06T13:12:28.020057Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-08-06T13:12:27.204923Z digest=sha256:74cc4e37c5d529e689bd0f803f6ea47307ff7cac97effa4c50234e105af0c56a

Observation 02b0cae8-38ac-489e-be96-ef4b0d8276e4 · outbound

This paper cites an unresolved cited work.

TypyBench: Evaluating LLM Type Inference for Untyped Python Repositories Unresolved cited work

Reference 20

Resolution
unresolved
raw_fallback, observed 2026-08-06T13:12:27.881031Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-08-06T13:12:27.279857Z digest=sha256:28adac75c43e75ce569b9f48543a097060834deee697bf6e8273205dfc2c05ef

Observation f51def23-a51e-4190-9756-42c279a66d77 · outbound

This paper cites Data Contamination Through the Lens of Time.

TypyBench: Evaluating LLM Type Inference for Untyped Python Repositories Data Contamination Through the Lens of Time

Reference 2015

Resolution
unresolved
no resolver link, observed 2026-08-06T13:12:26.242662Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T13:12:26.242662Z digest=sha256:e1a4b3f66a5abc2ba1507cf671d4539338a567fe5007cbd1e470882527ae5aa0

Observation b3b83ac6-b9a9-4554-aea3-49dd60cbc2dc · outbound

This paper cites LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Code.

TypyBench: Evaluating LLM Type Inference for Untyped Python Repositories LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Code

Reference 2018

Resolution
unresolved
no resolver link, observed 2026-08-06T13:12:25.780029Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T13:12:25.780029Z digest=sha256:9d125672dabcf8efa45c0c80092cbae2c7ad2fd9477cf500caaefd3c4cd3b178

Observation 46b94a5b-c9e8-470f-bb59-88695b3faaf7 · outbound

This paper cites Pyright: Static type checker for python.

TypyBench: Evaluating LLM Type Inference for Untyped Python Repositories Pyright: Static type checker for python

Reference 2019

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T13:12:29.042908Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-08-06T13:12:26.036090Z digest=sha256:42de05c13c26ace92db3ac07dbc615b9b0af425fcaa7bf993a929d354e7cf1e2

Observation 624e43b7-e775-4632-adfb-fece35d6f95d · outbound

This paper cites APPL: A Prompt Programming Language for Harmonious Integration of Programs and Large Language Model Prompts.

TypyBench: Evaluating LLM Type Inference for Untyped Python Repositories APPL: A Prompt Programming Language for Harmonious Integration of Programs and Large Language Model Prompts

Reference 2021

Resolution
verified exact
local_arxiv, observed 2026-08-06T13:12:27.644129Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-08-06T13:12:25.496645Z digest=sha256:1ef510cc331eb515b61df81baa75fc6838362caef4c593975f75a0f64d62cc3d

Observation bf30dcd8-a15b-4e87-95b2-92f1631972fc · outbound

This paper cites Evaluating Large Language Models Trained on Code.

TypyBench: Evaluating LLM Type Inference for Untyped Python Repositories Evaluating Large Language Models Trained on Code

Reference 2023

Resolution
unresolved
no resolver link, observed 2026-08-06T13:12:25.366886Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T13:12:25.366886Z digest=sha256:5ee87ddc63f272f8f7a876d02b692ce09848a5a7936afdb41d85a0f2694d837e

Observation eb5268bc-b9bb-43a4-894c-7d6bd9650e62 · outbound

This paper cites Brown, T., Mann, B., Ryder, N., Subbiah, M., Kaplan, J.

TypyBench: Evaluating LLM Type Inference for Untyped Python Repositories Brown, T., Mann, B., Ryder, N., Subbiah, M., Kaplan, J

Reference 2024

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T13:12:29.540548Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-08-06T13:12:25.258861Z digest=sha256:74321fae89b26cd08ae77da8e38f5dcd704ca9288d32d3c49ba28b009f62b17e

Pith citing papers

No inbound Pith citation observations are available.