Pith. sign in

REVIEW 1 cited by

AVATAR: A Parallel Corpus for Java-Python Program Translation

Not yet reviewed by Pith; the record is open.

Re-run · record.json Download PDF Read on arXiv ↗

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2108.11590 v2 pith:VQLLHZSD submitted 2021-08-26 cs.SE cs.CL

Wasi Uddin Ahmad , Md Golam Rahman Tushar , Saikat Chakraborty , Kai-Wei Chang This is my paper · ORCID
classification cs.SEcs.CL
keywords avatarprogramminglanguagelanguagesmodelsprogramsoftwaretranslation
verification ladder T0 review T1 audit T2 compute T3 formal
0 comments
read the original abstract

Program translation refers to migrating source code from one programming language to another. It has tremendous practical value in software development, as porting software across languages is time-consuming and costly. Automating program translation is of paramount importance in software migration, and recently researchers explored unsupervised approaches due to the unavailability of parallel corpora. However, the availability of pre-trained language models for programming languages enables supervised fine-tuning with a small number of labeled examples. Therefore, we present AVATAR, a collection of 9,515 programming problems and their solutions written in two popular languages, Java and Python. AVATAR is collected from competitive programming sites, online platforms, and open-source repositories. Furthermore, AVATAR includes unit tests for 250 examples to facilitate functional correctness evaluation. We benchmark several pre-trained language models fine-tuned on AVATAR. Experiment results show that the models lack in generating functionally accurate code.

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 1 Pith paper

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. A Tool for In-depth Analysis of Code Execution Reasoning of Large Language Models

    cs.SE 2025-01 conditional novelty 6.0 of 10

    ExeRScope uses static and dynamic program analysis to show that LLMs' code execution reasoning degrades with program complexity, nested structures, longer loops, and non-primitive types.

Pith tools