Pith. sign in

REVIEW 1 cited by

Which Features are Learned by CodeBert: An Empirical Study of the BERT-based Source Code Representation Learning

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2301.08427 v2 pith:EXORHD2I submitted 2023-01-20 cs.CL cs.CRcs.LGcs.PL

classification cs.CLcs.CRcs.LGcs.PL
keywords representationsourcebertcodelearningsomeappliedbert-based
verification ladder T0 review T1 audit T2 compute T3 formal
0 comments
read the original abstract

The Bidirectional Encoder Representations from Transformers (BERT) were proposed in the natural language process (NLP) and shows promising results. Recently researchers applied the BERT to source-code representation learning and reported some good news on several downstream tasks. However, in this paper, we illustrated that current methods cannot effectively understand the logic of source codes. The representation of source code heavily relies on the programmer-defined variable and function names. We design and implement a set of experiments to demonstrate our conjecture and provide some insights for future works.

Discussion (0). Sign in to comment.

Forward citations

Cited by 1 Pith paper

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. On The Impact of Merge Request Deviations on Code Review Practices

    cs.SE 2025-06 conditional novelty 6.0 of 10

    A taxonomy of seven non-review merge request types, a few-shot classifier that detects them, and evidence that excluding them changes code review analytics.

Pith tools