Pith. sign in

Paper Integrity Record · LEDGER

Position: Don't Use the CLT in LLM Evals With Fewer Than a Few Hundred Datapoints

As of an unrecorded date, Pith completed 0 of 0 listed checks against arXiv:2503.01747. No listed check completed, so this record makes no findings claim.

This is a record of named checks, not a clean-status claim or a paper verdict.

pith.integrity.v1
2503.01747 v3
pith:2025:4XPFWIKY77C5MD5N7F4GKURWBE

Coverage vector

No checks are listed for this paper yet.

Listed checks

No checks are listed for this paper yet.

Observations

No checks are listed for this paper yet.

Methods and limits

Each listed check names the surface it examined. A skipped, failed, partial, unavailable, not collected, not requested, or withheld check says nothing about what a completed check would have returned.

  • Only checks with status completed enter the claim sentence numerator.
  • Findings appear only from completed checks and only within the scope printed for that check.
  • Severity labels describe one observation row. They do not roll up into a paper judgment.