Pith. sign in

REVIEW 1 cited by

Report from the NSF Future Directions Workshop on Automatic Evaluation of Dialog: Research Directions and Challenges

Not yet reviewed by Pith; the record is open.

Re-run · record.json Download PDF Read on arXiv ↗

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2203.10012 v1 pith:S3UN4HPV submitted 2022-03-18 cs.CL cs.AIcs.LG

Shikib Mehri , Jinho Choi , Luis Fernando D'Haro , Jan Deriu , Maxine Eskenazi , Milica Gasic , Kallirroi Georgila , Dilek Hakkani-Tur
show 8 more authors
Zekang Li Verena Rieser Samira Shaikh David Traum Yi-Ting Yeh Zhou Yu Yizhe Zhang Chen Zhang
This is my paper · ORCID
classification cs.CLcs.AIcs.LG
keywords directionsfutureworkshopautomaticdialogevaluationreportresearch
verification ladder T0 review T1 audit T2 compute T3 formal
0 comments
read the original abstract

This is a report on the NSF Future Directions Workshop on Automatic Evaluation of Dialog. The workshop explored the current state of the art along with its limitations and suggested promising directions for future work in this important and very rapidly changing area of research.

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 1 Pith paper

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. Amulet: Putting Complex Multi-Turn Conversations on the Stand with LLM Juries

    cs.CL 2025-05 conditional novelty 6.0 of 10

    Dialog-act and maxim-aware prompting improves LLM judge accuracy on multi-turn preference data by up to 8 points, with further gains from jury-style voting.

Pith tools