REVIEW 3 cited by
nvBench: A Large-Scale Synthesized Dataset for Cross-Domain Natural Language to Visualization Task
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
NL2VIS - which translates natural language (NL) queries to corresponding visualizations (VIS) - has attracted more and more attention both in commercial visualization vendors and academic researchers. In the last few years, the advanced deep learning-based models have achieved human-like abilities in many natural language processing (NLP) tasks, which clearly tells us that the deep learning-based technique is a good choice to push the field of NL2VIS. However, a big balk is the lack of benchmarks with lots of (NL, VIS) pairs. We present nvBench, the first large-scale NL2VIS benchmark, containing 25,750 (NL, VIS) pairs from 750 tables over 105 domains, synthesized from (NL, SQL) benchmarks to support cross-domain NL2VIS task. The quality of nvBench has been extensively validated by 23 experts and 300+ crowd workers. Deep learning-based models training using nvBench demonstrate that nvBench can push the field of NL2VIS.
Forward citations
Cited by 3 Pith papers
-
AnnoBench: A Benchmark for Visualization Annotation Generation
A benchmark for chart annotation generation with a five-dimensional rubric shows current LLMs annotate code-based charts well but distort raster charts and over-rely on explicit instructions.
-
VIS-Shepherd: Constructing Critic for LLM-based Data Visualization Generation
A 7-billion-parameter multimodal model fine-tuned on 2,500 expert critiques of data visualizations matches or beats much larger models at identifying visualization defects.
-
nvAgent: Automated Data Visualization from Natural Language via Collaborative Agent Workflow
A three-agent workflow (processor, composer, validator) improves automatic data-to-chart generation on the VisEval benchmark, especially for multi-table queries.
Discussion (0). Continue with ORCID to comment.