REVIEW 13 cited by
TabFact: A Large-scale Dataset for Table-based Fact Verification
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
The problem of verifying whether a textual hypothesis holds based on the given evidence, also known as fact verification, plays an important role in the study of natural language understanding and semantic representation. However, existing studies are mainly restricted to dealing with unstructured evidence (e.g., natural language sentences and documents, news, etc), while verification under structured evidence, such as tables, graphs, and databases, remains under-explored. This paper specifically aims to study the fact verification given semi-structured data as evidence. To this end, we construct a large-scale dataset called TabFact with 16k Wikipedia tables as the evidence for 118k human-annotated natural language statements, which are labeled as either ENTAILED or REFUTED. TabFact is challenging since it involves both soft linguistic reasoning and hard symbolic reasoning. To address these reasoning challenges, we design two different models: Table-BERT and Latent Program Algorithm (LPA). Table-BERT leverages the state-of-the-art pre-trained language model to encode the linearized tables and statements into continuous vectors for verification. LPA parses statements into programs and executes them against the tables to obtain the returned binary value for verification. Both methods achieve similar accuracy but still lag far behind human performance. We also perform a comprehensive analysis to demonstrate great future opportunities. The data and code of the dataset are provided in \url{https://github.com/wenhuchen/Table-Fact-Checking}.
Forward citations
Cited by 13 Pith papers
-
CITBench: A Comprehensive Benchmark for Interactive Tabular Data Processing with LLMs
CITBench is a new benchmark for LLM table processing with 1,296 tasks, showing that model accuracy falls sharply under multi-turn interaction noise and complex dependencies.
-
ClimateViz: A Benchmark for Statistical Reasoning and Fact Verification on Scientific Charts
A large-scale benchmark shows that leading multimodal language models still underperform expert humans at verifying climate claims from scientific charts.
-
SVR-R1: Bootstrapping Multi-modal Reasoning with Self-verification in Reinforcement Learning
Integrating binary self-verification into multi-turn GRPO rollouts raises VLM multimodal reasoning accuracy over matched GRPO baselines while the model learns to need fewer rethinks.
-
Proof-Carrying Numbers (PCN): A Protocol for Trustworthy Numeric Answers from LLMs via Claim Verification
Proof-Carrying Numbers binds each displayed LLM number to a structured claim and only marks it verified after a policy-based mechanical check, leaving all other numbers unverified.
-
AraTable: Benchmarking LLMs' Reasoning and Understanding of Arabic Tabular Data
AraTable is the first Arabic tabular QA benchmark; its experiments show LLMs are much weaker at reasoning over Arabic tables than at direct lookup.
-
MDBench: A Synthetic Multi-Document Reasoning Benchmark Generated with Knowledge Guidance
MDBench is a synthetically generated, knowledge-guided benchmark for multi-document QA on which frontier LLMs achieve only about 60% exact match.
-
TableMind: An Autonomous Programmatic Agent for Tool-Augmented Table Reasoning
TableMind, a two-stage SFT-plus-RL agent trained on an 8B model, reports state-of-the-art results on three table reasoning benchmarks.
-
CF-RAG: A Dataset and Method for Carbon Footprint QA Using Retrieval-Augmented Generation
A fine-tuned Llama 3 model with a trained document critic and program-based reasoning beats GPT-4o and other baselines on a new carbon footprint QA benchmark.
-
ExpliCIT-QA: Explainable Code-Based Image Table Question Answering
ExpliCIT-QA turns table-image question answering into a traceable sequence of table extraction, natural-language reasoning, code generation, execution, and explanation.
-
Multimodal Tabular Reasoning with Privileged Structured Information
An 8B multimodal LLM trained on 9k reasoning traces distilled from structured tables reaches state-of-the-art open-source accuracy on table-image question answering and fact verification.
-
MRT at IberLEF-2025 PRESTA Task: Maximizing Recovery from Tables with Multiple Steps
MRT, an LLM code-generation pipeline for Spanish table QA, achieves 85% accuracy on the IberLEF 2025 PRESTA test set.
-
MRT at SemEval-2025 Task 8: Maximizing Recovery from Tables with Multiple Steps
A code-generation pipeline with step-by-step instructions and error recovery scores 70.50% on the SemEval-2025 table question-answering task.
-
LLM Inference Enhanced by External Knowledge: A Survey
A survey of methods that enhance LLM inference by integrating external structured knowledge from tables and knowledge graphs.
Discussion (0). Sign in to comment.