Pith. sign in

REVIEW 2 cited by

The TechQA Dataset

Not yet reviewed by Pith; the record is open.

Re-run · record.json Download PDF Read on arXiv ↗

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 1911.02984 v1 pith:C6GXOMC7 submitted 2019-11-08 cs.CL cs.IR

Vittorio Castelli , Rishav Chakravarti , Saswati Dana , Anthony Ferritto , Radu Florian , Martin Franz , Dinesh Garg , Dinesh Khandelwal
show 13 more authors
Scott McCarley Mike McCawley Mohamed Nasr Lin Pan Cezar Pendus John Pitrelli Saurabh Pujar Salim Roukos Andrzej Sakrajda Avirup Sil Rosario Uceda-Sosa Todd Ward Rong Zhang
This is my paper
classification cs.CLcs.IR
keywords domaintechnicaltechqadatasetquestionsactualquestionrather
verification ladder T0 review T1 audit T2 compute T3 formal
0 comments
read the original abstract

We introduce TechQA, a domain-adaptation question answering dataset for the technical support domain. The TechQA corpus highlights two real-world issues from the automated customer support domain. First, it contains actual questions posed by users on a technical forum, rather than questions generated specifically for a competition or a task. Second, it has a real-world size -- 600 training, 310 dev, and 490 evaluation question/answer pairs -- thus reflecting the cost of creating large labeled datasets with actual data. Consequently, TechQA is meant to stimulate research in domain adaptation rather than being a resource to build QA systems from scratch. The dataset was obtained by crawling the IBM Developer and IBM DeveloperWorks forums for questions with accepted answers that appear in a published IBM Technote---a technical document that addresses a specific technical issue. We also release a collection of the 801,998 publicly available Technotes as of April 4, 2019 as a companion resource that might be used for pretraining, to learn representations of the IT domain language.

Discussion (0). Sign in to comment.

Forward citations

Cited by 2 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. When the Judge Changes, So Does the Measurement: Auditing LLM-as-Judge Reliability

    cs.CL 2026-07 conditional novelty 5.0 of 10

    Judge upgrades are not interchangeable: only Qwen3 1.7B→4B yields robust adjacent gains, MiniMax adjacent releases do not, and stronger judges reduce but do not remove bias or correlated jury errors.

  2. DiffLoRA: Differential Low-Rank Adapters for Large Language Models

    cs.CL 2025-07 conditional novelty 4.0 of 10

    DiffLoRA, a low-rank adapter variant of differential attention, generally underperforms LoRA but shows gains on HumanEval and multi-value needle retrieval.

Pith tools