Pith. sign in

REVIEW 3 cited by

Instruction-Tuning LLMs for Event Extraction with Annotation Guidelines

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2502.16377 v2 pith:WU2KVFX7 submitted 2025-02-22 cs.CL

Instruction-Tuning LLMs for Event Extraction with Annotation Guidelines

classification cs.CL
keywords guidelinesannotationeventextractioninstruction-tuningwhenamountarguments
verification ladder T0 review T1 audit T2 compute T3 formal T4 reserved
0 comments
read the original abstract

In this work, we study the effect of annotation guidelines -- textual descriptions of event types and arguments, when instruction-tuning large language models for event extraction. We conducted a series of experiments with both human-provided and machine-generated guidelines in both full- and low-data settings. Our results demonstrate the promise of annotation guidelines when there is a decent amount of training data and highlight its effectiveness in improving cross-schema generalization and low-frequency event-type performance.

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Forward citations

Cited by 3 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. ChunkLLM: A Lightweight Pluggable Framework for Accelerating LLMs Inference

    cs.CL 2025-09 conditional novelty 6.0

    ChunkLLM adds lightweight chunk-boundary and chunk-attention adapters to frozen LLMs, keeping ~98% of long-context quality with ~49% KV cache and up to 4.48x speedup on 120K-token generation.

  2. Task Decomposition for Efficient Annotation

    cs.CL 2026-06 unverdicted novelty 4.0

    Decomposing annotation tasks using centers from centering theory reduces aggregate inferential load via a degrees-of-freedom model and enables better sub-task allocation.

  3. Refining and Reusing Annotation Guidelines for LLM Annotation

    cs.CL 2026-05 conditional novelty 4.0

    An iterative moderation framework refines and reuses annotation guidelines to improve LLM annotation accuracy on biomedical NER tasks across GPT, Gemini, and DeepSeek models.