Pith. sign in

REVIEW 1 cited by

Enhancing Large Language Models for Hardware Verification: A Novel SystemVerilog Assertion Dataset

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2503.08923 v1 pith:HIGAPINB submitted 2025-03-11 cs.LG cs.CRcs.PL

classification cs.LGcs.CRcs.PL
keywords modelsopen-sourcevertassertionassertionsdatasetgpt-4ohardware
verification ladder T0 review T1 audit T2 compute T3 formal
0 comments
read the original abstract

Hardware verification is crucial in modern SoC design, consuming around 70% of development time. SystemVerilog assertions ensure correct functionality. However, existing industrial practices rely on manual efforts for assertion generation, which becomes increasingly untenable as hardware systems become complex. Recent research shows that Large Language Models (LLMs) can automate this process. However, proprietary SOTA models like GPT-4o often generate inaccurate assertions and require expensive licenses, while smaller open-source LLMs need fine-tuning to manage HDL code complexities. To address these issues, we introduce **VERT**, an open-source dataset designed to enhance SystemVerilog assertion generation using LLMs. VERT enables researchers in academia and industry to fine-tune open-source models, outperforming larger proprietary ones in both accuracy and efficiency while ensuring data privacy through local fine-tuning and eliminating costly licenses. The dataset is curated by systematically augmenting variables from open-source HDL repositories to generate synthetic code snippets paired with corresponding assertions. Experimental results demonstrate that fine-tuned models like Deepseek Coder 6.7B and Llama 3.1 8B outperform GPT-4o, achieving up to 96.88% improvement over base models and 24.14% over GPT-4o on platforms including OpenTitan, CVA6, OpenPiton and Pulpissimo. VERT is available at https://github.com/AnandMenon12/VERT.

Discussion (0). Sign in to comment.

Forward citations

Cited by 1 Pith paper

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. WaveformQA: Benchmarking LLM Temporal Reasoning on Digital Waveforms

    cs.AI 2026-07 conditional novelty 7.0 of 10

    LLMs answer simple waveform queries well but fail on multi-signal temporal reasoning, and event-time JSON waveforms beat standard VCD by 37–53% in accuracy, according to a new 360-question benchmark.

Pith tools