Paper Citation Record · LEDGER

BenGER: Benchmarking LLM Systems on Subsumption-Based Legal Reasoning in German Law

As of 22 August 2026, this Paper Citation Record lists 34 of 34 outbound references and 1 inbound Pith citation observation for arXiv:2605.28183.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2605.28183 v3

Coverage vector

measured 34 of 34 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-07-01T07:59:42.981532Z

measured 35 of 35 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-22T06:32:14.747728+00:00

measured 1 of 1 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-06-26T22:16:25.919667Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: pith, observed 2026-07-03T23:29:02.476554Z

Reference resolution

34 of 34 outbound references displayed

verified exact1
verified fuzzy24
unresolved6
parse uncertain1
malformed identifier2
metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation a3a98ca4-299f-4050-8441-8137e430aacc · outbound

This paper cites 100 Odysseas S Chlapanis and others, 'GreekBarBench: A Challenging Benchmark for Free-Text Legal Reasoning and Citations' (2025) arXiv:2505.17267.

BenGER: Benchmarking LLM Systems on Subsumption-Based Legal Reasoning in German Law 100 Odysseas S Chlapanis and others, 'GreekBarBench: A Challenging Benchmark for Free-Text Legal Reasoning and Citations' (2025) arXiv:2505.17267

Reference 1

Resolution: verified exact; arxiv_id, observed 2026-07-01T08:05:31.154547Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

Observation 76640b33-bdb6-4b2e-bdd6-6760516ccf37 · outbound

This paper cites LLM Evaluators Recognize and Favor Their Own Generations.

BenGER: Benchmarking LLM Systems on Subsumption-Based Legal Reasoning in German Law LLM Evaluators Recognize and Favor Their Own Generations

Reference 2

Resolution: malformed identifier; local_arxiv, observed 2026-07-01T08:05:31.149817Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

Observation 7c9ba8db-c20a-4f49-824a-16d7277cba48 · outbound

This paper cites skilled annotator.

BenGER: Benchmarking LLM Systems on Subsumption-Based Legal Reasoning in German Law skilled annotator

Reference 3

Resolution: verified fuzzy; raw_fallback, observed 2026-07-06T13:52:37.102583Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

Observation 994f8616-27d9-4e7b-aa0f-b5652b197efd · outbound

This paper cites anderes, aber methodisch korrekt begründetes Ergebnis).

BenGER: Benchmarking LLM Systems on Subsumption-Based Legal Reasoning in German Law anderes, aber methodisch korrekt begründetes Ergebnis)

Reference 4

Resolution: verified fuzzy; raw_fallback, observed 2026-07-06T13:52:37.104481Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

Observation 789a61f7-0abf-41df-a376-243475e4838d · outbound

This paper cites Mittel (≈5–7): Ein wesentliches Problem fehlt oder ein Schwerpunkt wird übersehen; sonst or- dentlich.

BenGER: Benchmarking LLM Systems on Subsumption-Based Legal Reasoning in German Law Mittel (≈5–7): Ein wesentliches Problem fehlt oder ein Schwerpunkt wird übersehen; sonst or- dentlich

Reference 5

Resolution: verified fuzzy; raw_fallback, observed 2026-07-06T13:52:37.122070Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

Observation f7479f53-efff-4ba3-a72d-cc0a52dc8584 · outbound

This paper cites Mittel (≈5–7): Kleine Sys- tematikfehler (Reihenfolge, einzelne falsche/unnötige Grundlagen), aber Gesamt- struktur trägt.

BenGER: Benchmarking LLM Systems on Subsumption-Based Legal Reasoning in German Law Mittel (≈5–7): Kleine Sys- tematikfehler (Reihenfolge, einzelne falsche/unnötige Grundlagen), aber Gesamt- struktur trägt

Reference 6

Resolution: verified fuzzy; raw_fallback, observed 2026-07-06T13:52:37.124009Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

Observation 102a18fd-9eb7-482f-aa2d-1fa9608fb606 · outbound

This paper cites Mittel (≈8–11): Einzelne Definitio- nen/Normen ungenau; Streitstände schema- tisch oder lückenhaft, aber nicht fallentschei- dend falsch.

BenGER: Benchmarking LLM Systems on Subsumption-Based Legal Reasoning in German Law Mittel (≈8–11): Einzelne Definitio- nen/Normen ungenau; Streitstände schema- tisch oder lückenhaft, aber nicht fallentschei- dend falsch

Reference 7

Resolution: verified fuzzy; raw_fallback, observed 2026-07-06T13:52:37.096857Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

Observation 49ad301e-269a-42dd-9b38-367825c7e14a · outbound

This paper cites Mittel (≈8–11): Teil- weise nur abstrakt/„leerformelhaft“, aber wesentliche Punkte werden noch fallbezogen gelöst.

BenGER: Benchmarking LLM Systems on Subsumption-Based Legal Reasoning in German Law Mittel (≈8–11): Teil- weise nur abstrakt/„leerformelhaft“, aber wesentliche Punkte werden noch fallbezogen gelöst

Reference 8

Resolution: verified fuzzy; raw_fallback, observed 2026-07-06T13:52:37.113373Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

Observation 810cb47e-fabf-4341-ac51-ea03cf489190 · outbound

This paper cites Mittel (≈5–7): Entweder Über- länge bei Nebensachen oder Untergewichtung eines Schwerpunkts, aber noch erkennbares Klausurbewusstsein.

BenGER: Benchmarking LLM Systems on Subsumption-Based Legal Reasoning in German Law Mittel (≈5–7): Entweder Über- länge bei Nebensachen oder Untergewichtung eines Schwerpunkts, aber noch erkennbares Klausurbewusstsein

Reference 9

Resolution: verified fuzzy; raw_fallback, observed 2026-07-06T13:52:37.115325Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

Observation 4aecbe27-2fd9-470b-a7db-fa61d1720f91 · outbound

This paper cites Mittel (≈5–7): Grund- schema vorhanden, aber häufiger vermis- cht/ausgelassen; Definitionen oder Ergeb- nisse fehlen gelegentlich.

BenGER: Benchmarking LLM Systems on Subsumption-Based Legal Reasoning in German Law Mittel (≈5–7): Grund- schema vorhanden, aber häufiger vermis- cht/ausgelassen; Definitionen oder Ergeb- nisse fehlen gelegentlich

Reference 10

Resolution: verified fuzzy; raw_fallback, observed 2026-07-06T13:52:37.111168Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

Observation 19c427c3-21c5-46d4-964c-69ae921bbb85 · outbound

This paper cites 3–4: Kleinere Inkonsistenzen (Ebenen- sprünge, Überschriften nicht passgenau).

BenGER: Benchmarking LLM Systems on Subsumption-Based Legal Reasoning in German Law 3–4: Kleinere Inkonsistenzen (Ebenen- sprünge, Überschriften nicht passgenau)

Reference 11

Resolution: verified fuzzy; raw_fallback, observed 2026-07-06T13:52:37.094528Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

Observation bae601d6-ee9e-4cd1-a56a-11ab8458c12e · outbound

This paper cites 2: Teilweise umständlich/ungenau, aber ver- ständlich.

BenGER: Benchmarking LLM Systems on Subsumption-Based Legal Reasoning in German Law 2: Teilweise umständlich/ungenau, aber ver- ständlich

Reference 12

Resolution: verified fuzzy; raw_fallback, observed 2026-07-06T13:52:37.108902Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

Observation 45bb36fd-68e7-4be5-ae01-c2ed41c9a56c · outbound

This paper cites LLM Judge.

BenGER: Benchmarking LLM Systems on Subsumption-Based Legal Reasoning in German Law LLM Judge

Reference 13

Resolution: verified fuzzy; raw_fallback, observed 2026-07-06T13:52:37.117285Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

Observation 1ff5cd21-922b-4ede-88a3-7d9e05a39218 · outbound

This paper cites a different but methodologically correctly rea- soned result).

BenGER: Benchmarking LLM Systems on Subsumption-Based Legal Reasoning in German Law a different but methodologically correctly rea- soned result)

Reference 14

Resolution: verified fuzzy; raw_fallback, observed 2026-07-06T13:52:37.088226Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

Observation 0126f16f-b0bd-42b6-88f0-8e3e3aa70f22 · outbound

This paper cites blind spots.

BenGER: Benchmarking LLM Systems on Subsumption-Based Legal Reasoning in German Law blind spots

Reference 15

Resolution: verified fuzzy; raw_fallback, observed 2026-07-06T13:52:37.106733Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

Observation f5df3786-6457-4609-a9ba-e6e711e77d93 · outbound

This paper cites Middle (≈5–7): small systematic errors (sequence, in- dividual incorrect / unnecessary bases), but the overall structure holds.

BenGER: Benchmarking LLM Systems on Subsumption-Based Legal Reasoning in German Law Middle (≈5–7): small systematic errors (sequence, in- dividual incorrect / unnecessary bases), but the overall structure holds

Reference 16

Resolution: verified fuzzy; raw_fallback, observed 2026-07-06T13:52:37.099024Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

Observation e75d7fcf-266a-4869-b8b7-4651f63f94c9 · outbound

This paper cites Middle (≈8–11): individual definitions / norms are imprecise; scholarly debates are schematic or patchy, but not wrong in a case-decisive way.

BenGER: Benchmarking LLM Systems on Subsumption-Based Legal Reasoning in German Law Middle (≈8–11): individual definitions / norms are imprecise; scholarly debates are schematic or patchy, but not wrong in a case-decisive way

Reference 17

Resolution: verified fuzzy; raw_fallback, observed 2026-07-06T13:52:37.092453Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

Observation 953b8ae8-d718-4324-adce-79550a5144c6 · outbound

This paper cites empty-formula- like.

BenGER: Benchmarking LLM Systems on Subsumption-Based Legal Reasoning in German Law empty-formula- like

Reference 18

Resolution: verified fuzzy; raw_fallback, observed 2026-07-06T13:52:37.065181Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

Observation 050700fc-d2ee-4f91-9161-9aef27795288 · outbound

This paper cites sig- nals.

BenGER: Benchmarking LLM Systems on Subsumption-Based Legal Reasoning in German Law sig- nals

Reference 19

Resolution: verified fuzzy; raw_fallback, observed 2026-07-06T13:52:37.085958Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

Observation 410e01ca-7ca8-4e8d-89f0-2a38364e4072 · outbound

This paper cites Middle (≈5– 7): the basic scheme is present but is fre- quently blended or omitted; definitions or re- sults are occasionally missing.

BenGER: Benchmarking LLM Systems on Subsumption-Based Legal Reasoning in German Law Middle (≈5– 7): the basic scheme is present but is fre- quently blended or omitted; definitions or re- sults are occasionally missing

Reference 20

Resolution: verified fuzzy; raw_fallback, observed 2026-07-06T13:52:37.082466Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

Observation 9910ff8c-e05f-41fd-827d-dbe4012e8dfd · outbound

This paper cites 3–4: small inconsistencies (level jumps, headings not precisely fitting).

BenGER: Benchmarking LLM Systems on Subsumption-Based Legal Reasoning in German Law 3–4: small inconsistencies (level jumps, headings not precisely fitting)

Reference 21

Resolution: verified fuzzy; raw_fallback, observed 2026-07-06T13:52:37.127429Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

Observation 0ccd6dd9-3148-4612-8edd-56a067c9693b · outbound

This paper cites 2: partly clumsy / imprecise, but understand- able.

BenGER: Benchmarking LLM Systems on Subsumption-Based Legal Reasoning in German Law 2: partly clumsy / imprecise, but understand- able

Reference 22

Resolution: verified fuzzy; raw_fallback, observed 2026-07-06T13:52:37.080434Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

Observation 9255d25f-908e-4ed8-b8bf-54863e0915ff · outbound

This paper cites 1: isolated ci- tation / care errors, not serious.

BenGER: Benchmarking LLM Systems on Subsumption-Based Legal Reasoning in German Law 1: isolated ci- tation / care errors, not serious

Reference 23

Resolution: verified fuzzy; raw_fallback, observed 2026-07-06T13:52:37.125754Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

Observation 6fca198e-0a27-48bf-bf53-2f6dc75fbfce · outbound

This paper cites Bewertungsgrundsätze • Die Referenzlösung ist Orientierung, nicht die einzig mögliche vertretbare Lösung.

BenGER: Benchmarking LLM Systems on Subsumption-Based Legal Reasoning in German Law Bewertungsgrundsätze • Die Referenzlösung ist Orientierung, nicht die einzig mögliche vertretbare Lösung

Reference 24

Resolution: verified fuzzy; raw_fallback, observed 2026-07-06T13:52:37.084196Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

Observation 42d40318-69ca-4916-b73e-d2d500a22faf · outbound

This paper cites an unresolved cited work.

BenGER: Benchmarking LLM Systems on Subsumption-Based Legal Reasoning in German Law Unresolved cited work

Reference 25

Resolution: unresolved; raw_fallback, observed 2026-07-06T13:52:37.070984Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

Observation e3541f09-695b-4892-b187-44dba9c73b8a · outbound

This paper cites an unresolved cited work.

BenGER: Benchmarking LLM Systems on Subsumption-Based Legal Reasoning in German Law Unresolved cited work

Reference 26

Resolution: unresolved; raw_fallback, observed 2026-07-06T13:52:37.100734Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

Observation 53e53489-89e9-4c3c-8ed0-bb89c6f73e99 · outbound

This paper cites an unresolved cited work.

BenGER: Benchmarking LLM Systems on Subsumption-Based Legal Reasoning in German Law Unresolved cited work

Reference 27

Resolution: unresolved; raw_fallback, observed 2026-07-06T13:52:37.120081Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

Observation ad9403d1-6aac-47fb-9222-3354890b74d7 · outbound

This paper cites ” }, ”legal_knowledge”: { ”score”: ..., ”max”: 25, ”reason”: ”.

BenGER: Benchmarking LLM Systems on Subsumption-Based Legal Reasoning in German Law ” }, ”legal_knowledge”: { ”score”: ..., ”max”: 25, ”reason”: ”

Reference 28

Resolution: verified fuzzy; raw_fallback, observed 2026-07-06T13:52:37.078448Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

Observation 492289b0-e06a-4d06-b3ae-a59881e7340d · outbound

This paper cites an unresolved cited work.

BenGER: Benchmarking LLM Systems on Subsumption-Based Legal Reasoning in German Law Unresolved cited work

Reference 29

Resolution: parse uncertain; raw_fallback, observed 2026-07-06T13:52:37.067269Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

Observation 69e46016-564a-42f5-9ed1-c82399966e98 · outbound

This paper cites Do not use any external sources and do not in- vent any facts.

BenGER: Benchmarking LLM Systems on Subsumption-Based Legal Reasoning in German Law Do not use any external sources and do not in- vent any facts

Reference 30

Resolution: verified fuzzy; raw_fallback, observed 2026-07-06T13:52:37.076444Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

Observation b8c981db-bf9d-4303-af37-949fb006e07f · outbound

This paper cites an unresolved cited work.

BenGER: Benchmarking LLM Systems on Subsumption-Based Legal Reasoning in German Law Unresolved cited work

Reference 31

Resolution: unresolved; raw_fallback, observed 2026-07-06T13:52:37.063322Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

Observation c78c6f5d-ac58-424d-a983-770b1cd60b76 · outbound

This paper cites an unresolved cited work.

BenGER: Benchmarking LLM Systems on Subsumption-Based Legal Reasoning in German Law Unresolved cited work

Reference 32

Resolution: unresolved; raw_fallback, observed 2026-07-06T13:52:37.069073Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

Observation f4ce44dd-9a18-4f4a-a614-ac803cf29b1f · outbound

This paper cites an unresolved cited work.

BenGER: Benchmarking LLM Systems on Subsumption-Based Legal Reasoning in German Law Unresolved cited work

Reference 33

Resolution: unresolved; raw_fallback, observed 2026-07-06T13:52:37.072708Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

Observation 209913f6-9de2-4728-a936-009ede7ddd05 · outbound

This paper cites near pass.

BenGER: Benchmarking LLM Systems on Subsumption-Based Legal Reasoning in German Law near pass

Reference 34

Resolution: malformed identifier; raw_fallback, observed 2026-07-06T13:52:37.074542Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

Pith citing papers

Observation 9228edb1-f60a-4567-b89c-76d2660ce04d · inbound

The Measurement Gap in the Automation of EU Law: Benchmarking Doctrinal Legal Reasoning under the EU AI Act cites this paper.

The Measurement Gap in the Automation of EU Law: Benchmarking Doctrinal Legal Reasoning under the EU AI Act BenGER: Benchmarking LLM Systems on Subsumption-Based Legal Reasoning in German Law

Reference 48

Resolution: verified exact; local_arxiv, observed 2026-07-03T23:29:02.477892Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.