Pith. sign in

Paper Citation Record · LEDGER

Investigating the Shortcomings of LLMs in Step-by-Step Legal Reasoning

As of 22 August 2026, this Paper Citation Record lists 64 of 64 outbound references and 2 inbound Pith citation observations for arXiv:2502.05675.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2502.05675 v1

Coverage vector

measured 64 of 64 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-08T18:26:57.883610Z

measured 66 of 66 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-22T06:32:14.747728+00:00

measured 2 of 2 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-15T18:03:15.100738Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-07-02T22:47:25.291983Z

Reference resolution

64 of 64 outbound references displayed

  • verified exact0
  • verified fuzzy35
  • unresolved29
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation d19caa04-604a-41e1-942a-7a9eb8e40072 · outbound

This paper cites an unresolved cited work.

Investigating the Shortcomings of LLMs in Step-by-Step Legal Reasoning Unresolved cited work

Reference 1

Resolution
unresolved
raw_fallback, observed 2026-08-08T18:26:58.460799Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=pdf_text observed=2026-08-08T18:26:57.655806Z digest=sha256:38b05278bf7c0756e63c386387f1252b39275f9299d5f5eba11b8ff942f19805

Observation c2db9314-96ce-41a0-a1aa-78d98e1e2f42 · outbound

This paper cites an unresolved cited work.

Investigating the Shortcomings of LLMs in Step-by-Step Legal Reasoning Unresolved cited work

Reference 2

Resolution
unresolved
raw_fallback, observed 2026-08-08T18:26:58.452737Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=pdf_text observed=2026-08-08T18:26:57.660445Z digest=sha256:b847db98c99a02aa0bff8b05aff5202b720db0a3fc80416d16ea883f8d05b5ec

Observation d58410b1-6bf8-4be7-91bb-2040a65666d2 · outbound

This paper cites an unresolved cited work.

Investigating the Shortcomings of LLMs in Step-by-Step Legal Reasoning Unresolved cited work

Reference 3

Resolution
unresolved
raw_fallback, observed 2026-08-08T18:26:58.444514Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=pdf_text observed=2026-08-08T18:26:57.664131Z digest=sha256:e579400b6cf8c2c7e97b1a78747db30e311597d303c7edec8710ea0a6b6e10c5

Observation 5dffaca7-2232-43c2-8791-c0e48826cf61 · outbound

This paper cites an unresolved cited work.

Investigating the Shortcomings of LLMs in Step-by-Step Legal Reasoning Unresolved cited work

Reference 4

Resolution
unresolved
raw_fallback, observed 2026-08-08T18:26:58.435753Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=pdf_text observed=2026-08-08T18:26:57.667604Z digest=sha256:17ab959337866c381807521a1397675b64ec34211ab4e6d4acf9a06d008b10e6

Observation 97683d74-1da9-4ba2-a630-713605168be2 · outbound

This paper cites an unresolved cited work.

Investigating the Shortcomings of LLMs in Step-by-Step Legal Reasoning Unresolved cited work

Reference 5

Resolution
unresolved
raw_fallback, observed 2026-08-08T18:26:58.427314Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=pdf_text observed=2026-08-08T18:26:57.671436Z digest=sha256:fbe6c94c465a55f94ceea3452d30fc256cf1ed89b0797eaf39965d214b75725d

Observation 4e38f491-231e-4710-82d9-c813c9281631 · outbound

This paper cites an unresolved cited work.

Investigating the Shortcomings of LLMs in Step-by-Step Legal Reasoning Unresolved cited work

Reference 6

Resolution
unresolved
raw_fallback, observed 2026-08-08T18:26:58.419003Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=pdf_text observed=2026-08-08T18:26:57.674825Z digest=sha256:d57f7cafb129ce76834ea2037fe7e9ad9788590389f18a893a441c7b425aad1d

Observation 0c471ab2-905d-4681-8bb8-4386444ca197 · outbound

This paper cites an unresolved cited work.

Investigating the Shortcomings of LLMs in Step-by-Step Legal Reasoning Unresolved cited work

Reference 7

Resolution
unresolved
raw_fallback, observed 2026-08-08T18:26:58.410494Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=pdf_text observed=2026-08-08T18:26:57.678412Z digest=sha256:00ddfc4baf8159202144e090c56cff5f4bffc2cf2721313ac92402b815d27198

Observation 60cb1db7-961a-4a46-86e5-4e3c99ee2c22 · outbound

This paper cites an unresolved cited work.

Investigating the Shortcomings of LLMs in Step-by-Step Legal Reasoning Unresolved cited work

Reference 8

Resolution
unresolved
raw_fallback, observed 2026-08-08T18:26:58.402421Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=pdf_text observed=2026-08-08T18:26:57.681595Z digest=sha256:d4b5411a3a424cab95db961f30ccd9956009146570abafba203842f683de95af

Observation de1548b1-fd92-46eb-b649-b7330b3c34e4 · outbound

This paper cites an unresolved cited work.

Investigating the Shortcomings of LLMs in Step-by-Step Legal Reasoning Unresolved cited work

Reference 9

Resolution
unresolved
raw_fallback, observed 2026-08-08T18:26:58.394167Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=pdf_text observed=2026-08-08T18:26:57.684946Z digest=sha256:b4a0c8270696391c47e2c4661f041a9b2b2f1f7d2ffed717cc5b3353e9c96cfa

Observation 2b469460-9015-452d-9fed-716f740cc925 · outbound

This paper cites an unresolved cited work.

Investigating the Shortcomings of LLMs in Step-by-Step Legal Reasoning Unresolved cited work

Reference 10

Resolution
unresolved
raw_fallback, observed 2026-08-08T18:26:58.386216Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=pdf_text observed=2026-08-08T18:26:57.688339Z digest=sha256:8e5194cfffc1f6edf97790b21425afe521685de8ac113c69a4ccf9344b7790bd

Observation b1db18ec-df5b-4b32-817a-a0de46f1f7b3 · outbound

This paper cites an unresolved cited work.

Investigating the Shortcomings of LLMs in Step-by-Step Legal Reasoning Unresolved cited work

Reference 11

Resolution
unresolved
raw_fallback, observed 2026-08-08T18:26:58.377963Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=pdf_text observed=2026-08-08T18:26:57.691647Z digest=sha256:63e5861d1f59d42bcb93e89e0dd7dc1ebddb59a51e067fe4bb47d210830a6221

Observation 3f25d1e3-ee4d-489d-a962-2ba4a102209e · outbound

This paper cites Now, you understand how to identify and remove such errors.

Investigating the Shortcomings of LLMs in Step-by-Step Legal Reasoning Now, you understand how to identify and remove such errors

Reference 12

Resolution
verified fuzzy
raw_fallback, observed 2026-08-08T18:26:58.369408Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=pdf_text observed=2026-08-08T18:26:57.694762Z digest=sha256:ed4406a4eb6c8ad52c0b00927403c20b6338dfeba76f3160017cd19a8d6d2a10

Observation 878b4581-4542-45e7-aca8-57c5b9e5c574 · outbound

This paper cites All preceding statements are premises.

Investigating the Shortcomings of LLMs in Step-by-Step Legal Reasoning All preceding statements are premises

Reference 14

Resolution
verified fuzzy
raw_fallback, observed 2026-08-08T18:26:58.351858Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=pdf_text observed=2026-08-08T18:26:57.702378Z digest=sha256:0aef77d751497fd1014cb344f31f4b5b318ebf7110fc4b5f27e72cf775e25aff

Observation 2e5bc14a-7b95-4689-a70a-f57f828b1b49 · outbound

This paper cites an unresolved cited work.

Investigating the Shortcomings of LLMs in Step-by-Step Legal Reasoning Unresolved cited work

Reference 15

Resolution
unresolved
raw_fallback, observed 2026-08-08T18:26:58.343188Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=pdf_text observed=2026-08-08T18:26:57.705618Z digest=sha256:695a99acde6203e6226be6252c590c8a2ffa8a51cbc65914699682c3c76f54cd

Observation 6fdb7465-59f5-4e88-83e7-e6744c4a7857 · outbound

This paper cites If there is nofitting type, assign the NO MISINTERPRETATION category.

Investigating the Shortcomings of LLMs in Step-by-Step Legal Reasoning If there is nofitting type, assign the NO MISINTERPRETATION category

Reference 16

Resolution
verified fuzzy
raw_fallback, observed 2026-08-08T18:26:58.334799Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=pdf_text observed=2026-08-08T18:26:57.708722Z digest=sha256:0726675979c4c1110064486f20d86fcaf8595df26187456ae59a3ab90563a543

Observation ae3cbf93-6b8c-4964-9b16-15fa8ff784a2 · outbound

This paper cites an unresolved cited work.

Investigating the Shortcomings of LLMs in Step-by-Step Legal Reasoning Unresolved cited work

Reference 17

Resolution
unresolved
raw_fallback, observed 2026-08-08T18:26:58.326074Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=pdf_text observed=2026-08-08T18:26:57.711869Z digest=sha256:6998aa74ee448e27786d7a3bad9b9d4dabe70e39b478ef2dc405e22aeda76e4c

Observation 7c29ff6f-e63c-446a-a4aa-e18c630bb6ff · outbound

This paper cites bare" and.

Investigating the Shortcomings of LLMs in Step-by-Step Legal Reasoning bare" and

Reference 18

Resolution
verified fuzzy
raw_fallback, observed 2026-08-08T18:26:58.317874Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=pdf_text observed=2026-08-08T18:26:57.715073Z digest=sha256:fbc0166641de4d02a535cee15045ae0405f72683fb424bec4ba4d16d09c12be5

Observation b4bbad30-ad18-4375-8786-2b7d1d8c71bc · outbound

This paper cites NO MISINTERPRETATION.

Investigating the Shortcomings of LLMs in Step-by-Step Legal Reasoning NO MISINTERPRETATION

Reference 19

Resolution
verified fuzzy
raw_fallback, observed 2026-08-08T18:26:58.360425Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=pdf_text observed=2026-08-08T18:26:57.698920Z digest=sha256:90a2cdababcedd4ccfbd08369c9768dfb056f268918d006607387b393ab59602

Observation 071333b5-ea19-44a5-a71a-61a17cfad10c · outbound

This paper cites an unresolved cited work.

Investigating the Shortcomings of LLMs in Step-by-Step Legal Reasoning Unresolved cited work

Reference 20

Resolution
unresolved
raw_fallback, observed 2026-08-08T18:26:58.309258Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=pdf_text observed=2026-08-08T18:26:57.718368Z digest=sha256:3c9f5191aad11a7484f6f26ff44a42ab9ffef88948cd606e21fb41c56dbb1750

Observation 91f30d32-0e5f-42c3-9140-dd0b942c1a2f · outbound

This paper cites an unresolved cited work.

Investigating the Shortcomings of LLMs in Step-by-Step Legal Reasoning Unresolved cited work

Reference 21

Resolution
unresolved
raw_fallback, observed 2026-08-08T18:26:58.300823Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=pdf_text observed=2026-08-08T18:26:57.721557Z digest=sha256:93d6480f24040c25caa4a12d4a5454e44e393a7e4c4367f640e213f725faa399

Observation 69a98f8f-5616-4c14-b4d5-ad241e6a7192 · outbound

This paper cites an unresolved cited work.

Investigating the Shortcomings of LLMs in Step-by-Step Legal Reasoning Unresolved cited work

Reference 22

Resolution
unresolved
raw_fallback, observed 2026-08-08T18:26:58.292716Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=pdf_text observed=2026-08-08T18:26:57.724833Z digest=sha256:1f04f464247385fe5d2b2b929d2b8829da2dd31b69abdcb61b528730c54cb5ee

Observation 44909e00-118c-40b9-a9e0-cf6e96653b24 · outbound

This paper cites an unresolved cited work.

Investigating the Shortcomings of LLMs in Step-by-Step Legal Reasoning Unresolved cited work

Reference 23

Resolution
unresolved
raw_fallback, observed 2026-08-08T18:26:58.284245Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=pdf_text observed=2026-08-08T18:26:57.728007Z digest=sha256:6b76812e6f5f13d23877f9660ab15f2fbdb00b4e7e2be6590688e6fe4979c2b0

Observation 104d9a5d-4417-44d9-aea8-641bfbc12508 · outbound

This paper cites Central Hanover Bank & Trust Co.

Investigating the Shortcomings of LLMs in Step-by-Step Legal Reasoning Central Hanover Bank & Trust Co

Reference 24

Resolution
verified fuzzy
raw_fallback, observed 2026-08-08T18:26:58.275046Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=pdf_text observed=2026-08-08T18:26:57.732247Z digest=sha256:ca7457bc8222803074e0fcde8059b2794ec3ad0a42248de4e3f317398174467d

Observation d08c1b80-080f-48aa-af27-472b4284ebc0 · outbound

This paper cites an unresolved cited work.

Investigating the Shortcomings of LLMs in Step-by-Step Legal Reasoning Unresolved cited work

Reference 25

Resolution
unresolved
raw_fallback, observed 2026-08-08T18:26:58.266496Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=pdf_text observed=2026-08-08T18:26:57.735563Z digest=sha256:fbf3b87a9edcab56caf80c9c117629fce7333c9266be10a9bf8c6fe1ce5a84d4

Observation 99328834-792f-49cf-9687-c5d05d9600bc · outbound

This paper cites an unresolved cited work.

Investigating the Shortcomings of LLMs in Step-by-Step Legal Reasoning Unresolved cited work

Reference 26

Resolution
unresolved
raw_fallback, observed 2026-08-08T18:26:58.258133Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=pdf_text observed=2026-08-08T18:26:57.738899Z digest=sha256:206ac9e5ff2faa15f54795b77b662d3317f74ce89d41b6ad2ab67b1841f82a12

Observation 9f2f97c5-f121-4009-92f3-c95e555d41f4 · outbound

This paper cites an unresolved cited work.

Investigating the Shortcomings of LLMs in Step-by-Step Legal Reasoning Unresolved cited work

Reference 27

Resolution
unresolved
raw_fallback, observed 2026-08-08T18:26:58.249841Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=pdf_text observed=2026-08-08T18:26:57.742243Z digest=sha256:dc071c23d5fe9740bdc8e85fa8cfec73ed8603c5849e48ff71ec060198611518

Observation 3f58133a-34e2-4653-b8e1-44e0a64ed1d1 · outbound

This paper cites reasonable investigation.

Investigating the Shortcomings of LLMs in Step-by-Step Legal Reasoning reasonable investigation

Reference 28

Resolution
verified fuzzy
raw_fallback, observed 2026-08-08T18:26:58.241803Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=pdf_text observed=2026-08-08T18:26:57.745647Z digest=sha256:5c7ee757b50dee393d48d6ece923f54ac5e8c3425c4ed2485b87923efeed34f5

Observation 11082828-cfff-4100-910d-98636bf8d9a0 · outbound

This paper cites an unresolved cited work.

Investigating the Shortcomings of LLMs in Step-by-Step Legal Reasoning Unresolved cited work

Reference 29

Resolution
unresolved
raw_fallback, observed 2026-08-08T18:26:58.233403Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=pdf_text observed=2026-08-08T18:26:57.749095Z digest=sha256:33813a386077d5a53b42d35c38a82f3c707798238c088595aa79b2c7fd93305c

Observation 3d572289-1a17-4d7d-adab-3205fde1ac2e · outbound

This paper cites an unresolved cited work.

Investigating the Shortcomings of LLMs in Step-by-Step Legal Reasoning Unresolved cited work

Reference 30

Resolution
unresolved
raw_fallback, observed 2026-08-08T18:26:58.225234Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=pdf_text observed=2026-08-08T18:26:57.752578Z digest=sha256:c5263c6c7e5d2d16aae7189418ce4fe70ac0e16ed83bd268a5bd81f89e54cf4e

Observation 0fd2d271-8790-4249-9a08-f4bd46e401ed · outbound

This paper cites an unresolved cited work.

Investigating the Shortcomings of LLMs in Step-by-Step Legal Reasoning Unresolved cited work

Reference 31

Resolution
unresolved
raw_fallback, observed 2026-08-08T18:26:58.216588Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=pdf_text observed=2026-08-08T18:26:57.755902Z digest=sha256:141c98fcc58a1bd671aa9937ef9b1239fcb5061ec12ec50728aab78eec3c28d7

Observation 32777252-30c8-4df4-97ad-6285d08d4cc5 · outbound

This paper cites is domiciled in Colorado, because she resides there with the intent to remain indefinitely.

Investigating the Shortcomings of LLMs in Step-by-Step Legal Reasoning is domiciled in Colorado, because she resides there with the intent to remain indefinitely

Reference 32

Resolution
verified fuzzy
raw_fallback, observed 2026-08-08T18:26:58.207158Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=pdf_text observed=2026-08-08T18:26:57.759307Z digest=sha256:5be4fc336571f595f78ae2e3e9ffc61adff57278f98f20f44fe4ae98ddf98b53

Observation ef54ce0d-e95e-43a4-a9a7-b942ba95e2e1 · outbound

This paper cites intent-to-remain-indefinitely.

Investigating the Shortcomings of LLMs in Step-by-Step Legal Reasoning intent-to-remain-indefinitely

Reference 33

Resolution
verified fuzzy
raw_fallback, observed 2026-08-08T18:26:58.198030Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=pdf_text observed=2026-08-08T18:26:57.762620Z digest=sha256:9a1d652b3c65bde5b32d9af9d78b7652254937221d6414e32f6a5a27916ea7dc

Observation b6b2978e-0bd3-4a89-b37f-e253b667128e · outbound

This paper cites an unresolved cited work.

Investigating the Shortcomings of LLMs in Step-by-Step Legal Reasoning Unresolved cited work

Reference 34

Resolution
unresolved
raw_fallback, observed 2026-08-08T18:26:58.189518Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=pdf_text observed=2026-08-08T18:26:57.765725Z digest=sha256:763a428acb9f78901a799229fdeb37e2525c84cb2c2dd939acb2fcddc3e79d97

Observation 7f8fe803-f4c3-40dc-bf52-7fad916f5223 · outbound

This paper cites Could Marla's residence and intent to remain in Colorado establish Colorado as her domicile? Conclusion: Based on the legal context and the question, the correct answer is: D.

Investigating the Shortcomings of LLMs in Step-by-Step Legal Reasoning Could Marla's residence and intent to remain in Colorado establish Colorado as her domicile? Conclusion: Based on the legal context and the question, the correct answer is: D

Reference 35

Resolution
verified fuzzy
raw_fallback, observed 2026-08-08T18:26:58.180743Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=pdf_text observed=2026-08-08T18:26:57.768924Z digest=sha256:297bda16188f995ec8fc9c38e8c51929e761fed2f71ea333e180c045dd613b36

Observation 1579b188-d8c9-4770-9f3d-25ca2aa7f8e3 · outbound

This paper cites CORRECT CONCLUSION FROM FALSE PREMISES.

Investigating the Shortcomings of LLMs in Step-by-Step Legal Reasoning CORRECT CONCLUSION FROM FALSE PREMISES

Reference 36

Resolution
verified fuzzy
raw_fallback, observed 2026-08-08T18:26:58.171388Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=pdf_text observed=2026-08-08T18:26:57.772269Z digest=sha256:65f86668ca21245bcee9b5378fa36945c8bc5a025b8fa5f2556aab25ba7cc960

Observation 18df99eb-08b7-4dbd-b767-5d7030960b6c · outbound

This paper cites (Correct).

Investigating the Shortcomings of LLMs in Step-by-Step Legal Reasoning (Correct)

Reference 37

Resolution
verified fuzzy
raw_fallback, observed 2026-08-08T18:26:58.162515Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=pdf_text observed=2026-08-08T18:26:57.776105Z digest=sha256:e9a79bb68be5e751e30b76981599430e722e2bb1d30ed5d20b0ac3ec259acd67

Observation 2738c380-502b-4d3c-ab81-34af46dd1017 · outbound

This paper cites an unresolved cited work.

Investigating the Shortcomings of LLMs in Step-by-Step Legal Reasoning Unresolved cited work

Reference 38

Resolution
unresolved
raw_fallback, observed 2026-08-08T18:26:58.154393Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=pdf_text observed=2026-08-08T18:26:57.779753Z digest=sha256:3089b328649e6a240b00e8ad48279a8ee4a93252418d90690e6bc6dd77d379a6

Observation bf83424e-c1c8-4714-9113-f2524569c19d · outbound

This paper cites She was unsure about her career choice and had plans to leave the program if she didn’t like it.

Investigating the Shortcomings of LLMs in Step-by-Step Legal Reasoning She was unsure about her career choice and had plans to leave the program if she didn’t like it

Reference 39

Resolution
verified fuzzy
raw_fallback, observed 2026-08-08T18:26:58.145923Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=pdf_text observed=2026-08-08T18:26:57.782918Z digest=sha256:1c9aead39d197407431e546f29dc0874ec72b61cc6c4ec750b85b5434bae18fd

Observation 9b7435c0-75ee-4d14-9850-4cc8e7b35f0a · outbound

This paper cites an unresolved cited work.

Investigating the Shortcomings of LLMs in Step-by-Step Legal Reasoning Unresolved cited work

Reference 40

Resolution
unresolved
raw_fallback, observed 2026-08-08T18:26:58.137334Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=pdf_text observed=2026-08-08T18:26:57.786116Z digest=sha256:8ddf8bc6df003f998d20002581aebfeb7db19b8abb54737efc33c6c2c9482ce1

Observation ecd26824-9aba-4140-9af3-32c877f0bd55 · outbound

This paper cites Domicile is determined by the present intent to remain indefinitely in a state, not by past domicile.

Investigating the Shortcomings of LLMs in Step-by-Step Legal Reasoning Domicile is determined by the present intent to remain indefinitely in a state, not by past domicile

Reference 41

Resolution
verified fuzzy
raw_fallback, observed 2026-08-08T18:26:58.128814Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=pdf_text observed=2026-08-08T18:26:57.789346Z digest=sha256:92f1f688c9245e995ebcf396c0b242082068d643776ccba0dde087244833b174

Observation e8a25686-193a-4605-945b-ecadd8b6f549 · outbound

This paper cites arise under.

Investigating the Shortcomings of LLMs in Step-by-Step Legal Reasoning arise under

Reference 42

Resolution
verified fuzzy
raw_fallback, observed 2026-08-08T18:26:58.119875Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=pdf_text observed=2026-08-08T18:26:57.793073Z digest=sha256:bd2c85a980dd7c646e96768de7a9c21a8ea499952019d4b6c82130fdc0c20c71

Observation ab2df8ae-8ace-4498-9000-f93897d1ef92 · outbound

This paper cites This means the plaintiff must base their right to relief on federal law for the case to be heard in federal court.

Investigating the Shortcomings of LLMs in Step-by-Step Legal Reasoning This means the plaintiff must base their right to relief on federal law for the case to be heard in federal court

Reference 43

Resolution
verified fuzzy
raw_fallback, observed 2026-08-08T18:26:58.110432Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=pdf_text observed=2026-08-08T18:26:57.797628Z digest=sha256:49f255ff333b070a3c195df1a270f56a38598a18b80055d606226d5eeafbcd4d

Observation 5c841da6-052c-4ae2-ade8-26ee0250c8a9 · outbound

This paper cites The claim does not inherently rely on federal law for the basis of the relief sought.(Correct).

Investigating the Shortcomings of LLMs in Step-by-Step Legal Reasoning The claim does not inherently rely on federal law for the basis of the relief sought.(Correct)

Reference 44

Resolution
verified fuzzy
raw_fallback, observed 2026-08-08T18:26:58.101267Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=pdf_text observed=2026-08-08T18:26:57.801324Z digest=sha256:9fb406ffa843172c35b89eccdddef97863d54fab57b19be19f4a66807aa558e5

Observation 69ade9eb-0433-4075-9e0c-0767b1c64c6d · outbound

This paper cites an unresolved cited work.

Investigating the Shortcomings of LLMs in Step-by-Step Legal Reasoning Unresolved cited work

Reference 45

Resolution
unresolved
raw_fallback, observed 2026-08-08T18:26:58.092112Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=pdf_text observed=2026-08-08T18:26:57.805313Z digest=sha256:be558e4e86cdd56412fbdaeb16c422a9aeacd39bb16a68d9284d0a2ff899cd00

Observation d0ab2974-8d7d-46b8-8ea7-e425ee190dbe · outbound

This paper cites This counterclaim does indeed arise under federal law.

Investigating the Shortcomings of LLMs in Step-by-Step Legal Reasoning This counterclaim does indeed arise under federal law

Reference 46

Resolution
verified fuzzy
raw_fallback, observed 2026-08-08T18:26:58.083909Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=pdf_text observed=2026-08-08T18:26:57.809387Z digest=sha256:b0c04d28b6f362fa7d9932f484ac069605d342c0a2373e0000e9db74e57beda8

Observation 03739cfe-e1e6-4cd9-907a-c7c56fb61c02 · outbound

This paper cites an unresolved cited work.

Investigating the Shortcomings of LLMs in Step-by-Step Legal Reasoning Unresolved cited work

Reference 47

Resolution
unresolved
raw_fallback, observed 2026-08-08T18:26:58.075272Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=pdf_text observed=2026-08-08T18:26:57.813391Z digest=sha256:9475bea8a60629dbdb87949e61a8ad1ef6bb4e847c4da0ff09af904cd7c47e19

Observation 3acf4439-a503-4ca7-8344-88a6240fe931 · outbound

This paper cites any civil action brought in a State court of which the district courts of the United States have original jurisdiction.

Investigating the Shortcomings of LLMs in Step-by-Step Legal Reasoning any civil action brought in a State court of which the district courts of the United States have original jurisdiction

Reference 48

Resolution
verified fuzzy
raw_fallback, observed 2026-08-08T18:26:58.066359Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=pdf_text observed=2026-08-08T18:26:57.817131Z digest=sha256:28a0e3e5b3efefd5566d6b0eb43317fccf0b1f545638412d7a9b1a2e968bdf0f

Observation a5c1ef3f-5b36-452d-8783-d9c8e0ffc6a9 · outbound

This paper cites In this case, the claim is for breach of contract between two California companies.

Investigating the Shortcomings of LLMs in Step-by-Step Legal Reasoning In this case, the claim is for breach of contract between two California companies

Reference 49

Resolution
verified fuzzy
raw_fallback, observed 2026-08-08T18:26:58.057962Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=pdf_text observed=2026-08-08T18:26:57.821130Z digest=sha256:2c6d413817c3267702c539c2ced01aec63fd70f6dd283d1c644c224069e13eee

Observation 4b96d697-28db-45ff-9fef-60b2e1a3121e · outbound

This paper cites In this case, Pollux has raised a federal law issue in his answer by asserting that he could not manufacture the drug due to a patent.

Investigating the Shortcomings of LLMs in Step-by-Step Legal Reasoning In this case, Pollux has raised a federal law issue in his answer by asserting that he could not manufacture the drug due to a patent

Reference 50

Resolution
verified fuzzy
raw_fallback, observed 2026-08-08T18:26:58.049302Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=pdf_text observed=2026-08-08T18:26:57.825214Z digest=sha256:546dda87028a54fb74773f1a9e5f2d1397b23d7586f8516d53a28f42b4e56565

Observation 3af81f45-cc79-46fe-9acd-22304776023c · outbound

This paper cites §1441(a), applies to civil actions brought in state court that have original jurisdiction in federal courts.

Investigating the Shortcomings of LLMs in Step-by-Step Legal Reasoning §1441(a), applies to civil actions brought in state court that have original jurisdiction in federal courts

Reference 51

Resolution
verified fuzzy
raw_fallback, observed 2026-08-08T18:26:58.040849Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=pdf_text observed=2026-08-08T18:26:57.829320Z digest=sha256:2a2fadaa55a192a3b64a232a589d9c8f6ed84dc573cbfe2d458a49b5fed64be0

Observation 9db48d4d-b4f8-4071-8def-c9730354d9ad · outbound

This paper cites Therefore, even though a federal law issue has been raised, the case cannot be removed based on federal question jurisdiction alone.

Investigating the Shortcomings of LLMs in Step-by-Step Legal Reasoning Therefore, even though a federal law issue has been raised, the case cannot be removed based on federal question jurisdiction alone

Reference 52

Resolution
verified fuzzy
raw_fallback, observed 2026-08-08T18:26:58.032200Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=pdf_text observed=2026-08-08T18:26:57.833208Z digest=sha256:fe18e60203bcd59faff038c7bae4d9e0d44f12579c6ecfcf5813b08f0997ce18

Observation be89f8cc-06df-4e25-a781-62849d86f7a1 · outbound

This paper cites without due process of law,.

Investigating the Shortcomings of LLMs in Step-by-Step Legal Reasoning without due process of law,

Reference 53

Resolution
verified fuzzy
raw_fallback, observed 2026-08-08T18:26:58.023236Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=pdf_text observed=2026-08-08T18:26:57.837127Z digest=sha256:ad12917267036a1ac3de1e0ed9307357933a0bd97069d7f7cd5c7b92e8fe27de

Observation d6b22ed5-73b4-426f-af93-51430cb47a18 · outbound

This paper cites an unresolved cited work.

Investigating the Shortcomings of LLMs in Step-by-Step Legal Reasoning Unresolved cited work

Reference 54

Resolution
unresolved
raw_fallback, observed 2026-08-08T18:26:58.014950Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=pdf_text observed=2026-08-08T18:26:57.841430Z digest=sha256:863d5fb2dc0459b0d478dec501092c43729a59426c50500422ee9d92ebf82971

Observation c8416257-0423-4a05-b69a-95b3f4e55e0c · outbound

This paper cites She made the defamatory statements from her office in Montana.

Investigating the Shortcomings of LLMs in Step-by-Step Legal Reasoning She made the defamatory statements from her office in Montana

Reference 55

Resolution
verified fuzzy
raw_fallback, observed 2026-08-08T18:26:58.006395Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=pdf_text observed=2026-08-08T18:26:57.845123Z digest=sha256:5d3ac7b5aea6e4cec1ebe9e6a7fee7196dce201e9951045c49d14b22a0adea16

Observation 707b6943-6b11-4962-ba7a-c08f77f8c109 · outbound

This paper cites minimum contacts.

Investigating the Shortcomings of LLMs in Step-by-Step Legal Reasoning minimum contacts

Reference 56

Resolution
verified fuzzy
raw_fallback, observed 2026-08-08T18:26:57.997392Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=pdf_text observed=2026-08-08T18:26:57.848952Z digest=sha256:b19ed71d56c0b77fa2713d7efdbac58f7327c45d470e8d4f050d60c984e90e4c

Observation 1f3f6224-de7e-4015-b596-ad069c4ba4a5 · outbound

This paper cites Central Hanover Bank & Trust Co.

Investigating the Shortcomings of LLMs in Step-by-Step Legal Reasoning Central Hanover Bank & Trust Co

Reference 57

Resolution
verified fuzzy
raw_fallback, observed 2026-08-08T18:26:57.988745Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=pdf_text observed=2026-08-08T18:26:57.853638Z digest=sha256:97559e0a3f868da8c53c1486f3dc444883bf3229b6e22d8e7621f36d0e0ff4e8

Observation d37844f8-522c-4156-86db-74d3c3f880bd · outbound

This paper cites What is reasonable in one circumstance may not be in another.

Investigating the Shortcomings of LLMs in Step-by-Step Legal Reasoning What is reasonable in one circumstance may not be in another

Reference 58

Resolution
verified fuzzy
raw_fallback, observed 2026-08-08T18:26:57.979847Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=pdf_text observed=2026-08-08T18:26:57.857421Z digest=sha256:80681e0cbe6aecb72cdcca6ef8cf5dd6cc9193c34fb31c7c482896be87f30657

Observation 0a2730ab-44fc-4ee2-8f54-c111b9a8e67b · outbound

This paper cites Instead, the Court focused on the reasonableness of the notice given under the circumstances.(Correct).

Investigating the Shortcomings of LLMs in Step-by-Step Legal Reasoning Instead, the Court focused on the reasonableness of the notice given under the circumstances.(Correct)

Reference 59

Resolution
verified fuzzy
raw_fallback, observed 2026-08-08T18:26:57.970805Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=pdf_text observed=2026-08-08T18:26:57.861072Z digest=sha256:16c179cd1cf2841bbf3fb670324a8ef7259ce72ebc6029d27dc13b8dc750ddb7

Observation e8ba9c0e-07bc-4fcb-823e-dda6eafdee1b · outbound

This paper cites complete diversity,.

Investigating the Shortcomings of LLMs in Step-by-Step Legal Reasoning complete diversity,

Reference 60

Resolution
verified fuzzy
raw_fallback, observed 2026-08-08T18:26:57.961977Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=pdf_text observed=2026-08-08T18:26:57.864779Z digest=sha256:03afe38fc83377f2da7c7e7faf432c802645215d72e0c54c9d1051c30d7369a9

Observation 3e016d65-402a-4bdd-9d89-df4914f3e2db · outbound

This paper cites (Correct).

Investigating the Shortcomings of LLMs in Step-by-Step Legal Reasoning (Correct)

Reference 61

Resolution
verified fuzzy
raw_fallback, observed 2026-08-08T18:26:57.952414Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=pdf_text observed=2026-08-08T18:26:57.868642Z digest=sha256:12677ea61fd39676e1bd3a68517acbe2d699437ccd39aace1f684aa0f8b10ca2

Observation 015939bd-f46d-47b8-8653-b211622f67b7 · outbound

This paper cites (Correct).

Investigating the Shortcomings of LLMs in Step-by-Step Legal Reasoning (Correct)

Reference 62

Resolution
verified fuzzy
raw_fallback, observed 2026-08-08T18:26:57.943625Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=pdf_text observed=2026-08-08T18:26:57.872336Z digest=sha256:c79a1d5184596a1368fac3ae348eac7fbec11e2824ec68083df5750e38bd04bb

Observation 37de872c-7859-4bdc-a83c-3516140d1366 · outbound

This paper cites Therefore, there is no minimum amount in controversy required for a case to be considered a diversity case under the Constitution.

Investigating the Shortcomings of LLMs in Step-by-Step Legal Reasoning Therefore, there is no minimum amount in controversy required for a case to be considered a diversity case under the Constitution

Reference 63

Resolution
verified fuzzy
raw_fallback, observed 2026-08-08T18:26:57.934770Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=pdf_text observed=2026-08-08T18:26:57.875764Z digest=sha256:546f57cbf7cc7b182149a33a1e39beed5b790a32d11aa276a0b220f8c57bc699

Observation c808558d-28c1-4785-9cf8-ab1d495f0dfd · outbound

This paper cites (Correct).

Investigating the Shortcomings of LLMs in Step-by-Step Legal Reasoning (Correct)

Reference 64

Resolution
verified fuzzy
raw_fallback, observed 2026-08-08T18:26:57.925321Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=pdf_text observed=2026-08-08T18:26:57.879801Z digest=sha256:ca91c9db5463f813dd8dcceb895f880acd4e2fdb677a50fc42c26e4ea8c392fa

Observation d4018241-ac21-4887-a131-243f462b2aed · outbound

This paper cites the amount in controversy exceeds the sum or value of $75,000, exclusive of interest or costs.

Investigating the Shortcomings of LLMs in Step-by-Step Legal Reasoning the amount in controversy exceeds the sum or value of $75,000, exclusive of interest or costs

Reference 65

Resolution
verified fuzzy
raw_fallback, observed 2026-08-08T18:26:57.915532Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=pdf_text observed=2026-08-08T18:26:57.883610Z digest=sha256:8a614fd204b88de73f168dad52ea834c82e14e20cedad05b8dbd265024537863

Pith citing papers

Observation 5504c403-47e9-4d4a-a0ca-2b3860540945 · inbound

Trustworthy Reasoning: Evaluating and Enhancing Factual Accuracy in LLM Intermediate Thought Processes cites this paper.

Trustworthy Reasoning: Evaluating and Enhancing Factual Accuracy in LLM Intermediate Thought Processes Investigating the Shortcomings of LLMs in Step-by-Step Legal Reasoning

Reference 14

Resolution
unresolved
no resolver link, observed 2026-08-15T18:03:15.100738Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-15T18:03:15.100738Z digest=sha256:a78e5293eddbb589186c10883699db1be53785cff836e475d047a5005e02c36f

Observation 551b554c-bf59-49ca-803a-15ce3bd2e09c · inbound

LLMs in the Real World: Evaluating "AI" in Emergency Contexts cites this paper.

LLMs in the Real World: Evaluating "AI" in Emergency Contexts Investigating the Shortcomings of LLMs in Step-by-Step Legal Reasoning

Reference 53

Resolution
verified exact
arxiv_id, observed 2026-07-02T22:47:25.293313Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=arxiv_source observed=2026-07-02T22:45:59.495511Z digest=sha256:6fbaaefbef9e06b67a36d6171d75aaa8a51850df93c38bcec4f3d1f871817e0a