Pith. sign in

Paper Citation Record · LEDGER

Optimizing LLM-Based Multi-Agent System with Textual Feedback: A Case Study on Software Development

As of 21 August 2026, this Paper Citation Record lists 16 of 16 outbound references and 1 inbound Pith citation observation for arXiv:2505.16086.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2505.16086 v2

Coverage vector

measured 16 of 16 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-07T15:12:37.571410Z

measured 17 of 17 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-20T06:33:59.587034+00:00

measured 1 of 1 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-06-26T09:15:50.722199Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-07-04T09:59:45.569733Z

Reference resolution

16 of 16 outbound references displayed

  • verified exact0
  • verified fuzzy3
  • unresolved13
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 57b00b07-afb6-4d20-ba64-ea9719ff3a75 · outbound

This paper cites an unresolved cited work.

Optimizing LLM-Based Multi-Agent System with Textual Feedback: A Case Study on Software Development Unresolved cited work

Reference 1

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:12:38.782597Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-08-07T15:12:36.358440Z digest=sha256:da782c93cb4297c8a0621aee3af49ae96f2a0b9f33ffbdd16e9bbfe649164bc9

Observation 71262754-d894-4f4a-a2d8-3c63aa8ffb1a · outbound

This paper cites LLM Critics Help Catch LLM Bugs.

Optimizing LLM-Based Multi-Agent System with Textual Feedback: A Case Study on Software Development LLM Critics Help Catch LLM Bugs

Reference 2

Resolution
unresolved
no resolver link, observed 2026-08-07T15:12:36.041322Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:12:36.041322Z digest=sha256:2312f4d7329dcedde8bc9137b192d5e39245a6a54588070116b1e04f2e39db80

Observation 98e47070-f628-431a-ac88-05df882335ec · outbound

This paper cites an unresolved cited work.

Optimizing LLM-Based Multi-Agent System with Textual Feedback: A Case Study on Software Development Unresolved cited work

Reference 3

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:12:38.585217Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-08-07T15:12:36.586932Z digest=sha256:db0d8e259c6cc7d420828896ffa43420335c743961e3c373bbb9ad603d07801d

Observation 1d40cc74-272d-4687-9d18-d4850bbb55ae · outbound

This paper cites WebPilot: A Versatile and Autonomous Multi-Agent System for Web Task Execution with Strategic Exploration.

Optimizing LLM-Based Multi-Agent System with Textual Feedback: A Case Study on Software Development WebPilot: A Versatile and Autonomous Multi-Agent System for Web Task Execution with Strategic Exploration

Reference 4

Resolution
unresolved
no resolver link, observed 2026-08-07T15:12:36.251017Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:12:36.251017Z digest=sha256:ef97153c783ea7f5e8912994832800a5423e737cee65aad1d2538de9dd255c42

Observation 9f28627f-3974-402b-964b-0fe607ad1f7b · outbound

This paper cites an unresolved cited work.

Optimizing LLM-Based Multi-Agent System with Textual Feedback: A Case Study on Software Development Unresolved cited work

Reference 5

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:12:38.404875Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-08-07T15:12:36.791139Z digest=sha256:548d0bee2fa7eb39bd83b267205f6ad5dbf523da5f05e10c1f067f57a505cc31

Observation 36dee761-64ea-4b8d-9d41-123262036a44 · outbound

This paper cites an unresolved cited work.

Optimizing LLM-Based Multi-Agent System with Textual Feedback: A Case Study on Software Development Unresolved cited work

Reference 6

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:12:38.679996Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-08-07T15:12:36.481980Z digest=sha256:97aed24542a3b9c722864032732f456021d507a780e3a2815eed4ca4e3a9cc77

Observation f4e3ab12-0489-4a29-b318-a70e628e31d8 · outbound

This paper cites an unresolved cited work.

Optimizing LLM-Based Multi-Agent System with Textual Feedback: A Case Study on Software Development Unresolved cited work

Reference 7

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:12:38.237594Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-08-07T15:12:37.064525Z digest=sha256:e4cd3aa605d6a60e699f70497f5d9141f7f8acbb19ff9e7e6842e7ae9de1a5f3

Observation 4d2f308d-738b-49af-a260-1f452613de33 · outbound

This paper cites an unresolved cited work.

Optimizing LLM-Based Multi-Agent System with Textual Feedback: A Case Study on Software Development Unresolved cited work

Reference 8

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:12:38.494608Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-08-07T15:12:36.703811Z digest=sha256:fd58575c40c558f13c152480ff0876b33eaa1182899e2c2e6847b3e96c52cdd2

Observation 6cc156d8-ba53-45b8-bbba-2e984b9963bc · outbound

This paper cites [/Experts pool] You need to recruit a total of ${number of agents} experts from the above expert pool to collaboratively solve the given task.

Optimizing LLM-Based Multi-Agent System with Textual Feedback: A Case Study on Software Development [/Experts pool] You need to recruit a total of ${number of agents} experts from the above expert pool to collaboratively solve the given task

Reference 9

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:12:38.045532Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-08-07T15:12:37.285129Z digest=sha256:bee2265abc16f991c79fd837cdb023b2823d43d23d463672e3f3c442bf537dd9

Observation 681e4ec4-8574-48fa-a8a7-a27b9b38d9b3 · outbound

This paper cites an unresolved cited work.

Optimizing LLM-Based Multi-Agent System with Textual Feedback: A Case Study on Software Development Unresolved cited work

Reference 10

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:12:38.306417Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-08-07T15:12:36.917159Z digest=sha256:0aca7ac4f6a292a412e0d5ca9e6f7f2c981e3618de63e1171ee95f52f2bb1145

Observation 10a5ce6f-4cb1-41e6-b48b-535240aad065 · outbound

This paper cites an unresolved cited work.

Optimizing LLM-Based Multi-Agent System with Textual Feedback: A Case Study on Software Development Unresolved cited work

Reference 12

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:12:38.132630Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-08-07T15:12:37.154983Z digest=sha256:c092a8508f0da532dba35746445931d2b95cd557f6e82e40bb76de3dcd58eac2

Observation f8935d43-7e96-4562-8f22-c4d6afbb098e · outbound

This paper cites Also, make sure that you only give a high score when the solution code is really good at satisfying the definition of the evaluation dimension.

Optimizing LLM-Based Multi-Agent System with Textual Feedback: A Case Study on Software Development Also, make sure that you only give a high score when the solution code is really good at satisfying the definition of the evaluation dimension

Reference 14

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:12:37.969111Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-08-07T15:12:37.407708Z digest=sha256:30658571366086d3805a0b1c5bc0d959f879230575c979ba77b2aec53d0d6a54

Observation d7b08d7d-f738-412f-aef9-f665d7bb29af · outbound

This paper cites an unresolved cited work.

Optimizing LLM-Based Multi-Agent System with Textual Feedback: A Case Study on Software Development Unresolved cited work

Reference 15

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:12:37.871770Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-08-07T15:12:37.514578Z digest=sha256:86978db0ca868c0b0186b6b36efc12d4c88f336e2e2a1feb9beb8ac68d349e87

Observation 1353e1ea-4895-410a-a754-6a1c95e2341a · outbound

This paper cites Figure 11: System and user prompt for the locator.

Optimizing LLM-Based Multi-Agent System with Textual Feedback: A Case Study on Software Development Figure 11: System and user prompt for the locator

Reference 16

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:12:37.771103Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-08-07T15:12:37.571410Z digest=sha256:38f2467a3f63e9ad7e6b23c97d6f94e174f580b9bfec632d574d5fa0386490f1

Observation 3d8921f6-1766-48cb-933d-8a5b6c724a3d · outbound

This paper cites gradient descent.

Optimizing LLM-Based Multi-Agent System with Textual Feedback: A Case Study on Software Development gradient descent

Reference 2023

Resolution
unresolved
no resolver link, observed 2026-08-07T15:12:36.161058Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:12:36.161058Z digest=sha256:261a7476a3f0280318ea99aed2624b78a0bc1134d18bae4df26ca2ef8ccc6ba4

Observation 91b3e1b9-12ac-4838-af70-ffc9c0e8bcb1 · outbound

This paper cites Are Large Language Models Good Prompt Optimizers?.

Optimizing LLM-Based Multi-Agent System with Textual Feedback: A Case Study on Software Development Are Large Language Models Good Prompt Optimizers?

Reference 2024

Resolution
unresolved
no resolver link, observed 2026-08-07T15:12:35.988542Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:12:35.988542Z digest=sha256:cc8a17e62fcecb7c7296bc5fdd76e9b7934a819ceff5eb363a58cdea616195dd

Pith citing papers

Observation 99e7ba12-07d0-4657-a0d8-cac8af1da849 · inbound

MAS-PromptBench: When Does Prompt Optimization Improve Multi-Agent LLM Systems? cites this paper.

MAS-PromptBench: When Does Prompt Optimization Improve Multi-Agent LLM Systems? Optimizing LLM-Based Multi-Agent System with Textual Feedback: A Case Study on Software Development

Reference 51

Resolution
verified exact
arxiv_id, observed 2026-07-04T09:59:45.571119Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=arxiv_source observed=2026-06-26T09:15:50.722199Z digest=sha256:09e9ee0989d07e71ef756a221a0bccde5c1dbdea1a23db0a304157cfaab99f79