Pith. sign in

Paper Citation Record · LEDGER

Optimizing LLM-Based Multi-Agent System with Textual Feedback: A Case Study on Software Development

As of 21 August 2026, this Paper Citation Record lists 16 of 16 outbound references and 1 inbound Pith citation observation for arXiv:2505.16086.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2505.16086 v2

Coverage vector

measured 16 of 16 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-07T15:12:37.571410Z

measured 17 of 17 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-21T06:32:19.484+00:00

measured 1 of 1 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-06-26T09:15:50.722199Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-07-04T09:59:45.569733Z

Reference resolution

16 of 16 outbound references displayed

  • verified exact0
  • verified fuzzy3
  • unresolved13
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 57b00b07-afb6-4d20-ba64-ea9719ff3a75 · outbound

This paper cites an unresolved cited work.

Optimizing LLM-Based Multi-Agent System with Textual Feedback: A Case Study on Software Development Unresolved cited work

Reference 1

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:12:38.782597Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

source=pdf_text observed=2026-08-07T15:12:36.358440Z digest=sha256:3e7277a777102cc97a822cd097dae837ca074379af8764d004481f65fb361ecb

Observation 71262754-d894-4f4a-a2d8-3c63aa8ffb1a · outbound

This paper cites LLM Critics Help Catch LLM Bugs.

Optimizing LLM-Based Multi-Agent System with Textual Feedback: A Case Study on Software Development LLM Critics Help Catch LLM Bugs

Reference 2

Resolution
unresolved
no resolver link, observed 2026-08-07T15:12:36.041322Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:12:36.041322Z digest=sha256:2312f4d7329dcedde8bc9137b192d5e39245a6a54588070116b1e04f2e39db80

Observation 98e47070-f628-431a-ac88-05df882335ec · outbound

This paper cites an unresolved cited work.

Optimizing LLM-Based Multi-Agent System with Textual Feedback: A Case Study on Software Development Unresolved cited work

Reference 3

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:12:38.585217Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

source=pdf_text observed=2026-08-07T15:12:36.586932Z digest=sha256:813e9565c2c120ea34cab6adeea24bccbaf4a718a4b7292b08b92f2d9ebe7e5f

Observation 1d40cc74-272d-4687-9d18-d4850bbb55ae · outbound

This paper cites WebPilot: A Versatile and Autonomous Multi-Agent System for Web Task Execution with Strategic Exploration.

Optimizing LLM-Based Multi-Agent System with Textual Feedback: A Case Study on Software Development WebPilot: A Versatile and Autonomous Multi-Agent System for Web Task Execution with Strategic Exploration

Reference 4

Resolution
unresolved
no resolver link, observed 2026-08-07T15:12:36.251017Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:12:36.251017Z digest=sha256:ef97153c783ea7f5e8912994832800a5423e737cee65aad1d2538de9dd255c42

Observation 9f28627f-3974-402b-964b-0fe607ad1f7b · outbound

This paper cites an unresolved cited work.

Optimizing LLM-Based Multi-Agent System with Textual Feedback: A Case Study on Software Development Unresolved cited work

Reference 5

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:12:38.404875Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

source=pdf_text observed=2026-08-07T15:12:36.791139Z digest=sha256:02c6ab53becf487dc5dcce24193d8635befe6cdae6a1227928fffa4081c412cb

Observation 36dee761-64ea-4b8d-9d41-123262036a44 · outbound

This paper cites an unresolved cited work.

Optimizing LLM-Based Multi-Agent System with Textual Feedback: A Case Study on Software Development Unresolved cited work

Reference 6

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:12:38.679996Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

source=pdf_text observed=2026-08-07T15:12:36.481980Z digest=sha256:70c5d5fc05bc82e754599802ad98ccab6ea5147ca6fe08e0265a1d9e32fec63a

Observation f4e3ab12-0489-4a29-b318-a70e628e31d8 · outbound

This paper cites an unresolved cited work.

Optimizing LLM-Based Multi-Agent System with Textual Feedback: A Case Study on Software Development Unresolved cited work

Reference 7

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:12:38.237594Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

source=pdf_text observed=2026-08-07T15:12:37.064525Z digest=sha256:c71431fe083214e57a683eb332dd1ff29e295dfaf98142a404b09bab9f2d5b5e

Observation 4d2f308d-738b-49af-a260-1f452613de33 · outbound

This paper cites an unresolved cited work.

Optimizing LLM-Based Multi-Agent System with Textual Feedback: A Case Study on Software Development Unresolved cited work

Reference 8

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:12:38.494608Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

source=pdf_text observed=2026-08-07T15:12:36.703811Z digest=sha256:19d4e838661aeded3d46d183d1221558d8db8a0fb73bda2134db1c52be50df71

Observation 6cc156d8-ba53-45b8-bbba-2e984b9963bc · outbound

This paper cites [/Experts pool] You need to recruit a total of ${number of agents} experts from the above expert pool to collaboratively solve the given task.

Optimizing LLM-Based Multi-Agent System with Textual Feedback: A Case Study on Software Development [/Experts pool] You need to recruit a total of ${number of agents} experts from the above expert pool to collaboratively solve the given task

Reference 9

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:12:38.045532Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

source=pdf_text observed=2026-08-07T15:12:37.285129Z digest=sha256:ed3392b9a37b3134df5cdf608b7ff4a5f16a0f88ebc89bd1f8e9072828806712

Observation 681e4ec4-8574-48fa-a8a7-a27b9b38d9b3 · outbound

This paper cites an unresolved cited work.

Optimizing LLM-Based Multi-Agent System with Textual Feedback: A Case Study on Software Development Unresolved cited work

Reference 10

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:12:38.306417Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

source=pdf_text observed=2026-08-07T15:12:36.917159Z digest=sha256:fcd35ccb3a3daa9bf9c0a2aaf3ba69baf4dcd71654bef05e0ec2c212391d617d

Observation 10a5ce6f-4cb1-41e6-b48b-535240aad065 · outbound

This paper cites an unresolved cited work.

Optimizing LLM-Based Multi-Agent System with Textual Feedback: A Case Study on Software Development Unresolved cited work

Reference 12

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:12:38.132630Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

source=pdf_text observed=2026-08-07T15:12:37.154983Z digest=sha256:ecfbc88c0e8ecf36bdd59ebcbc8b5eec61b33368bb0098d70a32ed27d350b230

Observation f8935d43-7e96-4562-8f22-c4d6afbb098e · outbound

This paper cites Also, make sure that you only give a high score when the solution code is really good at satisfying the definition of the evaluation dimension.

Optimizing LLM-Based Multi-Agent System with Textual Feedback: A Case Study on Software Development Also, make sure that you only give a high score when the solution code is really good at satisfying the definition of the evaluation dimension

Reference 14

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:12:37.969111Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

source=pdf_text observed=2026-08-07T15:12:37.407708Z digest=sha256:054ee044e953b598257ebebac90afc082a174edefd9c33a45aa68a609dfacfa7

Observation d7b08d7d-f738-412f-aef9-f665d7bb29af · outbound

This paper cites an unresolved cited work.

Optimizing LLM-Based Multi-Agent System with Textual Feedback: A Case Study on Software Development Unresolved cited work

Reference 15

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:12:37.871770Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

source=pdf_text observed=2026-08-07T15:12:37.514578Z digest=sha256:4ff653cfbd510d6a1cedbfb87f1cd3281ab9ca10ae70c84f62795d24a57dc60a

Observation 1353e1ea-4895-410a-a754-6a1c95e2341a · outbound

This paper cites Figure 11: System and user prompt for the locator.

Optimizing LLM-Based Multi-Agent System with Textual Feedback: A Case Study on Software Development Figure 11: System and user prompt for the locator

Reference 16

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:12:37.771103Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

source=pdf_text observed=2026-08-07T15:12:37.571410Z digest=sha256:ae9c6ee237c13f5243304a7c7e43e992e82b2ba282ccb71252cc0caf0d4bf894

Observation 3d8921f6-1766-48cb-933d-8a5b6c724a3d · outbound

This paper cites gradient descent.

Optimizing LLM-Based Multi-Agent System with Textual Feedback: A Case Study on Software Development gradient descent

Reference 2023

Resolution
unresolved
no resolver link, observed 2026-08-07T15:12:36.161058Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:12:36.161058Z digest=sha256:261a7476a3f0280318ea99aed2624b78a0bc1134d18bae4df26ca2ef8ccc6ba4

Observation 91b3e1b9-12ac-4838-af70-ffc9c0e8bcb1 · outbound

This paper cites Are Large Language Models Good Prompt Optimizers?.

Optimizing LLM-Based Multi-Agent System with Textual Feedback: A Case Study on Software Development Are Large Language Models Good Prompt Optimizers?

Reference 2024

Resolution
unresolved
no resolver link, observed 2026-08-07T15:12:35.988542Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:12:35.988542Z digest=sha256:cc8a17e62fcecb7c7296bc5fdd76e9b7934a819ceff5eb363a58cdea616195dd

Pith citing papers

Observation 99e7ba12-07d0-4657-a0d8-cac8af1da849 · inbound

MAS-PromptBench: When Does Prompt Optimization Improve Multi-Agent LLM Systems? cites this paper.

MAS-PromptBench: When Does Prompt Optimization Improve Multi-Agent LLM Systems? Optimizing LLM-Based Multi-Agent System with Textual Feedback: A Case Study on Software Development

Reference 51

Resolution
verified exact
arxiv_id, observed 2026-07-04T09:59:45.571119Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

source=arxiv_source observed=2026-06-26T09:15:50.722199Z digest=sha256:c1ea9741bcc51879e1721f8b89a18f259f0bfee24e383e0bbbaae4b7e00eb661