Pith. sign in

Paper Citation Record · LEDGER

GEMMAS: Graph-based Evaluation Metrics for Multi Agent Systems

As of 18 August 2026, this Paper Citation Record lists 24 of 24 outbound references and 0 inbound Pith citation observations for arXiv:2507.13190.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2507.13190 v1

Coverage vector

measured 24 of 24 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-06T16:32:46.738028Z

measured 24 of 24 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-18T06:34:40.430872+00:00

measured 0 of 0 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: cited_works

Reference resolution

24 of 24 outbound references displayed

  • verified exact0
  • verified fuzzy0
  • unresolved24
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 58d6ab0e-0c90-4790-b4b3-ceeb014d5590 · outbound

This paper cites GPT-4 Technical Report.

GEMMAS: Graph-based Evaluation Metrics for Multi Agent Systems GPT-4 Technical Report

Reference 1

Resolution
unresolved
no resolver link, observed 2026-08-06T16:32:45.283390Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-06T16:32:45.283390Z digest=sha256:fa0a92664d4843fd847f48eeb6b98f17d0cd0ae45c529afe9f8b29f05b542583

Observation 07449451-32c7-488c-a017-59e43ca001d9 · outbound

This paper cites Qwen Technical Report.

GEMMAS: Graph-based Evaluation Metrics for Multi Agent Systems Qwen Technical Report

Reference 2

Resolution
unresolved
no resolver link, observed 2026-08-06T16:32:45.338160Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-06T16:32:45.338160Z digest=sha256:755f549f488402564fe34f444d0ec5b98e77537d9aa70d266a7bf55b65b82577

Observation 5c9a6b5e-8d3c-485b-a556-63da74bd110b · outbound

This paper cites AgentVerse: Facilitating Multi-Agent Collaboration and Exploring Emergent Behaviors.

GEMMAS: Graph-based Evaluation Metrics for Multi Agent Systems AgentVerse: Facilitating Multi-Agent Collaboration and Exploring Emergent Behaviors

Reference 3

Resolution
unresolved
no resolver link, observed 2026-08-06T16:32:45.475210Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-06T16:32:45.475210Z digest=sha256:dfa8ff82461f076e83d096f665a0a805fd395d5c27eb56935ea50400b658c479

Observation 4d11d178-5f5d-4b4d-bdc3-d211244ca9ab · outbound

This paper cites Training Verifiers to Solve Math Word Problems.

GEMMAS: Graph-based Evaluation Metrics for Multi Agent Systems Training Verifiers to Solve Math Word Problems

Reference 4

Resolution
unresolved
no resolver link, observed 2026-08-06T16:32:45.546141Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-06T16:32:45.546141Z digest=sha256:1b0664ef09f3dae25fcb8c6bdbe757ee6f0c6109a831f57f9f2a7f8af41704f4

Observation 8bc62629-9426-4f48-96c3-c16794dacb28 · outbound

This paper cites an unresolved cited work.

GEMMAS: Graph-based Evaluation Metrics for Multi Agent Systems Unresolved cited work

Reference 5

Resolution
unresolved
no resolver link, observed 2026-08-06T16:32:45.643734Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-06T16:32:45.643734Z digest=sha256:c7f602375cca7d2764f201254064559b0b5a13d466a6987eae933f23210ec245

Observation 81d3c6a1-761c-4d88-bad6-77e9022d741e · outbound

This paper cites an unresolved cited work.

GEMMAS: Graph-based Evaluation Metrics for Multi Agent Systems Unresolved cited work

Reference 6

Resolution
unresolved
no resolver link, observed 2026-08-06T16:32:45.729759Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-06T16:32:45.729759Z digest=sha256:4aa8712145bd0c402c87a7422dd34a5740e29dad1505c7d71f45e57e37c02143

Observation 83afe228-ee6d-4c49-b5ff-7565bf8a5ccf · outbound

This paper cites The Llama 3 Herd of Models.

GEMMAS: Graph-based Evaluation Metrics for Multi Agent Systems The Llama 3 Herd of Models

Reference 7

Resolution
unresolved
no resolver link, observed 2026-08-06T16:32:45.816466Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-06T16:32:45.816466Z digest=sha256:00c4d426ef88819c5746db276ffa45d60fdd5d089ad655c8f495d8d3eaa74ea3

Observation 0eecd898-7752-4d60-8ff6-31a7eb44ee93 · outbound

This paper cites an unresolved cited work.

GEMMAS: Graph-based Evaluation Metrics for Multi Agent Systems Unresolved cited work

Reference 8

Resolution
unresolved
no resolver link, observed 2026-08-06T16:32:45.925496Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-06T16:32:45.925496Z digest=sha256:2a215b41faa9624b4ccb67d7b864cafe23db2bff55b5c70609254e6b00fa22b1

Observation e192a4f0-075f-40db-8531-88ad272a7453 · outbound

This paper cites A Diversity-Promoting Objective Function for Neural Conversation Models.

GEMMAS: Graph-based Evaluation Metrics for Multi Agent Systems A Diversity-Promoting Objective Function for Neural Conversation Models

Reference 9

Resolution
unresolved
no resolver link, observed 2026-08-06T16:32:45.993247Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-06T16:32:45.993247Z digest=sha256:5b714addf47e968532c5736c1b6a36e3d1e73822df7954c2e9c0bb44d1c708a2

Observation 074ee321-72cb-43ee-8d37-8ae80fd88cf0 · outbound

This paper cites an unresolved cited work.

GEMMAS: Graph-based Evaluation Metrics for Multi Agent Systems Unresolved cited work

Reference 10

Resolution
unresolved
no resolver link, observed 2026-08-06T16:32:46.054573Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-06T16:32:46.054573Z digest=sha256:b45a74c306f044b5befbb306c644f68f408cd54f6228f4c0f109fadf0c3b0d09

Observation 8fd73add-634f-4902-b74d-52e9b3f0d8cb · outbound

This paper cites AgentBench: Evaluating LLMs as Agents.

GEMMAS: Graph-based Evaluation Metrics for Multi Agent Systems AgentBench: Evaluating LLMs as Agents

Reference 11

Resolution
unresolved
no resolver link, observed 2026-08-06T16:32:46.103936Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-06T16:32:46.103936Z digest=sha256:6ba130f84f9b2e9ee5575116f3dfa86e64d0af2f3e1f45e48bd75758f829f781

Observation e72261ed-8f67-4ffe-93ac-33156ce75bb4 · outbound

This paper cites Ensembling Large Language Models with Process Reward-Guided Tree Search for Better Complex Reasoning.

GEMMAS: Graph-based Evaluation Metrics for Multi Agent Systems Ensembling Large Language Models with Process Reward-Guided Tree Search for Better Complex Reasoning

Reference 12

Resolution
unresolved
no resolver link, observed 2026-08-06T16:32:46.143917Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-06T16:32:46.143917Z digest=sha256:070d1b68bf635d1a22c91f71fc74b9677ec1c4781d321f8b0e3d19a65a4decf0

Observation 893baf41-7972-4e8e-909e-2388a8d46366 · outbound

This paper cites an unresolved cited work.

GEMMAS: Graph-based Evaluation Metrics for Multi Agent Systems Unresolved cited work

Reference 13

Resolution
unresolved
no resolver link, observed 2026-08-06T16:32:46.205789Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-06T16:32:46.205789Z digest=sha256:2aeb5fe62bf1681f751c17dc32d53f2677feff678b053e546347fb2967ebceb2

Observation 9b28ae04-2316-4f0d-b974-c685b09b41c1 · outbound

This paper cites an unresolved cited work.

GEMMAS: Graph-based Evaluation Metrics for Multi Agent Systems Unresolved cited work

Reference 14

Resolution
unresolved
no resolver link, observed 2026-08-06T16:32:46.266733Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-06T16:32:46.266733Z digest=sha256:311b0554cb5d47657324108f7a2a37ca386667e3a4757d89538d13972fdbdf9d

Observation fd6e25a2-9f51-4b9f-87e2-dac3aaf22a78 · outbound

This paper cites an unresolved cited work.

GEMMAS: Graph-based Evaluation Metrics for Multi Agent Systems Unresolved cited work

Reference 15

Resolution
unresolved
no resolver link, observed 2026-08-06T16:32:46.282362Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-06T16:32:46.282362Z digest=sha256:3a293253a098f7a444f816ff08bec175a67ee742037a3ec758530ef10bb4c6c0

Observation 0f523a21-9b4f-44bd-8a1a-b89adbe70bbc · outbound

This paper cites an unresolved cited work.

GEMMAS: Graph-based Evaluation Metrics for Multi Agent Systems Unresolved cited work

Reference 16

Resolution
unresolved
no resolver link, observed 2026-08-06T16:32:46.341320Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-06T16:32:46.341320Z digest=sha256:044212e845b326e769cddb79b801b728dd7640b20e158bd774ebfbc60c4f9f0f

Observation 36654da7-4944-44ec-87eb-dca38f12e7aa · outbound

This paper cites LLaMA: Open and Efficient Foundation Language Models.

GEMMAS: Graph-based Evaluation Metrics for Multi Agent Systems LLaMA: Open and Efficient Foundation Language Models

Reference 17

Resolution
unresolved
no resolver link, observed 2026-08-06T16:32:46.406606Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-06T16:32:46.406606Z digest=sha256:2beb97f4c2fdf94e402d1c7e3dac64f059d356fba107d3731bb5eb02ac474e72

Observation d5556b73-0d1a-451d-b9f4-09c04befa02e · outbound

This paper cites AgentDropout: Dynamic Agent Elimination for Token-Efficient and High-Performance LLM-Based Multi-Agent Collaboration.

GEMMAS: Graph-based Evaluation Metrics for Multi Agent Systems AgentDropout: Dynamic Agent Elimination for Token-Efficient and High-Performance LLM-Based Multi-Agent Collaboration

Reference 18

Resolution
unresolved
no resolver link, observed 2026-08-06T16:32:46.438272Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-06T16:32:46.438272Z digest=sha256:907878f13d3917fa272f8939afa2c8b274475430258e7e5196649498dfef442e

Observation a4154ee9-0e04-4976-b907-674121c03cae · outbound

This paper cites Qwen3 Technical Report.

GEMMAS: Graph-based Evaluation Metrics for Multi Agent Systems Qwen3 Technical Report

Reference 19

Resolution
unresolved
no resolver link, observed 2026-08-06T16:32:46.499381Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-06T16:32:46.499381Z digest=sha256:8ef012b06e2f9e89f69ba7400bd55089daf976e2e09ed547c9545e4e451ec6ae

Observation a7e4301c-0efb-4db5-8d2b-41717004db85 · outbound

This paper cites Cut the Crap: An Economical Communication Pipeline for LLM-based Multi-Agent Systems.

GEMMAS: Graph-based Evaluation Metrics for Multi Agent Systems Cut the Crap: An Economical Communication Pipeline for LLM-based Multi-Agent Systems

Reference 20

Resolution
unresolved
no resolver link, observed 2026-08-06T16:32:46.559716Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-06T16:32:46.559716Z digest=sha256:94848439413c386f48d069b8eae5a1abf53e9a93bce8238dc232fbe7a69f0c6a

Observation a87486a9-6178-49a6-a886-216b62f48280 · outbound

This paper cites G-Designer: Architecting Multi-agent Communication Topologies via Graph Neural Networks.

GEMMAS: Graph-based Evaluation Metrics for Multi Agent Systems G-Designer: Architecting Multi-agent Communication Topologies via Graph Neural Networks

Reference 21

Resolution
unresolved
no resolver link, observed 2026-08-06T16:32:46.583795Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-06T16:32:46.583795Z digest=sha256:9c47c053ec299299bc8e11dab461d4e9594bf2655be608ff66d1af59232ee9fc

Observation bf227277-b30b-4217-8e9d-ec0e940627db · outbound

This paper cites an unresolved cited work.

GEMMAS: Graph-based Evaluation Metrics for Multi Agent Systems Unresolved cited work

Reference 22

Resolution
unresolved
no resolver link, observed 2026-08-06T16:32:46.644031Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-06T16:32:46.644031Z digest=sha256:d0d7d51596de864ccccc9f9745723db9471d10e1a673217f4e55ea84f01273d6

Observation cd993823-0b3f-44c6-9ae6-006e5e06ebff · outbound

This paper cites online" 'onlinestring :=.

GEMMAS: Graph-based Evaluation Metrics for Multi Agent Systems online" 'onlinestring :=

Reference 23

Resolution
unresolved
no resolver link, observed 2026-08-06T16:32:46.704892Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-06T16:32:46.704892Z digest=sha256:ed1a00d2f26a9e012d52d344c71a2ca58ef22be6221b0a364ce81d7cbca05e85

Observation 9bcfec94-560f-4a08-a2db-dc03f78c66e0 · outbound

This paper cites write newline.

GEMMAS: Graph-based Evaluation Metrics for Multi Agent Systems write newline

Reference 24

Resolution
unresolved
no resolver link, observed 2026-08-06T16:32:46.738028Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-06T16:32:46.738028Z digest=sha256:cb6d32fd8ea4d9ea5c51012f4ac731fc313f3e9d6eb83b0a7afc105db1950df4

Pith citing papers

No inbound Pith citation observations are available.