Paper Citation Record · LEDGER

MORTAR: Multi-turn Metamorphic Testing for LLM-based Dialogue Systems

As of 17 August 2026, this Paper Citation Record lists 56 of 56 outbound references and 2 inbound Pith citation observations for arXiv:2412.15557.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2412.15557 v4

Coverage vector

measured 56 of 56 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-11T11:22:56.865686Z

measured 58 of 58 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-17T06:30:58.91139+00:00

measured 2 of 2 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-05T14:55:56.666623Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-05-15T05:19:46.615078Z

Reference resolution

56 of 56 outbound references displayed

verified exact1
verified fuzzy32
unresolved23
parse uncertain0
malformed identifier0
metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation cd5da5e4-d763-425d-8245-21bb7407f39c · outbound

This paper cites A review of dialogue systems: current trends and future directions,.

MORTAR: Multi-turn Metamorphic Testing for LLM-based Dialogue Systems A review of dialogue systems: current trends and future directions,

Reference 1

Resolution: verified fuzzy; raw_fallback, observed 2026-08-11T11:22:57.697758Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation 069dff8c-2df6-49a9-84bd-42f5311879f6 · outbound

This paper cites Software testing of generative ai systems: Challenges and opportunities,.

MORTAR: Multi-turn Metamorphic Testing for LLM-based Dialogue Systems Software testing of generative ai systems: Challenges and opportunities,

Reference 2

Resolution: verified fuzzy; raw_fallback, observed 2026-08-11T11:22:57.683310Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation 6fa4f9ae-75d9-449a-9f38-3471c356838e · outbound

This paper cites Hotpotqa: A dataset for diverse, explainable multi- hop question answering,.

MORTAR: Multi-turn Metamorphic Testing for LLM-based Dialogue Systems Hotpotqa: A dataset for diverse, explainable multi- hop question answering,

Reference 3

Resolution: verified fuzzy; raw_fallback, observed 2026-08-11T11:22:57.668160Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation 1fcf0792-1540-4255-b963-2876d245627f · outbound

This paper cites Decodingtrust: A comprehensive assessment of trustworthiness in gpt models.

MORTAR: Multi-turn Metamorphic Testing for LLM-based Dialogue Systems Decodingtrust: A comprehensive assessment of trustworthiness in gpt models

Reference 4

Resolution: verified fuzzy; raw_fallback, observed 2026-08-11T11:22:57.653480Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation 499566f3-2434-4cdd-9078-95b8bb5a7bcd · outbound

This paper cites Measuring Massive Multitask Language Understanding.

MORTAR: Multi-turn Metamorphic Testing for LLM-based Dialogue Systems Measuring Massive Multitask Language Understanding

Reference 5

Resolution: unresolved; no resolver link, observed 2026-08-11T11:22:56.614625Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation bb1c302b-7e4f-4c79-a870-5c3cbcf6c383 · outbound

This paper cites GPQA: A Graduate-Level Google-Proof Q&A Benchmark.

MORTAR: Multi-turn Metamorphic Testing for LLM-based Dialogue Systems GPQA: A Graduate-Level Google-Proof Q&A Benchmark

Reference 6

Resolution: unresolved; no resolver link, observed 2026-08-11T11:22:56.619709Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation a7f683bf-66bc-40a8-9c36-4172a54a3a27 · outbound

This paper cites A survey on evaluation of large language models,.

MORTAR: Multi-turn Metamorphic Testing for LLM-based Dialogue Systems A survey on evaluation of large language models,

Reference 7

Resolution: unresolved; no resolver link, observed 2026-08-11T11:22:56.625099Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 769be06d-e7b7-47a2-95e8-08677ad9b1a5 · outbound

This paper cites ShareGPT Data,.

MORTAR: Multi-turn Metamorphic Testing for LLM-based Dialogue Systems ShareGPT Data,

Reference 8

Resolution: verified fuzzy; raw_fallback, observed 2026-08-11T11:22:57.628738Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation 75876efb-9200-462b-8abe-be8ed00a86b0 · outbound

This paper cites LLM Defenses Are Not Robust to Multi-Turn Human Jailbreaks Yet.

MORTAR: Multi-turn Metamorphic Testing for LLM-based Dialogue Systems LLM Defenses Are Not Robust to Multi-Turn Human Jailbreaks Yet

Reference 9

Resolution: unresolved; no resolver link, observed 2026-08-11T11:22:56.634008Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 122dbb91-1f5a-4e53-a094-6b990a864e5c · outbound

This paper cites MT-bench-101: A fine-grained benchmark for evaluating large language models in multi-turn dialogues,.

MORTAR: Multi-turn Metamorphic Testing for LLM-based Dialogue Systems MT-bench-101: A fine-grained benchmark for evaluating large language models in multi-turn dialogues,

Reference 10

Resolution: verified fuzzy; raw_fallback, observed 2026-08-11T11:22:57.614487Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation 662f4db7-c759-4fab-bdd2-7d671afac391 · outbound

This paper cites Judging llm-as-a-judge with mt-bench and chatbot arena,.

MORTAR: Multi-turn Metamorphic Testing for LLM-based Dialogue Systems Judging llm-as-a-judge with mt-bench and chatbot arena,

Reference 11

Resolution: unresolved; no resolver link, observed 2026-08-11T11:22:56.643140Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation a903227b-2518-481d-9957-2412a706135e · outbound

This paper cites Appli- cation of metamorphic testing in numerical analysis,.

MORTAR: Multi-turn Metamorphic Testing for LLM-based Dialogue Systems Appli- cation of metamorphic testing in numerical analysis,

Reference 13

Resolution: verified fuzzy; raw_fallback, observed 2026-08-11T11:22:57.589805Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation 1f1d8f1d-ec60-4c42-a527-4d7a36b44144 · outbound

This paper cites Testing your question answering software via asking recursively,.

MORTAR: Multi-turn Metamorphic Testing for LLM-based Dialogue Systems Testing your question answering software via asking recursively,

Reference 14

Resolution: verified fuzzy; raw_fallback, observed 2026-08-11T11:22:57.574992Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation 4f909497-011e-4753-9cdd-801c2411cbf4 · outbound

This paper cites Metal: Metamorphic testing framework for analyzing large-language model qualities,.

MORTAR: Multi-turn Metamorphic Testing for LLM-based Dialogue Systems Metal: Metamorphic testing framework for analyzing large-language model qualities,

Reference 16

Resolution: verified fuzzy; raw_fallback, observed 2026-08-11T11:22:57.546199Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation aedc3dfa-54dd-4ef7-9ee4-4b3686601f68 · outbound

This paper cites Neural approaches to conversational ai,.

MORTAR: Multi-turn Metamorphic Testing for LLM-based Dialogue Systems Neural approaches to conversational ai,

Reference 17

Resolution: verified fuzzy; raw_fallback, observed 2026-08-11T11:22:57.530963Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation 220a23ff-2156-4662-a256-d32c159d9f24 · outbound

This paper cites Coqa: A conversational question answering challenge,.

MORTAR: Multi-turn Metamorphic Testing for LLM-based Dialogue Systems Coqa: A conversational question answering challenge,

Reference 18

Resolution: verified fuzzy; raw_fallback, observed 2026-08-11T11:22:57.514915Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation 21103b77-a78f-42e8-98c3-2bd3807b01a7 · outbound

This paper cites A survey of dialogue system evaluation,.

MORTAR: Multi-turn Metamorphic Testing for LLM-based Dialogue Systems A survey of dialogue system evaluation,

Reference 19

Resolution: verified fuzzy; raw_fallback, observed 2026-08-11T11:22:57.500603Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation cebd7e80-5b9d-468f-adfc-b00a36abe7e8 · outbound

This paper cites Evaluating Large Language Models: A Comprehensive Survey.

MORTAR: Multi-turn Metamorphic Testing for LLM-based Dialogue Systems Evaluating Large Language Models: A Comprehensive Survey

Reference 20

Resolution: unresolved; no resolver link, observed 2026-08-11T11:22:56.682754Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 512b31bf-753c-402a-aa56-d99f9a4ad693 · outbound

This paper cites DialoGLUE: A Natural Language Understanding Benchmark for Task-Oriented Dialogue.

MORTAR: Multi-turn Metamorphic Testing for LLM-based Dialogue Systems DialoGLUE: A Natural Language Understanding Benchmark for Task-Oriented Dialogue

Reference 21

Resolution: unresolved; no resolver link, observed 2026-08-11T11:22:56.687426Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 03b49369-5801-459d-86ed-8da74b0d23b5 · outbound

This paper cites Drowzee: Metamorphic testing for fact-conflicting hallucination detection in large language models,.

MORTAR: Multi-turn Metamorphic Testing for LLM-based Dialogue Systems Drowzee: Metamorphic testing for fact-conflicting hallucination detection in large language models,

Reference 22

Resolution: unresolved; no resolver link, observed 2026-08-11T11:22:56.692088Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 07ce1f3a-6e0d-4698-93b8-0d15661efa1d · outbound

This paper cites Leveraging large language models for nlg evaluation: Advances and challenges,.

MORTAR: Multi-turn Metamorphic Testing for LLM-based Dialogue Systems Leveraging large language models for nlg evaluation: Advances and challenges,

Reference 23

Resolution: verified fuzzy; raw_fallback, observed 2026-08-11T11:22:57.485891Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation e166fa5e-c210-4f11-a55c-35b1573ba0f3 · outbound

This paper cites DialogBench: Evaluating LLMs as Human-like Dialogue Systems.

MORTAR: Multi-turn Metamorphic Testing for LLM-based Dialogue Systems DialogBench: Evaluating LLMs as Human-like Dialogue Systems

Reference 24

Resolution: verified exact; local_arxiv, observed 2026-08-11T11:22:57.058752Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation 68e838b5-9a1c-47fd-892c-7425c794e264 · outbound

This paper cites GSM-Symbolic: Understanding the Limitations of Mathematical Reasoning in Large Language Models.

MORTAR: Multi-turn Metamorphic Testing for LLM-based Dialogue Systems GSM-Symbolic: Understanding the Limitations of Mathematical Reasoning in Large Language Models

Reference 25

Resolution: unresolved; no resolver link, observed 2026-08-11T11:22:56.706061Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 063417dd-fc9b-481b-a57c-626b2c45513d · outbound

This paper cites Parrot: Enhancing multi-turn instruction fol- lowing for large language models,.

MORTAR: Multi-turn Metamorphic Testing for LLM-based Dialogue Systems Parrot: Enhancing multi-turn instruction fol- lowing for large language models,

Reference 26

Resolution: verified fuzzy; raw_fallback, observed 2026-08-11T11:22:57.471940Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation 83aea4ad-7624-47e5-8d3b-e0ca6f8fcdae · outbound

This paper cites MT-Eval: A Multi-Turn Capabilities Evaluation Benchmark for Large Language Models.

MORTAR: Multi-turn Metamorphic Testing for LLM-based Dialogue Systems MT-Eval: A Multi-Turn Capabilities Evaluation Benchmark for Large Language Models

Reference 27

Resolution: unresolved; no resolver link, observed 2026-08-11T11:22:56.715566Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation cc51e12d-9b0c-4636-b45d-2e8181925a91 · outbound

This paper cites MINT: Evaluating LLMs in Multi-turn Interaction with Tools and Language Feedback.

MORTAR: Multi-turn Metamorphic Testing for LLM-based Dialogue Systems MINT: Evaluating LLMs in Multi-turn Interaction with Tools and Language Feedback

Reference 28

Resolution: unresolved; no resolver link, observed 2026-08-11T11:22:56.721158Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 7745d24c-fa75-455a-acea-86af814f6c8d · outbound

This paper cites BotChat: Evaluating LLMs’ capabilities of having multi-turn dialogues,.

MORTAR: Multi-turn Metamorphic Testing for LLM-based Dialogue Systems BotChat: Evaluating LLMs’ capabilities of having multi-turn dialogues,

Reference 29

Resolution: verified fuzzy; raw_fallback, observed 2026-08-11T11:22:57.456991Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation 65f4c591-b58d-4cd9-91d7-b4680f66caf1 · outbound

This paper cites A survey on metamorphic testing,.

MORTAR: Multi-turn Metamorphic Testing for LLM-based Dialogue Systems A survey on metamorphic testing,

Reference 30

Resolution: unresolved; no resolver link, observed 2026-08-11T11:22:56.731001Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 5efa980f-5fab-4174-8fdd-9fe24a249e5d · outbound

This paper cites Metamorphic Testing: A New Approach for Generating Next Test Cases.

MORTAR: Multi-turn Metamorphic Testing for LLM-based Dialogue Systems Metamorphic Testing: A New Approach for Generating Next Test Cases

Reference 31

Resolution: unresolved; no resolver link, observed 2026-08-11T11:22:56.735593Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 25b83a0f-8c07-4164-a6b2-072fae49bc1f · outbound

This paper cites Metamorphic testing: A review of challenges and opportunities,.

MORTAR: Multi-turn Metamorphic Testing for LLM-based Dialogue Systems Metamorphic testing: A review of challenges and opportunities,

Reference 32

Resolution: unresolved; no resolver link, observed 2026-08-11T11:22:56.740449Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 613f4ce7-4151-4c5d-92ff-61037b05e7f4 · outbound

This paper cites Machine learning test- ing: Survey, landscapes and horizons,.

MORTAR: Multi-turn Metamorphic Testing for LLM-based Dialogue Systems Machine learning test- ing: Survey, landscapes and horizons,

Reference 33

Resolution: verified fuzzy; raw_fallback, observed 2026-08-11T11:22:57.423816Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation 0b89fa87-c083-4589-8a7f-e8d7d84baf51 · outbound

This paper cites Natural test generation for precise testing of question answering software,.

MORTAR: Multi-turn Metamorphic Testing for LLM-based Dialogue Systems Natural test generation for precise testing of question answering software,

Reference 34

Resolution: verified fuzzy; raw_fallback, observed 2026-08-11T11:22:57.560566Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation 31ac894d-a33b-4956-b466-07b1d114f783 · outbound

This paper cites Dialtest: automated testing for recurrent- neural-network-driven dialogue systems,.

MORTAR: Multi-turn Metamorphic Testing for LLM-based Dialogue Systems Dialtest: automated testing for recurrent- neural-network-driven dialogue systems,

Reference 35

Resolution: verified fuzzy; raw_fallback, observed 2026-08-11T11:22:57.408643Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation 88e64ce3-1dea-4d28-8fce-c6cae94592b5 · outbound

This paper cites A metamorphic testing approach for assessing question answering systems,.

MORTAR: Multi-turn Metamorphic Testing for LLM-based Dialogue Systems A metamorphic testing approach for assessing question answering systems,

Reference 36

Resolution: verified fuzzy; raw_fallback, observed 2026-08-11T11:22:57.392673Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation 7d54273a-4860-4fdd-bd69-a2e27b4f9a5a · outbound

This paper cites Filling conversation ellipsis for better social dialog understanding,.

MORTAR: Multi-turn Metamorphic Testing for LLM-based Dialogue Systems Filling conversation ellipsis for better social dialog understanding,

Reference 37

Resolution: verified fuzzy; raw_fallback, observed 2026-08-11T11:22:57.377992Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation 3805f2ee-723b-4c3e-b3d2-89f0d6c20690 · outbound

This paper cites Mitkov,The Oxford handbook of computational linguistics.

MORTAR: Multi-turn Metamorphic Testing for LLM-based Dialogue Systems Mitkov,The Oxford handbook of computational linguistics

Reference 38

Resolution: verified fuzzy; raw_fallback, observed 2026-08-11T11:22:57.363558Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation 00292d6e-3572-46b5-9752-128585074f1d · outbound

This paper cites Anaphora and coreference resolution: A review,.

MORTAR: Multi-turn Metamorphic Testing for LLM-based Dialogue Systems Anaphora and coreference resolution: A review,

Reference 39

Resolution: verified fuzzy; raw_fallback, observed 2026-08-11T11:22:57.348344Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation 7660433f-916d-4a20-8e91-76ec2bf79167 · outbound

This paper cites From Local to Global: A Graph RAG Approach to Query-Focused Summarization.

MORTAR: Multi-turn Metamorphic Testing for LLM-based Dialogue Systems From Local to Global: A Graph RAG Approach to Query-Focused Summarization

Reference 40

Resolution: unresolved; no resolver link, observed 2026-08-11T11:22:56.777537Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 3e36c39f-b3fe-41a0-80f8-8d8f09233ac6 · outbound

This paper cites Extract, Define, Canonicalize: An LLM-based Framework for Knowledge Graph Construction.

MORTAR: Multi-turn Metamorphic Testing for LLM-based Dialogue Systems Extract, Define, Canonicalize: An LLM-based Framework for Knowledge Graph Construction

Reference 41

Resolution: unresolved; no resolver link, observed 2026-08-11T11:22:56.783874Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation d24dfe24-c8f9-49e2-909c-4909b472331a · outbound

This paper cites Qwen2 Technical Report.

MORTAR: Multi-turn Metamorphic Testing for LLM-based Dialogue Systems Qwen2 Technical Report

Reference 42

Resolution: unresolved; no resolver link, observed 2026-08-11T11:22:56.788561Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation f44c7dc7-1453-4dac-8ab4-83451743b9f2 · outbound

This paper cites Mistral-7b-instruct-v0.3 model,.

MORTAR: Multi-turn Metamorphic Testing for LLM-based Dialogue Systems Mistral-7b-instruct-v0.3 model,

Reference 43

Resolution: verified fuzzy; raw_fallback, observed 2026-08-11T11:22:57.332368Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation 27cfddac-bc88-45e5-b4de-b3e79efe66cc · outbound

This paper cites Llama 3 model card,.

MORTAR: Multi-turn Metamorphic Testing for LLM-based Dialogue Systems Llama 3 model card,

Reference 44

Resolution: unresolved; no resolver link, observed 2026-08-11T11:22:56.798663Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 7a902399-1bbe-4704-9bac-673685245328 · outbound

This paper cites Team, “Gemma,” 2024.

MORTAR: Multi-turn Metamorphic Testing for LLM-based Dialogue Systems Team, “Gemma,” 2024

Reference 45

Resolution: unresolved; no resolver link, observed 2026-08-11T11:22:56.803091Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 48cab994-c9a8-41c6-875c-f3f5dfed7237 · outbound

This paper cites Language mod- els are few-shot learners,.

MORTAR: Multi-turn Metamorphic Testing for LLM-based Dialogue Systems Language mod- els are few-shot learners,

Reference 46

Resolution: unresolved; no resolver link, observed 2026-08-11T11:22:56.807530Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 3cfade8e-dcd7-4b77-9909-06065e854648 · outbound

This paper cites SQuAD: 100,000+ Questions for Machine Comprehension of Text.

MORTAR: Multi-turn Metamorphic Testing for LLM-based Dialogue Systems SQuAD: 100,000+ Questions for Machine Comprehension of Text

Reference 47

Resolution: unresolved; no resolver link, observed 2026-08-11T11:22:56.812475Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 73425cfc-16c6-4d98-8ede-640a136c86db · outbound

This paper cites Know what you don’t know: Unanswerable questions for squad,.

MORTAR: Multi-turn Metamorphic Testing for LLM-based Dialogue Systems Know what you don’t know: Unanswerable questions for squad,

Reference 48

Resolution: verified fuzzy; raw_fallback, observed 2026-08-11T11:22:57.289680Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation a9ee1099-ac90-4ccb-a621-636cee3cc764 · outbound

This paper cites Mutual: A dataset for multi-turn dialogue reasoning,.

MORTAR: Multi-turn Metamorphic Testing for LLM-based Dialogue Systems Mutual: A dataset for multi-turn dialogue reasoning,

Reference 49

Resolution: verified fuzzy; raw_fallback, observed 2026-08-11T11:22:57.274645Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation 5f8fbf1b-aae6-4303-a4a9-1e1a3577189c · outbound

This paper cites An Empirical Study of LLM-as-a-Judge for LLM Evaluation: Fine-tuned Judge Model is not a General Substitute for GPT-4.

MORTAR: Multi-turn Metamorphic Testing for LLM-based Dialogue Systems An Empirical Study of LLM-as-a-Judge for LLM Evaluation: Fine-tuned Judge Model is not a General Substitute for GPT-4

Reference 50

Resolution: unresolved; no resolver link, observed 2026-08-11T11:22:56.827813Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 49974e84-fefb-412e-92b3-d155e2db70f1 · outbound

This paper cites Opal: Ontology- aware pretrained language model for end-to-end task-oriented dialogue,.

MORTAR: Multi-turn Metamorphic Testing for LLM-based Dialogue Systems Opal: Ontology- aware pretrained language model for end-to-end task-oriented dialogue,

Reference 51

Resolution: verified fuzzy; raw_fallback, observed 2026-08-11T11:22:57.259822Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation 02a65745-8f11-4e92-a625-2cef3445f092 · outbound

This paper cites ChatIE: Zero-Shot Information Extraction via Chatting with ChatGPT.

MORTAR: Multi-turn Metamorphic Testing for LLM-based Dialogue Systems ChatIE: Zero-Shot Information Extraction via Chatting with ChatGPT

Reference 52

Resolution: unresolved; no resolver link, observed 2026-08-11T11:22:56.837496Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 922061ef-e2ae-4efb-b467-dcf04b1a6e54 · outbound

This paper cites Testing graph database systems via graph-aware metamorphic relations,.

MORTAR: Multi-turn Metamorphic Testing for LLM-based Dialogue Systems Testing graph database systems via graph-aware metamorphic relations,

Reference 53

Resolution: verified fuzzy; raw_fallback, observed 2026-08-11T11:22:57.244428Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation e306b403-54b9-42bb-999f-e907642b6b4d · outbound

This paper cites Metamorphic testing for software quality assessment: A study of search engines,.

MORTAR: Multi-turn Metamorphic Testing for LLM-based Dialogue Systems Metamorphic testing for software quality assessment: A study of search engines,

Reference 54

Resolution: verified fuzzy; raw_fallback, observed 2026-08-11T11:22:57.227902Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation ab95c28e-5f95-434d-a4fe-f873152f0a27 · outbound

This paper cites Testing and validating machine learning classifiers by metamorphic testing,.

MORTAR: Multi-turn Metamorphic Testing for LLM-based Dialogue Systems Testing and validating machine learning classifiers by metamorphic testing,

Reference 55

Resolution: verified fuzzy; raw_fallback, observed 2026-08-11T11:22:57.212808Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation d3df67be-58e4-4017-98f3-cbb6cbd6d54c · outbound

This paper cites Mttm: Metamorphic testing for textual content modera- tion software,.

MORTAR: Multi-turn Metamorphic Testing for LLM-based Dialogue Systems Mttm: Metamorphic testing for textual content modera- tion software,

Reference 56

Resolution: verified fuzzy; raw_fallback, observed 2026-08-11T11:22:57.198165Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation 5429a64c-18d3-4640-acf7-84779a841497 · outbound

This paper cites Ontology-based metamorphic testing for chatbots,.

MORTAR: Multi-turn Metamorphic Testing for LLM-based Dialogue Systems Ontology-based metamorphic testing for chatbots,

Reference 57

Resolution: verified fuzzy; raw_fallback, observed 2026-08-11T11:22:57.182591Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation a3389b90-247f-4215-a836-8e2f7d0276a3 · outbound

This paper cites Knowledge graph driven inference testing for question answering software,.

MORTAR: Multi-turn Metamorphic Testing for LLM-based Dialogue Systems Knowledge graph driven inference testing for question answering software,

Reference 58

Resolution: verified fuzzy; raw_fallback, observed 2026-08-11T11:22:57.167741Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Pith citing papers

Observation 74526514-5f58-4b19-a06b-67597f6aecc0 · inbound

Rethinking Testing for LLM Applications: Characteristics, Challenges, and a Lightweight Interaction Protocol cites this paper.

Rethinking Testing for LLM Applications: Characteristics, Challenges, and a Lightweight Interaction Protocol MORTAR: Multi-turn Metamorphic Testing for LLM-based Dialogue Systems

Reference 15

Resolution: unresolved; no resolver link, observed 2026-08-05T14:55:56.666623Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 61500a84-b75f-47ec-b7ab-6ab4ed8e434e · inbound

Bidirectional Empowerment of Metamorphic Testing and Large Language Models: A Systematic Survey cites this paper.

Bidirectional Empowerment of Metamorphic Testing and Large Language Models: A Systematic Survey MORTAR: Multi-turn Metamorphic Testing for LLM-based Dialogue Systems

Reference 31

Resolution: verified exact; arxiv_id, observed 2026-06-19T17:10:42.202763Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.