REVIEW 5 cited by
Metamorphic Testing: A New Approach for Generating Next Test Cases
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
In software testing, a set of test cases is constructed according to some predefined selection criteria. The software is then examined against these test cases. Three interesting observations have been made on the current artifacts of software testing. Firstly, an error-revealing test case is considered useful while a successful test case which does not reveal software errors is usually not further investigated. Whether these successful test cases still contain useful information for revealing software errors has not been properly studied. Secondly, no matter how extensive the testing has been conducted in the development phase, errors may still exist in the software [5]. These errors, if left undetected, may eventually cause damage to the production system. The study of techniques for uncovering software errors in the production phase is seldom addressed in the literature. Thirdly, as indicated by Weyuker in [6], the availability of test oracles is pragmatically unattainable in most situations. However, the availability of test oracles is generally assumed in conventional software testing techniques. In this paper, we propose a novel test case selection technique that derives new test cases from the successful ones. The selection aims at revealing software errors that are possibly left undetected in successful test cases which may be generated using some existing strategies. As such, the proposed technique augments the effectiveness of existing test selection strategies. The technique also helps uncover software errors in the production phase and can be used in the absence of test oracles.
Forward citations
Cited by 5 Pith papers
-
Assessing Behavioral Validation in UI Component Test Suites Using Inferred Metamorphic Relations
UI component tests explicitly validate only 42.5-47.6% of inferred metamorphic relations while touching far more, revealing a behavioral validation gap that execution coverage does not capture.
-
ASSURE: Metamorphic Testing for AI-powered Browser Extensions
A modular metamorphic testing framework for LLM-based browser extensions reports 531 automatically detected issues across six real-world extensions.
-
Generate Realistic Test Scenes for V2X Communication Systems
V2XGen automatically creates perspective-consistent V2X test scenes, finds more occlusion and long-range perception errors than random selection or CooTest, and improves detection accuracy after retraining.
-
Not as Sweet by Another Name: An Empirical Study of Format Robustness in LLM Document Workflows
Changing the file format of identical input content changes LLM workflow decisions in 41% of cases on average and can reduce accuracy by up to 56 percentage points, with CSV the most error-prone format.
-
Coverage-Guided Testing for Deep Learning Models: A Comprehensive Survey
A systematic review of coverage-guided testing for deep learning models, covering coverage criteria, test generation, optimization, and evaluation practices.
Discussion (0). Sign in to comment.