REVIEW 2 cited by
Situation Coverage Testing for a Simulated Autonomous Car -- an Initial Case Study
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
It is hard to test autonomous robot (AR) software because of the range and diversity of external situations (terrain, obstacles, humans, peer robots) that AR must deal with. Common measures of testing adequacy may not address this diversity. Explicit situation coverage has been proposed as a solution, but there has been little empirical study of its effectiveness. In this paper, we describe an implementation of situation coverage for testing a simple simulated autonomous road vehicle, and evaluate its ability to find seeded faults compared to a random test generation approach. In our experiments, the performance of the two methods is similar, with situation coverage having a very slight advantage. We conclude that situation coverage probably does not have a significant benefit over random generation for the type of simple, research-grade AR software used here. It will likely be valuable when applied to more complex and mature software.
Forward citations
Cited by 2 Pith papers
-
Probabilistic Safety Verification for an Autonomous Ground Vehicle: A Situation Coverage Grid Approach
A situation coverage grid is augmented with transition probabilities and checked with probabilistic model checking to rank AGV situations by collision risk.
-
SCALOFT: An Initial Approach for Situation Coverage-Based Safety Analysis of an Autonomous Aerial Drone in a Mine Environment
SCALOFT, a situation coverage-based testing approach for a simulated mine drone, detected all three seeded faults it was tested against.
Discussion (0). Continue with ORCID to comment.