The reviewed record of science sign in
Pith

arxiv: 2310.06486 · v1 · pith:ITY2TLJY · submitted 2023-10-10 · cs.AI · cs.CV· cs.IR

Topological RANSAC for instance verification and retrieval without fine-tuning

Reviewed by Pith T0 review T1 audit T2 compute T3 formal T4 kernel pith:ITY2TLJYrecord.jsonopen to challenge →

classification cs.AI cs.CVcs.IR
keywords spatialtopologicalfeaturesmethodmodelretrievalapproachfine-tuning
0
0 comments X
read the original abstract

This paper presents an innovative approach to enhancing explainable image retrieval, particularly in situations where a fine-tuning set is unavailable. The widely-used SPatial verification (SP) method, despite its efficacy, relies on a spatial model and the hypothesis-testing strategy for instance recognition, leading to inherent limitations, including the assumption of planar structures and neglect of topological relations among features. To address these shortcomings, we introduce a pioneering technique that replaces the spatial model with a topological one within the RANSAC process. We propose bio-inspired saccade and fovea functions to verify the topological consistency among features, effectively circumventing the issues associated with SP's spatial model. Our experimental results demonstrate that our method significantly outperforms SP, achieving state-of-the-art performance in non-fine-tuning retrieval. Furthermore, our approach can enhance performance when used in conjunction with fine-tuned features. Importantly, our method retains high explainability and is lightweight, offering a practical and adaptable solution for a variety of real-world applications.

This paper has not been read by Pith yet.

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.