Pith. sign in

REVIEW 35 cited by

Fast Segment Anything

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2306.12156 v1 pith:RFYZR7V3 submitted 2023-06-21 cs.CV cs.AI

classification cs.CVcs.AI
keywords taskmethodsegmentationimageinstanceanythingcomparablecomputation
verification ladder T0 review T1 audit T2 compute T3 formal
0 comments
read the original abstract

The recently proposed segment anything model (SAM) has made a significant influence in many computer vision tasks. It is becoming a foundation step for many high-level tasks, like image segmentation, image caption, and image editing. However, its huge computation costs prevent it from wider applications in industry scenarios. The computation mainly comes from the Transformer architecture at high-resolution inputs. In this paper, we propose a speed-up alternative method for this fundamental task with comparable performance. By reformulating the task as segments-generation and prompting, we find that a regular CNN detector with an instance segmentation branch can also accomplish this task well. Specifically, we convert this task to the well-studied instance segmentation task and directly train the existing instance segmentation method using only 1/50 of the SA-1B dataset published by SAM authors. With our method, we achieve a comparable performance with the SAM method at 50 times higher run-time speed. We give sufficient experimental results to demonstrate its effectiveness. The codes and demos will be released at https://github.com/CASIA-IVA-Lab/FastSAM.

Discussion (0). Sign in to comment.

Forward citations

Cited by 35 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. Segment This Thing: Foveated Tokenization for Efficient Point-Prompted Segmentation

    cs.CV 2025-06 conditional novelty 7.0 of 10

    A point-prompted segmentation model gains efficiency by foveated tokenization, cutting tokens from 4096 to 172 while staying competitive on mIoU benchmarks.

  2. TestMate: Test-Time Domain Adaptation Aided by Lightweight Vision Foundation Model

    cs.CV 2026-07 accept novelty 6.5 of 10

    TestMate fuses FastSAM mask proposals with a segmentation network via size-ordered soft refinement to achieve backpropagation-free, first-frame TTDA gains on semantic segmentation benchmarks.

  3. From Transparent Labware Segmentation to Collision Avoidance: A Real-Time Edge-Aware Perception Pipeline

    cs.RO 2026-08 conditional novelty 6.0 of 10

    An edge-aware YOLOv5-Seg variant, together with a new real-world dataset, segments transparent labware in real time and enables conservative 3D collision avoidance for robots.

  4. AtlasLC: Fast Codec-Ready Compression of Object-Centric 3D Gaussian Splatting

    cs.GR 2026-07 conditional novelty 6.0 of 10

    A training-free pipeline prunes object-centric 3D Gaussian splats by local competition and packs them into deterministic codec-ready atlases, cutting preparation time and payload with modest quality loss.

  5. MV-GEL: Language-Driven Multi-View Geometric Entity Localization on Meshes

    cs.CV 2026-06 unverdicted novelty 6.0 of 10

    MV-GEL uses a learned view selector and a fine-tuned vision-language segmentation model to localize text-described faces and edges on 3D meshes.

  6. StateScribe: Towards Accessible Change Awareness Across Real-World Revisits

    cs.HC 2026-04 unverdicted novelty 6.0 of 10

    StateScribe uses a dual-layer memory architecture for episodic scenes and object-centric changes to deliver live and historical descriptions, achieving 83.1% F1 accuracy across revisits in evaluations and user studies...

  7. Active Semantic Perception

    cs.RO 2025-10 conditional novelty 6.0 of 10

    An LLM-based scene-graph completion routine can guide a robot to infer and find unseen rooms faster than frontier-based exploration, at least in the three simulated apartments tested.

  8. AIM-CoT: Active Information-driven Multimodal Chain-of-Thought for Vision-Language Reasoning

    cs.CV 2025-09 unverdicted novelty 6.0 of 10

    AIM-CoT improves multimodal chain-of-thought by selecting image regions that reduce predictive uncertainty and inserting them when attention shifts toward the visual input.

  9. DreamNav: A Trajectory-Based Imaginative Framework for Zero-Shot Vision-and-Language Navigation

    cs.RO 2025-09 conditional novelty 6.0 of 10

    DreamNav achieves new zero-shot SOTA on VLN-CE with an egocentric-only pipeline that generates candidate trajectories, imagines their futures, and selects the best by language alignment.

  10. Probabilistic Human Intent Prediction for Mobile Manipulation: An Evaluation with Human-Inspired Constraints

    cs.RO 2025-07 conditional novelty 6.0 of 10

    GUIDER couples navigation-level and manipulation-level probabilistic intent beliefs using map context, visual saliency, grasp-feasibility checks, and end-effector kinematics, and reports higher prediction stability th...

  11. Learning human-to-robot handovers through 3D scene reconstruction

    cs.RO 2025-07 conditional novelty 6.0 of 10

    A handover policy trained only on images rendered from a sparse-view Gaussian Splatting scene can deploy on a real robot without real-robot training data.

  12. Move to Understand a 3D Scene: Bridging Visual Grounding and Exploration for Efficient and Versatile Embodied Navigation

    cs.CV 2025-07 conditional novelty 6.0 of 10

    MTU3D unifies visual grounding and frontier-based exploration in a single transformer, achieving state-of-the-art success rates on HM3D-OVON, GOAT-Bench, SG3D, and A-EQA after large-scale vision-language-exploration p...

  13. ViRefSAM: Visual Reference-Guided Segment Anything Model for Remote Sensing Segmentation

    cs.CV 2025-07 conditional novelty 6.0 of 10

    A few-shot segmentation framework that injects reference-image prototypes into SAM's decoder and image encoder, eliminating per-image manual prompts and improving remote sensing segmentation accuracy.

  14. LoD-Loc v2: Aerial Visual Localization over Low Level-of-Detail City Models using Explicit Silhouette Alignment

    cs.CV 2025-07 conditional novelty 6.0 of 10

    LoD-Loc v2 localizes aerial cameras by aligning predicted building silhouettes with rendered low-detail city-model silhouettes, achieving accurate 4-DoF pose without textured maps.

  15. SAM4D: Segment Anything in Camera and LiDAR Streams

    cs.CV 2025-06 conditional novelty 6.0 of 10

    SAM4D is a promptable model that segments and tracks objects across camera and LiDAR streams with cross-modal prompts, trained on pseudo-labels generated by an automated data engine.

  16. T-Rex: Task-Adaptive Spatial Representation Extraction for Robotic Manipulation with Vision-Language Models

    cs.RO 2025-06 conditional novelty 6.0 of 10

    A zero-training framework that adaptively selects spatial representation extractors per object and per task stage improves real-world robot manipulation success and efficiency over fixed-representation baselines.

  17. Lean-SAM2: Target-Anchored Memory and Encoder Acceleration for SAM2

    cs.CV 2026-07 conditional novelty 5.0 of 10

    Lean-SAM2 combines target-anchored memory pruning, condensed insurance memory, and risk-aware window routing to accelerate SAM2.1 inference ~1.4× with better accuracy than Efficient-SAM2.

  18. MuViSeg: Multi-View Segment Correspondences from Dense Geometry Priors

    cs.CV 2026-07 conditional novelty 5.0 of 10

    A joint multi-view self-attention matcher over SAM segments beats pairwise matchers at wide baselines and lifts HM3D navigation success from 50% to 70%, while a LightGlue-style pairwise head wins outdoors and at narro...

  19. Analysis of the Dick Effect for AI-based Dynamic Gravimeter

    physics.atom-ph 2025-08 unverdicted novelty 5.0 of 10

    A 0.12 s accelerometer dead time in an atom-interferometer dynamic gravimeter introduces roughly 8 mGal of measurement noise, which the paper attributes to high-frequency aliasing and analyzes with a derived frequency...

  20. ProVox: Personalization and Proactive Planning for Situated Human-Robot Collaboration

    cs.RO 2025-06 conditional novelty 5.0 of 10

    A personalized, proactive LLM planner suggests helpful next actions during human-robot lunch packing, reporting 38.7% faster task execution at the cost of an extra 5.6-minute setup phase.

  21. Accurate and efficient zero-shot 6D pose estimation with frozen foundation models

    cs.CV 2025-06 conditional novelty 5.0 of 10

    A training-free 6D pose estimator using sparse-to-dense matching of frozen foundation model features achieves new state-of-the-art results on BOP with large speedups.

  22. Dynamic Sub-region Search in Homogeneous Collections Using CLIP

    cs.MM 2025-06 conditional novelty 5.0 of 10

    Dynamic region detection plus IoU-based geometric constraints roughly doubles recall over static grid partitioning for underwater known-item search, given accurate query boxes.

  23. Towards Terrain-Aware Task-Driven 3D Scene Graph Generation in Outdoor Environments

    cs.RO 2025-06 conditional novelty 5.0 of 10

    An outdoor 3D scene graph pipeline using LiDAR-camera fusion, CLIP embeddings, and per-terrain Voronoi graphs is demonstrated on a campus dataset with qualitative results.

  24. Perceive Anything: Recognize, Explain, Caption, and Segment Anything in Images and Videos

    cs.CV 2025-06 reject novelty 5.0 of 10

    PAM extends SAM 2 with a frozen LLM and a Semantic Perceiver to jointly segment and describe regions in images, videos, and streaming video, and contributes a 0.6M-sample region-level streaming video caption dataset.

  25. Efficient Segment Anything with Depth-Aware Fusion and Limited Training Data

    cs.CV 2026-02 reject novelty 4.0 of 10

    Adding monocular depth to EfficientViT-SAM improves point-prompted segmentation at 3 and 5 clicks after fine-tuning on 11.2k images, but universal gains and data-efficiency are not established.

  26. SAM-MI: A Mask-Injected Framework for Enhancing Open-Vocabulary Semantic Segmentation with SAM

    cs.CV 2025-11 conditional novelty 4.0 of 10

    SAM-MI improves open-vocabulary segmentation by injecting aggregated SAM masks as low- and high-frequency guidance into CLIP cost maps, with sparse text-guided point prompts for speed.

  27. Multi-modal video data-pipelines for machine learning with minimal human supervision

    cs.CV 2025-10 conditional novelty 4.0 of 10

    An open-source video pipeline automatically extracts 13+ visual modalities from raw video with no human annotation, and a sub-1M-parameter distilled model reaches near-Mask2Former accuracy on an aerial scene benchmark.

  28. SegDINO: An Efficient Design for Medical and Natural Image Segmentation with DINO-V3

    cs.CV 2025-08 reject novelty 4.0 of 10

    A frozen DINOv3 backbone plus a simple MLP head reportedly beats specialized segmentation models on six benchmarks, but the evidence lacks statistical rigor.

  29. Object-Centric Cropping for Visual Few-Shot Classification

    cs.CV 2025-07 unverdicted novelty 4.0 of 10

    The supplied full text (arXiv:2508.00225) is a different paper from the claimed metadata (arXiv:2508.00218), so no claim about few-shot classification is backed by the manuscript.

  30. PlantSAM: An Object Detection-Driven Segmentation Pipeline for Herbarium Specimens

    cs.CV 2025-07 conditional novelty 4.0 of 10

    PlantSAM, a pipeline that uses YOLOv10 bounding boxes to prompt SAM2, segments plants from herbarium backgrounds with IoU 0.94 and improves trait classification accuracy by up to 4.36%.

  31. FastSmoothSAM: A Fast Smooth Method For Segment Anything Model

    cs.CV 2025-07 conditional novelty 4.0 of 10

    FastSmoothSAM smooths FastSAM's jagged segmentation boundaries through a four-stage B-Spline fitting pipeline, with a modest runtime overhead.

  32. Objectomaly: Objectness-Aware Refinement for OoD Segmentation with Structural Consistency and Boundary Precision

    cs.CV 2025-07 reject novelty 4.0 of 10

    A training-free, SAM-based score-calibration and boundary-refinement pipeline reports SOTA OoD segmentation results, but internal inconsistencies prevent the claim from standing.

  33. Experimental Evaluation of Static Image Sub-Region-Based Search Models Using CLIP

    cs.MM 2025-06 conditional novelty 4.0 of 10

    Static spatial grids over CLIP image embeddings improve text-to-image retrieval on homogeneous underwater keyframes, while text-only position suffixes do not.

  34. Foundation Models for Zero-Shot Segmentation of Scientific Images without AI-Ready Data

    cs.CV 2025-06 conditional novelty 3.0 of 10

    GroundingDINO plus SAM, wrapped in an interactive web tool, achieves high segmentation scores on FIB-SEM catalyst images, although the evaluation is limited and ground-truth creation is unexplained.

  35. Prompt Engineering in Segment Anything Model: Methodologies, Applications, and Emerging Challenges

    cs.CV 2025-07 conditional novelty 2.0 of 10

    A structured survey of prompt engineering methods for the Segment Anything Model, covering geometric, textual, and multimodal prompts and their applications.

Pith tools