REVIEW 9 cited by
Vivim: a Video Vision Mamba for Medical Video Segmentation
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
Medical video segmentation gains increasing attention in clinical practice due to the redundant dynamic references in video frames. However, traditional convolutional neural networks have a limited receptive field and transformer-based networks are mediocre in constructing long-term dependency from the perspective of computational complexity. This bottleneck poses a significant challenge when processing longer sequences in medical video analysis tasks using available devices with limited memory. Recently, state space models (SSMs), famous by Mamba, have exhibited impressive achievements in efficient long sequence modeling, which develops deep neural networks by expanding the receptive field on many vision tasks significantly. Unfortunately, vanilla SSMs failed to simultaneously capture causal temporal cues and preserve non-casual spatial information. To this end, this paper presents a Video Vision Mamba-based framework, dubbed as Vivim, for medical video segmentation tasks. Our Vivim can effectively compress the long-term spatiotemporal representation into sequences at varying scales with our designed Temporal Mamba Block. We also introduce an improved boundary-aware affine constraint across frames to enhance the discriminative ability of Vivim on ambiguous lesions. Extensive experiments on thyroid segmentation, breast lesion segmentation in ultrasound videos, and polyp segmentation in colonoscopy videos demonstrate the effectiveness and efficiency of our Vivim, superior to existing methods. The code is available at: https://github.com/scott-yjyang/Vivim. The dataset will be released once accepted.
Forward citations
Cited by 9 Pith papers
-
STAC: Selective Spatiotemporal Aggregation and Compression for Video Reasoning Segmentation
SSM enrichment before hierarchical adaptive compression cuts video tokens 85% and yields 1.8× speedup while matching or exceeding uncompressed baselines on zero-shot reasoning segmentation.
-
HRVVS: A High-resolution Video Vasculature Segmentation Network via Hierarchical Autoregressive Residual Priors
A new dataset and network for segmenting hepatic vasculature in high-resolution hepatectomy videos, reporting the best scores on the new benchmark.
-
Explicit Context Reasoning with Supervision for Visual Tracking
RSTrack supervises a Mamba-based state reasoning module with true target states, improving visual tracking accuracy on six benchmarks.
-
Training-free Token Reduction for Vision Mamba
MTR uses Mamba's timescale parameter Δ as a token importance score to merge unimportant tokens, giving training-free inference speedups with small accuracy loss.
-
Spatial-Temporal Graph Mamba for Music-Guided Dance Video Synthesis
STG-Mamba generates dance videos from music using a spatial-temporal graph Mamba block for skeleton generation and forward-backward self-supervised losses for video synthesis, reporting SOTA on benchmarks.
-
FreeVPS: Repurposing Training-Free SAM2 for Generalizable Video Polyp Segmentation
FreeVPS pairs a per-frame polyp segmenter with frozen SAM2 tracking and two filtering modules to reduce error accumulation, improving in-domain and out-of-domain video polyp segmentation.
-
ASM-UNet: Adaptive Scan Mamba Integrating Group Commonalities and Individual Variations for Fine-Grained Segmentation
A Mamba-based segmentation network whose scan order is guided by a per-image learned score, plus a new fine-grained biliary tract dataset.
-
MARL-MambaContour: Unleashing Multi-Agent Deep Reinforcement Learning for Active Contour Optimization in Medical Image Segmentation
A multi-agent Soft Actor-Critic framework with adaptive entropy and a Mamba policy network iteratively moves contour points to segment organs, reporting higher Dice and boundary scores on five datasets.
-
Hierarchical Spatio-temporal Segmentation Network for Ejection Fraction Estimation in Echocardiography Videos
A hybrid convolutional-Mamba network segments left ventricular contours in echocardiography videos and reports improved ejection fraction correlation on three benchmarks.
Discussion (0). Sign in to comment.