REVIEW 11 cited by
ProRes: Exploring Degradation-aware Visual Prompt for Universal Image Restoration
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
Image restoration aims to reconstruct degraded images, e.g., denoising or deblurring. Existing works focus on designing task-specific methods and there are inadequate attempts at universal methods. However, simply unifying multiple tasks into one universal architecture suffers from uncontrollable and undesired predictions. To address those issues, we explore prompt learning in universal architectures for image restoration tasks. In this paper, we present Degradation-aware Visual Prompts, which encode various types of image degradation, e.g., noise and blur, into unified visual prompts. These degradation-aware prompts provide control over image processing and allow weighted combinations for customized image restoration. We then leverage degradation-aware visual prompts to establish a controllable and universal model for image restoration, called ProRes, which is applicable to an extensive range of image restoration tasks. ProRes leverages the vanilla Vision Transformer (ViT) without any task-specific designs. Furthermore, the pre-trained ProRes can easily adapt to new tasks through efficient prompt tuning with only a few images. Without bells and whistles, ProRes achieves competitive performance compared to task-specific methods and experiments can demonstrate its ability for controllable restoration and adaptation for new tasks. The code and models will be released in \url{https://github.com/leonmakise/ProRes}.
Forward citations
Cited by 11 Pith papers
-
SpikeRestormer: Towards Energy-Efficient All-in-One Image Restoration via Unified Event Reasoning
A spiking neural network with subtractive and additive attention performs all-in-one image restoration in one time step, matching older ANN baselines with much lower estimated energy.
-
CoRE-UIR: Prior-guided common and residual experts for efficient all-in-one remote sensing image restoration
CoRE-UIR achieves state-of-the-art all-in-one remote sensing image restoration with a common dense expert plus low-rank routed residual experts, improving PSNR by 1.05 dB over BaryIR at 11.83x lower latency.
-
TIR-Agent: Training an Explorative and Efficient Agent for Image Restoration
A vision-language agent trained with SFT plus RL, exploration-driven trajectory perturbation, and adaptive multi-metric rewards learns direct tool selection for composite image restoration, beating training-free agent...
-
TAP: Parameter-efficient Task-Aware Prompting for Adverse Weather Removal
A two-stage prompt-tuning method with low-rank and contrastive prompt enhancement claims all-in-one adverse weather removal at 2.75M parameters.
-
Uni-DocDiff: A Unified Document Restoration Model Based on Diffusion
A dual-stream diffusion model with a handcrafted prior pool and a prior fusion module unifies six document restoration tasks and matches task-specific specialists.
-
Grounding Degradations in Natural Language for All-In-One Video Restoration
RONIN distills per-frame language descriptions of video degradations into lightweight input-conditioned prompts, achieving all-in-one video restoration without any text encoder or MLLM at inference and outperforming p...
-
4KAgent: Agentic Any Image to 4K Super-Resolution
An agentic pipeline that plans and executes image restoration from a toolbox of pretrained models to upscale arbitrary images to 4K, reporting state-of-the-art results on many benchmarks.
-
Towards Blind Lens Aberration Correction via Large LensLib Pre-training and Discrete Degradation Priors
A blind aberration-correction model trained on a larger, uniformly sampled lens library with a latent PSF codebook achieves state-of-the-art zero-shot correction across diverse lenses.
-
Fast and Accurate Image Restoration and Generation with Rank Enhanced Linear Attention
LAformer applies rank-enhanced linear attention to image restoration, reporting state-of-the-art performance across 21 benchmarks with linear-complexity global modeling.
-
ClusIR: Towards Cluster-Guided All-in-One Image Restoration
A cluster-guided mixture-of-experts network with frequency modulation reports competitive all-in-one image restoration results, with uneven gains and no public code.
-
Exploring Scalable Unified Modeling for General Low-Level Vision
A prompt-conditioned image-to-image model trained jointly on 101 low-level vision tasks shows measurable improvements from model scaling and cross-task transfer.
Discussion (0). Continue with ORCID to comment.