REVIEW 4 cited by
Pretraining is All You Need for Image-to-Image Translation
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
We propose to use pretraining to boost general image-to-image translation. Prior image-to-image translation methods usually need dedicated architectural design and train individual translation models from scratch, struggling for high-quality generation of complex scenes, especially when paired training data are not abundant. In this paper, we regard each image-to-image translation problem as a downstream task and introduce a simple and generic framework that adapts a pretrained diffusion model to accommodate various kinds of image-to-image translation. We also propose adversarial training to enhance the texture synthesis in the diffusion model training, in conjunction with normalized guidance sampling to improve the generation quality. We present extensive empirical comparison across various tasks on challenging benchmarks such as ADE20K, COCO-Stuff, and DIODE, showing the proposed pretraining-based image-to-image translation (PITI) is capable of synthesizing images of unprecedented realism and faithfulness.
Forward citations
Cited by 4 Pith papers
-
Transfer Your Perspective: Controllable 3D Generation from Any Viewpoint in a Driving Scene
A conditioned diffusion model generates realistic reference-view LiDAR from ego-centric data, so collaborative perception can be trained without real multi-agent data.
-
InstancePin: Instance-Addressable Layout-to-Image Diffusion via Coordinate Pinning
InstancePin adds per-instance coordinate tokens and mask-guided fusion to a frozen layout-to-image diffusion model, improving FID and mIoU on Cityscapes while reducing visual blending of nearby same-category objects.
-
FlexControl: Computation-Aware ControlNet with Differentiable Router for Text-to-Image Generation
FlexControl learns per-timestep, per-block gating for ControlNet control branches, using a FLOPs budget loss to cut compute while preserving or improving image fidelity.
-
Translationese as a Rational Response to Translation Task Difficulty
Translationese is partly predictable from quantifiable translation-task difficulty, especially cross-lingual transfer load, more so for English-to-German than the reverse.
Discussion (0). Continue with ORCID to comment.