REVIEW 19 cited by
Less-to-More Generalization: Unlocking More Controllability by In-Context Generation
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
Although subject-driven generation has been extensively explored in image generation due to its wide applications, it still has challenges in data scalability and subject expansibility. For the first challenge, moving from curating single-subject datasets to multiple-subject ones and scaling them is particularly difficult. For the second, most recent methods center on single-subject generation, making it hard to apply when dealing with multi-subject scenarios. In this study, we propose a highly-consistent data synthesis pipeline to tackle this challenge. This pipeline harnesses the intrinsic in-context generation capabilities of diffusion transformers and generates high-consistency multi-subject paired data. Additionally, we introduce UNO, which consists of progressive cross-modal alignment and universal rotary position embedding. It is a multi-image conditioned subject-to-image model iteratively trained from a text-to-image model. Extensive experiments show that our method can achieve high consistency while ensuring controllability in both single-subject and multi-subject driven generation.
Forward citations
Cited by 19 Pith papers
-
DSH-Bench: A Difficulty- and Scenario-Aware Benchmark with Hierarchical Subject Taxonomy for Subject-Driven Text-to-Image Generation
DSH-Bench supplies a hierarchical 58-category subject set, difficulty/scenario labels, and a human-aligned SICS metric that exposes systematic failures of 19 subject-driven T2I models.
-
Imagine for Me: Creative Conceptual Blending of Real Images and Text via Blended Attention
IT-Blender blends a real image and a text prompt by injecting clean reference features into a trained attention module, improving disentangled concept blending in SD and FLUX.
-
LoRAShop: Training-Free Multi-Concept Image Generation and Editing with Rectified Flow Transformers
LoRAShop localizes each LoRA's effect to attention-derived spatial masks inside a Flux transformer, enabling training-free multi-concept image generation and editing.
-
Hierarchical Concept-to-Appearance Guidance for Multi-Subject Image Generation
A diffusion-transformer framework with VLM-grounded masked attention and VAE dropout improves identity and prompt fidelity for multi-subject image generation.
-
Muses: Designing, Composing, Generating Nonexistent Fantasy 3D Creatures without Training
Muses creates new fantasy 3D animals by designing a combined skeleton, fusing voxel parts from separate 3D models along that skeleton, then restyling textures via image editing — with no training.
-
Scone: Bridging Composition and Distinction in Subject-Driven Image Generation via Unified Understanding-Generation Modeling
Scone unifies subject understanding and generation in a two-stage trained model to improve both composition and distinction in multi-subject image generation, outperforming prior open-source models on new benchmarks.
-
iMontage: Unified, Versatile, Highly Dynamic Many-to-many Image Generation
iMontage repurposes a pretrained video diffusion model to generate coherent yet highly dynamic image sets from arbitrary numbers of input images.
-
UMO: Scaling Multi-Identity Consistency for Image Customization via Matching Reward
A reinforcement-learning reward based on bipartite face matching improves multi-identity consistency and reduces identity confusion in image customization models.
-
FocusDPO: Dynamic Preference Optimization for Multi-Subject Personalized Image Generation via Adaptive Focus
FocusDPO adds dynamic spatial weighting to preference-based fine-tuning, improving subject fidelity and reducing attribute leakage in multi-subject personalized image generation.
-
USO: Unified Style and Subject-Driven Generation via Disentangled and Reward Learning
USO trains one DiT model for subject-driven, style-driven, and joint generation by disentangling content and style from triplet data and adding a style-reward objective, claiming SOTA on USO-Bench.
-
Echo-4o: Harnessing the Power of GPT-4o Synthetic Images for Improved Image Generation
A curated GPT-4o synthetic image dataset improves open-source generation models on instruction-following, surreal scenes, and multi-reference synthesis, plus two new benchmarks to measure those skills.
-
DreamPainter: Image Background Inpainting for E-commerce Scenarios
DreamPainter introduces a two-stage diffusion framework trained on a new synthetic e-commerce dataset, DreamEcom-400K, that outperforms open-source inpainting baselines on background generation with text and reference...
-
FreeLoRA: Enabling Training-Free LoRA Fusion for Autoregressive Multi-Subject Personalization
A method for multi-subject image personalization that fuses independently trained LoRA modules at inference time on visual autoregressive models.
-
Image Editing As Programs with Diffusion Models
IEAP decomposes complex editing instructions into atomic operations executed sequentially on a diffusion transformer, and reports state-of-the-art results on MagicBrush and AnyEdit.
-
XVerse: Consistent Multi-Subject Control of Identity and Semantic Attributes via DiT Modulation
XVerse learns token-specific offsets that modify the text-stream modulation of a diffusion transformer, enabling multi-subject identity and attribute control in image generation.
-
PairEdit: Learning Semantic Variations for Exemplar-based Image Editing
PairEdit trains two LoRA adapters on a pretrained diffusion model to capture the semantic direction between paired source-target images, enabling text-free, controllable image editing from as few as one pair.
-
FullDiT2: Efficient In-Context Conditioning for Video Diffusion Transformers
FullDiT2 accelerates FullDiT-style in-context conditioning for video by dynamic token selection and selective context caching, cutting per-step time by 2-3x with minimal quality loss.
-
Dimension-Reduction Attack! Video Generative Models are Experts on Controllable Image Synthesis
A video diffusion model, HunyuanVideo-I2V, is adapted with mixup transitions, frame-skip position embeddings, and attention masking to outperform image-only models on several controllable image generation benchmarks.
-
EditIDv2: Editable ID Customization with Data-Lubricated ID Feature Integration for Text-to-Image Generation
EditIDv2 fine-tunes only PerceiverAttention cross-attention weights on 3K images to inject editability into Flux-based ID customization, reporting selective gains on the self-proposed IBench benchmark.
Discussion (0). Continue with ORCID to comment.