REVIEW 11 cited by
StyleDrop: Text-to-Image Generation in Any Style
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
abstract
Pre-trained large text-to-image models synthesize impressive images with an appropriate use of text prompts. However, ambiguities inherent in natural language and out-of-distribution effects make it hard to synthesize image styles, that leverage a specific design pattern, texture or material. In this paper, we introduce StyleDrop, a method that enables the synthesis of images that faithfully follow a specific style using a text-to-image model. The proposed method is extremely versatile and captures nuances and details of a user-provided style, such as color schemes, shading, design patterns, and local and global effects. It efficiently learns a new style by fine-tuning very few trainable parameters (less than $1\%$ of total model parameters) and improving the quality via iterative training with either human or automated feedback. Better yet, StyleDrop is able to deliver impressive results even when the user supplies only a single image that specifies the desired style. An extensive study shows that, for the task of style tuning text-to-image models, StyleDrop implemented on Muse convincingly outperforms other methods, including DreamBooth and textual inversion on Imagen or Stable Diffusion. More results are available at our project website: https://styledrop.github.io
Forward citations
Cited by 11 Pith papers
-
Imagine for Me: Creative Conceptual Blending of Real Images and Text via Blended Attention
IT-Blender blends a real image and a text prompt by injecting clean reference features into a trained attention module, improving disentangled concept blending in SD and FLUX.
-
LoRAShop: Training-Free Multi-Concept Image Generation and Editing with Rectified Flow Transformers
LoRAShop localizes each LoRA's effect to attention-derived spatial masks inside a Flux transformer, enabling training-free multi-concept image generation and editing.
-
ElasticTTT: Prior-Preserving Test-Time Tuning for Video Editing
Test-time tuning of video diffusion models collapses generation toward the source video; ElasticTTT counters this with noisy targets, contrastive source-prompt guidance, and asynchronous region-wise noise scheduling, ...
-
Calligrapher: Freestyle Text Image Customization
Calligrapher trains a style encoder and in-context inference on self-distilled FLUX outputs to redraw arbitrary text in the visual style of a reference image.
-
FairyGen: Storied Cartoon Video from a Single Child-Drawn Character
A pipeline that generates story-driven cartoon videos from one child-drawn character by separating foreground style, background synthesis, and motion learning.
-
BlenderFusion: 3D-Grounded Visual Editing and Generative Compositing
A dual-stream diffusion model trained with Blender-render conditioning, source masking, and object jittering performs 3D-grounded multi-object editing and compositing better than existing baselines on three video datasets.
-
Noise Consistency Regularization for Improved Subject-Driven Image Synthesis
Adding consistency-to-pretrained and multiplicative-noise consistency losses to fine-tuning improves subject identity and background diversity over DreamBooth on a 30-subject benchmark.
-
CDST: Color Disentangled Style Transfer for Universal Style Reference Customization
CDST disentangles color from style via greyscale style input and a color histogram stream, enabling zero-shot style transfer with separate color control and a new characteristics-preserved mode.
-
OmniStyle: Filtering High Quality Style Transfer Data at Scale
A new million-triplet dataset and a diffusion transformer model that performs text-guided and image-guided style transfer, with a filtering pipeline used to curate high-quality training examples.
-
DICT: Data Injection and Contrastive Trajectory Refinement for Conditional Image Generation with Diffusion Models
Noise-perturbed condition injection plus contrastive trajectory refinement improves training-free conditional diffusion sampling across style transfer, super-resolution and deblurring.
-
StyleAR: Customizing Multimodal Autoregressive Model for Style-Aligned Text-to-Image Generation
StyleAR enables autoregressive image generation models to do style-aligned text-to-image generation using only binary text-image data, via self-reconstruction training and style-enhanced tokens.
Discussion (0). Sign in to comment.