REVIEW 8 cited by
StyleBooth: Image Style Editing with Multimodal Instruction
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
Signed reviews
read the original abstract
Given an original image, image editing aims to generate an image that align with the provided instruction. The challenges are to accept multimodal inputs as instructions and a scarcity of high-quality training data, including crucial triplets of source/target image pairs and multimodal (text and image) instructions. In this paper, we focus on image style editing and present StyleBooth, a method that proposes a comprehensive framework for image editing and a feasible strategy for building a high-quality style editing dataset. We integrate encoded textual instruction and image exemplar as a unified condition for diffusion model, enabling the editing of original image following multimodal instructions. Furthermore, by iterative style-destyle tuning and editing and usability filtering, the StyleBooth dataset provides content-consistent stylized/plain image pairs in various categories of styles. To show the flexibility of StyleBooth, we conduct experiments on diverse tasks, such as text-based style editing, exemplar-based style editing and compositional style editing. The results demonstrate that the quality and variety of training data significantly enhance the ability to preserve content and improve the overall quality of generated images in editing tasks. Project page can be found at https://ali-vilab.github.io/stylebooth-page/.
Forward citations
Cited by 8 Pith papers
-
MultiRef: Controllable Image Generation with Multiple Visual References
MultiRef-bench shows that current image generators that accept multiple visual references still fail to combine them reliably, with the best tested model OmniGen reaching only 66.6% synthetic and 79.0% real-world alig...
-
Nexus-Gen: Unified Image Understanding, Generation, and Editing via Prefilled Autoregression in Shared Embedding Space
Prefilled autoregression in a shared embedding space lets Nexus-Gen unify image understanding, generation, and editing, achieving competitive benchmark scores with a 7B model.
-
MINIMA: Modality Invariant Image Matching
A synthetic data engine built on generative models lets a single fine-tuned matcher outperform modality-specific methods across many real cross-modal image matching tasks.
-
Style3D: Attention-guided Multi-view Style Transfer for 3D Object Generation
Style3D generates stylized 3D objects from a content image and a style image in about 30 seconds using attention-guided multi-view diffusion and a feed-forward 3D reconstruction model.
-
Ovis-U1 Technical Report
A 3B unified multimodal model with a diffusion decoder and bidirectional refiner achieves competitive understanding, generation, and editing benchmark scores.
-
UNIC-Adapter: Unified Image-instruction Adapter with Multi-modal Transformer for Image Generation
A unified adapter for Stable Diffusion 3 that enables one model to follow conditional images and task instructions across spatial, subject, and style control tasks.
-
Ming-Lite-Uni: Advancements in Unified Architecture for Natural Multimodal Interaction
Ming-Lite-Uni couples a frozen multimodal LLM with a learnable diffusion model via multi-scale learnable tokens to perform text-to-image generation and instruction-based image editing.
-
Instruction-Guided Editing Controls for Images and Multimedia: A Survey in LLM era
A survey that organizes over 100 instruction-guided image and multimedia editing papers into a process-based taxonomy, with an emphasis on LLM and MLLM empowered methods.
Discussion (0). Continue with ORCID to comment.