pith. sign in

arxiv: 2407.02489 · v1 · pith:G7IW4YIQnew · submitted 2024-07-02 · 💻 cs.CV · cs.AI· cs.GR· cs.HC· cs.LG

Magic Insert: Style-Aware Drag-and-Drop

classification 💻 cs.CV cs.AIcs.GRcs.HCcs.LG
keywords imagemethodstyle-awareinsertionobjectstyletargetdomain
0
0 comments X
read the original abstract

We present Magic Insert, a method for dragging-and-dropping subjects from a user-provided image into a target image of a different style in a physically plausible manner while matching the style of the target image. This work formalizes the problem of style-aware drag-and-drop and presents a method for tackling it by addressing two sub-problems: style-aware personalization and realistic object insertion in stylized images. For style-aware personalization, our method first fine-tunes a pretrained text-to-image diffusion model using LoRA and learned text tokens on the subject image, and then infuses it with a CLIP representation of the target style. For object insertion, we use Bootstrapped Domain Adaption to adapt a domain-specific photorealistic object insertion model to the domain of diverse artistic styles. Overall, the method significantly outperforms traditional approaches such as inpainting. Finally, we present a dataset, SubjectPlop, to facilitate evaluation and future progress in this area. Project page: https://magicinsert.github.io/

This paper has not been read by Pith yet.

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Forward citations

Cited by 2 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. When Style Similarity Scores Fail: Diagnosing Raw CSD Cosine in Artist-Style Evaluation

    cs.CV 2026-05 conditional novelty 7.0

    Raw CSD cosine similarity produces negative discrimination gaps for many artists and does not support absolute style-fidelity interpretation, but CSLS readout on frozen backbones reduces failures and improves AUC.

  2. GenHSI: Controllable Generation of Human-Scene Interaction Videos

    cs.CV 2025-06 unverdicted novelty 7.0

    GenHSI is a training-free three-stage pipeline that turns a scene image, character image, and complex HSI prompt into long videos with plausible chained interactions by generating atomic actions, 3D keyframes via 2D i...