pith. sign in

arxiv: 2505.05101 · v2 · pith:6CA2KLHQnew · submitted 2025-05-08 · 💻 cs.CV

MDE-Edit: Masked Dual-Editing for Multi-Object Image Editing via Diffusion Models

classification 💻 cs.CV
keywords multi-objectmde-editobjectsregionsattentioncolorcomplexcross-attention
0
0 comments X
read the original abstract

Multi-object editing aims to modify multiple objects or regions in complex scenes while preserving structural coherence. This task faces significant challenges in scenarios involving overlapping or interacting objects: (1) Inaccurate localization of target objects due to attention misalignment, leading to incomplete or misplaced edits; (2) Attribute-object mismatch, where color or texture changes fail to align with intended regions due to cross-attention leakage, creating semantic conflicts (\textit{e.g.}, color bleeding into non-target areas). Existing methods struggle with these challenges: approaches relying on global cross-attention mechanisms suffer from attention dilution and spatial interference between objects, while mask-based methods fail to bind attributes to geometrically accurate regions due to feature entanglement in multi-object scenarios. To address these limitations, we propose a training-free, inference-stage optimization approach that enables precise localized image manipulation in complex multi-object scenes, named MDE-Edit. MDE-Edit optimizes the noise latent feature in diffusion models via two key losses: Object Alignment Loss (OAL) aligns multi-layer cross-attention with segmentation masks for precise object positioning, and Color Consistency Loss (CCL) amplifies target attribute attention within masks while suppressing leakage to adjacent regions. This dual-loss design ensures localized and coherent multi-object edits. Extensive experiments demonstrate that MDE-Edit outperforms state-of-the-art methods in editing accuracy and visual quality, offering a robust solution for complex multi-object image manipulation tasks.

This paper has not been read by Pith yet.

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Forward citations

Cited by 1 Pith paper

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. BindEdit: Taming Attention Leakage for Precise Multi-Object Image Editing

    cs.CV 2026-06 unverdicted novelty 5.0

    BindEdit suppresses two forms of attention leakage in diffusion-based editing by binding target tokens to regions, rebalancing cross-attention, and adding a region fidelity term, plus a new multi-object benchmark.