Pith. sign in

REVIEW 2 cited by

FEAT: Face Editing with Attention

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2202.02713 v1 pith:G32O4DH6 submitted 2022-02-06 cs.CV

classification cs.CV
keywords faceattentionlatentmanipulationmethodregionsspacebeen
verification ladder T0 review T1 audit T2 compute T3 formal
0 comments
read the original abstract

Employing the latent space of pretrained generators has recently been shown to be an effective means for GAN-based face manipulation. The success of this approach heavily relies on the innate disentanglement of the latent space axes of the generator. However, face manipulation often intends to affect local regions only, while common generators do not tend to have the necessary spatial disentanglement. In this paper, we build on the StyleGAN generator, and present a method that explicitly encourages face manipulation to focus on the intended regions by incorporating learned attention maps. During the generation of the edited image, the attention map serves as a mask that guides a blending between the original features and the modified ones. The guidance for the latent space edits is achieved by employing CLIP, which has recently been shown to be effective for text-driven edits. We perform extensive experiments and show that our method can perform disentangled and controllable face manipulations based on text descriptions by attending to the relevant regions only. Both qualitative and quantitative experimental results demonstrate the superiority of our method for facial region editing over alternative methods.

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 2 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. FACEMUG: A Multimodal Generative and Fusion Framework for Local Facial Editing

    cs.CV 2024-12 conditional novelty 6.0 of 10

    FACEMUG fuses up to five input modalities in the StyleGAN latent space to perform local, incremental facial edits while preserving unedited regions.

  2. HAIFAI: Human-AI Interaction for Mental Face Reconstruction

    cs.CV 2024-12 conditional novelty 6.0 of 10

    HAIFAI reconstructs a user's mental face image from iterative ranking feedback and optional manual refinement, achieving a 60.6% lineup identification rate.

Pith tools