REVIEW 6 cited by
Demystifying Neural Style Transfer
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
Signed reviews
read the original abstract
Neural Style Transfer has recently demonstrated very exciting results which catches eyes in both academia and industry. Despite the amazing results, the principle of neural style transfer, especially why the Gram matrices could represent style remains unclear. In this paper, we propose a novel interpretation of neural style transfer by treating it as a domain adaptation problem. Specifically, we theoretically show that matching the Gram matrices of feature maps is equivalent to minimize the Maximum Mean Discrepancy (MMD) with the second order polynomial kernel. Thus, we argue that the essence of neural style transfer is to match the feature distributions between the style images and the generated images. To further support our standpoint, we experiment with several other distribution alignment methods, and achieve appealing results. We believe this novel interpretation connects these two important research fields, and could enlighten future researches.
Forward citations
Cited by 6 Pith papers
-
Recognizing Artistic Style of Archaeological Image Fragments Using Deep Style Extrapolation
A style extrapolation module followed by a transfer-learned classifier achieves state-of-the-art artistic style recognition on archaeological image fragments, validated on a new Pompeii fresco fragment dataset.
-
How Sequence-to-Sequence Models Perceive Language Styles?
Style in text is represented by the covariance matrix of seq2seq semantic vectors, enabling a whitening-coloring style transfer algorithm.
-
Through Van Gogh's Eyes: Global Style Transfer with Diffusion Model
The paper proposes Global Style Transfer, which trains a residual style offset in the h-space of a diffusion model on many artworks of one artist and applies it to new content images, aiming for artist-level rather th...
-
Contrastive Desensitization Learning for Cross Domain Face Forgery Detection
CDN mixes feature statistics of genuine face images and reconstructs them to reduce false alarms in cross-domain deepfake detection, but the supporting theory is flawed and the artifacts are missing.
-
Demystifying Brain Tumour Segmentation Networks: Interpretability and Uncertainty Analysis
Applying network dissection, Grad-CAM, activation maximization, and test-time dropout to three 2D brain tumor segmentation networks suggests filter-level concepts and coarse-to-fine localization, with high uncertainty...
-
STaDA: Style Transfer as Data Augmentation
STaDA applies neural style transfer as a data augmentation method for image classification, reporting up to 2% accuracy improvement on Caltech 101 with VGG16, though the effect varies strongly by style.
Discussion (0). Continue with ORCID to comment.